Voice Quality Sonification — User Guide
Maps local jitter and shimmer trajectories to two continuously changing spectral bands, turning measured voice-quality instability into an audible time-varying timbral transformation.
What this does
Voice Quality Sonification is a data-to-sound processor that measures local jitter and shimmer across a voice recording and uses those trajectories to move two spectral pass bands over time. Jitter and shimmer therefore become control signals for a timbral transformation: one trajectory moves a lower spectral region and the other moves a higher region.
The processor preserves the source recording as the sound material. At each analysis point it creates a pair of filtered versions of the full source, then crossfades continuously between neighboring filter states. The result follows the measured voice-quality trajectory without hard segment boundaries.
Processing pipeline
- Prepare an analysis source. Mono input is analyzed directly. Multichannel input is averaged to mono; if that average is nearly cancelled, channel 1 is used instead.
- Sample the recording at evenly spaced analysis points. Each point uses a rectangular window centered on its analysis time.
- Measure local perturbation. Praat estimates pulses and measures local jitter and local shimmer in each valid window.
- Normalize each trajectory within the file. Valid jitter values are min–max scaled to 0–1, and shimmer is normalized independently.
- Repair missing control points. An invalid window inherits the nearest valid normalized value for that metric. A metric that is undefined throughout remains neutral at 0.5.
- Map controls to two spectral bands. The normalized values shift the lower and higher pass-band ranges upward or downward by the selected mapping depth.
- Create filter states. At every analysis point, the complete multichannel source is filtered into a low spectral band and a high spectral band; the two bands are summed.
- Interpolate through time. Adjacent filter-state signals are linearly crossfaded so the weights sum to one throughout the file.
- Mix dry and wet. The time-varying filtered signal is blended with the original according to
Dry_wet_mix. - Apply safety attenuation if required.
Safety_peakonly turns the result down when its peak exceeds the requested ceiling.
Quick start
- Select exactly one Sound object in Praat.
- Run
Voice_Quality_Sonification.praat. - Start with Moderate Effect.
- Use clearly periodic or voiced material so that local pulse measurements are available.
- Leave the default low and high bands at 280–900 Hz and 900–2500 Hz for a broad, voice-centered spectral mapping, or set your own regions.
- Use
Dry_wet_mixto control how strongly the sonification replaces the original spectrum. - Enable
Draw_analysisto inspect the measured controls and mapped band trajectories.
Jitter & shimmer analysis
Analysis grid
Num_windows analysis centers are distributed evenly from half a window after the beginning to half a window before the end. The extraction window is rectangular so that an amplitude taper does not artificially create shimmer.
analysisTime[last] = duration - Window_size_s / 2
intermediate points = evenly spaced between them
Pulse and perturbation measurements
Each window is converted to a Praat cross-correlation pitch representation, aligned to the waveform with Sound & Pitch: To PointProcess (cc), then queried with Get jitter (local) and Get shimmer (local). A window needs at least four pulse points before the script attempts either measurement.
| Internal setting | Value |
|---|---|
| Pitch range | 75–600 Hz |
| Period floor | 1/600 s |
| Period ceiling | 1/75 s |
| Maximum period factor | 1.3 |
| Maximum amplitude factor | 1.6 |
Within-file normalization
Jitter and shimmer are normalized separately using only their valid windows:
If all valid values of one metric are equal, that metric is held at 0.5. Invalid windows copy the nearest valid control value. If jitter is unavailable throughout, only the jitter-derived control remains neutral; the same rule applies independently to shimmer. The script stops only when neither metric has any valid measurement.
Mapping & filtering
Control-to-frequency mapping
A normalized control of 0.5 leaves its base band unchanged. At the normal mapping direction, 0 shifts the band downward by the selected depth and 1 shifts it upward by the same percentage.
shifted_low_edge = base_low_edge × shift
shifted_high_edge = base_high_edge × shift
For example, a depth of 0.15 produces a frequency multiplier from 0.85 to 1.15 across the normalized trajectory. Invert Direction reverses that relationship. Frequency edges are clamped to safe limits below Nyquist.
Four mapping modes
| Mapping mode | Low band | High band |
|---|---|---|
| Jitter → low, Shimmer → high | Jitter | Shimmer |
| Shimmer → low, Jitter → high | Shimmer | Jitter |
| Jitter/Shimmer inverted direction | Jitter, inverted | Shimmer, inverted |
| Swapped + inverted direction | Shimmer, inverted | Jitter, inverted |
Dual-band state
Each state consists of two Praat pass Hann band filters applied to the full source. The two filtered bands are summed. Filter_transition_Hz is the spectral smoothing width at the edges of each pass band; it is independent of the temporal interpolation between analysis states.
Temporal motion is created by a linear crossfade between the complete filtered signals of adjacent states. Before the first analysis center the first state is held; after the last center the final state is held.
Presets
| Preset | Windows | Window | Mapping | Jitter depth | Shimmer depth |
|---|---|---|---|---|---|
| Custom | User | User | User | User | User |
| Subtle Variation | 6 | 250 ms | Jitter → low / Shimmer → high | 0.08 | 0.06 |
| Moderate Effect | 8 | 200 ms | Jitter → low / Shimmer → high | 0.15 | 0.12 |
| Extreme Mapping | 12 | 150 ms | Jitter → low / Shimmer → high | 0.30 | 0.25 |
| Swap Jitter/Shimmer | 8 | 200 ms | Shimmer → low / Jitter → high | 0.15 | 0.12 |
| Invert Direction | 8 | 200 ms | Jitter → low / Shimmer → high, inverted | 0.15 | 0.12 |
Parameters
| Parameter | Default | Behavior |
|---|---|---|
| Num_windows | 8 | Number of local measurements/control points. Internally clamped to 2–64. |
| Window_size_s | 0.2 s | Rectangular measurement window. Minimum 0.05 s; the source must be at least this long. |
| Mapping_mode | Jitter → low, Shimmer → high | Selects assignment and/or directional inversion. |
| Jitter_mapping_depth | 0.15 | Maximum proportional shift of the jitter-controlled band. Magnitude is clamped to 0–0.90. |
| Shimmer_mapping_depth | 0.12 | Maximum proportional shift of the shimmer-controlled band. Magnitude is clamped to 0–0.90. |
| Low_band_low_Hz / Low_band_high_Hz | 280 / 900 Hz | Base edges of the lower pass band. |
| High_band_low_Hz / High_band_high_Hz | 900 / 2500 Hz | Base edges of the higher pass band. |
| Filter_transition_Hz | 100 Hz | Hann smoothing width at each pass-band edge; minimum 1 Hz. |
| Dry_wet_mix | 1.0 | 0 = dry source, 1 = time-varying dual-band output. Clamped to 0–1. |
| Safety_peak | 0.99 | Attenuation-only output ceiling. 0 disables the ceiling. |
| Draw_analysis | On | Draw the AudioTools diagnostic visualization. |
| Play_result | On | Play the final Sound after processing. |
Input & output behavior
- Selection: exactly one Sound object.
- Minimum sample rate: 8 kHz.
- Channels: arbitrary channel count is preserved. One common control trajectory is derived from the mono analysis source and applied to every channel; each channel's audio remains distinct.
- Analysis fallback: for multichannel input, the channel average is used unless its peak is below 5% of the original multichannel peak, in which case channel 1 is analyzed.
- Duration: unchanged; there is no tail extension.
- Sampling rate: unchanged.
- Start time: preserved. Processing is done internally on a zero-based copy and the original
xminis restored. - Output name:
<source>_jitshim. - Level: no per-state normalization and no final upward normalization.
Safety_peakattenuates only when necessary. - Dry/Wet = 0: the audio path is the original source; if the source itself exceeds an active Safety peak, the final safety stage can still attenuate it.
- Randomness: none. The process is deterministic for the same source, settings and Praat implementation.
Visualization
When Draw_analysis is enabled, v1.2 draws four diagnostic regions plus a summary strip:
- Normalized voice-quality controls: jitter and shimmer trajectories on a shared 0–1 scale.
- Mapped band-center trajectories: the geometric center frequency of the lower and higher mapped bands.
- Input and output waveforms: displayed on the same amplitude scale. Multichannel Sounds are converted to mono only for this drawing.
- Summary: valid measurement counts, base band ranges, transition width, channel count, wet amount and input/output peaks.
The visualization is diagnostic only. In testing, the same settings produced sample-identical audio with drawing enabled and disabled.
Notes & limitations
- Relative, not absolute sonification: min–max normalization means the audible trajectory represents variation within the selected recording. Two files with different absolute jitter/shimmer ranges can produce similar normalized control curves.
- Voicing matters: local perturbation measures require a usable pulse sequence. Long unvoiced/noisy passages can therefore inherit neighboring control values, and a file with no valid jitter or shimmer measurement is rejected.
- Window size controls temporal detail: shorter windows give denser local sampling but may contain too few reliable pulses; longer windows average over more cycles.
- The pass bands are not measured formants: their frequency ranges are mapping targets chosen by the user.
- Filtering is zero-phase and acausal: Praat's Hann-band frequency-domain filter preserves spectral phase but has a symmetric impulse response, so strong spectral changes can produce energy before and after sharp transients.
- Temporal interpolation is signal crossfading: the script does not continuously recalculate a filter coefficient for every sample; it crossfades neighboring full-file filter states.
Further Reading
- Praat: Voice 6. Automating voice analysis with a script — authoritative workflow for waveform-aligned pulse extraction and scripted jitter/shimmer measurement.
- Praat: PointProcess — Get jitter (local) — definition and acceptance settings for the local jitter measure used here.
- Praat: Voice 3. Shimmer — definition and interpretation of local shimmer.
- Praat: Spectrum — Filter (pass Hann band) and Praat: Filtering — the spectral filter shape and zero-phase/acausal behavior used by the synthesis stage.
- Kramer, G., et al. (1999). Sonification Report: Status of the Field and Research Agenda. International Community for Auditory Display — foundational parameter-mapping sonification context.
- Hermann, T., Hunt, A., & Neuhoff, J. G. (Eds.). (2011). The Sonification Handbook. Logos Verlag — comprehensive reference on data-to-sound mapping and auditory display design.