Beyond Frequency | The Time Dimension of Musical Realism — Part I

Auditory sensory memory integrates successive acoustic inputs into a single perceptual event within a limited temporal window. Tamakoshi et al. define the temporal window of integration as “the time period during which successive sensory inputs are integrated into a single perceptual event,” and estimate its duration to be approximately 160 - 170 ms.

Within this window, sound is processed as a unitary representation rather than as discrete events. This is the basis for explaining hearing detection of the following aspects of sound timing in music.

Across-frequency synchrony experiments demonstrate:

• The auditory system treats low and high frequencies as simultaneous only within a window of roughly ±10–20 ms
• When low frequencies lag mid/high frequencies by 20–30 ms or more, listeners reliably detect asynchrony
• Beyond this range, the auditory system no longer fuses the event into a single percept
  

This tolerance window matches other key temporal thresholds in human perception:

• 5–50 ms – expressive microtiming deviations that shape groove and musical feel
• 20–40 ms – temporal order threshold for determining which event occurs first
  

Thus, a Low Frequency (LF) delay of 20–50 ms intrudes directly into the time-range where rhythm, drive and event coherence are constructed.

Musical bass generally spans 40–150 Hz:

• 50 Hz → one cycle ≈ 20 ms
• 100 Hz → one cycle ≈ 10 ms
• 150 Hz → one cycle ≈ 6.6 ms

A 20–30 ms bass delay therefore shifts the bass envelope by:

• 1–3 cycles, depending on frequency

This moves the bass onset outside the auditory system’s synchrony window and into a region where bass becomes perceptually separated from the rest of the event.

This is exactly where listeners describe bass as:

• slow
• thick
• detached from transients
• masking articulation
• lacking timing precision

To summarise above - the brain appears to continuously process a window of integration. Within this window, psychoacoustic studies show that the auditory system binds low- and high-frequency components into a single event only when their onsets fall within a narrow timing window, on the order of a few to a few tens of milliseconds.

Beyond roughly 20–30 ms, timing differences begin to be heard as asynchrony or separate events.

This same temporal architecture is consistent with known mechanisms underlying the Haas / Precedence Effect: early reflections arriving within about 1–40 ms of the direct sound are fused with it and localised in the direction of the first wavefront, provided that the reflection carries a similar spectrum to the direct sound.

This has been well established by Dr. Floyd Toole and Dr. Sean Olive, as it applies to loudspeaker preference and design.

Linking timing integration to spatial perception

This temporal integration strategy applies not only to reflections and localisation, but also to how low-frequency energy is perceived as spatial or internal. When timing and pressure gradients are preserved, bass events are externalised and experienced as part of a coherent acoustic scene. When they are not, bass becomes perceptually disembodied. This distinction explains why live instruments heard in the same room as the listener consistently feel more present and physically grounded than reproduced bass from conventional loudspeakers, even at similar sound pressure levels.

In other words, the brain uses a common temporal integration strategy both to align frequencies within a sound and to merge early reflections with that sound into a single auditory event, as long as timing and spectral content remain closely matched.

In summary - Human hearing is exquisitely sensitive to timing:

• millisecond-scale envelope cues
• microtiming in the 5–50 ms band
• cross-frequency synchrony limits around ±10–20 ms

Timing perception depends not only on when sounds start, but also on when they stop.

The perception of timing includes the brain’s ability to detect very brief moments of silence between sounds. This is known as gap detection. Human hearing can reliably detect silent gaps as short as 0.5 to 5 milliseconds, depending on frequency content and context. These gaps are not perceived as absences, but as meaningful boundaries that define articulation, phrasing and rhythmic structure.

Silence as musical structure

Musicians intuitively rely on these micro-gaps. Pauses, releases and decays are not absences, but structural elements that define intent. When low-frequency energy lingers beyond its musical cause, silence is overwritten and timing relationships lose meaning. This is not perceived simply as slower bass, but as a weakening of phrasing, groove and emotional contrast. Listeners may struggle to articulate the cause, yet consistently describe the effect as reduced involvement or fatigue.

In music, silence is not empty. The brief pauses between drum hits, the momentary release between piano notes, the space between a vocalist’s consonants and vowels, or the breath between phrases all carry expressive information. These micro-gaps allow the brain to segment sound into events, recognise intent and maintain a sense of flow and anticipation.

When a playback system introduces stored or delayed energy, particularly at low frequencies, these gaps are no longer preserved. Bass energy that arrives late or decays slowly fills in the silence that should follow an attack. Instead of a clean transition from sound to silence, the brain receives a blurred continuation of energy. This masks the gap and weakens the perceptual boundary between events.

This effect is especially pronounced when Group Delay causes low-frequency components to lag by 20 to 50 milliseconds. While high-frequency transients may stop abruptly, delayed bass energy continues, effectively overwriting the silence. The result is not simply slower bass, but a loss of articulation. Notes run together, rhythmic intent softens and expressive timing cues lose their meaning.

Gap detection therefore links directly to the earlier discussion of temporal integration. Just as the auditory system binds frequencies into a single event when their onsets are sufficiently aligned, it relies on accurate offsets to determine when one event ends and the next begins. Preserving both the attack and the release of sounds is essential for musical coherence.

In live acoustic music, silence between notes is naturally maintained because energy decays according to the physics of the instrument and the room. When a loudspeaker introduces additional stored energy or delayed decay, it alters this balance. The brain no longer receives the temporal contrast it expects, and fatigue, loss of engagement or a sense of vagueness can result.

This is why Time Coherence is not only about when sounds start, but also about when they stop.

Musicians spend a lifetime refining these temporal relationships. The smallest deviations in timing shape groove, phrasing and emotional intent. When reproduction alters those relationships, it is not merely a technical error but a loss of musical meaning.

The following examples illustrate how timing differences of only a few milliseconds carry decisive musical meaning.

Example 1 — Drum Set Microtiming

A drummer might strike the hi-hat slightly ahead of the kick drum, often by only 5–15 ms, to create a sense of forward motion or rhythmic tension. Then, a moment later, the drummer may close or mute the hi-hat, creating a brief gap of just a few milliseconds before the next onset.

To the listener, these microtiming relationships communicate:

• drive
• intentional phrasing
• rhythmic articulation
• expressive push or pull
• the performer’s “feel” and “touch”

But they only work if the timing relationships across frequencies remain intact.

If the bass (kick drum fundamental around 50–100 Hz) is delayed by 20–40 ms relative to the hi-hat’s mid/high-frequency attack, the perceptual structure breaks:

• The kick lands perceptually late
• The hi-hat–kick relationship dissolves
• The rhythmic intention becomes blurred
• The sense of groove weakens
• The micro-gap loses meaning

The listener hears the elements as disjointed, even though the performer’s timing was precise.

If the bass (kick drum fundamental around 50–100 Hz) is delayed by 20–40 ms relative to the hi-hat’s mid/high-frequency attack, the perceptual structure breaks:

• The kick lands perceptually late
• The hi-hat–kick relationship dissolves
• The rhythmic intention becomes blurred
• The sense of groove weakens
• The micro-gap loses meaning

The listener hears the elements as disjointed, even though the performer’s timing was precise.

Example 2 — Pianist: Left-Hand Bass + Right-Hand Attack

When a pianist plays a chord with the right hand while reinforcing the harmony with a left-hand bass note, the two hands often land together within 10–20 ms. This creates:

• a single perceived musical event
• clear harmonic grounding
• precise rhythmic articulation

If bass reproduction lags by 20–30 ms, the left-hand fundamental (60–150 Hz) becomes decoupled:

• the chord no longer “locks”
• the musical gesture feels less unified
• harmonic weight arrives late
• rhythmic authority disappears

A single musical gesture becomes two disconnected sounds.

Example 3 — String Quartet: Cello vs. Violin Attacks

In tightly coordinated ensemble playing, the cello’s low-frequency transient (100–200 Hz band) and the violin’s upper harmonics (1–5 kHz) must align to convey:

• unified phrasing
• ensemble precision
• the emotional shape of the gesture

If the cello’s attack is represented with system-induced delay approaching 20–30 ms:

• the cello seems to articulate after the violin
• ensemble tightness collapses
• the phrase contour becomes less intelligible
• the expressive intention is altered

In reality, the performers were perfectly in time — the playback system was not.

In groove-based music, the bassist often places notes slightly behind or exactly on the drummer’s snare. The relationship is often within 10–25 ms, and it defines:

• pocket
• groove
• feel
• emotional character

If bass reproduction adds 30–50 ms of Group Delay:

• the bass always sounds late
• the pocket collapses
• the groove feels “dragging”
• rhythmic propulsion is lost

This is why listeners describe delayed bass as “slow” or “thick”.

Example 5 — Vocalist Plosive (“P”) + Room Body

A vocal plosive (“p”, “b”) produces:

• a mid/high-frequency burst
• a low-frequency body component that shapes the expressive contour

These two components normally reach the brain within a few milliseconds of each other and form a single perceptual unit. If playback delays the LF body by 20–40 ms:

• the vocal transient sounds detached
• articulation is blurred
• emotional detail is lost
• intelligibility may degrade

The voice no longer feels “whole”.

If timing is so critical, why have loudspeakers failed to preserve it for decades?