Measuring speakers using music (Michael Tsiroulnikov's FSAF)

One of these 3 traces was measured with music. Which one is it?

  • Red - nothing goes fast as red!

    Votes: 3 18.8%
  • Blue - yawn...

    Votes: 1 6.3%
  • Black! You know what they say about black...

    Votes: 1 6.3%
  • What? Is there more than one trace?

    Votes: 4 25.0%
  • I need more hints... can I at least listen to the test file?

    Votes: 7 43.8%

  • Total voters
    16
I'll be surprised if the ability to use real music ends up being a major value creator.
Main benefit is being able to provide some real analysis using a test signal that approximates real world audio, or simply is real world audio. No longer can people criticize that the performance measurement does not represent real world audio, since sine wave is only 3dB crest factor, where real world audio is 12dB+. But as I've seen in this thread, the people have found all sorts of new ways to criticize, so that will never end.

Potential value add of real world crest factor stimulus is not needing some high SPL sine wave stress test just to see what a speaker may do for the occasional peak in output, for example a common HD sine sweep test is at 86dB and 96dB/1m. There's also the common misconception that the HD result of 86dB SPL is representative of performance at 86dB RMS audio level, which is isn't, simply due to the difference in crest factor.

Another value add for REW, forgetting about any distortion analysis, is the ability to generate an accurate impulse response / frequency response from any audio. You don't have to listen to that annoying sweep anymore just for a frequency response.

The ability to separate the signal from distortion and listen for yourself is an added bonus, as Bill Waslo mentioned, not truly a new feature but now is available free to all DIYer in modern, actively supported and developed software.
 
Last edited:
It remains to be seen how well FSAF correlates with existing measurement process eg. Exponential sine sweep aka chirp (since 2000) or Maximum Length Sequence (C20, DOS 386 era)
We know all these methods are OK for response provided THD isn't too 'large' ... including using music as Bill Waslo and I have done in da previous Millenium

Can we please call 'ESS' its proper name; Angelo Farina's method. It's actually a logarithmic (not exponential) sweep as I've argued with Prof Farina on many an occasion.

It's the sweep you get from a B&K 2010 driven by a 2307 chart recorder; response as God intended 😊 I no longer have these as it's impossible to get the steam to run them. I do have B&K toilet roll stolen from Naerum.

It's Angelo's simple (??) but powerful processing that makes this the theoretically fastest way to a given accuracy in the presence of noise.
The criticism levelled at the my, or sm52’s testing on the REW thread should understood as user error/ Garbage In Garbage Out, or as working through the kinks of a beta release.
I'm certainly not criticizing you or sm52. Just pointing out that NO ONE has managed to get a FSAF THD measurement that sorta aligns with THD done with Angelo's method. Remember, FSAF is OK for response.

The FSAF measurement is the only one where I can listen to the Distortion residual.
There are several methods which allow the 'modelled' response to be compared the real thing ie what FSAF claims to do. Bill has done so commercially and I've done so experimentally in da previous Millenium as computing power got rapidly cheaper.

But IMHO, these illustrate the non-Time Invariant (compression) aspects, rather than the Linear (distortion) aspects of our assumption that speakers are LTI. So far, the examples I've listened to bear this out ... but as they aren't the result of FSAF Total Distortion measurements that even slightly resemble more traditional methods, I'm not sure they are representative of what is actually happening.
 
  • Like
Reactions: Juhazi
https://www.roomeqwizard.com/betahelp/help_en-GB/html/fsafmeasurement.html

USB microphones which rely on the USB clock are not suitable for FSAF measurement as the USB clock is not stable. That means, for example, UMIK-1, UMM-6 and Omnimic are unsuitable for FSAF measurements. It is possible to use a USB mic which has an internal clock source, such as UMIK-2.

I have only UMIK-1 mk2
 
Regarding measuring signals. If the speaker really did behave differently whether it received a full range noise/random signal or a standard sweep. Wouldn't it then show different results from either a MLS vs sweep?
I thought I'd answered this recently but it must have been in another thread.

All these methods are for weakly non-linear systems. ie they assume THD is 'small'. If this is so, they all give 'similar' response with different accuracies and efficiencies.

When THD is high, eg when the device / signal clips, this breaks down and you get very different results. Angelo's method is probably the best at (not) reacting to this and MLS the worst. MLS can't measure distortion at all and is seriously affected by it. Dunno about FSAF and it's one of the things I want to find out
 
DcibeL, can you confirm that the test signal for both Angelo's method and FSAF in #58 for the two speakers are exactly the same? ie The same 'exponential' sweep, the same start & end, same length & level.

This is what hifijim suggested 😊

If this is the case, we can get some important results and conclusions.
Post 58 is not strictly apples to apples. HD is a sine sweep, FSAF is using pink noise. Same RMS level.l, but here the pink noise provides higher crest factor, perhaps some contribution to the different result on a real speaker.
Missed this. Could you repeat the FSAF test on that speaker using the same 'exponential' sweep. This would give us the closest conditions for the two methods.
I think Mikets would think we are being very silly to try to make comparison to HD sweep and using sine stimulus for FSAF.
The Dynamic Duo, Lipshitz & Vanderkooy who helped develop MLS in Jurassic times, would think us very silly to try to measure HD with MLS ... but I'm sure they would be delighted to be proven wrong 😊
 
Last edited:
Angelo's method is probably the best at (not) reacting to this and MLS the worst. MLS can't measure distortion at all and is seriously affected by it.

But MLS is better for noisy environment. You also need to keep in mind, measurement results obtained using the sweep sine technique can vary dependent on the sweep rate, which is known problem in vibroacoustic measurements. For instance, observant experimenters have probably noticed that when measuring impedance with a sweep tone in REW, the shape of the impedance curve depends on the sweep tone rate.
 
In the past measurements were developed to prove a theory. Today measurements are quoted to substantiate righteousness. I know several professionals (non-engineers) who own substantial hi-fi systems purchased by listening only without having a clue what is discussed here.
 
https://www.roomeqwizard.com/betahelp/help_en-GB/html/fsafmeasurement.html

USB microphones which rely on the USB clock are not suitable for FSAF measurement as the USB clock is not stable. That means, for example, UMIK-1, UMM-6 and Omnimic are unsuitable for FSAF measurements. It is possible to use a USB mic which has an internal clock source, such as UMIK-2.

I have only UMIK-1 mk2
Omnimic has an internal crystal clock source, change the capacitors across the crystal, the rate changes slightly.

I wonder if the statement refers to inability of single input channel sources to sample synchronize with output DAC clocks, which prevents some measurement methods.
 
Sam Berkow's SMAART software was measuring frequency and impulse response using music or noise in 1996. It works well given time, though dynamic range with such signals isn't optimum and the program material needs to have sufficient energy across the measured spectrum Measuring distortion with it would seem to be FSAF"s unique ability though.
 
  • Like
Reactions: kgrlee
For sure! but have to wait for a suitable silent time, busy family life doesn't have silent hours except at night when everyone is sleeping 🙂 I'll try and make listening test for it as well, but, not sure if I have time this year or the next.
 
  • Like
Reactions: DcibeL
But MLS is better for noisy environment. You also need to keep in mind, measurement results obtained using the sweep sine technique can vary dependent on the sweep rate, which is known problem in vibroacoustic measurements. For instance, observant experimenters have probably noticed that when measuring impedance with a sweep tone in REW, the shape of the impedance curve depends on the sweep tone rate.
Stepped sine wave is best for a noisy environment. Great out of band suppression of noise. Very annoying, not fast. Tough on the device under test. But very robust when you have the time and the ability to wear hearing protection.
 
  • Like
Reactions: Hörnli
Stepped sine wave is best for a noisy environment.

This is not entirely true. Sweep sine vs. MLS is well discussed in academic papers.

The ESS signal has some advantages over MLS, such as a better signal to noise ratio (SNR) and a robust nonlinearity rejection, but some precautions should be taken in order to exploit its potential fully. Firstly, impulsive and steady tonal background noises should be avoided; in case of its occurrence, taking a new measurement is the best option. Not always the residual background noise gives reliable information about a corrupted measurement. Secondly, the generation of the ESS should be phase controlled and a data windowing targeted to the specific application of the measured impulse response should be applied, in order to optimize the results and avoid possible computation errors. The findings described in this work suggest that: i) the shape of the data window is not critical, provided it is smooth enough; ii) the fade-in window should be 1-octave wide, while the fade-out window should be 1/24 or 1/12-octave wide.
 
But MLS is better for noisy environment.
I think you mean worse. MLS or noise signal is exciting a wide spectrum for the entire duration of the measurement, which allows for greater potential for contamination of background noise. Sine Sweep is only observed a single frequency for a given point in time, so there's less opportunity for background noise to contaminate the measurement.

In your own citation provided above, it indicates higher SNR of a sine sweep vs MLS/noise signal..

Anyway, let's try to steer back on topic and not get too detailed by semantics.
 
  • Like
Reactions: Kravchenko_Audio