Audio statistics

[Samoed]

Ref #3498

I’ve started integrating audio statistics. For now, I’ve come up with this format. Do you have any suggestions?

class AudioStatistics(TypedDict):
    """Class for descriptive statistics for audio.

    Attributes:
        total_audio_seconds_length: Total length of all audio clips in total frames
        min_audio_seconds_length: Minimum length of audio clip in seconds
        average_audio_seconds_length: Average length of audio clip in seconds
        max_audio_seconds_length: Maximum length of audio clip in seconds
        unique_audios: Number of unique audio clips
        average_sampling_rate: Average sampling rate
        sampling_rates: Dict of unique sampling rates and their frequencies
    """

    total_audio_seconds_length: float

    min_audio_seconds_length: float
    average_audio_seconds_length: float
    max_audio_seconds_length: float

    unique_audios: int

    average_sampling_rate: float
    sampling_rates: dict[int, int]

[isaac-chung]

When I see length, I think in seconds. I like the frames approach too, and I'd like it spelled out explicitly (num_frames or whatever). I'd like to see:

• the max/min/total number of seconds
• the unique set of sampling rates (specify unit)

Would love to hear other feedback as well while I read into it a bit more.

[Samoed]

Added seconds and sampling rates

[isaac-chung]

Sorry for adding more. Revisited some papers and maybe we should use the standard measure of audio dataset size.

[isaac-chung]

Just wanted to align with HF notation + plus some questions.

[isaac-chung]

This line assumes there is the sampling_rate key. Based on what you mentioned, this will fail for some datasets then?

[Samoed]

Yes, but it's better to fix them to improve benchmark quality overall

[isaac-chung]

Could you please open an issue to track this?

[Samoed]

I'm not sure what to open. Possible missing sampling rate?

[isaac-chung]

Yeah, all audio should have sampling_rate. So if you say that's not true, then it's an issue.

[isaac-chung]

Could this just be a unique set of sampling rates? OK either way.

Suggested change

	sampling_rates: dict[int, int]
	sampling_rates: list[int]

[KennethEnevoldsen]

Minor things - generally think this looks good (of course Isaac's comments still apply, but nothing more to add)