Transfer Learning and Bias Correction with Pre-trained Audio Embeddings - Laboratoire Traitement et Communication de l'Information Access content directly
Conference Papers Year : 2023

Transfer Learning and Bias Correction with Pre-trained Audio Embeddings

Abstract

Deep neural network models have become the dominant approach to a large variety of tasks within music information retrieval (MIR). These models generally require large amounts of (annotated) training data to achieve high accuracy. Because not all applications in MIR have sufficient quantities of training data, it is becoming increasingly common to transfer models across domains. This approach allows representations derived for one task to be applied to another, and can result in high accuracy with less stringent training data requirements for the downstream task. However, the properties of pre-trained audio embeddings are not fully understood. Specifically, and unlike traditionally engineered features, the representations extracted from pre-trained deep networks may embed and propagate biases from the model's training regime. This work investigates the phenomenon of bias propagation in the context of pre-trained audio representations for the task of instrument recognition. We first demonstrate that three different pre-trained representations (VGGish, OpenL3, and YAMNet) exhibit comparable performance when constrained to a single dataset, but differ in their ability to generalize across datasets (OpenMIC and IRMAS). We then investigate dataset identity and genre distribution as potential sources of bias. Finally, we propose and evaluate post-processing countermeasures to mitigate the effects of bias, and improve generalization across datasets.
Fichier principal
Vignette du fichier
ISMIR2023 Transfer Learning and Bias Correction with Pre-trained Audio Embeddings.pdf (297.87 Ko) Télécharger le fichier
Origin Files produced by the author(s)
licence

Dates and versions

hal-04160013 , version 1 (12-07-2023)

Licence

Identifiers

  • HAL Id : hal-04160013 , version 1

Cite

Changhong Wang, Gaël Richard, Brian Mcfee. Transfer Learning and Bias Correction with Pre-trained Audio Embeddings. The 24th conference of the International Society for Music Information Retrieval (ISMIR), Nov 2023, Milan, Italy. ⟨hal-04160013⟩
262 View
105 Download

Share

Gmail Mastodon Facebook X LinkedIn More