Adversarial Fine-tuning using Generated Respiratory Sound to Address Class Imbalance

• DOI: 10.48550/arxiv.2311.06480
• Publication Date: 2023-01-01
• Authors: Kim, June-Woo; Yoon, Chihyeon; Toikkanen, Miika; Bae, Sangmin; Jung, Ho-Young
• Keywords: FOS: Computer and information sciences; Computer Science - Machine Learning; Sound (cs.SD); Audio and Speech Processing (eess.AS); FOS: Electrical engineering, electronic engineering, information engineering; Computer Science - Sound; 3. Good health; Electrical Engineering and Systems Science - Audio and Speech Processing; Machine Learning (cs.LG)

Deep generative models have emerged as a promising approach in the medical image domain to address data scarcity. However, their use for sequential data like respiratory sounds is less explored. In this work, we propose a straightforward approach to augment imbalanced respiratory sound data using an audio diffusion model as a conditional neural vocoder. We also demonstrate a simple yet effective adversarial fine-tuning method to align features between the synthetic and real respiratory sound samples to improve respiratory sound classification performance. Our experimental results on the ICBHI dataset demonstrate that the proposed adversarial fine-tuning is effective, while only using the conventional augmentation method shows performance degradation. Moreover, our method outperforms the baseline by 2.24% on the ICBHI Score and improves the accuracy of the minority classes up to 26.58%. For the supplementary material, we provide the code at https://github.com/kaen2891/adversarial_fine-tuning_using_generated_respiratory_sound.<br/>accepted in NeurIPS 2023 Workshop on Deep Generative Models for Health (DGM4H)<br/>