DUAP: Disentanglement-Based Universal Adversarial Perturbations for Robust Multilingual Speech Privacy Protection
Universal multilingual adversarial perturbations for speech privacy against Whisper
This work addresses privacy risks from multilingual automatic speech recognition models such as Whisper through DUAP, a universal adversarial perturbation method based on language feature disentanglement. The method first separates and reconstructs language-related features in latent space, then uses gradient optimization to disrupt language identification, providing protection across languages, model sizes, and digital and physical settings.

Language feature disentanglement (LFD): separating language and content features, then reconstructing exchanged features to generate Mel spectrograms with target-language features.