Topic

Multilingual Speech

1 post about Multilingual Speech. Every summary links to the original.

Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.

Newest first

Posts

Apple
Language Discrimination Improves Linguistic Learning in Multilingual Speech Models
Multilingual self-supervised speech models underperform monolingual models under a matched total pretraining data budget, but strengthening language discrimination during pretraining reduces this gap while preserving cross-language sharing. In a controlled English/French HuBERT setting, two interventions—an auxiliary language classifier and per-language k-means targets—improve language discrimination. Continuous-feature phone discrimination error (phone-ABX) decreased from 11.6% in the bilingual baseline to 10.4%, approaching the monolingual 10.8%. Lexical performance (sWUGGY) rose from 52.1% to 56.7% (monolingual: 58.5%), and prosodic performance (ProsAudit lexical subtask) from 68.9% to 72.9% (monolingual: 72.6%). The strongest gains occur when language discrimination is introduced in the first HuBERT iteration; later or repeated interventions yield smaller improvements and increase language-wise segregation, supporting a causal role for language discrimination in reducing the cost of multilingual learning.

The best engineering reads, once a week.

Topic

1 post about Multilingual Speech. Every summary links to the original.

Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.

Newest first

Apple
Language Discrimination Improves Linguistic Learning in Multilingual Speech Models
Multilingual self-supervised speech models underperform monolingual models under a matched total pretraining data budget, but strengthening language discrimination during pretraining reduces this gap while preserving cross-language sharing. In a controlled English/French HuBERT setting, two interventions—an auxiliary language classifier and per-language k-means targets—improve language discrimination. Continuous-feature phone discrimination error (phone-ABX) decreased from 11.6% in the bilingual baseline to 10.4%, approaching the monolingual 10.8%. Lexical performance (sWUGGY) rose from 52.1% to 56.7% (monolingual: 58.5%), and prosodic performance (ProsAudit lexical subtask) from 68.9% to 72.9% (monolingual: 72.6%). The strongest gains occur when language discrimination is introduced in the first HuBERT iteration; later or repeated interventions yield smaller improvements and increase language-wise segregation, supporting a causal role for language discrimination in reducing the cost of multilingual learning.

The best engineering reads, once a week.