Topic

Pseudo-Labeling

1 post about Pseudo-Labeling. Every summary links to the original.

Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.

Newest first

Posts

Apple
A Practical Recipe for Semi-Supervised Federated ASR: Online Pseudo-Labels with Server Update Stabilization
Semi-supervised federated learning (SSFL) for ASR uses a teacher to generate pseudo-labels on unlabeled client data while the server trains on a small labeled seed. The paper finds that pseudo-label errors compound across the output sequence and training rounds, causing divergence and a large gap to fully-supervised FL. Two coupled design axes close this gap: the teacher type (per-client online, global broadcast, or transitioning) and the anchor (server-side labeled-data updates that stabilize training). A per-client online teacher diverges on its own but, once stabilized, matches or beats the global teacher in-domain and under domain shift. The server must keep training on labeled data between rounds; otherwise the online teacher drifts, and this interleaving governs convergence more than the seed model does. The proposed guidelines improve over the strongest prior method on 9 of 11 pairs, by 20.8% in-domain and 10.0% cross-domain on average.

The best engineering reads, once a week.

Topic

1 post about Pseudo-Labeling. Every summary links to the original.

Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.

Newest first

Apple
A Practical Recipe for Semi-Supervised Federated ASR: Online Pseudo-Labels with Server Update Stabilization
Semi-supervised federated learning (SSFL) for ASR uses a teacher to generate pseudo-labels on unlabeled client data while the server trains on a small labeled seed. The paper finds that pseudo-label errors compound across the output sequence and training rounds, causing divergence and a large gap to fully-supervised FL. Two coupled design axes close this gap: the teacher type (per-client online, global broadcast, or transitioning) and the anchor (server-side labeled-data updates that stabilize training). A per-client online teacher diverges on its own but, once stabilized, matches or beats the global teacher in-domain and under domain shift. The server must keep training on labeled data between rounds; otherwise the online teacher drifts, and this interleaving governs convergence more than the seed model does. The proposed guidelines improve over the strongest prior method on 9 of 11 pairs, by 20.8% in-domain and 10.0% cross-domain on average.

The best engineering reads, once a week.