Zhuoyan Tao (Terry)

Speech & audio ML researcher

  • Carnegie Mellon · M.S. student, LTI
  • Apple · Software engineering intern, 2026

I study speech quality, multilingual speech, and speech restoration with Prof. Shinji Watanabe at WavLab. I lead student research on an Amazon AGI project on target-speaker speech restoration.

Open to Summer 2027 research & ML engineering internships

Portrait of Zhuoyan (Terry) Tao

Selected publications

TurnBench turn-taking overview

IEEE SLT 2026

TurnBench — evaluating conversational turn-taking

Freeman Jiang, Ramon Sanabria, …, Zhuoyan Tao, …, Hung-yi Lee, Shinji Watanabe

A benchmark for when conversational systems should speak or wait: 30 hours of conversation · 14 systems evaluated.

My contribution: evaluation protocol and an ANCHOR-based baseline.

Paper (PDF) ↗︎ Leaderboard ↗︎
Off-target posterior mass and probe gain prediction

JASA-EL · Under review

When does language-ID fine-tuning help?

Zhuoyan Tao, Aditya Kommineni, Shrikanth Narayanan

Predicts whether fine-tuning will improve language diarization—identifying which language is spoken when—using one training-free diagnostic.

Paper (PDF) ↗︎

Open source

Background

Carnegie Mellon2025–present M.S. Intelligent Information SystemsWavLab · Expected Dec 2027

M.S. in Intelligent Information Systems, expected Dec 2027. Speech research at WavLab with Prof. Shinji Watanabe.

AppleSummer 2026 Software engineering internSatellite connectivity · ~1000× experiment throughput

Built simulation tooling with ~1000× higher experiment throughput.

USCGraduated 2026 B.S. Computer Science · B.S. Applied and Computational MathematicsTrustee Scholar · Full-tuition merit scholarship

Trustee Scholar (full-tuition merit scholarship); graduated magna cum laude. Multilingual speech research with Prof. Shrikanth Narayanan at SAIL.

Outside research, I led the audio team for Bone Boy, a game released on Steam, and taught multivariable calculus review sessions. Full experience and honors in my résumé ↗︎

Contact

For research collaborations or Summer 2027 internships: terrytao@andrew.cmu.edu.