Featured image of post NetEase Youdao Unveils 'Model + Agent + Workflow' AI Paradigm, Open-Sources Ziyue Live Interpreting Model

NetEase Youdao Unveils 'Model + Agent + Workflow' AI Paradigm, Open-Sources Ziyue Live Interpreting Model

Youdao AI Open Day showcases a three-layer AI capability framework: Model, Agent, and Workflow in action.

Event Snapshot: Youdao Unveils ‘Model + Agent + Workflow’ AI Paradigm

Event Snapshot: Youdao Unveils ‘Model + Agent + Workflow’ AI Paradigm
Event Snapshot: Youdao Unveils ‘Model + Agent + Workflow’ AI Paradigm|News screenshot

On September 16, NetEase Youdao hosted the ‘NEXT, AGENT|Youdao AI Open Day’ in Beijing, formally presenting a three-tiered AI capability framework: Model + Agent + Workflow. According to Youdao CEO Zhou Feng, AI value has shifted from standalone model performance to synergistic system能力:

  • Model: Represents ‘smartness’, setting capability upper bounds via the ‘Ziyue’ model matrix
  • Agent: Makes AI ‘productive’, translating model power into executable services
  • Workflow: Ensures ‘reliable’ delivery, guaranteeing value in real business contexts

Notably, the Ziyue 4.0 model upgrade released in May included multimodal reasoning (open-sourced), cross-lingual zero-shot (open-sourced), and translation enhancements. The newly launched Ziyue Live simultaneous interpretation model is also open-sourced, delivering streaming speech recognition at Agent-level quality.

From Technology to Products: End-to-End Capability Integration

From Technology to Products: End-to-End Capability Integration
From Technology to Products: End-to-End Capability Integration|News screenshot

Chief Scientist Duan Yitao detailed the Ziyue model matrix evolution. The Ziyue 4.0 series includes multimodal reasoning, cross-lingual zero-shot, and translation upgrades, with the first two open-sourced and achieving state-of-the-art performance among equivalent-scale models.

The Ziyue Live model supports real-time streaming input/output and full-duplex interaction, replacing the conventional ‘you-say-one-sentence, I-reply-one-sentence’ pattern with significantly reduced latency and improved fluency.

Agent products bridge theory to practice across办公, learning, and marketing domains:

  • Office: LobsterAI 2.0 supports OpenClaw2.0 ecosystem, adds Sites/Teams features, enables public address sharing with password protection, and features pay-per-usage pricing
  • Learning: Hi Echo serves 10M+ users with end-to-end full-duplex voice dialogue and Echo HELIX self-evolution system; Bayige Shuo converts natural speech directly into structured text
  • Marketing: iMagicBox generates digital human videos from image + instruction, cutting content cost by 80% and boosting click-through rates by 30%; YODA provides influencer insights from 2000+ real projects

An unexpected metric emerged: AI-generated marketing content increased 12-fold within two years to reach 25% of total volume, signaling rapid adoption beyond pilot phases.

Hardware Evolution: From Recording to Execution

The OpenPods AI earbuds integrate Agent capabilities into hardware, covering ’listen, record, act’ workflows:

  • Supports real-time translation across 20+ languages with voice cloning for speaker characteristics
  • Standalone operation: earbud pods handle recording, translation, and playback without smartphone
  • Automatically identifies speakers, cleans up repetitive/revised speech, and generates actionable To-Dos
  • Crucially, To-Dos become executable task lists—marking the shift from passive recording to proactive action

Human-AI Collaboration: A ‘Workbench + Living Assistant’

Human-AI Collaboration: A ‘Workbench + Living Assistant’
Human-AI Collaboration: A ‘Workbench + Living Assistant’|News screenshot

Duan Yitao argued that the real question is not which jobs AI will replace, but how AI amplifies human value. His ‘Youdao Youju’ platform provides verifiable evidence (papers, patents, laws) for every claim, supporting AI-human co-creation of papers and presentations.

His thesis: Future high-value AI products should be ‘workbench + living assistant’, not mere ‘Chat’ task-executors. Here, AI serves as both a model harness and human cognition harness, aiming for ‘1+1>2’ outcomes.

User Recommendations: Who Should Try Now

User Recommendations: Who Should Try Now
User Recommendations: Who Should Try Now|News screenshot

  • Content creators & marketers: Use iMagicBox to assess cost/benefit for periodic video素材; ideal for SMEs with consistent output needs
  • Remote teams: LobsterAI 2.0’s sharing nativity suits cross-departmental coordination and deliverable distribution
  • Language learners: Hi Echo and Bayige Shuo suit advanced learners; beginners should combine with traditional courses to adapt to structured AI feedback

Final Word

Youdao’s shift from ‘model parameter wars’ to ‘workflow integration depth’ marks the industry’s transition from capability competition to value creation. Its three-layer协同 framework offers a clearer methodology for enterprise AI adoption.