IT course Advanced level

Voice AI and Realtime Multimodal Agents

Build production voice AI and realtime multimodal agents in 2026: STT, TTS, the Realtime API, WebRTC, barge-in, telephony, evaluation, cost, and safety.

Lessons
30in 10 modules
Duration
~25 hself-paced
Quiz
382questions
Level
Advancedfor practitioners
  • In English
  • Updated on
Free preview · lesson 1 · no account needed The Voice AI Stack: Cascaded Pipelines vs Speech-Native Models Voice is the most natural human interface, and in 2026 it has finally become a first-class way to build AI applications. But "voice AI" is not one thing. Read the preview

What you will learn

The course’s skills. The same ones appear on your Certificate of Completion, so you can show what you covered.

  • Foundations of Voice AI in 2026
  • Speech-to-Text: Modern ASR
  • Text-to-Speech: Neural Voices
  • The Realtime API and Speech-Native Models
  • Building a Voice Agent: Orchestration
  • Function Calling and Multimodal Voice
  • Telephony and SIP for Voice Agents
  • Evaluation, Testing, and Safety

About the course

A premium, advanced and complete course on building production voice AI and realtime multimodal agents, updated for 2026. You will master the modern voice stack — cascaded pipelines versus speech-native models — including speech-to-text (Whisper, Deepgram, streaming ASR), text-to-speech (ElevenLabs, Cartesia, OpenAI voices), and speech-to-speech via the OpenAI Realtime API and GPT Realtime. You will learn bidirectional streaming over WebSockets and WebRTC, latency budgeting, voice activity detection, turn detection and barge-in, orchestration with Pipecat and LiveKit Agents, function calling in voice, multimodal agents that combine audio, text and vision, realtime video, telephony and SIP integration with Twilio, rigorous evaluation and testing, deployment, scaling and cost modeling, and real-world case studies. The course carries a strong, practical focus on legal and ethical voice AI: consent to record, biometric voiceprints under GDPR, responsible voice cloning, and AI-disclosure transparency under the EU AI Act. Includes a comprehensive final assessment.

Who it is for

For developers, engineers and technical professionals who build or integrate AI solutions. It belongs to AI Engineering, on the IT track.

What you need

Advanced level: assumes hands-on experience with AI in the course’s field.

Course curriculum

10 modules · 30 lessons · about 25 hours · 382 quiz questions

Read a free preview of lesson 1: “The Voice AI Stack: Cascaded Pipelines vs Speech-Native Models” No account needed. See how a lesson is written before you pay.
  1. Module 1: Foundations of Voice AI in 2026

    3 lessons · 2 h 33 min · 39 questions
    1. The Voice AI Stack: Cascaded Pipelines vs Speech-Native Models Free preview of the lesson “The Voice AI Stack: Cascaded Pipelines vs Speech-Native Models” 52 min 13 questions
    2. Conversation Anatomy: Latency, Turn-Taking, and Endpointing 51 min 13 questions
    3. Consent, Privacy, and AI Transparency: The Legal Foundation 50 min 13 questions
  2. Module 2: Speech-to-Text: Modern ASR

    3 lessons · 2 h 31 min · 37 questions
    1. How Modern Speech Recognition Works: Whisper, Deepgram, and the ASR Landscape 51 min 13 questions
    2. Streaming Transcription: Partial Results, Interim Hypotheses, and Endpointing 50 min 12 questions
    3. ASR Accuracy: WER, Diarization, and Handling Real-World Audio 50 min 12 questions
  3. Module 3: Text-to-Speech: Neural Voices

    3 lessons · 2 h 30 min · 37 questions
    1. Neural TTS in 2026: ElevenLabs, Cartesia, and Hosted Voices 51 min 13 questions
    2. Streaming TTS: Latency, Chunking, and Voice Consistency 50 min 12 questions
    3. Voice Cloning: Ethics, Consent, and the Law 49 min 12 questions
  4. Module 4: The Realtime API and Speech-Native Models

    3 lessons · 2 h 32 min · 36 questions
    1. Speech-to-Speech Models: The OpenAI Realtime API and GPT Realtime 51 min 12 questions
    2. Bidirectional Streaming: WebSockets, WebRTC, and Audio Framing 51 min 12 questions
    3. Sessions, Events, and Managing Realtime State 50 min 12 questions
  5. Module 5: Building a Voice Agent: Orchestration

    4 lessons · 3 h 22 min · 48 questions
    1. Orchestration Frameworks: Pipecat and LiveKit Agents 51 min 12 questions
    2. Turn Detection, VAD, and Barge-In in Practice 51 min 12 questions
    3. The Latency Budget: Engineering Natural Conversation 50 min 12 questions
    4. Conversation Design and System Prompts for Voice Agents 50 min 12 questions
  6. Module 6: Function Calling and Multimodal Voice

    3 lessons · 2 h 30 min · 36 questions
    1. Tool and Function Calling in Voice Agents 51 min 12 questions
    2. Multimodal Agents: Combining Audio, Text, and Vision 50 min 12 questions
    3. Realtime Video and Vision Agents 49 min 12 questions
  7. Module 7: Telephony and SIP for Voice Agents

    3 lessons · 2 h 31 min · 36 questions
    1. Connecting Voice Agents to the Phone Network: Twilio and SIP 51 min 12 questions
    2. Media Streams, DTMF, and Call Control 50 min 12 questions
    3. Building a Production Phone Agent 50 min 12 questions
  8. Module 8: Evaluation, Testing, and Safety

    3 lessons · 2 h 31 min · 35 questions
    1. Evaluating Voice Agents: Metrics and Methods 50 min 11 questions
    2. Testing, Simulation, and Regression 50 min 12 questions
    3. Safety, Guardrails, and Responsible Voice AI 51 min 12 questions
  9. Module 9: Deployment, Cost, and Case Studies

    4 lessons · 3 h 19 min · 48 questions
    1. Deployment Architecture and Scaling 50 min 12 questions
    2. Cost Modeling and Optimization 50 min 12 questions
    3. Case Studies: Real-World Voice Agents 49 min 12 questions
    4. Observability, Monitoring, and Incident Response for Voice Agents 50 min 12 questions
  10. Module 10: Final Quiz — Voice AI and Realtime Multimodal Agents

    1 lesson · 52 min · 30 questions
    1. Final Assessment — Voice AI and Realtime Multimodal Agents 52 min 30 questions
By email

Email me the course syllabus

Modules and lessons in order, plus the link to the preview of lesson 1 — so you can decide at your own pace.

How you learn

You read the lesson, ask the AI Professor right on the page and check what you remember.

The Voice AI Stack: Cascaded Pipelines vs Speech-Native Models

Voice is the most natural human interface, and in 2026 it has finally become a first-class way to build AI applications. But "voice AI" is not one thing.

The AI Professor bar that appears in the lesson under the selected passage, with the actions “Explain this to me”, “Give me an example”, “Why does it matter?” and “My own question”
The first lines of lesson 1 of this course. Read the free preview, no account needed.
  1. You read the lesson at your own pace

    Written lessons, with examples and exercises. Your progress is saved automatically, so you can pick up where you left off.

  2. You ask the AI Professor inside the lesson

    Select a passage and it explains it, gives you an example or tells you why it matters. You can type or talk to it, in English.

  3. You check what you remember

    Every lesson has its own quiz, with explanations for the answers: 382 questions across the course. The professor also summarizes the lesson and prepares review flashcards.

  4. You get the Certificate of Completion

    Once you complete the lessons and reach the minimum quiz score, you issue it from your account, with a unique number, publicly verifiable.

The AI Professor is included in your subscription, per-course access included, with a monthly fair-use limit. It is an AI system, not a human teacher, and its answers may contain errors; details in the Terms. See how the AI Professor works.

You leave with proof anyone can check

The Certificate of Completion for “Voice AI and Realtime Multimodal Agents”: a private attestation with a unique number and a QR code. A recruiter confirms it is authentic on the public verification page, with no account and no cost.

Example of a Cursuri AI Certificate of Completion with sample data: the serial number and the issue date in the top-right corner, the holder’s name, the course, the tier awarded, the percentage of lessons, the average score, the study time, the course version, the issuer and the verification QR code
The real document, an A4 PDF, shown here with sample data. Yours carries your name, the course “Voice AI and Realtime Multimodal Agents”, the serial number, the issue date and the tier you earned; the QR code in the image is decorative.
  • Anyone can verify it

    Public verification page, QR code and cryptographic fingerprint, with no account for the person checking.

  • You show it where it counts

    Add it to your CV and LinkedIn profile; a recruiter confirms authenticity with one click.

  • It says exactly what it attests

    The course, the tier you earned (Pass, Merit or Distinction), the serial number and the issue date, plus the percentage of lessons completed.

Verify a certificate
Pricing

Just this course, or more with this one included

A subscription by number of courses: 1, 3, 5, 10, 15 or 25 courses a month, or the full catalog. You pick them and can change them at every renewal; your progress and certificates stay. Billed monthly or yearly (12 months for the price of 10), in EUR. You can stop the renewal anytime from your account, and access starts right after payment. Prices are totals, with VAT included at the rate of your country.

How many courses a month?

This course goes first on your list; you pick the others in your account and can change them at every renewal.

Billing period
  1. 1 course Only this course

    €99 a course

    €99a month €990a year, 12 months of access

  2. 3 courses This one + 2 of your choice

    under €67 a course

    €199a month €1,990a year, 12 months of access

  3. 5 courses This one + 4 of your choice

    under €52 a course

    €259a month €2,590a year, 12 months of access

  4. 10 courses Recommended This one + 9 of your choice

    under €32 a course

    €319a month €3,190a year, 12 months of access

  5. 15 courses This one + 14 of your choice

    under €24 a course

    €359a month €3,590a year, 12 months of access

  6. 25 courses This one + 24 of your choice

    under €16 a course

    €399a month €3,990a year, 12 months of access

  7. Full catalog Nothing to pick, new courses included

    under €10 a course, across all 50

    €499a month €4,990a year, 12 months of access

Total prices, VAT included. Move up anytime and pay only the difference for the days left; move down at renewal. Renews automatically, you stop it anytime from your account; your progress and certificates stay. Digital content with immediate access: see the withdrawal terms.

Before you decide

Frequently asked questions

About the course, the price, the AI Professor and the certificate.

What will I learn in “Voice AI and Realtime Multimodal Agents”?

A premium, advanced and complete course on building production voice AI and realtime multimodal agents, updated for 2026. You will master the modern voice stack — cascaded pipelines versus speech-native models — including speech-to-text (Whisper, Deepgram, streaming ASR), text-to-speech (ElevenLabs, Cartesia, OpenAI voices), and speech-to-speech via the OpenAI Realtime API and GPT Realtime. You will learn bidirectional streaming over WebSockets and WebRTC, latency budgeting, voice activity detection, turn detection and barge-in, orchestration with Pipecat and LiveKit Agents, function calling in voice, multimodal agents that combine audio, text and vision, realtime video, telephony and SIP integration with Twilio, rigorous evaluation and testing, deployment, scaling and cost modeling, and real-world case studies. The course carries a strong, practical focus on legal and ethical voice AI: consent to record, biometric voiceprints under GDPR, responsible voice cloning, and AI-disclosure transparency under the EU AI Act. Includes a comprehensive final assessment.

The course has 10 modules and 30 lessons, with 382 quiz questions. The full curriculum, module by module, is shown on the course page.

Do I need prior experience for this course?

Yes. The course is Advanced level and assumes hands-on experience with AI in its field.

How long does the course take?

The estimated duration is about 25 hours, across 30 lessons. You learn at your own pace, and your progress is saved automatically at every lesson, so you can pick up where you left off.

How much does it cost, and which plan do I need?

This course alone: the 1 course plan, €99 per month. The course fits into every plan of the subscription, next to other courses you choose: for example 3 courses for €199, 10 courses for €319 (recommended) or the full catalog for €499 per month.

You pick your courses after paying and can change them at every renewal; starting from here, this one is already picked. Plans are billed in EUR, monthly or yearly (pay for 10 months, get 12). Every price is a total, with VAT included at the rate of your country. See all plans.

Can I read part of the course before paying?

Yes. You can read a free preview of lesson 1, “The Voice AI Stack: Cascaded Pipelines vs Speech-Native Models”, without an account. The preview shows you how the lesson is written; the rest of the lesson and the other lessons open after payment.

How does the AI Professor help me in this course?

The AI Professor is built into every lesson and starts from the lesson you have open: it explains the passages you select, gives you examples, summarizes the lesson, tests you with a quiz and prepares review flashcards. You can type or talk to it, in English.

It is included in every plan of your subscription, with a fair-use limit. It is an AI system, not a human teacher, and its answers may contain errors; details in the Terms.

Do I get a certificate when I finish the course?

When you meet the completion thresholds shown on the platform (lessons completed and the minimum quiz score), you can issue your Certificate of Completion for “Voice AI and Realtime Multimodal Agents” from your account, with a unique number, publicly verifiable on the site.

It is a private attestation of course completion, issued by GALIAN SOFTWARE DEVELOPMENT SRL. It is NOT a diploma or a state-recognised qualification under Romanian Laws 198/2023, 199/2023 or Government Ordinance 129/2000; employers may take it into account at their own discretion. Details in the Certification policy.

Does the subscription renew automatically? How do I stop it?

Yes. The subscription renews automatically at the end of each monthly billing period. You can see the next renewal date in your account at any time.

You can stop the renewal at any time, from your account or by email, with no other formality. Access stays active until the end of the period already paid for, and no pro-rata refund is made for a period already started, except in the cases provided by law. Your progress stays saved in your account. Details in the Terms & Conditions, section 5.5.

Can my company buy this course for a team?

Yes. With the team library, the company admin picks 3, 5, 10, 15 or 25 courses a month, or the full catalog, for the whole team, from €49 per member per month, excl. VAT, for 5 members or more. A dashboard shows each member’s progress and manages seats centrally. Price it for your team.

From the same track

Similar courses

You can pick them together with this one in a 3, 5 or 10-course subscription (3 courses for €199 a month), and the full catalog includes them all. A single course is €99 a month.

IT: AI Engineering

MCP (Model Context Protocol) — Building Servers and Integrations (Enterprise Edition)

Build MCP servers in Python and TypeScript: protocol architecture, OAuth 2.1, security, Docker and Kubernetes, CI/CD to production. Hands-on course for 2026.

Start the course today, at your own pace

“Voice AI and Realtime Multimodal Agents”: 30 lessons and about 25 hours of content, with your progress saved at every lesson.

  • Instant access after payment, on computer, tablet or phone.
  • AI Professor in every lesson, included in your subscription.
  • Certificate of Completion, publicly verifiable.

1-course subscription

€99/month

VAT included · stop the renewal anytime from your account

Start the course · €99/month Or 3 courses for €199/month, this one included