AI for Voice and Video - Daily

Daily′s AI Toolkit for Voice & Video

Introducing Daily′s AI Toolkit. Easily build AI-powered features into your apps, create new workflows, or enrich your recordings with our client and server-side SDKs.

Build AI-powered apps & workflows

Combine WebRTC real-time video and audio with Large Language Models and other AI tools. Our SDKs allow developers to connect to sessions via their native desktop and cloud-deployed services.

Explore SDKs
1from daily import CallClient, Daily
2  
3# Initialize Daily context & create client
4Daily.init()
5client = CallClient()
6
7# Join your Daily room
8client.join("https://DOMAIN.daily.co/ROOM_URL")
9
10try:
11    # Print list of call participants
12    participants = client.participants()
13    print(participants)
14finally:
15    client.leave()
1import DailyIframe from "@daily-co/daily-js";
2
3// Create the call object
4const callObject = Daily.createCallObject({
5    url: "ROOM_URL",
6    userName: "Jane Doe"
7});
8
9// Join the call
10callObject.join();

Create third-party integrations in seconds

Easily access session data as well as participant audio and video tracks. Transcribe or connect them to AI-powered services like OpenAI and GPT4.

1# ... 
2  
3# Forward video track to your service of choice
4def on_video_frame(participant_id, video_frame):
5    print(video_frame)
6# ...
7
8# Retrieve video track for a participant
9client.set_video_renderer(PARTICIPANT_ID, on_video_frame)
1import DailyIframe from "@daily-co/daily-js";
2
3// Create the call object
4const callObject = Daily.createCallObject({
5    url: "ROOM_URL",
6    userName: "Jane Doe"
7});
8
9// Join the call
10callObject.join();

Explore what′s possible

Dive into some of our demos and experiments to see how Daily′s AI Toolkit can be used to add AI-powered features to your apps.

Content moderation with ActiveFence

Using Daily's AI toolkit and Python SDK alongside ActiveFence, the leader in Trust and Safety, developers can build features and UX to identify unwanted content and illegal behavior, and protect their users from harm.

The technology behind AI-powered Clinical Notes API for Telehealth

The technology behind AI-powered Clinical Notes API for Telehealth

Building blocks for video call analytics and summarization workflows.

Cerebrium + Daily: Simplifying deployments for your AI-powered voice and video apps

Cerebrium + Daily: Simplifying deployments for your AI-powered voice and video apps

With Cerebrium’s serverless deployment, you can sidestep the intricacies of scaling the CPU/GPU and the Kubernetes resources. Plus, you can easily deploy off-the-shelf ML Prebuilt models that are fine-tuned on your data.

How to talk to an LLM with your voice

As LLMs are becoming increasingly multi-modal, and users' expectations are rapidly rising for how they want to interface with them, adding voice and video into your apps and AI experiences is crucial. In this demo, we showcase a Choose Your Own Adventure 'storybot' using Daily's AI toolkit.

Automatic short-form video: Highlight reels at scale with AI and VCSRender

Automatic short-form video: Highlight reels at scale with AI and VCSRender

Build your own Read the docs
New from Daily

AI-powered Clinical Notes

Introducing clinical notes generation, seamlessly integrated into telehealth developer APIs, powered by today′s most advanced AI tools.

// Do more with your data

Daily AI: Voice, video, and AI for developers

Daily′s developer platform powers audio and video experiences for millions of people all over the world. Our customers are developers who use our APIs and client SDKs to build audio and video features into apps and websites. We′re now rolling out several AI initiatives, combining voice, video and AI for developers.