Daily′s AI Toolkit for Voice & Video

Introducing Daily′s AI Toolkit. Easily build AI-powered features into your apps, create new workflows, or enrich your recordings with our client and server-side SDKs.

Build AI-powered apps & workflows

Combine WebRTC real-time video and audio with Large Language Models and other AI tools. Our SDKs allow developers to connect to sessions via their native desktop and cloud-deployed services.

Explore SDKs

1from daily import CallClient, Daily
2  
3# Initialize Daily context & create client
4Daily.init()
5client = CallClient()
6
7# Join your Daily room
8client.join("https://DOMAIN.daily.co/ROOM_URL")
9
10try:
11    # Print list of call participants
12    participants = client.participants()
13    print(participants)
14finally:
15    client.leave()

1import DailyIframe from "@daily-co/daily-js";
2
3// Create the call object
4const callObject = Daily.createCallObject({
5    url: "ROOM_URL",
6    userName: "Jane Doe"
7});
8
9// Join the call
10callObject.join();

Create third-party integrations in seconds

Easily access session data as well as participant audio and video tracks. Transcribe or connect them to AI-powered services like OpenAI and GPT4.

# ... 
  
# Forward video track to your service of choice
def on_video_frame(participant_id, video_frame):
    print(video_frame)
# ...

# Retrieve video track for a participant
client.set_video_renderer(PARTICIPANT_ID, on_video_frame)
import DailyIframe from "@daily-co/daily-js";

// Create the call object
const callObject = Daily.createCallObject({
    url: "ROOM_URL",
    userName: "Jane Doe"
});

// Join the call
callObject.join();

Meeting summaries

Virtual Characters

Content moderation

Sentiment analysis

Voice-driven LLM

Real-time translation

Meeting summaries

Virtual Characters

Content moderation

Sentiment analysis

Voice-driven LLM

Real-time translation

Explore what′s possible

Dive into some of our demos and experiments to see how Daily′s AI Toolkit can be used to add AI-powered features to your apps.

Content moderation with ActiveFence

Using Daily's AI toolkit and Python SDK alongside ActiveFence, the leader in Trust and Safety, developers can build features and UX to identify unwanted content and illegal behavior, and protect their users from harm.

The technology behind AI-powered Clinical Notes API for Telehealth

Building blocks for video call analytics and summarization workflows.

Cerebrium + Daily: Simplifying deployments for your AI-powered voice and video apps

With Cerebrium’s serverless deployment, you can sidestep the intricacies of scaling the CPU/GPU and the Kubernetes resources. Plus, you can easily deploy off-the-shelf ML Prebuilt models that are fine-tuned on your data.

How to talk to an LLM with your voice

As LLMs are becoming increasingly multi-modal, and users' expectations are rapidly rising for how they want to interface with them, adding voice and video into your apps and AI experiences is crucial. In this demo, we showcase a Choose Your Own Adventure 'storybot' using Daily's AI toolkit.

Automatic short-form video: Highlight reels at scale with AI and VCSRender

Build your own Read the docs

New from Daily

AI-powered Clinical Notes

Introducing clinical notes generation, seamlessly integrated into telehealth developer APIs, powered by today′s most advanced AI tools.

// Do more with your data

Daily AI: Voice, video, and AI for developers

Daily′s developer platform powers audio and video experiences for millions of people all over the world. Our customers are developers who use our APIs and client SDKs to build audio and video features into apps and websites. We′re now rolling out several AI initiatives, combining voice, video and AI for developers.