Daily′s AI Toolkit for Voice & Video
Introducing Daily′s AI Toolkit. Easily build AI-powered features into your apps, create new workflows, or enrich your recordings with our client and server-side SDKs.
Build AI-powered apps & workflows
Combine WebRTC real-time video and audio with Large Language Models and other AI tools. Our SDKs allow developers to connect to sessions via their native desktop and cloud-deployed services.Explore SDKs
1from daily import CallClient, Daily 2 3# Initialize Daily context & create client 4Daily.init() 5client = CallClient() 6 7# Join your Daily room 8client.join("https://DOMAIN.daily.co/ROOM_URL") 9 10try: 11 # Print list of call participants 12 participants = client.participants() 13 print(participants) 14finally: 15 client.leave()
Create third-party integrations in seconds
Easily access session data as well as participant audio and video tracks. Transcribe or connect them to AI-powered services like OpenAI and GPT4.
1# ... 2 3# Forward video track to your service of choice 4def on_video_frame(participant_id, video_frame): 5 print(video_frame) 6# ... 7 8# Retrieve video track for a participant 9client.set_video_renderer(PARTICIPANT_ID, on_video_frame)
Explore what′s possible
Dive into some of our demos and experiments to see how Daily′s AI Toolkit can be used to add AI-powered features to your apps.
Content moderation with ActiveFence
Using Daily's AI toolkit and Python SDK alongside ActiveFence, the leader in Trust and Safety, developers can build features and UX to identify unwanted content and illegal behavior, and protect their users from harm.
The technology behind AI-powered Clinical Notes API for Telehealth
Building blocks for video call analytics and summarization workflows.
Cerebrium + Daily: Simplifying deployments for your AI-powered voice and video apps
With Cerebrium’s serverless deployment, you can sidestep the intricacies of scaling the CPU/GPU and the Kubernetes resources. Plus, you can easily deploy off-the-shelf ML Prebuilt models that are fine-tuned on your data.
How to talk to an LLM with your voice
As LLMs are becoming increasingly multi-modal, and users' expectations are rapidly rising for how they want to interface with them, adding voice and video into your apps and AI experiences is crucial. In this demo, we showcase a Choose Your Own Adventure 'storybot' using Daily's AI toolkit.
Automatic short-form video: Highlight reels at scale with AI and VCSRender
Daily AI: Voice, video, and AI for developers
Daily′s developer platform powers audio and video experiences for millions of people all over the world. Our customers are developers who use our APIs and client SDKs to build audio and video features into apps and websites. We′re now rolling out several AI initiatives, combining voice, video and AI for developers.