Changelog
Follow up on the latest improvements and updates.
RSS
About the Release
We are thrilled to announce the beta release of
SDXL for StreamDiffusion
, bringing the most advanced Stable Diffusion model into a highly controllable real-time video workflow.Better yet:
it’s all open source
and available for the real-time AI video community to explore and extend.Builders and Creative Technologists can now generate
HD real-time video at over 15FPS
directly on the Daydream platform, with the potential to achieve up to 25 FPS in optimized configurations.dotsimulate and others are already creating SDXL-based tools and applications using the Daydream API or self-hosting our open-source StreamDiffusion fork.
Getting Started
- StreamDiffusion can create a wide variety of video styles. Craft a custom configuration and share it with the world. Explore →
- If you’re ready to build, check out our Quickstart guides: Start Building →orConnect to StreamDiffusionTD →
- Learn about real-time AI and world models Explore Knowledge Hub and Research Resources →
Quality you can actually control
Our open source stack allows us to rapidly combine many parallel research tracks and deliver groundbreaking quality and controllability.
Here a few of the key components - already battle-tested by Daydream builders:
SDXL
- 3.5× larger modelwith expanded attention blocks for better image quality
- Native 1024×1024 resolution- HD output with improved colors, contrast, and details
- Less flickering and fewer artifactswith better frame-to-frame consistency
Image-Based Style Control (through IPAdapters)
IPAdapters (Image-Prompt Adapters)
let you use any reference image to guide your video's style - similar to LoRAs but with real-time control.Two modes:
- IPAdapter Standard: Apply artistic styles across your video stream
- IPAdapter FaceID: Maintain character consistency throughout sequences
Technical features:
- 7+ Temporal Weight Types: Linear, Ease-in/out, Style transfer, Composition, etc.
- Runtime Parameter Tuning: Adjust settings during generation
Fine-tuned Spatial Consistency (through Multi-ControlNet Support)
We’ve accelerated HED, Depth, Pose, Tile, Canny ControlNets for incredibly granular control of the workflow’s spatial awareness. You can use multiple at the same time, and adjust the strength of each.
TensorRT Acceleration
- Sustained real-time generation through NVIDIA's inference optimization
- Consistent 15-25 FPS with complex models
🎁 Bonus: SD1.5 + IPAdapters
SD1.5 is a community favorite for a reason - and we’ve coupled it with accelerated IPAdapters for a high-framerate style transfer experience.
Note: IPAdapters aren't available for SDTurbo models.
Daydream is a growing community of researchers, builders and artists, steering the future of open-source real-time AI video and world models like StreamDiffusion and MatrixGameV2.
Much of
the existing information about this domain is scattered
across the reaches of the internet, and we're compiling a knowledge hub
to help builders, artists, and researchers accelerate their work. We've compiled some resources to start, but open source is most powerful when a community collaborates;
we welcome and encourage community contributions!
Explore Resources
Here's what you'll find in the knowledge hub today
Tutorials and Guides
- Code samples and vibecoding guidesfor the most popular app styles, including camera ingest, canvas integration, fluid simulation, and audio-reactive
- Videos and tutorials on getting the most from StreamDiffusion
- Guides for using Daydream as a cloud backend for dotsimulate’s StreamDiffusionTD
Articles and Research
- Real-time AI video fundamentals
- Summaries of recent AI Video and World Model research
- Technical explainers
new
Playground
Improved Controllability in the Daydream Playground
About this release
The Daydream community has created some amazing experiences and visuals with the Playground - but it's been a little too difficult to get good results.
Starting from scratch with all the knobs can be overwhelming and error-prone, so we’ve made it simpler and more fun. Now you can:
- Start with proven configs from community→ jump in without overthinking every parameter to get good results.
- Remix with image-based prompts→ swap in your own images to instantly change the style.
You don’t need to know every parameter to get great results. Now, you can build on community creations, tweak them, and share your own experiences.
To help you get started, we’ve curated a few amazing configurations created by Daydream community members. You can try them here.
✨ Getting good results with prefilled configs
No more guesswork for getting good results: now you can
learn about effective configurations
by testing out some community creations, save the configurations you love
, and share your own configuration
for others to build on. Share a look you love, try someone else’s setup, or collaborate to push an idea further.

Image-based prompts for effortless style & vibe changes
Creating detailed prompts isn’t always easy- that’s why we added image-based controls.
With IPAdapters (Image-Prompt Adapters), you can just shuffle images or upload your own reference, then adjust intensity to instantly change the style or vibe. IPAdapters behave a bit like LoRAs, but live and versatile.
Now with
Streamdiffusion 1.5
and SDXL
plus faster IPAdapters
, you can guide your video’s look in real time using any image.
By combining
configs
and image-based prompts
, you get two simple but powerful ways to unlock creativity: start from a proven recipe, then swap in your own reference images to instantly make it yours. What's New
Added strict parameter validation to prevent malformed requests. Previously, the API silently accepted requests with incorrect parameters, incorrect types, or unknown parameters. Now, any of these validation failures will return a 400 Bad Request response with a descriptive error message indicating the specific issue.
Potential Breaking Change
Requests that were previously accepted despite having invalid parameters will now be rejected. Ensure all API calls use correct parameter names, types, and values.
What's New
We're removing the biggest friction point for new developers - waiting for Daydream to provision an API key. Now anyone can sign up and start building immediately.
This dashboard enables builders to generate, manage, and organize their API keys.
Link
Key Features
- API Key Management: Generate multiple API keys with custom naming (perfect for local/staging/prod environments)
- Secure Key Handling: Keys shown once at creation, then masked for security
- Quick Actions: Copy keys to clipboard, rename, and delete with confirmation
- Mobile Support: Responsive design for basic key operations on mobile
Available Now
Existing builders can access their keys immediately; new signups get instant self-serve access.
Coming Soon
Future improvements will include usage tracking, debugging tools, billing, and team management.