Feature Requests

Enhance your generated StreamDiffusion output to higher resolutions in real-time. Perfect for web apps that need larger output, big-screen installations, and creative visual projects

Pass through and synchronize audio output with the video output. Perfect for audio-reactive applications

Streaming tools to help you build great applications (component examples, etc) The kit provides ready-to-use components and primitives for common inputs (camera, canvas, audio, text prompt, and more), optional preprocessing (e.g., background segmentation), and first-class playback and debugging tools. Primary goal: Enable builders to ship functional prototypes and production integrations rapidly, without needing deep streaming expertise.

Isolate any object in any video, track it. Additionally, identify objects by subject matter or location in a video

Ultra-high resolution for giant screens

Identify NSFW content in frames of a video and return a blurred or redacted frame. Available as standalone endpoint, or in combination with our StreamDiffusion API. This is "best-effort" redaction, not intended to fulfill legal obligations such as CSAM moderation.

Would like to see a current stream configuration endpoint - needed to understand the status and to debug. In trying to build for the Builder Cohort #2, multiple issues related to prompting passthrough and model selection took many hours out of the coding timeline and no real solution was found. It would be helpful to be able to quickly and easily review if something is going wrong server side or not so that we can better create for Daydream.

Currently, there is set of default configuration at stream creation and a subsequent request is need to update to a configuration. This is not idea, because the ideal stream configuration is often times already known when the stream is being created. It makes more sense to able to specify the "starting configuration" of a stream at creation time.

Not all builders are familiar with creating input streams via software like OBS. Being able to select a default input stream for testing with the API can help remove major friction. This feedback came from the builder cohort #2.

Use NDI Bridge to integrate with video-production related software like Resolume and Notch