Full AI Production Pipeline (multimodal prompt to video / explicit object controls)
(as of 2024-June)
Contents
hide
Production Pipeline
-
PlayBookXR
- beta
- vision: full end-to-end AI production pipeline
- multi-platform (Web / Spatial XR / goggles)
- https://www.playbookxr.com/
.
Text-to-Video / genAI Video
-
LumaLabs
- Dream Machine — video creator
- Genie — 3d object creator (Discord)
-
OpenAI
- Sora
- SotA — R&D — not public release
- https://openai.com/index/sora/
.
-
Pika Labs
- text to video
- https://pika.art/home
.
-
Runway
- gen3-alpha
- A new frontier for high-fidelity, controllable video generation.
- long term vision: BUILDING GENERAL WORLD MODELS
- A world model is an AI system that builds an internal representation of an environment, and uses it to simulate future events within that environment
- https://runwayml.com/
.
-
Krea
- Ai video generation
- https://www.krea.ai/home
.
-
Wonder Dynamics [acq: AutoDesk]
- WonderStudio
- An AI tool that automatically animates, lights and composes CG characters into a live-action scene
- includes full 3D avatar mocap replacements for actors
- text to video — AI rotocope
- https://wonderdynamics.com/
.
- WonderStudio
AI Game Engines
-
InWorld
- AI game engine
- products: Engine / Studio / Core
- https://www.inworld.ai
.
-
Unity (Game Engine)
-
Adobe (Creative Suite)
- Firefly
- genAI integrated across entire Creative Suite
- PhotoShop, Premiere, etc
- https://www.adobe.com/products/firefly.html
..
AI Voice Synthesis
-
ElevenLabs
- SotA AI TTS (text-to-speech)
- https://elevenlabs.io/
.
AI PRODUCTION PIPELINE USERS:
- Corridor Digital
- Corridor Crew (YouTube channel)
engine: GPT-4o / DALL-e3
prompt: “a meat grinder with human hand dumping printed words into the top and shiny photographic prints coming out of the sieve. graphic novel style. bold saturated colors. side of meatgrinder should read ‘Gen-AI’”
post: minor “healing brush” removal of chunks of meat flying out alongside the photo sequence