Compositional 3D-aware Video Generation with LLM Director


Comparison with State-of-the-Art Methods


Prompt: In a Magician's magical cabin alone in a serene forest, an alien walking on the floor, starting from the cabin's door to the mow near the bottom right corner of this image.


Ours
Ours: Depth
4D-FY
Comp4D
VideoCrafter2


Prompt: Four characters stood on the stage. In front of the stage, a man and a woman are performing China Kung Fu and dancing respectively. On the right side of the stage, a skeleton man is dancing, and behind them, a clown is performing.


Ours
Ours: Depth
4D-FY
Comp4D
VideoCrafter2



Applications on Controllable Generation: Actor's Appearance Editing


Prompt: A black man wearing a green t-shirt playing Kungfu on the stage.




Prompt: Turn the character into a fairy.




Prompt: Turn the character into a warlock.






Applications on Controllable Generation: Actor's Motion Editing


Prompt: A demon slayer performing a han and tang dance on the stage.




Prompt: Turn the motion of the character into a ballet.




Prompt: Turn the motion of the character into a kin kong exotic dance.






Applications on Controllable Generation: Scene Editing


Prompt: A revenant dancing Daily Lovedive in a ultra-modern mega villa by the sea with swimming pool.




Prompt: Turn the scene into a long anime-style road with anime-blocks and little anime-grass.




Prompt: Turn the character into a postapocalyptic city in desert.