Text-Guided Synthesis of Eulerian Cinemagraphs

1 CMU    2Snap Research

ACM Transactions on Graphics (TOG), SIGGRAPH Asia 2023

Back

Comparison to Baseline Methods (Artistic Domain)

Given the input text prompt (below each row of results), we compare our method with both single-image animation methods and text-to-video models in the artistic domain. For single-image animation methods, we use the same static image as our method, generated by Stable Diffusion. As the videos produced by these baselines are non-looping, we implement a postprocessing method [Endo et al. 2019] to make the generated videos looping. page.

Ours

Animating Landscape

Eulerian

SLR-SFS

CogVideo

Text2VideoZero

VideoCrafter

"a large waterfall falling between hills in the style Van Gogh painting during sunset, 4k"


Ours

Animating Landscape

Eulerian

SLR-SFS

CogVideo

Text2VideoZero

VideoCrafter

"a photo of a waterfall falling from a hill covered in snow during winter"


Ours

Animating Landscape

Eulerian

SLR-SFS

CogVideo

Text2VideoZero

VideoCrafter

"a small wooden house, with a boat floating on lake, in the style of Camille Pissarro"


Ours

Animating Landscape

Eulerian

SLR-SFS

CogVideo

Text2VideoZero

VideoCrafter

"world war scene, fighter planes in the sky, clouds, cinematic ancient photo, brown tint"


Ours

Animating Landscape

Eulerian

SLR-SFS

CogVideo

Text2VideoZero

VideoCrafter

"always the sun, beautiful strange detailed summer seascape painting 8k resolution deviantart trending on Artstation concept art digital illustration"


Ours

Animating Landscape

Eulerian

SLR-SFS

CogVideo

Text2VideoZero

VideoCrafter

"a large waterfall falling from hills during sunset in the style of Leonid Afremov"


Ours

Animating Landscape

Eulerian

SLR-SFS

CogVideo

Text2VideoZero

VideoCrafter

"a large river flowing in front of a mountain in the style of starry nights painting"


Ours

Animating Landscape

Eulerian

SLR-SFS

CogVideo

Text2VideoZero

VideoCrafter

"a watercolor painting of a waterfall, high definition, 4k"


Ours

Animating Landscape

Eulerian

SLR-SFS

CogVideo

Text2VideoZero

VideoCrafter

"a surreal and dreamlike waterfall scene, using imaginative colors and shapes to create a fantastical image"