Text-Guided Synthesis of Eulerian Cinemagraphs

1 CMU    2Snap Research

ACM Transactions on Graphics (TOG), SIGGRAPH Asia 2023

Paper Code Project Gallery

Gallery (Our Results)

We introduce a fully automated method for creating cinemagraphs from text descriptions — an especially challenging task when prompts feature imaginary elements and artistic styles, given the complexity of interpreting the semantics and motions of these images. Below we shows a grid of paris of input text prompt (top) and their corresponding generated cinemagraphs (bottom).

"a large waterfall falling between hills in the style Van Gogh painting during sunset, 4k"

"a large waterfall falling between hills in the style Van Gogh painting during sunset, 4k"

"a photo of a waterfall falling
from a hill covered in
snow during winter"


"a small wooden house, with a boat
floating on lake, in the style
of Camille Pissarro"

"pirate ships in turbulant
ocean, ancient photo,
brown tint"

"ultra realistic illustration, a lighthouse by night being attacked by a kraken, the tentacles are wrapped ..."


"world war scene, fighter
planes in the sky,
clouds, cinematic ancient photo,
brown tint"

"Old Victorian architecture in a Victorian
valley, dramatic sky,
cloudy sky, digital art,
4k, 8k, trending on ArtStation"

"always the sun, beautiful strange detailed summer seascape painting 8k resolution deviantart trending on Artstation concept art digital illustration"


"a large waterfall falling from hills
during sunset in the style
of Leonid Afremov"

"a large river flowing in front of a mountain in the style of starry nights painting"

"a watercolor painting
of a waterfall,
high definition, 4k"


"oil painting of a waterfall
falling from the hills in the
essence of renaissance style,
no humans"

"pirate ships in
turbulant ocean,
ancient photo,
brown tint"

"always the sun, beautiful strange detailed summer seascape painting 8k resolution deviantart trending on Artstation concept art digital illustration"


"super detailed color lowpoly art, northern sunset on a lake, monochrome photorealistic, lake, unreal engine, high contrast color palette, 3 d render, lowpoly, colorful, digital art, perspective, robb cobb"

"super detailed color lowpoly art, northern sunset on a lake, monochrome photorealistic, lake, unreal engine, high contrast color palette, 3 d render, lowpoly, colorful, digital art, perspective, robb cobb"

"a surreal and dreamlike
waterfall scene, using
imaginative colors
and shapes to
create a fantastical image"


"a large waterfall falling from
hills during sunset in the style of
Leonid Afremov"

"Dead river, red color,
highly detailed, 8 k, artstation,
beutifull, masterpiece"

"a large river flowing in front of a mountain in the style of starry nights painting"


"an ocean scene during a storm, and use intense colors and powerful brushstrokes to capture the energy and drama of the turbulent waters"

"oil painting of a waterfall
falling from the hills in
the essence of renaissance style,
no humans"

"a large river in a
futuristic world,
large buildings,
cyberpunk style "


"dense black smoke over a large
grassland, after fire, vibrant colors,
saturated, RGB, psychedelic colors"

"Old Victorian architecture in a Victorian
valley, dramatic sky, cloudy sky, digital
art, 4k, 8k, trending on ArtStation"

"dense black smoke over a large
grassland, after fire, in the
style of oil painting"