Text-Guided Synthesis of Eulerian Cinemagraphs

1 CMU    2Snap Research

ACM Transactions on Graphics (TOG), SIGGRAPH Asia 2023

Back

Ablation - Importance of Twin Image Generation

We study the role of twin image synthesis. We compare our full method, which predicts optical flow on the realistic image, to Ours (w/o twin), which directly predicts optical flow using the artistic image. The results show that our predicted flow (using a realistic image) is significantly smoother and consistent.

Ours (w/o twin) [Optical Flow]

Ours (w/o twin) [Video]

Ours [Optical Flow]

Ours [Video]

"a large waterfall falling between hills in the style Van Gogh painting during sunset, 4k"


Ours (w/o twin) [Optical Flow]

Ours (w/o twin) [Video]

Ours [Optical Flow]

Ours [Video]

"a large waterfall falling between hills in the style Van Gogh painting during sunset, 4k"


Ours (w/o twin) [Optical Flow]

Ours (w/o twin) [Video]

Ours [Optical Flow]

Ours [Video]

"oil painting of a waterfall falling from the hills in the essence of renaissance style, no humans"


Ours (w/o twin) [Optical Flow]

Ours (w/o twin) [Video]

Ours [Optical Flow]

Ours [Video]

"oil painting of a waterfall falling from the hills in the essence of renaissance style, no humans"


Ours (w/o twin) [Optical Flow]

Ours (w/o twin) [Video]

Ours [Optical Flow]

Ours [Video]

"world war scene, fighter planes in the sky, clouds, cinematic ancient photo, brown tint"


Ours (w/o twin) [Optical Flow]

Ours (w/o twin) [Video]

Ours [Optical Flow]

Ours [Video]

"always the sun, beautiful strange detailed summer seascape painting 8k resolution deviantart trending on Artstation concept art digital illustration"


Ours (w/o twin) [Optical Flow]

Ours (w/o twin) [Video]

Ours [Optical Flow]

Ours [Video]

"a large waterfall falling from hills during sunset in the style of Leonid Afremov"


Ours (w/o twin) [Optical Flow]

Ours (w/o twin) [Video]

Ours [Optical Flow]

Ours [Video]

"a large waterfall falling from hills during sunset in the style of Leonid Afremov"


Ours (w/o twin) [Optical Flow]

Ours (w/o twin) [Video]

Ours [Optical Flow]

Ours [Video]

"Dead river, red color, highly detailed, 8 k, artstation, beutifull, masterpiece"