Text to Video/Music to video generator GAN

https://www.youtube.com/watch?v=V8MlYa_yhF0

https://netease-gameai.github.io/ChoreoMaster/Paper.pdf

该系统可依据音乐风格生成爵士、二次元、街舞等不同类型的舞蹈动画。给定一段音乐，舞蹈演员可以自动生成高质量的舞蹈动作序列以伴随输入音乐的风格、节奏和结构。为了实现这一目标，我们引入了一种新的面向编舞的编舞音乐嵌入框架，它成功地构建了一个统一的舞蹈音乐嵌入空间音乐和舞蹈短语之间的风格和节奏关系。

https://www.youtube.com/watch?v=VrVsAcgFK_4

该方法提出了一个基于cross-modal transformer的架构模型和一个新的3D舞蹈数据集，该数据集包含了根据真实舞者重建的3D运动

项目地址: https://google.github.io/aichoreographer

数据集地址: https://google.github.io/aistplusplus_dataset/

欢迎点赞、评论、分享、收藏！

video generation using music based on bigGAN:

https://github.com/Remideza/MichelAI/

bigGAN Large Scale GAN Training for High Fidelity Natural Image Synthesis:

https://github.com/ajbrock/BigGAN-PyTorch

dance video generation self-supervised:

https://github.com/xrenaa/Music-Dance-Video-Synthesis

show me what and tell me how based on openai clip by snap research with pretrained models, able to generate arbitrary video based on text description:

https://github.com/snap-research/MMVID

text to video generator based on vqgan and clip with primitive colab notebooks by kapwing the online video editor:

https://www.kapwing.com/ai-video-generator

thin plate spline motion model

video animation generation only using few character portraits: 根据角色设定图画出人物动画（有动画驱动器）

https://github.com/megvii-research/CoNR

galgame video generator using pygame（自动化类galgame动画生成器）:

https://github.com/w4123/TRPG-Replay-Generator

digan, could generate taichi videos

suggest you to segment video first and then use this to do the freaking work.

https://github.com/sihyun-yu/digan?ref=pythonawesome.com

https://sihyun-yu.github.io/digan/

https://pythonawesome.com/official-pytorch-implementation-of-generating-videos-with-dynamics-aware-implicit-generative-adversarial-networks/

MoCoGAN can generate the same object performing different actions, as well as the same action performed by different objects:

https://github.com/sergeytulyakov/mocogan

still image to talking with hands moving video generation compared to FOMM, can even animate non-human objects:

https://snap-research.github.io/articulated-animation/

montage.ai generate video by music with deep analyzer:

https://github.com/Tartar-san/montage.ai

tiktok hashtag montage:

https://github.com/andreabenedetti/tiktok-montage