2022-09-07
Vapoursynth 光流算法 补帧 画面优化 Denoising

nazobase NAZOrip basement, with cython dll docs

DBmbk a debanding toolkit, for easier bezier curve generation

ffmpeg super resolution filter could get faster if run on gpu with libtensorflow

VESPCN: real-time super resolution

mpv is a media player with VapourSynth built-in, and that’s probably how vapoursynth gets in my mac via brew dependency manager

view.py is Python module for vapoursynth scripts that previews clips

to use opencv functions with vapoursynth

svp is free on linux, offering plugin for vlc while vlc cannot be run as root

you might harvest some prebuilt binaries of vapoursynth plugins for linux

补帧算法可适用于我们的动态水印追踪系统 但是可能需要优化 才能做到比较快速的补帧 因为水印所在位置的区间实际上只是白色的 不需要过于复杂的网络 同时这种补出来的水印需要逐帧处理 或者两帧一处理 生成的区间数量会非常的多

it is much easier to do this on windows since we need quick evaluation. might run this on virtualbox?

build scripts on how to build plugins for macos, including how to configure the installation prefix.

brew compatible, macos compatible vapoursynth plugin build script provider: homebrew-vsplugins does not provide build scripts for all plugins avaliable for windows, and it requires additional linking

tutorial on how to configure it: (is it intel only?)

Alternative VapourSynth Install Method (Brew):

IMPORTANT: Brew users will need to create and set the autoload folder prior to installing VapourSynth! Simply run the following commands:

Code:

1
2
3
4
5
6
mkdir -p /usr/local/lib/vapoursynth
mkdir -p "$HOME/Library/Application Support/VapourSynth"
touch "$HOME/Library/Application Support/VapourSynth/vapoursynth.conf"
echo UserPluginDir=/usr/local/lib/vapoursynth >> "$HOME/Library/Application Support/VapourSynth/vapoursynth.conf"
echo SystemPluginDir=/usr/local/lib/vapoursynth >> "$HOME/Library/Application Support/VapourSynth/vapoursynth.conf"

(Optional) Create desktop shortcuts for the plugins and scripts folders. Run the following commands in terminal:

Code:

1
2
3
4
mkdir $HOME/Desktop/VapourSynth
ln -s /usr/local/lib/vapoursynth $HOME/Desktop/VapourSynth/Plugins
ln -s /usr/local/lib/python3.9/site-packages $HOME/Desktop/VapourSynth/Scripts

Use brew command:

Code:

1
2
brew install vapoursynth

bm3d denoising using cuda

fft3d denoising

python opencv 光流算法详解 分为sparse和dense两种 某种程度上都可以计算场景的变换激烈程度

frame interpolation using deep optical flow

openmmlab mmflow

google research: FILM (frame interpolation for large motion)

vapoursynth get started (official doc)

vapoursynth plugin database only provide prebuilt binaries for windows while the plugin source code might work with linux and macos (if it has the source code)

VSRepo plugin manager installing vapoursynth plugin via commandline tool and vsrepo is only supported on windows, for other platforms we need to compile plugins manually.

nazorip vapoursynth blogs

nazorip bezier curve

nazorip gamma curve and convolution

flowpy: tool for visualizing and processing image with optical flow

Read More

2022-09-03
补帧 插帧 提高帧数

补帧 插帧 提高帧数 黑白相片上色 慢动作视频 照片优化 提高清晰度 模糊变清晰 人像美颜

超分辨率 super resolution realcugan bilibili official real cugan

avisynth的替代品:vapoursynth(in Python) FrameServer

vapoursynth is somehow installed on python 3.10(brew). do not know what depends on that.

mvtools for vapoursynth motion compensation

效果好 速度慢 dain

rife 速度快 画质会变差 another repo link with more stars

vapoursynth rife filter usage just a gist

vsrife using cuda

rife plugin for vapoursynth using vulkan

nvidia super slomo 比较吃显存 需要NVIDIA SDK 速度快

sepconv 看起来比较模糊 但是还是比直接overlay要好

pytorch sepconv slomo

memc-net比较清晰

FFmpeg自带插帧的filter:

1
2
ffmpeg -i input.60fps.hevc -filter "minterpolate='fps=120'" output.120fps.hevc

ai黑白上色可以把原视频洗稿:image colorization

coloring grayscale images

Coloring black and white images with deep learning

memc (motion estimation/motion compensation)

在CSDN上看到的算法名称和内容

内置超分辨率算法:

Waifu2x / SRMD / RealSR / Real-ESRGAN/ Real-CUGAN / Anime4K / ACNet

内置超分辨率引擎:

Waifu2x-caffe / Waifu2x-converter / Waifu2x-ncnn-vulkan

SRMD-ncnn-vulkan / RealSR-ncnn-vulkan / Anime4KCPP / SRMD-CUDA

RealESRGAN-NCNN-Vulkan / Real-CUGAN-ncnn-vulkan

内置插帧算法:

RIFE / CAIN / DAIN

内置插帧引擎:

rife-ncnn-vulkan / cain-ncnn-vulkan / dain-ncnn-vulkan

Read More