My goal is to get broadcasts from my clients on RTMP format, do some improvement, applying some filters in real time, and then rebroadcast to other servers using RTMP. I also want the modified video to me used as a Virtual Web Cam. The filters I want to apply are Selective Gaussian Blur and Waifu2X . Both filters must be very fast, if necessary they can use the GPUs.
I was planning of using ffmpeg, Frei0r and nginx, but any other program could be used like GStreamer.
If you can do only part of the job, like creating the filters, it will be already very good.