Real-Time High-Resolution Background Matting

Fork from the repository Real-Time High-Resolution Background Matting. You can check their paper here.

Download

Model / Weights

• Download model / weights

Demo

Scripts

I mainly modified the inference_webcam.py script to use along with Open Broadcaster Software (OBS). An example of how to use this script is provided in run.sh.

 

Compute remotely matting

I added a proof of concept to offload matting on another computer using the Bidirectional Mode from vidgear. You can see more here.

A Compute Node is a computer with a GPU and a Client is a computer with a webcam. The computer node process the image coming from the webcam and send it back to this computer.

You need to adjust IP address in the compute_node.py and client.py.

Server part :

python compute_node.py --model-backbone-scale 0.25 --model-type mattingrefine --model-backbone resnet50 --model-checkpoint pytorch_resnet50.pth

Client part :

python client.py

 

Acknowledgements

• Shanchuan Lin*, University of Washington
• Andrey Ryabtsev*, University of Washington
• Soumyadip Sengupta, University of Washington
• Brian Curless, University of Washington
• Steve Seitz, University of Washington
• Ira Kemelmacher-Shlizerman, University of Washington

^{* Equal contribution.}

 

License

This work is licensed under the MIT License.