Background filters flip the video upside-down before joining a meeting

[Jim-Bar]

Hi. Recently a fix was made so that it is possible to use background blur / replacement image before joining a meeting session on Android: #504. But now when using those filters before joining a meeting, the video is upside-down.

1. Implement a blur filter
2. Apply it to the video preview, not being in a meeting
3. The blur is applied, but the video is upside down

The same occurs with the background replacement image.

This is actually a follow up on the comments I already posted in the original issue.

Tested on a Samsung Galaxy S20 FE, Android 12 and:

• Amazon Chime SDK 0.17.7
• Amazon Chime SDK Machine learning 0.1.0
• Amazon Chime SDK Media 0.17.8

See this video:

Bug-Chime-Blur-Background-before-LIVE.mp4

[dingyishen-amazon]

Thanks for reporting the issue, we will investigate it.

[hokyungh]

Thank you for reporting I am able to reproduce the issue. We'll do further investigation and get back to you.

[hokyungh]

This is due to flipping logic in here. I think internally it comes as flipped which works in this case, but in usual case it might not be working. We'll think of better way to fix this.

[Jim-Bar]

All right, thank you for your investigation. We are looking forward to this bug fix.

[Jim-Bar]

Hi, do you have news on this?

[hokyungh]

HI sorry I am still working on this issue. I'll let you know when I have solution for this issue.

[Jim-Bar]

Hi, this is still an issue for us. Has it been fixed in a new version?

[Jim-Bar]

Hello, sorry to ping repeatedly, but this is still an issue for us. Do you have news on this?

[hokyungh]

Hi sorry for late reply. Unfortunately, I was still caught up with other tasks and didn't have time to work on it. We'll let you know once we work on it, but for short-term mitigation, would it be possible to implement CustomBackgroundProcessor before joining that resembles BackgroundFilterVideoFrameProcessor.kt?

[kackogut]

@hokyungh any news on this one? It's still occurring on the latests (0.19.1) release

[Sotatek-HungHa2]

I tried creating a CustomBackgroundReplacementVideoFrameProcessor, CustomBackgroundFilterVideoFrameProcessor is the same as BackgroundReplacementVideoFrameProcessor, BackgroundFilterVideoFrameProcessor file. In the CustomBackgroundReplacementVideoFrameProcessor file, replace BackgroundFilterVideoFrameProcessor with CustomBackgroundFilterVideoFrameProcessor. In the CustomBackgroundFilterVideoFrameProcessor file, add VideoRotation.Rotation180 to the VideoFrame. And it worked

[PalankiBharat]

I tried creating a CustomBackgroundReplacementVideoFrameProcessor, CustomBackgroundFilterVideoFrameProcessor is the same as BackgroundReplacementVideoFrameProcessor, BackgroundFilterVideoFrameProcessor file. In the CustomBackgroundReplacementVideoFrameProcessor file, replace BackgroundFilterVideoFrameProcessor with CustomBackgroundFilterVideoFrameProcessor. In the CustomBackgroundFilterVideoFrameProcessor file, add VideoRotation.Rotation180 to the VideoFrame. And it worked

I am getting an error while creating CustomBackgroundFilter
VideoFrameProcessor there i am geting error for some functions and variables of Segment processor class how did you manage that ?

[Sotatek-HungHa2]

I tried creating a CustomBackgroundReplacementVideoFrameProcessor, CustomBackgroundFilterVideoFrameProcessor is the same as BackgroundReplacementVideoFrameProcessor, BackgroundFilterVideoFrameProcessor file. In the CustomBackgroundReplacementVideoFrameProcessor file, replace BackgroundFilterVideoFrameProcessor with CustomBackgroundFilterVideoFrameProcessor. In the CustomBackgroundFilterVideoFrameProcessor file, add VideoRotation.Rotation180 to the VideoFrame. And it worked

I am getting an error while creating CustomBackgroundFilter VideoFrameProcessor there i am geting error for some functions and variables of Segment processor class how did you manage that ?

Segment processor class is managed by Chime Sdk. This is the version i used

[PalankiBharat]

Segment processor class is managed by Chime Sdk. This is the version i used

I have used the same can you share with me your CustomBackgroundReplacementVideoFrameProcessor and CustomBackgroundFilterVideoFrameProcessor if that is not a problem ?

[Sotatek-HungHa2]

CustomBackgroundReplacementVideoFrameProcessor
Archive.zip