Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gaze and pose #15

Open
royrs opened this issue Feb 4, 2025 · 4 comments
Open

Gaze and pose #15

royrs opened this issue Feb 4, 2025 · 4 comments

Comments

@royrs
Copy link

royrs commented Feb 4, 2025

Thank for your work.

In the paper you talk about the capability to control gaze and pose.
Is this feature enabled in the repo? If so can you share how it can be done?

@digital-avatar
Copy link
Collaborator

The default configuration favors natural poses and annotated gazes. If you want explicit control, try changing the parameters of this line (which controls the amplitude of the pose) and this line (which specifies the offset of the pose at certain frames).

@royrs
Copy link
Author

royrs commented Feb 12, 2025

Thank you for your response.

I saw here that you plan to add descriptions for the parameters. Do you plan to release it soon?

While the head looks great, I encountered an issue that the teeth are not consistent through the video (which becomes more noticeable when increasing the exp amplitude), especially after closing the mouth they may change appearance \ lighting etc.
Did you encountered such issues? If so, do you have any recommendations for the input \ parameters to minimize it?

@digital-avatar
Copy link
Collaborator

@royrs
Can you show examples of bad cases?

@royrs
Copy link
Author

royrs commented Feb 23, 2025

It is nothing "extreme", but if one looks at the mouth it relatively easy to note the inconsistencies.

For example using your example audio with the following frame:

Image

You get sometimes clear teeth

Image

And sometimes one blob for the teeth, no separation

Image

Another example for this frame:

Image

Which gives:

glas2.mp4

You can see some general temporal inconsistencies in the teeth (as long you don't look at small screen).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants