Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gradio运行版本只能对于当前帧进行分析 #4

Open
zhuyr97 opened this issue Jan 18, 2025 · 3 comments
Open

Gradio运行版本只能对于当前帧进行分析 #4

zhuyr97 opened this issue Jan 18, 2025 · 3 comments

Comments

@zhuyr97
Copy link

zhuyr97 commented Jan 18, 2025

  1. 怎么支持对于整个视频分析呢?
  2. 怎么对于历史视频进行分析呢?
  3. 怎么支持视频检索呢?
@Jazzcharles
Copy link

你好,

  1. 对于整个视频分析的要求是指?应该在播放到最后可以支持对整段视频进行询问
  2. 历史已经整合在当前功能之中了
  3. 当前版本暂未支持retrieval功能

@zhuyr97
Copy link
Author

zhuyr97 commented Jan 21, 2025

感谢回复~

  1. 指的就是我希望输入类似指令:帮我总结这个视频内容;帮我描述这个视频发生了什么; (属于对于整个视频内容的回答,但是我在使用gradio demo时发现其实每次询问就是对于当前帧进行分析)

  2. 历史视频确实已支撑,不过我遇到记忆紊乱,就是会把上一个输入视频的内容当作当前视频内容;

  3. 期待未来更多功能~

@hyf015
Copy link
Collaborator

hyf015 commented Jan 24, 2025

你好,

记忆紊乱应该是由于记忆队列没有清空,可以点一下对话框右侧的按钮清空,或者重启一下程序。

基于这一版本,总结的时候可以先自己加一下prompt,比如问的时候说根据历史信息总结。比如我用这一条效果就还不错:Summarize and list all actions I have done in the past based on the history.

后续更新版我们会增强这方面能力,希望继续关注~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants