Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support the text agent #20

Closed
lynchee-owo opened this issue Feb 14, 2024 · 1 comment
Closed

Support the text agent #20

lynchee-owo opened this issue Feb 14, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@lynchee-owo
Copy link
Contributor

Describe the bug
If the user selects models that do not support vision, like gpt-3.5, then the agent cannot find the element on the website and stuck due to "Unable to find element with selector: "

To Reproduce
Steps to reproduce the behavior:

  1. start web wand service and open chrome extension.
  2. start any task.

Expected behavior
Correct selector should be extracted from action, and getObjectIdBySelector should return true by finding that element.

Screenshots
If applicable, add screenshots to help explain your problem.
Screenshot 2024-02-14 at 2 48 08 PM

Desktop (please complete the following information):

  • Browser: chrome

Additional context
This is due to that the old Taxy agent is not fully supported (the current agent is built to support gpt4-vision). We need to support the old Taxy agent by retrieving correct id from simplified dom, updating available action prompt and system prompt, updating the label attribute constant, etc.

@lynchee-owo lynchee-owo added the bug Something isn't working label Feb 14, 2024
@lynchee-owo lynchee-owo self-assigned this Feb 14, 2024
Copy link

Thank you for your contribution. We will check and reply to you as soon as possible.

@lynchee-owo lynchee-owo changed the title Support the old Taxy actions Support the text agent Feb 14, 2024
@lynchee-owo lynchee-owo closed this as not planned Won't fix, can't repro, duplicate, stale Feb 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant