You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
If the user selects models that do not support vision, like gpt-3.5, then the agent cannot find the element on the website and stuck due to "Unable to find element with selector: "
To Reproduce
Steps to reproduce the behavior:
start web wand service and open chrome extension.
start any task.
Expected behavior
Correct selector should be extracted from action, and getObjectIdBySelector should return true by finding that element.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
Browser: chrome
Additional context
This is due to that the old Taxy agent is not fully supported (the current agent is built to support gpt4-vision). We need to support the old Taxy agent by retrieving correct id from simplified dom, updating available action prompt and system prompt, updating the label attribute constant, etc.
The text was updated successfully, but these errors were encountered:
Describe the bug
If the user selects models that do not support vision, like gpt-3.5, then the agent cannot find the element on the website and stuck due to "Unable to find element with selector: "
To Reproduce
Steps to reproduce the behavior:
Expected behavior
Correct selector should be extracted from action, and getObjectIdBySelector should return true by finding that element.
Screenshots

If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
Additional context
This is due to that the old Taxy agent is not fully supported (the current agent is built to support gpt4-vision). We need to support the old Taxy agent by retrieving correct id from simplified dom, updating available action prompt and system prompt, updating the label attribute constant, etc.
The text was updated successfully, but these errors were encountered: