Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Internet search support for full model like DeepSeek R1 | 联网搜索支持到全模型如 DeepSeek R1 #6843

Open
arvinxx opened this issue Mar 9, 2025 · 24 comments
Labels
🌠 Feature Request New feature or request | 特性与建议

Comments

@arvinxx
Copy link
Contributor

arvinxx commented Mar 9, 2025

Version 1.70.0 has supported online search for the full model. We welcome everyone to provide feedback on usage~


v.1.70.0 已支持到全模型的联网搜索,欢迎大家提出使用反馈~

@arvinxx arvinxx pinned this issue Mar 9, 2025
@lobehub lobehub deleted a comment from lobehubbot Mar 9, 2025
@dosubot dosubot bot added the 🌠 Feature Request New feature or request | 特性与建议 label Mar 9, 2025
@agluo
Copy link

agluo commented Mar 9, 2025

用deepseek 官方api ,r1无法触发联网emmm

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Using deepseek official API, r1 cannot trigger networking emmm

@agluo
Copy link

agluo commented Mar 9, 2025

Image是我问的方式不对吗?

@mondepari
Copy link

@arvinxx yesterday I tried to make edits to make the search work. The thing is that when building a Docker image, various errors pop up: either with node_modules from packages/web-crawler (error of undefined rights) errors in the code eslint complains about spelling). I'll check now, maybe I'm doing something wrong? Do I need to run pnpm install commands after making edits to the code? When running pnpm dev locally, everything works, but it doesn't compile the Docker file

@ChenLuoi
Copy link

前置判断模型,我使用了我手上大部分支持fc的模型
以下是测试结果

  1. qwen系列,包括qwen-plus和qwen-max: 出现400错误
    <400> InternalError.Algo.InvalidParameter: Input should be a valid dictionary or instance of PluginParameters: parameters.plugins

  2. grok-2-1212: 输出以下内容后直接中断

id: 9a59e274-9955-4698-a5cf-bbd071294752
event: text
data: "I"
  1. gemini-2.0-flash: 正常
  2. doubao-1.5-pro-32k: 正常
  3. qwen-2.0-14B: 大概率正常,偶尔会匹配到crawlSinglePage的tool

几个建议

  1. 这个前置小模型智能水平一般不会太高,大部分都不可能链式启动多个tool,这里只是为了搜索,可以去掉crawlSinglePage和crawlMultiPage,只保留search的tool;
  2. 建议在消息中将搜索结果和用户输入整合,并添加时间等必要信息,比如deepseek给出的prompt
  3. 前置判断模型的提示词也建议加上时间

@SAnBlog

This comment has been minimized.

@lobehubbot

This comment has been minimized.

@arvinxx

This comment has been minimized.

@lobehubbot

This comment has been minimized.

@arvinxx
Copy link
Contributor Author

arvinxx commented Mar 10, 2025

@ChenLuoi

qwen系列,包括qwen-plus和qwen-max: 出现400错误
<400> InternalError.Algo.InvalidParameter: Input should be a valid dictionary or instance of PluginParameters: parameters.plugins

这个我怀疑是入参没裁剪导致的,可能是系统bug,晚点我看看

grok-2-1212: 输出以下内容后直接中断

中断是正常的,我的实现中做的逻辑是,如果输出的 chunk 类型不是 fc,就停止搜索模型的输出,并开始生成。

这个前置小模型智能水平一般不会太高,大部分都不可能链式启动多个tool,这里只是为了搜索,可以去掉crawlSinglePage和crawlMultiPage,只保留search的tool;

这个我觉得不太好,我昨天测了下其实像 4omini 都能做到简单的链式调用多个 tool。所以还是保留比较合适。

建议在消息中将搜索结果和用户输入整合,并添加时间等必要信息,比如deepseek给出的prompt

目前搜索结果的返回里的确没加上时间,我补一下吧

前置判断模型的提示词也建议加上时间

这个现在没加吗?我记得应该有才对

@huangkairan
Copy link

huangkairan commented Mar 10, 2025

  1. 模型无法确定问题是否需要联网(如图)
  2. 模型联网搜索获取到的信息有误(看起来像是没有给时间相关的prompt)

Image

问天气,2次查的信息有些出入

Image

Image

@ChenLuoi
Copy link

@arvinxx

grok-2-1212: 输出以下内容后直接中断

中断是正常的,我的实现中做的逻辑是,如果输出的 chunk 类型不是 fc,就停止搜索模型的输出,并开始生成。

大部分fc的模型都是只返回fc的结果,但是部分模型,比如grok会在返回fc结果之前增加一段文本 I am searching for recent hot topics related to Boardmix using multiple search engines. 这种case会导致部分模型没法作为搜索辅助

前置判断模型的提示词也建议加上时间

这个现在没加吗?我记得应该有才对

从networks里面看好像是没有,没看代码,不知道在server有没有附加上去

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


@arvinxx

grok-2-1212: Export the following content and directly interrupt it

Interrupts are normal, the logic I did in my implementation is that if the output chunk type is not fc, stop searching for the output of the model and start generating.

Most of the FC models only return the results of FC, but some models, such as grok, will add a piece of text before returning the results of FC. I am searching for recent hot topics related to Boardmix using multiple search engines. This case will cause some models to be unable to be used as search assistance.

The prompt words for the pre-judgment model are also recommended to add time

Haven't this been added now? I remember there should be talent

It seems that there is no code from the networks. I don't know if it is attached to the server.

@samurai00
Copy link

在一次会话中,第二次的搜索结果展示好像还是第一次的结果,但根据第二次的回答内容,看起来,实际搜索结果应该是对的。

Image
Image
Image
Image
Image

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


In a session, the second search result appears to be the first result, but according to the second answer, it seems that the actual search result should be correct.

Image
Image
Image
Image
Image

@arvinxx
Copy link
Contributor Author

arvinxx commented Mar 10, 2025

大部分fc的模型都是只返回fc的结果,但是部分模型,比如grok会在返回fc结果之前增加一段文本 I am searching for recent hot topics related to Boardmix using multiple search engines. 这种case会导致部分模型没法作为搜索辅助

的确… 我昨天测 Claude 3.7 的时候也发现有这个问题。我感觉通过 prompt 约束可以解决,但昨天太晚了没测。后面有空再试试看。

从networks里面看好像是没有,没看代码,不知道在server有没有附加上去

你看下 第一句消息,放在 system role 里的

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Most of the FC models only return the results of FC, but some models, such as grok, will add a piece of text before returning the results of FC. I am searching for recent hot topics related to Boardmix using multiple search engines. This case will cause some models to be unable to serve as search assistance.

Indeed... I also found this problem when I tested Claude 3.7 yesterday. I feel that it can be solved through prompt constraints, but it was too late yesterday and it was not tested. Try it later if you have time.

It seems that there is no code from the networks, I don't know if it is attached to the server

Look at the first message, put in the system role

@xt1990xt1990
Copy link

Image

Image
官方api和siliconflow pro的api都报错,只有sophnet这个第三方的api返回搜索结果了,不过看思考过程感觉怪怪的,是我打开方式有问题吗😂

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Image

Image
Both the official API and the Siliconflow Pro API report errors, and only the third-party API of Sophnet returns the search results. However, it feels strange to see the thinking process. Is there any problem with the way I open it?

@arvinxx
Copy link
Contributor Author

arvinxx commented Mar 10, 2025

@xt1990xt1990 你是不是额外配置 reasoner 允许它用 Function Calling 了?

@shog86
Copy link

shog86 commented Mar 10, 2025

没能触发联网

1.70.0

改成Sreach online...之后可以了

image

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Failed to trigger the Internet

1.70.0

image

@xt1990xt1990
Copy link

@xt1990xt1990 你是不是额外配置 reasoner 允许它用 Function Calling 了?

找到问题了,我把r1的function开关都关掉后,全部正常了,感谢大佬

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


@xt1990xt1990 Have you configured the reasoner to allow it to use Function Calling?

I found the problem. After I turned off the function switch of r1, it was all normal. Thank you guys

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🌠 Feature Request New feature or request | 特性与建议
Projects
None yet
Development

No branches or pull requests

10 participants