Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[⭐] 能否发布一个排行榜 #221

Open
2ySong opened this issue Jan 5, 2025 · 1 comment
Open

[⭐] 能否发布一个排行榜 #221

2ySong opened this issue Jan 5, 2025 · 1 comment
Labels
enhancement New feature or request

Comments

@2ySong
Copy link

2ySong commented Jan 5, 2025

Description of the new feature / enhancement | 您所需的新功能或能力

类似于TFB:https://decisionintelligence.github.io/OpenTS/leaderboards/multivariate_time_series/

Scenario when this would be used? | 使用场景

排行榜

Supporting information | 附加信息

No response

@2ySong 2ySong added enhancement New feature or request needs-triaged for issues raised to be triaged labels Jan 5, 2025
@zezhishao
Copy link
Collaborator

模型的性能和实验设置之间紧密相关,通过调整实验设置可以得到完全不同的排名结果,甚至不同的随机种子和模型设置多跑几次排名也会有不小变化。这主要是由于目前的模型性能差异不显著。所以在公认的实验设置、评测数据集出现前,我们也不清楚这个排行榜应该怎么做。为了避免对研究者和领域造成误导,在解决上述问题之前,应该不会有排行榜。

@duyifanict duyifanict changed the title [⭐] <title>能否发布一个排行榜 [⭐] 能否发布一个排行榜 Jan 7, 2025
@duyifanict duyifanict removed the needs-triaged for issues raised to be triaged label Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants