Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add CrowS-Pairs to Full Benchmark #37

Open
epavlick opened this issue Aug 10, 2021 · 5 comments · May be fixed by #70
Open

Add CrowS-Pairs to Full Benchmark #37

epavlick opened this issue Aug 10, 2021 · 5 comments · May be fixed by #70
Assignees
@aneveol @oskarvanderwal
Labels
In-Progress social_impact Benchmark Tasks for Bias and Social Impact

Comments

@epavlick
Copy link
Contributor

No description provided.

@epavlick epavlick added the social_impact Benchmark Tasks for Bias and Social Impact label Aug 10, 2021
@trishalaneeraj
Copy link
Collaborator

I can do this one.

@oskarvanderwal
Copy link

@trishalaneeraj, do you need any help?

@aneveol
Copy link

aneveol commented Sep 1, 2021

@trishalaneeraj We are discussing how to contribute to this issue in the bias, fairness and social impact evaluation subgroup. It would be great to coordinate on this. We have an upcoming meeting Monday September 6 at 10 pm CET (details are in slack channel)

@oskarvanderwal oskarvanderwal linked a pull request Nov 10, 2021 that will close this issue
Open
@oskarvanderwal
Copy link

@aneveol and I will work on making CrowS-Pairs ready for the prompt evaluation:

@jzf2101
Copy link
Collaborator

jzf2101 commented Apr 27, 2022

See also PR bigscience-workshop/promptsource#742

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@aneveol aneveol

@oskarvanderwal oskarvanderwal

Labels
In-Progress social_impact Benchmark Tasks for Bias and Social Impact
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add CrowS-Pairs task oskarvanderwal/evaluation
5 participants
@epavlick @jzf2101 @trishalaneeraj @aneveol @oskarvanderwal