You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Error when execute alpaca_eval --model_outputs 'results/Meta-Llama-3.1-8B-Instruct/model_outputs.json'
File "/home/anaconda3/envs/factory/lib/python3.12/site-packages/alpaca_eval/metrics/glm_winrate.py", line 105, in get_length_controlled_winrate
model = fit_LogisticRegressionCV(
File "/home/anaconda3/envs/factory/lib/python3.12/site-packages/alpaca_eval/metrics/glm_winrate.py", line 354, in fit_LogisticRegressionCV
model.fit(
File "/home/anaconda3/envs/factory/lib/python3.12/site-packages/sklearn/base.py", line 1151, in wrapper
return fit_method(estimator, *args, **kwargs)
TypeError: LogisticRegressionCV.fit() got an unexpected keyword argument 'groups'
Error when execute alpaca_eval --model_outputs 'results/Meta-Llama-3.1-8B-Instruct/model_outputs.json'
File "/home/anaconda3/envs/factory/lib/python3.12/site-packages/alpaca_eval/metrics/glm_winrate.py", line 105, in get_length_controlled_winrate
model = fit_LogisticRegressionCV(
File "/home/anaconda3/envs/factory/lib/python3.12/site-packages/alpaca_eval/metrics/glm_winrate.py", line 354, in fit_LogisticRegressionCV
model.fit(
File "/home/anaconda3/envs/factory/lib/python3.12/site-packages/sklearn/base.py", line 1151, in wrapper
return fit_method(estimator, *args, **kwargs)
TypeError: LogisticRegressionCV.fit() got an unexpected keyword argument 'groups'
https://github.com/tatsu-lab/alpaca_eval/blob/0b4af7601853e718b72a8da6a35460bda3015754/src/alpaca_eval/metrics/glm_winrate.py#L348C13-L348C24
‘groups’ seems to be incompatible with LogisticRegressionCV? How to use it correctly?
The text was updated successfully, but these errors were encountered: