You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Description:
I have observed a not so significant performance difference between BanditPAM and sklearn for the mnist dataset n <= 20000. BanditPAM is marginally slower compared to sklearn.
Reproducibility:
You can reproduce the results by running the code available in the branch "sklearn_comparison" of the BanditPAM repository. To run the experiment, execute the following command: python experiments/run_scaling_experiment.py. I've installed banditpam with pip install banditpam
You will then observe the results similar to the following:
Num data: 1000
<Running SKLEARN >
0.19861984252929688
<Running BanditPAM VA with caching >
0.8404459953308105
Num data: 10000
<Running SKLEARN >
15.577669143676758
<Running BanditPAM VA with caching >
20.48973298072815
But fortunately for larger N, banditpam significantly outperforms sklearn:
Num data: 20000
<Running SKLEARN >
42.05375599861145
<Running BanditPAM VA with caching >
29.887195110321045
The text was updated successfully, but these errors were encountered:
lukeleeai
changed the title
Significant performance difference between BanditPAM and sklearn for mnist n10000 k5
Significant performance difference between BanditPAM and sklearn
Jun 16, 2023
lukeleeai
changed the title
Significant performance difference between BanditPAM and sklearn
Minor performance difference between BanditPAM and sklearn for a small number of data points
Jun 18, 2023
Description:
I have observed a not so significant performance difference between BanditPAM and sklearn for the mnist dataset n <= 20000. BanditPAM is marginally slower compared to sklearn.
Reproducibility:
You can reproduce the results by running the code available in the branch "sklearn_comparison" of the BanditPAM repository. To run the experiment, execute the following command:
python experiments/run_scaling_experiment.py
. I've installed banditpam withpip install banditpam
You will then observe the results similar to the following:
But fortunately for larger N, banditpam significantly outperforms sklearn:
The text was updated successfully, but these errors were encountered: