Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NEUROPOWER: Incorrect output when requesting statistical power for a certain sample size #87

Open
karitaojala opened this issue Aug 5, 2022 · 0 comments

Comments

@karitaojala
Copy link

Dear Neuropowertools developers,

In the "Power calculation" tab of Neuropower, there seems to be an error where requesting the level of statistical power for a specific sample size (and multiple comparisons correction method) gives a clearly completely incorrect text output.

This same error can also be seen even in the Neuropower tutorial image:

image

Here, the software interface states that with N = 35 subjects, using Random Field Theory correction, the power is 96%. In contrast, the graph in the same figure shows that power should be close to 10%. At first sight, it seems that the software interface computes the power graphs correctly but is deriving the desired power from the wrong curve (Benjamini-Hochberg instead of RFT). However, testing different examples with our own data revealed that it might also be that the power value stated in text is consistent with the graphs when adding to the number of subjects in the enquiry (N = 35), the x-offset of the graph (in this case, around 25 subjects), i.e. the power value would be correct for N = 35 + 25 subjects.

It is of course also possible that the plotted curves themselves are wrong, which would be a more serious issue - although it seems more likely that simply the text output is incorrect.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant