Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Concurrency Issues #217

Open
anonymous-sushi opened this issue Sep 26, 2024 · 2 comments
Open

Concurrency Issues #217

anonymous-sushi opened this issue Sep 26, 2024 · 2 comments

Comments

@anonymous-sushi
Copy link

Trying to async.gather user_tweets_and_replies gets bottlenecked when doing 10+ accounts at once, is there any way to properly scale this (with many accounts) with less delay in between calls?

@vladkens
Copy link
Owner

vladkens commented Oct 6, 2024

@anonymous-sushi Hi. What exactly are you calling a bottleneck? I've run it with hundreds of accounts and don't remember having any problems with it.

@anonymous-sushi
Copy link
Author

@anonymous-sushi Hi. What exactly are you calling a bottleneck? I've run it with hundreds of accounts and don't remember having any problems with it.

if you try running 100 accounts calling user_tweets concurrently, it will bottleneck and take 3-5 seconds to async gather them all versus a normal 0.01 second call, ideally with enough accounts we should be able to fetch these all simutaneously in roughly the same amout of time 0.01~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants