You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, i can't explain so good, but is it possible to speed up the crawl?
We wait hours to finish big Sites. We need browsershoot to run, because we want to crawl .js files.
Can't we set something which is running concurrently instead of one by one.
Good tool but in the End really slow, with our Usecase.
Problem is we need browsershoot as JS is often loaded a little bit later.
BTW: you can set any number you want with setConcurrency
if will only start the browser once. I wont start several Instance. We also see no corresponding code for that.
This discussion was converted from issue #399 on May 05, 2022 20:45.
Heading
Bold
Italic
Quote
Code
Link
Numbered list
Unordered list
Task list
Attach files
Mention
Reference
Menu
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi, i can't explain so good, but is it possible to speed up the crawl?
We wait hours to finish big Sites. We need browsershoot to run, because we want to crawl .js files.
Can't we set something which is running concurrently instead of one by one.
Good tool but in the End really slow, with our Usecase.
Problem is we need browsershoot as JS is often loaded a little bit later.
BTW: you can set any number you want with setConcurrency
if will only start the browser once. I wont start several Instance. We also see no corresponding code for that.
Beta Was this translation helpful? Give feedback.
All reactions