Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

scraping limitations #771

Closed
AcidkoHorkaCokolada opened this issue Jun 3, 2022 · 3 comments
Closed

scraping limitations #771

AcidkoHorkaCokolada opened this issue Jun 3, 2022 · 3 comments

Comments

@AcidkoHorkaCokolada
Copy link

Hi Everyone,

what comments can be scrapped? its seems im able to get only most relevant comments without full threads(replies)

@dihiaselma
Copy link

I have the same problem. I released that I can't scrape all the comments and replies of a page.
I have also another issue: when I specify the cookies.txt file in get_posts, I can gather just the posts (no comments returned).
I used cookies.txt chrome extension to generate the cookies file.
Please anyone to explain us how to generate the right cookies.txt, and how to use it to expand the data to extract ?

@neon-ninja
Copy link
Collaborator

@AcidkoHorkaCokolada The scraper uses m.facebook.com, so it's limited by the functionality available there. As such, only most relevant comments are available. RE: missing replies, this looks like a duplicate of #769, try update lxml with pip install -U lxml.

@dihiaselma duplicate of #764 (comment), I replied in that issue

@AcidkoHorkaCokolada
Copy link
Author

thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants