New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat: Add asyncio support to python SDK #963

Open

RutamBhagat wants to merge 1 commit into mendableai:main from RutamBhagat:support-asyncio

Contributor

RutamBhagat commented Dec 11, 2024

This PR adds asyncio support to the python SDK.
Fixes: #916

Implemented async versions of scrape_url, batch_scrape_urls and crawl_url.
Added aiohttp and asyncio as dependencies.

nickscamara requested review from rafaelsideguide and tomkosm

December 11, 2024 23:09

Member

nickscamara commented Dec 11, 2024

Thank you @RutamBhagat! An upgrade we needed indeed. ccing @tomkosm and @rafaelsideguide for a review

nickscamara added the in review label

RutamBhagat force-pushed the support-asyncio branch from 8a69b4e to a62aa3e Compare

December 17, 2024 14:25

RutamBhagat changed the title ~~Feat: Fixes #916 Add asyncio support to python SDK~~ Feat: Add asyncio support to python SDK


          feat(python-sdk): add async scraping and crawling methods using aioht…

49f7fec

…tp and asyncio

RutamBhagat force-pushed the support-asyncio branch from a62aa3e to 49f7fec Compare

December 21, 2024 12:20

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels