Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Upgrade to Crawlee v0.5 #355

Merged
merged 7 commits into from
Jan 8, 2025
Merged

feat: Upgrade to Crawlee v0.5 #355

merged 7 commits into from
Jan 8, 2025

Conversation

vdusek
Copy link
Contributor

@vdusek vdusek commented Dec 12, 2024

  • service locator
  • updates in proxy configuration

@vdusek vdusek self-assigned this Dec 12, 2024
@vdusek vdusek force-pushed the adapt-service-locator branch from 7e853dd to fa871b8 Compare December 12, 2024 12:51
@github-actions github-actions bot added this to the 104th sprint - Tooling team milestone Dec 12, 2024
@github-actions github-actions bot added t-tooling Issues with this label are in the ownership of the tooling team. tested Temporary label used only programatically for some analytics. labels Dec 12, 2024
pyproject.toml Outdated Show resolved Hide resolved
src/apify/_actor.py Outdated Show resolved Hide resolved
@vdusek vdusek force-pushed the adapt-service-locator branch from 12256f3 to 89e28b6 Compare December 13, 2024 14:33
@vdusek vdusek changed the title chore: adapt to use service locator from crawlee chore: Integrate service locator from Crawlee Dec 13, 2024
@vdusek vdusek force-pushed the adapt-service-locator branch from 89e28b6 to 18efd5d Compare December 17, 2024 10:14
@vdusek vdusek changed the title chore: Integrate service locator from Crawlee feat: Upgrade to Crawlee v0.5 Dec 17, 2024
@vdusek vdusek added adhoc Ad-hoc unplanned task added during the sprint. enhancement New feature or request. labels Dec 17, 2024
@vdusek vdusek force-pushed the adapt-service-locator branch from 18efd5d to 37a1adf Compare December 17, 2024 10:48
@vdusek vdusek marked this pull request as ready for review December 17, 2024 11:46
@vdusek vdusek requested a review from janbuchar December 17, 2024 11:47
@vdusek vdusek force-pushed the adapt-service-locator branch 2 times, most recently from 51be03d to 581e5d7 Compare January 3, 2025 13:11
from crawlee import service_container

cast(dict, service_container._services).clear()
def prepare_test_env(monkeypatch: pytest.MonkeyPatch, tmp_path: Path) -> Callable[[], None]:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

prepare_test_env is the same as in the Crawlee

def _reset_and_patch_default_instances() -> None:
"""Reset the used singletons and patch the default storage client with a temporary directory.
@pytest.fixture
def prepare_test_env(monkeypatch: pytest.MonkeyPatch, tmp_path: Path) -> Callable[[], None]:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

prepare_test_env is the same as in the Crawlee

@vdusek vdusek force-pushed the adapt-service-locator branch from 581e5d7 to 2c6d513 Compare January 3, 2025 13:34
@janbuchar janbuchar self-requested a review January 6, 2025 15:38
@janbuchar

This comment was marked as resolved.

src/apify/_actor.py Outdated Show resolved Hide resolved
src/apify/_actor.py Outdated Show resolved Hide resolved
src/apify/apify_storage_client/_request_queue_client.py Outdated Show resolved Hide resolved
@vdusek vdusek requested a review from janbuchar January 8, 2025 12:17
Copy link
Contributor

@janbuchar janbuchar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, see the suggestion 🙂

src/apify/_actor.py Outdated Show resolved Hide resolved
@vdusek vdusek merged commit 826f4db into master Jan 8, 2025
27 checks passed
@vdusek vdusek deleted the adapt-service-locator branch January 8, 2025 13:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
adhoc Ad-hoc unplanned task added during the sprint. enhancement New feature or request. t-tooling Issues with this label are in the ownership of the tooling team. tested Temporary label used only programatically for some analytics.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants