Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate tasks to Faktory #2

Open
2 of 7 tasks
fennifith opened this issue Jan 25, 2025 · 0 comments
Open
2 of 7 tasks

Migrate tasks to Faktory #2

fennifith opened this issue Jan 25, 2025 · 0 comments
Assignees

Comments

@fennifith
Copy link
Member

fennifith commented Jan 25, 2025

Currently, tasks are passed through a TaskRequest/Result table in postgres. (partially completed by #4, in faktory-migration)

We'd like to migrate to faktory instead. This involves:

  • Create a docker container for local dev to run a faktory server
  • Configure NodeJS worker/ to connect to Faktory using its NodeJS library
  • Edit the Kotlin server (TaskService) to push jobs to Faktory instead of Postgres
  • Write to separate tables for each job type (e.g. CREATE TABLE UrlMetadata) to write results into
  • Remove the now-unused "Task*" postgres tables/code
  • Create a Fly.io service configuration for Faktory
  • Set up Faktory's web UI to be accessible from Fly.io?
@fennifith fennifith moved this to Todo in BE Dev Work Jan 25, 2025
@taylor-shift taylor-shift moved this from Todo to In Progress in BE Dev Work Jan 31, 2025
@taylor-shift taylor-shift self-assigned this Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In Progress
Development

No branches or pull requests

2 participants