Bug 1922986 - Create script that exports BMO data as JSON suitable for import into a BigQuery instance in GCP#2370

Merged

dklawren merged 13 commits intomozilla-bteam:masterfrom dklawren:1922986

Jan 29, 2025

+1,391-2

Commits on Dec 10, 2024

Bug 1922986 - Create script that exports BMO data as JSON suitable for import into a BigQuery instance in GCP
dklawren
committed

Commits on Dec 12, 2024

Delete lock before dying
dklawren
committed
Added #! line for export script so webservices-infra can call it using ./extensions/BMO/bin/export_bmo_etl.pl
dklawren
committed
Merge remote-tracking branch 'upstream/master' into 1922986
dklawren
committed

Commits on Dec 16, 2024

Extra cleanup and more verbose output
dklawren
committed

Commits on Dec 18, 2024

Remove extra bigquery service from docker-compose.yml
dklawren
committed

Commits on Jan 17, 2025

Added some missing functionality and reorganized the code to use functions as suggested.
dklawren
committed

Commits on Jan 18, 2025

Fixed failing sanity test
dklawren
committed

Commits on Jan 22, 2025

- Updated test script to use todays date instead of hardcoded date
dklawren
committed

Commits on Jan 24, 2025

* Use LIMIT/OFFSET for all tables instead of just slurping the whole table into memory
dklawren
committed

Commits on Jan 25, 2025

Change bug_see_also to see_also to match proper BigQuery table name
dklawren
committed

Commits on Jan 28, 2025

- Convert last_seen_date from date to a timestamp for BigQuery
dklawren
committed

Commits on Jan 29, 2025

Small changes based on review
dklawren
committed