Code

Logging overhaul#137

Code

Merged

jonaraphael merged 47 commits intomainSkyTruth/cerulean-cloud:mainfrom feat/logging-overhaulSkyTruth/cerulean-cloud:feat/logging-overhaulCopy head branch name to clipboardJan 28, 2025

+1,244-84

Commits

Commits on Jan 2, 2025

• added structured_log util and updated github actions file

  sstill88

  committed
  027da3f

  Copy full SHA for 027da3f

• updated structured logs in orchestrator handler

  sstill88

  committed
  dae4832

  Copy full SHA for dae4832

• Merge branch 'main' into feat/logging-overhaul

  sstill88

  committed
  f445f5e

  Copy full SHA for f445f5e

• towards adding logs to clients.py

  sstill88

  committed
  840d4c2

  Copy full SHA for 840d4c2

Commits on Jan 8, 2025

• add scene_id to model initiation for logging

  sstill88

  committed
  833f002

  Copy full SHA for 833f002

• Merge branch 'main' into feat/logging-overhaul

  sstill88

  committed
  a486d20

  Copy full SHA for a486d20

• more logs

  sstill88

  committed
  7d16538

  Copy full SHA for 7d16538

• few more logs

  sstill88

  committed
  850d769

  Copy full SHA for 850d769

• typo

  sstill88

  committed
  271151a

  Copy full SHA for 271151a

• maxscale=1

  sstill88

  committed
  f845076

  Copy full SHA for f845076

• added notebook and utils to filter logs

  sstill88

  committed
  656b459

  Copy full SHA for 656b459

• maxScale back to 45

  sstill88

  committed
  a39c2e6

  Copy full SHA for a39c2e6

Commits on Jan 9, 2025

• testing

  sstill88

  committed
  41c14f5

  Copy full SHA for 41c14f5

• attempt to fix database schema...

  sstill88

  committed
  ffe0c4a

  Copy full SHA for ffe0c4a

• attempt to fix database schema take 2...

  sstill88

  committed
  606d6c9

  Copy full SHA for 606d6c9

• add sigterm handler with logs

  sstill88

  committed
  99fe3df

  Copy full SHA for 99fe3df

• flush logs

  sstill88

  committed
  d442060

  Copy full SHA for d442060

• merge/conflict resolution

  sstill88

  committed
  3c94513

  Copy full SHA for 3c94513

• make scene_id global

  sstill88

  committed
  021bd85

  Copy full SHA for 021bd85

• debugging...

  sstill88

  committed
  fd329ee

  Copy full SHA for fd329ee

• removed life cycle event logs

  sstill88

  committed
  3a52dd0

  Copy full SHA for 3a52dd0

• cleaned up logging in send_inference_request_and_handle_response retries

  sstill88

  committed
  7d274cf

  Copy full SHA for 7d274cf

• clean up notebook and add SIGTERM examples

  sstill88

  committed
  99fb200

  Copy full SHA for 99fb200

Commits on Jan 10, 2025

• review comments

  sstill88

  committed
  eb25f7a

  Copy full SHA for eb25f7a

Commits on Jan 23, 2025

• Merge branch 'main' into feat/logging-overhaul

  sstill88

  committed
  d5c7911

  Copy full SHA for d5c7911

Commits on Jan 24, 2025

• update logger notebook/utils to give state when no logs exist instead of erroring

  sstill88

  committed
  c48af62

  Copy full SHA for c48af62

• update logging message for when there are no oceanic tiles

  sstill88

  committed
  511b326

  Copy full SHA for 511b326

• warning-->info

  sstill88

  committed
  9e69ceb

  Copy full SHA for 9e69ceb

• moved utils up one directory and adjusted code and action yaml accordingly

  sstill88

  committed
  5c19ff6

  Copy full SHA for 5c19ff6

Commits on Jan 25, 2025

• make model scene agnostic

  sstill88

  committed
  0522a0b

  Copy full SHA for 0522a0b

• Does this contextVar and loggingFilters work instead of injecting the scene_id deep into every single function?

  jonaraphael

  committed
  ed1c774

  Copy full SHA for ed1c774

Commits on Jan 26, 2025

• oops!

  jonaraphael

  committed
  83054bb

  Copy full SHA for 83054bb

• Ugh. sceneid vs scene_id mixup. I've started a new branch to get rid of all sceneid

  jonaraphael

  committed
  827e391

  Copy full SHA for 827e391

• Oh no. forgot to edit the function definition

  jonaraphael

  committed
  38f8333

  Copy full SHA for 38f8333

• Shoot. Missed two more.

  jonaraphael

  committed
  3ba7fa9

  Copy full SHA for 3ba7fa9

• try consistent naming

  jonaraphael

  committed
  c14a5a6

  Copy full SHA for c14a5a6

Commits on Jan 28, 2025

• Linting

  jonaraphael

  committed
  ee1e0fc

  Copy full SHA for ee1e0fc

• Automatically choose last revision if none provided.

  jonaraphael

  committed
  65e433d

  Copy full SHA for 65e433d

• Rename start_time

  jonaraphael

  committed
  12f28b0

  Copy full SHA for 12f28b0

• Combine logging utils into one file

  jonaraphael

  committed
  3028925

  Copy full SHA for 3028925

• Rename utils.py to structured_logger.py

  jonaraphael

  committed
  05507ba

  Copy full SHA for 05507ba

• Try fixing the google-cloud-logging import issue in the tests

  jonaraphael

  committed
  2e5fa4f

  Copy full SHA for 2e5fa4f

• Oops. The auto-renaming tool missed this one.

  jonaraphael

  committed
  6a703a0

  Copy full SHA for 6a703a0

• test removing logger import

  sstill88

  committed
  ece53aa

  Copy full SHA for ece53aa

• add google-cloud-logging cloud_run_offset_tiles requirements and undo commenting from last commit

  sstill88

  committed
  bc7c24f

  Copy full SHA for bc7c24f

• also add logging to the cloud_run_orchestrator requirements (eye roll)

  sstill88

  committed
  8d9538b

  Copy full SHA for 8d9538b

• updated utils --> structured_logger in CLoudRunLogs.ipynb

  sstill88

  committed
  48d76ca

  Copy full SHA for 48d76ca