Code

Add KDVH migration package#30

Code

Merged

Lun4m merged 36 commits intotrunkmetno/lard:trunkfrom kdvh_importermetno/lard:kdvh_importerCopy head branch name to clipboardNov 20, 2024

+5,469-47

Commits

Commits on Nov 11, 2024

• Add KDVH migration package

  Lun4m

  committed
  621330d

  Copy full SHA for 621330d

• Switch to justfile

  Lun4m

  committed
  3344e4a

  Copy full SHA for 3344e4a

• Rework interfaces and move lard.Timeseries to kdvh.LardTimeseries

  Lun4m

  committed
  574cc0f

  Copy full SHA for 574cc0f

• Remove useless field initialization

  Lun4m

  committed
  00f649d

  Copy full SHA for 00f649d

• Keep elapsed time for progressbar

  Lun4m

  committed
  bf647fe

  Copy full SHA for bf647fe

• Check for overwrite at the element file level

  Lun4m

  committed
  5ccf60d

  Copy full SHA for 5ccf60d

Commits on Nov 13, 2024

• Save available elements and stations in separate files

  Lun4m

  committed
  928c0ba

  Copy full SHA for 928c0ba

• Add comment about T_HOMOGEN_MONTH

  Lun4m

  committed
  a40d91c

  Copy full SHA for a40d91c

• Upgrade logging inside dump functions

  Lun4m

  committed
  603ee09

  Copy full SHA for 603ee09

• Rework some comments based on Ketil's feedback

  Lun4m

  committed
  81fe231

  Copy full SHA for 81fe231

• Update README.md

  Lun4m

  committed
  f4bf567

  Copy full SHA for f4bf567

• Remove redundant comment

  Lun4m

  committed
  c0a6cd1

  Copy full SHA for c0a6cd1

• Exit if separator is not valid

  Lun4m

  committed
  65ea8b6

  Copy full SHA for 65ea8b6

• Move Obs to KdvhObs

  Lun4m

  committed
  255e2f8

  Copy full SHA for 255e2f8

• Update importUntil doc string

  Lun4m

  committed
  c98411f

  Copy full SHA for c98411f

• Use fork that is able to correctly parse comma separated strings into slices

  Lun4m

  committed
  2b5ebf9

  Copy full SHA for 2b5ebf9

Commits on Nov 14, 2024

• Use ELEM table to query unique stations in DATA table

  Lun4m

  committed
  954774b

  Copy full SHA for 954774b

• Add go ci

  Lun4m

  committed
  c231e90

  Copy full SHA for c231e90

• Add some docs about implemented DumpFunctions

  Lun4m

  committed
  f30c704

  Copy full SHA for f30c704

• Change name of ConvertFunction and add some docs

  Lun4m

  committed
  681b9d1

  Copy full SHA for 681b9d1

• Concurrent dump with semaphore for limiting total number of connections

  Lun4m

  committed
  85a65fa

  Copy full SHA for 85a65fa

• Create three separate slices inside parseData that can be fed directly to pgx.CopyFromRows

  Lun4m

  committed
  a4150c0

  Copy full SHA for a4150c0

• Fix README.md

  Lun4m

  committed
  9b87e5e

  Copy full SHA for 9b87e5e

• Use pgx in dump code

  Lun4m

  committed
  8b7be5f

  Copy full SHA for 8b7be5f

Commits on Nov 15, 2024

• Separate dump and import in different packages for better module navigation

  Lun4m

  committed
  8212649

  Copy full SHA for 8212649

• Add permission caching and rework cache package

  Lun4m

  committed
  efed05f

  Copy full SHA for efed05f

Commits on Nov 18, 2024

• Filter out restricted station/elements

  Lun4m

  committed
  6143007

  Copy full SHA for 6143007

• Use struct instead of global map

  Lun4m

  committed
  d5d4399

  Copy full SHA for d5d4399

• Update version of go-flags fork (fix bug if flag is not passed)

  Lun4m

  committed
  6a18c98

  Copy full SHA for 6a18c98

• Add possibility to remove indices before bulk insertion

  Lun4m

  committed
  ea811bf

  Copy full SHA for ea811bf

• Add a couple more log statements

  Lun4m

  committed
  e497c96

  Copy full SHA for e497c96

Commits on Nov 20, 2024

• Remove email code

  Lun4m

  committed
  0d69485

  Copy full SHA for 0d69485

• Simplify ImportTable

  Lun4m

  committed
  b80c811

  Copy full SHA for b80c811

• Update func name to be symmetric with import

  Lun4m

  committed
  3c7456d

  Copy full SHA for 3c7456d

• Defer createIndices

  Lun4m

  committed
  f3216e1

  Copy full SHA for f3216e1

• Change cfailed type

  Lun4m

  committed
  c6365be

  Copy full SHA for c6365be