Code

Implemented the loss NTK calculation#109

Code

Open

ma-sauter wants to merge 35 commits intomainzincware/ZnNL:mainfrom Marc_Loss_NTK_Calculationzincware/ZnNL:Marc_Loss_NTK_CalculationCopy head branch name to clipboard

+710-67

Commits

Commits on Jan 12, 2024

• starting out

  

  Marc Sauter

  committed
  076d0df

  Copy full SHA for 076d0df

Commits on Jan 18, 2024

• Renaming file

  ma-sauter

  committed
  930cac8

  Copy full SHA for 930cac8

• analysis file should be done

  ma-sauter

  committed
  580194a

  Copy full SHA for 580194a

• quick fix

  ma-sauter

  committed
  768fc13

  Copy full SHA for 768fc13

Commits on Jan 19, 2024

• Included loss ntk, eigval and entropy in jax recorder

  ma-sauter

  committed
  c802010

  Copy full SHA for c802010

• Updated recorder instantiation test

  ma-sauter

  committed
  17fd83a

  Copy full SHA for 17fd83a

• Bugfixing

  ma-sauter

  committed
  e88292f

  Copy full SHA for e88292f

• Stand vor Kino

  

  Marc Sauter

  committed
  4eb8362

  Copy full SHA for 4eb8362

Commits on Jan 22, 2024

• First thing state that might be working

  ma-sauter

  committed
  fb1da2e

  Copy full SHA for fb1da2e

• writing test

  

  Marc Sauter

  committed
  d22bb68

  Copy full SHA for d22bb68

Commits on Jan 30, 2024

• Included vmap_axes

  ma-sauter

  committed
  e141dd8

  Copy full SHA for e141dd8

• Working on calculating loss derivatives to calculate loss ntk comparison

  ma-sauter

  committed
  22cfc90

  Copy full SHA for 22cfc90

Commits on Feb 4, 2024

• Calculation and test should work now

  ma-sauter

  committed
  5f9b6bf

  Copy full SHA for 5f9b6bf

• some linting updates

  ma-sauter

  committed
  131d5cb

  Copy full SHA for 131d5cb

• Fixed tests

  ma-sauter

  committed
  5b244ff

  Copy full SHA for 5b244ff

Commits on Feb 6, 2024

• Some modifications to simplify the loss ntk test code

  ma-sauter

  committed
  3a06e75

  Copy full SHA for 3a06e75

• Class renaming to follow convention

  ma-sauter

  committed
  001e46e

  Copy full SHA for 001e46e

• added reshape and unshape methods in the loss_ntk_calculation

  ma-sauter

  committed
  fd99b77

  Copy full SHA for fd99b77

Commits on Feb 20, 2024

• quicksave

  

  Marc Sauter

  committed
  0ef059f

  Copy full SHA for 0ef059f

• Quick save

  ma-sauter

  committed
  98c6b30

  Copy full SHA for 98c6b30

• Added test for eigenvalues, precision is still only e-4

  ma-sauter

  committed
  cd5644a

  Copy full SHA for cd5644a

• Added some docstrings

  ma-sauter

  committed
  b4fe246

  Copy full SHA for b4fe246

• More docstrings

  ma-sauter

  committed
  bf7a401

  Copy full SHA for bf7a401

• Black formatting

  ma-sauter

  committed
  43cdcb9

  Copy full SHA for 43cdcb9

• More docstrings

  ma-sauter

  committed
  fd8626f

  Copy full SHA for fd8626f

Commits on Feb 21, 2024

• Some PR modifications

  ma-sauter

  committed
  b6ebb8d

  Copy full SHA for b6ebb8d

Commits on Feb 26, 2024

• fixing PR comment

  

  Marc Sauter

  committed
  d17e514

  Copy full SHA for d17e514

• requirements change

  

  Marc Sauter

  committed
  eb49043

  Copy full SHA for eb49043

• Black formatter changes

  

  Marc Sauter

  committed
  53c548d

  Copy full SHA for 53c548d

• changed recorder to use the use_loss_ntk flag

  

  Marc Sauter

  committed
  1dac434

  Copy full SHA for 1dac434

• Change recorder test for new flag

  

  Marc Sauter

  committed
  422eceb

  Copy full SHA for 422eceb

• removed unneccesary CNN model from loss_ntk calculation test

  

  Marc Sauter

  committed
  b5e8170

  Copy full SHA for b5e8170

• Started integration test for loss_ntk_calculation

  

  Marc Sauter

  committed
  594f4cb

  Copy full SHA for 594f4cb

Commits on Feb 27, 2024

• Implemented integration test

  

  Marc Sauter

  committed
  b55fc30

  Copy full SHA for b55fc30

• isort

  

  Marc Sauter

  committed
  080099e

  Copy full SHA for 080099e