Performance improvement: fetch merkle paths from masks instead of disk#14570

Merged

deepthiskumar merged 48 commits intofeature/batch-account-lookupsfrom feature/improved-merkle-masks-for-staged-ledger

Dec 5, 2023

+608-253

Commits on Nov 28, 2023

Return the merkle path from the current mask instead of from the ledger

mrmr1993
authored and
georgeee
committed
Always attempt to get the merkle path from the ledger mask

mrmr1993
authored and
georgeee
committed
Update doc for copy method of masking ledger

mrmr1993
authored and
georgeee
committed
Fixup for self_merkle_path
georgeee
committed
Add helper to preload accounts and merkle paths in masks

mrmr1993
authored and
georgeee
committed
Fixup set_merkle_path_unsafe

mrmr1993
authored and
georgeee
committed
Preload accounts for transactions

mrmr1993
authored and
georgeee
committed
Fixup: propagate unsafe_preload_accounts_from_parent
georgeee
committed
Add comment for unsafe_preload_accounts_from_parent
georgeee
committed
Add get_hash_batch_exn to ledgers

mrmr1993
authored and
georgeee
committed
Preload all hases for the merkle path and the self hashes in masks

mrmr1993
authored and
georgeee
committed
Allow fetching empty merkle paths from masks

mrmr1993
authored and
georgeee
committed
Handle known-empty accounts in merkle masks without hitting the db

mrmr1993
authored and
georgeee
committed
Handle known-empty accounts in get_batch for merkle masks

mrmr1993
authored and
georgeee
committed
Remove invalid test: mask parents should not be changed

mrmr1993
authored and
georgeee
committed
Remove a TODO in location_of_account_batch
georgeee
committed
Avoid ledger copy and mutation in Sparse_ledger.of_ledger_subset_exn

mrmr1993
authored and
georgeee
committed

Commits on Nov 29, 2023

refactor the code a little bit
Tang Jiawei
committed
further clean up the code
Tang Jiawei
committed
Small refactoring in of_ledger_subset_exn
georgeee
committed

Commits on Dec 1, 2023

fix the order in the location list

deepthiskumar
authored and
georgeee
committed
Add Sparse_ledger.add_wide_path

mrmr1993
authored and
georgeee
committed
Add add_wide_path_batch to Ledger_intf

mrmr1993
authored and
georgeee
committed
Use wide ledger paths for Sparse_ledger.of_ledger_subset_exn

mrmr1993
authored and
georgeee
committed
Refactor wide merkle path functions
georgeee
committed
Small rewrite of path_batch_impl
georgeee
committed
Nit: rename variables
georgeee
committed
Refactor wide_merkle_path_batch

Tang Jiawei
authored and
georgeee
committed
fix the order of the locations

Tang Jiawei
authored and
georgeee
committed
fixup! Use wide ledger paths for Sparse_ledger.of_ledger_subset_exn
georgeee
committed
Refactor add_wide_path_unsafe
georgeee
committed
Generalize add_path in sparse ledger
georgeee
committed
Simplify add_path_impl's recursion
georgeee
committed
Replace tables with maps in merkle masks

nholland94
authored and
georgeee
committed
Fix merkle ledger tests

nholland94
authored and
georgeee
committed
Use map refs instead of mutable map fields

nholland94
authored and
georgeee
committed
Fixup after rebase
georgeee
committed

Commits on Dec 5, 2023