Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expand distributed indexing, match numpy indexing scheme #938

Draft
wants to merge 150 commits into
base: main
Choose a base branch
from
Draft

Expand distributed indexing, match numpy indexing scheme #938

wants to merge 150 commits into from

Commits on Feb 17, 2022

  1. Broken. __getitem__ refactoring in prep for distributed/non-ordered i… 

    …ndexing
    @ClaudiaComito
    ClaudiaComito committed Feb 17, 2022
    Configuration menu
    Copy the full SHA
    445fc94 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2022

  1. Preprocess key, workaround torch_proxy for advanced indexing, simplif… 

    …y slice-indexing.

UNTESTED
    Ben Bourgart committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    6641d1e View commit details
    Browse the repository at this point in the history

  2. put advanced index shape in the dimensions name to get the correct po… 

    …sition in the index_proxy
    Ben Bourgart committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    cd78ecb View commit details
    Browse the repository at this point in the history

  3. first changes to setitem

    Ben Bourgart committed Feb 22, 2022
    Configuration menu
    Copy the full SHA
    7d97ea2 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2022

  1. Expand __process_key() to address advanced indexing.

    @ClaudiaComito
    ClaudiaComito committed Feb 24, 2022
    Configuration menu
    Copy the full SHA
    0c37abf View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2022

  1. Address boolean indexing

    @ClaudiaComito
    ClaudiaComito committed Feb 26, 2022
    Configuration menu
    Copy the full SHA
    b1508b9 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2022

  1. separate advanced indexing on dim 0 from adv ind across dimensions

    @ClaudiaComito
    ClaudiaComito committed Feb 28, 2022
    Configuration menu
    Copy the full SHA
    ae5af94 View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2022

  1. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Mar 11, 2022
    Configuration menu
    Copy the full SHA
    ace900a View commit details
    Browse the repository at this point in the history

  2. Replace sanitize_in with try:...except: construct

    @ClaudiaComito
    ClaudiaComito committed Mar 11, 2022
    Configuration menu
    Copy the full SHA
    0a8cb35 View commit details
    Browse the repository at this point in the history

  3. nonzero(): do not assume input DNDarray is load-balanced

    @ClaudiaComito
    ClaudiaComito committed Mar 11, 2022
    Configuration menu
    Copy the full SHA
    6c7c10a View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2022

  1. Memory management

    @ClaudiaComito
    ClaudiaComito committed Mar 14, 2022
    Configuration menu
    Copy the full SHA
    fb3524b View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2022

  1. fix #925: ht.nonzero() returns tuple of 1-D arrays instead of n-D arr… 

    …ays (#937)

* Create ci.yaml

* Update ci.yaml

* Update ci.yaml

* Create CITATION.cff

* Update CITATION.cff

* Update ci.yaml

different python and pytorch versions

* Update ci.yaml

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Delete pre-commit.yml

* Update ci.yaml

* Update CITATION.cff

* Update tutorial.ipynb

delete example with different split axis

* Delete logo_heAT.pdf

Removal of old logo

* ht.nonzero() returns tuple of 1-D arrays instead of n-D arrays

* Updated documentation and Unit-tests

* replace x.larray with local_x

* Code fixes

* Fix return type of nonzero function and gout value

* Made sure DNDarray meta-data is available to the tuple members

* Transpose before if-branching + adjustments to accomodate it

* Fixed global shape assignment

* Updated changelog

Co-authored-by: mtar <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Daniel Coquelin <[email protected]>
Co-authored-by: Markus Goetz <[email protected]>
Co-authored-by: Claudia Comito <[email protected]>
    @Mystic-Slice @mtar
    @pre-commit-ci @coquelin77 @Markus-Goetz @ClaudiaComito
    6 people authored Apr 8, 2022
    Configuration menu
    Copy the full SHA
    eb297fb View commit details
    Browse the repository at this point in the history

Commits on May 24, 2022

  1. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed May 24, 2022
    Configuration menu
    Copy the full SHA
    8485a31 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2022

  1. calculate output_shape, split axis bookkeeping for advanced indexing

    @ClaudiaComito
    ClaudiaComito committed Jun 7, 2022
    Configuration menu
    Copy the full SHA
    a52e518 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2022

  1. __process_key() to return expanded array, expanded key, output gsha… 

    …pe and new split axis
    @ClaudiaComito
    ClaudiaComito committed Jul 12, 2022
    Configuration menu
    Copy the full SHA
    5995639 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2022

  1. in , copy before manipulations

    @ClaudiaComito
    ClaudiaComito committed Aug 25, 2022
    Configuration menu
    Copy the full SHA
    3830e62 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2022

  1. nonzero() to return tuple of 1D arrays, stable distributed results

    @ClaudiaComito
    ClaudiaComito committed Aug 27, 2022
    Configuration menu
    Copy the full SHA
    82b2508 View commit details
    Browse the repository at this point in the history

  2. update __process_key(), get rid of recursive calls, __getitem__ broken

    @ClaudiaComito
    ClaudiaComito committed Aug 27, 2022
    Configuration menu
    Copy the full SHA
    aafaf99 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2022

  1. deal with scalar key, local and distributed cases

    @ClaudiaComito
    ClaudiaComito committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    b746872 View commit details
    Browse the repository at this point in the history

  2. test getitem separately, follow numpy Indexing on ndarray examples

    @ClaudiaComito
    ClaudiaComito committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    00fe538 View commit details
    Browse the repository at this point in the history

  3. test for 0-dim DNDarray key

    @ClaudiaComito
    ClaudiaComito committed Aug 30, 2022
    Configuration menu
    Copy the full SHA
    4360bd1 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2022

  1. Expand __process_key() to deal with distributed boolean mask

    @ClaudiaComito
    ClaudiaComito committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    231c1de View commit details
    Browse the repository at this point in the history

  2. Expand test_getitem for distributed single-element indexing, non-dist… 

    …r boolean mask
    @ClaudiaComito
    ClaudiaComito committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    f19f902 View commit details
    Browse the repository at this point in the history

  3. Add check for matching boolean index / indexed array shapes

    @ClaudiaComito
    ClaudiaComito committed Aug 31, 2022
    Configuration menu
    Copy the full SHA
    7ed435f View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2022

  1. Only sort result if input.split != 0

    @ClaudiaComito
    ClaudiaComito committed Sep 3, 2022
    Configuration menu
    Copy the full SHA
    0da7f56 View commit details
    Browse the repository at this point in the history

  2. BROKEN: distributed boolean indexing to return stable result for all … 

    …splits
    @ClaudiaComito
    ClaudiaComito committed Sep 3, 2022
    Configuration menu
    Copy the full SHA
    e55c7f9 View commit details
    Browse the repository at this point in the history

  3. Add tests for distributed boolean indexing

    @ClaudiaComito
    ClaudiaComito committed Sep 3, 2022
    Configuration menu
    Copy the full SHA
    75d9314 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2022

  1. BROKEN: Fixed key redistribution for input.split != 0.

    @ClaudiaComito
    ClaudiaComito committed Sep 4, 2022
    Configuration menu
    Copy the full SHA
    15a8a28 View commit details
    Browse the repository at this point in the history

  2. Expanded boolean indexing tests

    @ClaudiaComito
    ClaudiaComito committed Sep 4, 2022
    Configuration menu
    Copy the full SHA
    8db0511 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2022

  1. Set up communication matrix for boolean indexing along non-zero split

    @ClaudiaComito
    ClaudiaComito committed Sep 8, 2022
    Configuration menu
    Copy the full SHA
    291329e View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2022

  1. Implement getitem for non-ordered key along split axis

    @ClaudiaComito
    ClaudiaComito committed Nov 4, 2022
    Configuration menu
    Copy the full SHA
    6d986dd View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2022

  1. Fix edge-case contiguity mismatch for Allgatherv

    @ClaudiaComito
    ClaudiaComito committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    f46ae67 View commit details
    Browse the repository at this point in the history

  2. merge branch release/1.2.x

    @ClaudiaComito
    ClaudiaComito committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    4da69fd View commit details
    Browse the repository at this point in the history

  3. Update ubuntu

    @ClaudiaComito
    ClaudiaComito committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    27ea911 View commit details
    Browse the repository at this point in the history

  4. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    d0fb6c8 View commit details
    Browse the repository at this point in the history

  5. switch back to ubuntu 20.04

    @ClaudiaComito
    ClaudiaComito committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    0e704d4 View commit details
    Browse the repository at this point in the history

  6. pull

    @ClaudiaComito
    ClaudiaComito committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    f5d7850 View commit details
    Browse the repository at this point in the history

  7. Upgrade CI to ubuntu 22.04 and cuda 11.7.1

    @ClaudiaComito
    ClaudiaComito committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    acfe9bd View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2022

  1. avoid unnecessary gathering of test DNDarrays

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    0fd3d87 View commit details
    Browse the repository at this point in the history

  2. early out for resplit of non-distributed DNDarrays

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    3c4c07c View commit details
    Browse the repository at this point in the history

  3. match split of comparison array to expected output

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    989e0f4 View commit details
    Browse the repository at this point in the history

  4. avoid MPI calls in non-distributed cases

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    6d66fad View commit details
    Browse the repository at this point in the history

  5. avoid MPI calls in non-distributed resplit

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    a37b4d3 View commit details
    Browse the repository at this point in the history

  6. set default to None

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    8eebe10 View commit details
    Browse the repository at this point in the history

  7. remove print statement

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    22c5c68 View commit details
    Browse the repository at this point in the history

  8. upgrade torch version

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    c692bff View commit details
    Browse the repository at this point in the history

  9. copy to cpu before comparing

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2022
    Configuration menu
    Copy the full SHA
    df6a4e5 View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2022

  1. use ht.allclose instead of np.allclose

    @ClaudiaComito
    ClaudiaComito committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    af0e721 View commit details
    Browse the repository at this point in the history

  2. cast different dtype operands to promoted dtype within torch call

    @ClaudiaComito
    ClaudiaComito committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    bac6d4e View commit details
    Browse the repository at this point in the history

  3. compare local tensors to corresponding slice of expected_array only

    @ClaudiaComito
    ClaudiaComito committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    c0c6362 View commit details
    Browse the repository at this point in the history

  4. expand tests

    @ClaudiaComito
    ClaudiaComito committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    587bc05 View commit details
    Browse the repository at this point in the history

  5. remove redundant code

    @ClaudiaComito
    ClaudiaComito committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    24239a1 View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2022

  1. Implement slicing with negative step

    @ClaudiaComito
    ClaudiaComito committed Dec 26, 2022
    Configuration menu
    Copy the full SHA
    cd65b37 View commit details
    Browse the repository at this point in the history

  2. test slicing with negative step

    @ClaudiaComito
    ClaudiaComito committed Dec 26, 2022
    Configuration menu
    Copy the full SHA
    86e8801 View commit details
    Browse the repository at this point in the history

  3. merge branch bugs/#1057-Allgatherv-contiguity-mismatch

    @ClaudiaComito
    ClaudiaComito committed Dec 26, 2022
    Configuration menu
    Copy the full SHA
    6779010 View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2022

  1. Fix single-element indexing within mixed-type key

    @ClaudiaComito
    ClaudiaComito committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    3b1f46d View commit details
    Browse the repository at this point in the history

  2. Non-ordered indexing, split != 0

    @ClaudiaComito
    ClaudiaComito committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    1a4bf97 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2022

  1. generalize negative step slicing to all splits, loss of dims

    @ClaudiaComito
    ClaudiaComito committed Dec 28, 2022
    Configuration menu
    Copy the full SHA
    9e42156 View commit details
    Browse the repository at this point in the history

  2. loop over active ranks only when key in descending order

    @ClaudiaComito
    ClaudiaComito committed Dec 28, 2022
    Configuration menu
    Copy the full SHA
    1a310a9 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2022

  1. replace list-on-list mapping with argsort mapping for non-ordered key

    @ClaudiaComito
    ClaudiaComito committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    c2ba0d9 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2022

  1. replace list-on-list mapping with argsort mapping for boolean indexing

    @ClaudiaComito
    ClaudiaComito committed Dec 30, 2022
    Configuration menu
    Copy the full SHA
    f6bb5c3 View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2022

  1. fix advanced indexing via list, remove last key-mapping bottleneck fo… 

    …r unsorted key
    @ClaudiaComito
    ClaudiaComito committed Dec 31, 2022
    Configuration menu
    Copy the full SHA
    cad9975 View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2023

  1. fix local slices, expand tests

    @ClaudiaComito
    ClaudiaComito committed Jan 2, 2023
    Configuration menu
    Copy the full SHA
    83e6950 View commit details
    Browse the repository at this point in the history

  2. fix and test dimensional indexing

    @ClaudiaComito
    ClaudiaComito committed Jan 2, 2023
    Configuration menu
    Copy the full SHA
    28ab925 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2023

  1. Fix same-dim advanced indexing, expand tests

    @ClaudiaComito
    ClaudiaComito committed Jan 5, 2023
    Configuration menu
    Copy the full SHA
    bc226fc View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2023

  1. [skip ci] implement single-element indexing along split axis w/ Itera… 

    …ble key
    @ClaudiaComito
    ClaudiaComito committed Jan 25, 2023
    Configuration menu
    Copy the full SHA
    c48c66e View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2023

  1. [skip ci] generalize advanced indexing incl. distributed DNDarray key

    @ClaudiaComito
    ClaudiaComito committed Jan 26, 2023
    Configuration menu
    Copy the full SHA
    18329a1 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2023

  1. [skip ci] Expand tests combined advanced / basic indexing

    @ClaudiaComito
    ClaudiaComito committed Jan 29, 2023
    Configuration menu
    Copy the full SHA
    f024ebb View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2023

  1. [skip ci] fix advanced dimensional indexing on non-distributed array

    @ClaudiaComito
    ClaudiaComito committed Feb 5, 2023
    Configuration menu
    Copy the full SHA
    6ae2788 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    178d7f8 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. fix distr advanced indexing with broadcasted shape

    @ClaudiaComito
    ClaudiaComito committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    09e586c View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2023

  1. transpose without copying

    @ClaudiaComito
    ClaudiaComito committed Jul 29, 2023
    Configuration menu
    Copy the full SHA
    c56ebf4 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. [skip ci] document __process_key(), clean up code

    @ClaudiaComito
    ClaudiaComito committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    86f704a View commit details
    Browse the repository at this point in the history

  2. [skip ci] docs edits

    @ClaudiaComito
    ClaudiaComito committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    68ead71 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. fix Ellipsis dimensions

    @ClaudiaComito
    ClaudiaComito committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    252995c View commit details
    Browse the repository at this point in the history

  2. fix shape and split bookkeeping within advanced indexing

    @ClaudiaComito
    ClaudiaComito committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    c2a7e20 View commit details
    Browse the repository at this point in the history

  3. test adv indexing on non consecutive dims

    @ClaudiaComito
    ClaudiaComito committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    235a7b8 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. abstract scalar key checks for both getitem and setitem

    @ClaudiaComito
    ClaudiaComito committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    4e936e8 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. setitem scalar key

    @ClaudiaComito
    ClaudiaComito committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    8a74cd9 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2023

  1. DRAFT - abstraction common utilities for getitem and setitem

    @ClaudiaComito
    ClaudiaComito committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    8cf3ff1 View commit details
    Browse the repository at this point in the history

  2. handle all single-element indexing along split axis in same block

    @ClaudiaComito
    ClaudiaComito committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    b45578a View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2023

  1. resolve send/recv dimensions mismatch in a few edge cases

    @ClaudiaComito
    ClaudiaComito committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    cec4bb9 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2023

  1. transpose self back to original shape after indexing

    @ClaudiaComito
    ClaudiaComito committed Aug 12, 2023
    Configuration menu
    Copy the full SHA
    cc49a49 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. add setitem tests

    @ClaudiaComito
    ClaudiaComito committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    fe26ae8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    611b46d View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    affdb60 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    7e5be66 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. do not index input unnecessarily for sanitation

    @ClaudiaComito
    ClaudiaComito committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    6d2e369 View commit details
    Browse the repository at this point in the history

  2. test named split dimension for torch_proxy

    @ClaudiaComito
    ClaudiaComito committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    f528356 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2023

  1. value broadcasting abstraction

    @ClaudiaComito
    ClaudiaComito committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    01a1140 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. introduce distr sanitation for value when key is ordered

    @ClaudiaComito
    ClaudiaComito committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    f8264a9 View commit details
    Browse the repository at this point in the history

  2. keep track of original key

    @ClaudiaComito
    ClaudiaComito committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    b1cd02f View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2023

  1. fix value broadcasting for advanced setitem

    @ClaudiaComito
    ClaudiaComito committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    31bdb34 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2023

  1. match broadcasting to numpy

    @ClaudiaComito
    ClaudiaComito committed Dec 16, 2023
    Configuration menu
    Copy the full SHA
    c4d6749 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. finalize broadcast_value and fix test

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    5782d6e View commit details
    Browse the repository at this point in the history

  2. assignment to negative slice along split axis

    @ClaudiaComito
    ClaudiaComito committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    2174e84 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. getitem: index underlying tensor with processed key in non-distr case

    @ClaudiaComito
    ClaudiaComito committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    782bde2 View commit details
    Browse the repository at this point in the history

  2. setitem: test neg step slice along non-zero split axis

    @ClaudiaComito
    ClaudiaComito committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    084371d View commit details
    Browse the repository at this point in the history

  3. allow for nominal value/self split mismatch

    @ClaudiaComito
    ClaudiaComito committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    b1aa7aa View commit details
    Browse the repository at this point in the history

  4. expand test negative step along split axis

    @ClaudiaComito
    ClaudiaComito committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    1c2b71e View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2024

  1. allow value.ndim > indexed_dims if extra dims are singletons

    @ClaudiaComito
    ClaudiaComito committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    7201a89 View commit details
    Browse the repository at this point in the history

  2. BROKEN: expand negative step tests

    @ClaudiaComito
    ClaudiaComito committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    dfc7266 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2024

  1. squeeze out singleton dimensions when broadcasting value

    @ClaudiaComito
    ClaudiaComito committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    8bbe242 View commit details
    Browse the repository at this point in the history

  2. fix negative step slicing on 1 process

    @ClaudiaComito
    ClaudiaComito committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    00a17e6 View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. setitem w. dimensional indexing, add tests

    @ClaudiaComito
    ClaudiaComito committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    bdd2dd8 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. setitem w. advanced indexing on first dim

    @ClaudiaComito
    ClaudiaComito committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    1fbd4d6 View commit details
    Browse the repository at this point in the history

  2. setitem: test boolean indexing, local and split=0

    @ClaudiaComito
    ClaudiaComito committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    95d3c92 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2024

  1. fix output shape for boolean indexing w. split>0

    @ClaudiaComito
    ClaudiaComito committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    f335aa8 View commit details
    Browse the repository at this point in the history

  2. setitem with non-ordered, mask-like key and non-distr value

    @ClaudiaComito
    ClaudiaComito committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    d520ddf View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2024

  1. allow for partial boolean indexing on first key.ndim dims of array

    @ClaudiaComito
    ClaudiaComito committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    d754a9c View commit details
    Browse the repository at this point in the history

  2. remove unnecessary check

    @ClaudiaComito
    ClaudiaComito committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    5e69fe6 View commit details
    Browse the repository at this point in the history

  3. add tests for partial boolean indexing

    @ClaudiaComito
    ClaudiaComito committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    8d9849e View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2024

  1. set w. single-tensor key and non-distr value

    @ClaudiaComito
    ClaudiaComito committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    66ae371 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    980e8f0 View commit details
    Browse the repository at this point in the history

  2. non-ordered, non-mask-like key and local value

    @ClaudiaComito
    ClaudiaComito committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    ae4d423 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. broken: set up comm map for full distributed setitem

    @ClaudiaComito
    ClaudiaComito committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    b695e5a View commit details
    Browse the repository at this point in the history

  2. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    e6c1e10 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. implement setitem w. distributed non-ordered key

    @ClaudiaComito
    ClaudiaComito committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    d42f1cb View commit details
    Browse the repository at this point in the history

  2. [skip ci] broken: add tests for distr value non-ordered key

    @ClaudiaComito
    ClaudiaComito committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    7868fa0 View commit details
    Browse the repository at this point in the history

  3. Merge branch '914_adv-indexing-outshape-outsplit' of github.com:helmh… 

    …oltz-analytics/heat into 914_adv-indexing-outshape-outsplit
    @ClaudiaComito
    ClaudiaComito committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    f8055ff View commit details
    Browse the repository at this point in the history

  4. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    2944903 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. __process_key(): refactor adv indexing tensor extraction

    @ClaudiaComito
    ClaudiaComito committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    1bffd26 View commit details
    Browse the repository at this point in the history

  2. working: setitem w. mask-like adv indexing, non-ordered split key

    @ClaudiaComito
    ClaudiaComito committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    83842ec View commit details
    Browse the repository at this point in the history

  3. adapt tests

    @ClaudiaComito
    ClaudiaComito committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    366aaf9 View commit details
    Browse the repository at this point in the history

  4. refactor __process_key(): address boolean ind within adv ind

    @ClaudiaComito
    ClaudiaComito committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    bbe0a7b View commit details
    Browse the repository at this point in the history

  5. Merge branch '914_adv-indexing-outshape-outsplit' of github.com:helmh… 

    …oltz-analytics/heat into 914_adv-indexing-outshape-outsplit
    @ClaudiaComito
    ClaudiaComito committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    24c6cd1 View commit details
    Browse the repository at this point in the history

  6. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    1c47b42 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. getitem: address mask-like key

    @ClaudiaComito
    ClaudiaComito committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    4ee9b96 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2024

  1. Merge branch '914_adv-indexing-outshape-outsplit' of github.com:helmh… 

    …oltz-analytics/heat into 914_adv-indexing-outshape-outsplit
    @ClaudiaComito
    ClaudiaComito committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    3c88f8b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    54db23d View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2024

  1. define nonzero_size in non-distr case

    @ClaudiaComito
    ClaudiaComito committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    15cce44 View commit details
    Browse the repository at this point in the history

  2. handle split_bookkeeping when key is mask-like

    @ClaudiaComito
    ClaudiaComito committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    09fb199 View commit details
    Browse the repository at this point in the history

  3. fix key type mismatch in advanced indexing

    @ClaudiaComito
    ClaudiaComito committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    9c8d051 View commit details
    Browse the repository at this point in the history

  4. getitem: address n-D key along split axis, free memory

    @ClaudiaComito
    ClaudiaComito committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    41fba0a View commit details
    Browse the repository at this point in the history

  5. balance indexed array before eq()

    @ClaudiaComito
    ClaudiaComito committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    e4a90de View commit details
    Browse the repository at this point in the history

  6. remove print statements

    @ClaudiaComito
    ClaudiaComito committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    c8967e7 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    2d443d8 View commit details
    Browse the repository at this point in the history

  8. test adv ind on non-consecutive dims

    @ClaudiaComito
    ClaudiaComito committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    95eaaeb View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. remove print statement

    @ClaudiaComito
    ClaudiaComito committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    835a13f View commit details
    Browse the repository at this point in the history

  2. setitem: mixed indexing w. shape broadcasting

    @ClaudiaComito
    ClaudiaComito committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    216a1a0 View commit details
    Browse the repository at this point in the history

  3. expand tests for mixed indexing w. broadcasting

    @ClaudiaComito
    ClaudiaComito committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    b62bad2 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    7ea2abe View commit details
    Browse the repository at this point in the history

  5. reinstate tests for specific bugs

    @ClaudiaComito
    ClaudiaComito committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    435ff0c View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    30efe59 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. Merge branch 'main' into 914_adv-indexing-outshape-outsplit

    @ClaudiaComito
    ClaudiaComito committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    e6679a0 View commit details
    Browse the repository at this point in the history

  2. prep send_buffer - expand value dimension if necessary

    @ClaudiaComito
    ClaudiaComito committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    ad96822 View commit details
    Browse the repository at this point in the history

  3. fix send_indices dims when key is not mask-like

    @ClaudiaComito
    ClaudiaComito committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    c9d44ae View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. test split mismatch on comm.size > 1

    @ClaudiaComito
    ClaudiaComito committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    cc70400 View commit details
    Browse the repository at this point in the history

  2. broadcasting assignment along split axis

    @ClaudiaComito
    ClaudiaComito committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    b78de30 View commit details
    Browse the repository at this point in the history

  3. expand tests

    @ClaudiaComito
    ClaudiaComito committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    a8f2d57 View commit details
    Browse the repository at this point in the history