Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding CPU training support to AxoNN #39

Open
wants to merge 28 commits into
base: develop
Choose a base branch
from
Open

Adding CPU training support to AxoNN #39

wants to merge 28 commits into from

Commits on Feb 2, 2024

  1. Rebased cpu changes onto latest axonn

    Sathwik Yanamaddi committed Feb 2, 2024
    1 Configuration menu
    Copy the full SHA
    e3bfa64 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. Args should default to true, removed tensor_list operator for cpus

    Sathwik Yanamaddi committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    472d355 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. Made changes conditional for CPUs/GPUs

    Sathwik Yanamaddi committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    9c237b1 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. Gpu runs do not make Slurm calls

    Sathwik Yanamaddi committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    676640d View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Revamped cpu flag with cpu hard set in comm.py 

    Add default values for environment vars

Fixed communication handle flags

Fixed formatting
    Sathwik Yanamaddi committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    e84c64d View commit details
    Browse the repository at this point in the history

  2. Set device before init 

    Formatting fixed

formatting again

tensor-list change

Formatting and Device-Setting

Fixed gpus_per_node access
    Sathwik Yanamaddi authored and Sathwik Yanamaddi committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    ae74e70 View commit details
    Browse the repository at this point in the history

  3. Added initial pytest parameters for cpu tests

    Sathwik Yanamaddi authored and Sathwik Yanamaddi committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    9514d65 View commit details
    Browse the repository at this point in the history

  4. removed mpi4py dependency (#63) 

    Co-authored-by: Mahua Singh <[email protected]>
    @S-Mahua
    2 people authored and Sathwik Yanamaddi committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    0a22f88 View commit details
    Browse the repository at this point in the history

  5. adding parallelize context for opt (#65)

    @jwendlan
    jwendlan authored and Sathwik Yanamaddi committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    52b0aef View commit details
    Browse the repository at this point in the history

  6. Removing the drop and gathers in depth tensor parallelism for the eas… 

    …y API (#66)
    @siddharth9820
    siddharth9820 authored and Sathwik Yanamaddi committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    7728f1a View commit details
    Browse the repository at this point in the history

  7. change parallelize context to use AutoConfig (#67)

    @siddharth9820
    siddharth9820 authored and Sathwik Yanamaddi committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    5087268 View commit details
    Browse the repository at this point in the history

  8. Bugfix: Initialize grad_input, grad_weight to None (#68) 

    * initialize grad_input to None

* minor
    @adityaranjan
    adityaranjan authored and Sathwik Yanamaddi committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    5faec5b View commit details
    Browse the repository at this point in the history

  9. Removed distributed communication class 

    Added missing parameter to test

Fixed formatting

docs: fix build issues and add sub-sections (#69)
    Sathwik Yanamaddi committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    e831180 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. Merge branch 'develop' into axonn-cpu

    @siddharth9820
    siddharth9820 authored May 1, 2024
    Configuration menu
    Copy the full SHA
    0444e50 View commit details
    Browse the repository at this point in the history

  2. formatting

    @siddharth9820
    siddharth9820 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    70a5a37 View commit details
    Browse the repository at this point in the history

  3. fix CI

    @siddharth9820
    siddharth9820 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    e185214 View commit details
    Browse the repository at this point in the history

  4. format

    @siddharth9820
    siddharth9820 committed May 1, 2024
    Configuration menu
    Copy the full SHA
    e9f21ce View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Matched changes for intra_layer_conv tests

    Sathwik Yanamaddi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    f3a5dfc View commit details
    Browse the repository at this point in the history

  2. Removed unused env variables and format

    Sathwik Yanamaddi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    88176e9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into axonn-cpu

    @Avuxon
    Avuxon authored May 8, 2024
    Configuration menu
    Copy the full SHA
    c63e489 View commit details
    Browse the repository at this point in the history

  4. Fixed CI to return for depth > 1

    Sathwik Yanamaddi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    f933edc View commit details
    Browse the repository at this point in the history

  5. Merge branch 'axonn-cpu' of https://github.com/axonn-ai/axonn into ax… 

    …onn-cpu
    Sathwik Yanamaddi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    20af63a View commit details
    Browse the repository at this point in the history

  6. Added depth check to fw pass in fc test

    Sathwik Yanamaddi committed May 8, 2024
    Configuration menu
    Copy the full SHA
    8249add View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Merge develop into this branch

    Sathwik Yanamaddi committed May 24, 2024
    Configuration menu
    Copy the full SHA
    1a677ff View commit details
    Browse the repository at this point in the history

  2. Added xfail to convolution tests

    Sathwik Yanamaddi committed May 24, 2024
    Configuration menu
    Copy the full SHA
    f39883f View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. remove xfail

    @siddharth9820
    siddharth9820 committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    d24fa4c View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Merge branch 'develop' into axonn-cpu

    @siddharth9820
    siddharth9820 authored Jun 18, 2024
    Configuration menu
    Copy the full SHA
    ad779c3 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. Merge branch 'develop' into axonn-cpu

    @siddharth9820
    siddharth9820 authored Jun 26, 2024
    Configuration menu
    Copy the full SHA
    1f9e54b View commit details
    Browse the repository at this point in the history