Skip to content

WeeklyTelcon_20211005

Jump to bottom
Geoffrey Paulsen edited this page Oct 12, 2021 · 1 revision

Open MPI Weekly Telecon ---

Attendees (on Web-ex)

not there today (I keep this for easy cut-n-paste for future notes)

  • Akshay Venkatesh (NVIDIA)
  • Artem Polyakov (NVIDIA)
  • Aurelien Bouteiller (UTK)
  • Austen Lauria (IBM)
  • Brandon Yates (Intel)
  • Brendan Cunningham (Cornelis Networks)
  • Brian Barrett (AWS) - Welcome Back!
  • Charles Shereda (LLNL)
  • Christoph Niethammer (HLRS)
  • David Bernholdt (ORNL)
  • Edgar Gabriel (UH)
  • Erik Zeiske (HPE)
  • Geoffrey Paulsen (IBM)
  • Geoffroy Vallee (ARM)
  • George Bosilca (UTK)
  • Harumi Kuno (HPE)
  • Hessam Mirsadeghi (NVIDIA))
  • Howard Pritchard (LANL)
  • Jeff Squyres (Cisco)
  • Joseph Schuchart (HLRS)
  • Josh Hursey (IBM)
  • Joshua Ladd (NVIDIA)
  • Marisa Roman (Cornelius)
  • Mark Allen (IBM)
  • Matias Cabral (Intel)
  • Matthew Dosanjh (Sandia)
  • Michael Heinz (Cornelis Networks)
  • Nathan Hjelm (Google)
  • Noah Evans (Sandia)
  • Raghu Raja
  • Ralph Castain (Intel)
  • Sam Gutierrez (LANL)
  • Scott Breyer (Sandia?)
  • Shintaro iwasaki
  • Sriraj Paul (Intel)
  • Thomas Naughton (ORNL)
  • Todd Kordenbrock (Sandia)
  • Tomislav Janjusic (NVIDIA)
  • William Zhang (AWS)
  • Xin Zhao (NVIDIA)

New Topics For Today

v4.0.x

  • Schedule: Pushed to October for 4.0.7
  • --cpu-set - Geoff working on PR for nice warning/docs
  • Fortran PR 9259, 9367 probably affect v4.0.x branch as well.
    • Geoff will follow up.

v4.1.x

  • Schedule:
    • Made a v4.1.2rc1 - Please TEST.
  • Two outstanding:
    • ROMIO update.
    • --cpu-set PR from Geoff (see above)
    • One more pending on v4.1.x Jenkins had some issues that Brian is looking at.
  • ROMIO 3.2.1 based PR 8371 do we want to take this?
    • v4.1.x does this need to go back to v4.0.x?
  • Issue #9432 - MPI4Py testing see ROMIO issue.
  • Common OFI memory registraiton
    • Brian Backporting to v4.1 and 5.0
  • Debian saw a new SEGFAULT in 32bit build of vader.
    • Details on Debian tracker.
    • Jeff asked for a reproducer.
    • Not obviously an Open MPI bug with existing information.

v5.0.x

  • Schedule: aiming for rc1 on Sept 23rd.
  • George was able to verify the BTL+OSC RDMA failures is not only IBM.
  • Blocker v4.1.x blocker also in v5.0.x Common/OFI
  • Tommy's still pushing on UCX Onesided.
  • PMIx and/or PRRTE are releasing a new minor rev that we'll pickup for v5.0.x
    • Did we update yet?
  • Think there are other issues than just one sided.
    • 5 in issues, only 2 are one-sided.
    • One is static linking, Austen will reverify
  • Talk about gcc v4.7 and RHEL6
    • PMIx and PRRTE just don't compile on RHEL6, but because of this, do we even care about RHEL6? specifically gcc v4.4.7
    • RHEL7 v4.8.5 works fine.
    • Not interested in testing all of those gcc version.
      • Jeff will post a Pull Request.
      • Will officially truncate support as well.
      • No issues with glibc issues, so no hard check.
  • Documentation
    • Got a change in sphynx tools needed. No sure if there's a release yet.
      • This fixes outputting issues in manpages.
    • Process to update FAQ is to talk to Jeff or Harumi.
    • Any changes in README or FAQ let them know to make changes in NEW docs.
      • For now, make changes in ompi-www and README as usual and let them know.
  • v5.0.x requires pandoc. If user downloads from .tarball they do NOT need pandoc installed.
    • If user runs make dist or make dist-check they WILL need pandoc.
      • This is a strange quirk, but seems fine.
  • Problem with OFI and Open MPI
    • No discussion
  • Github Project of [critical v5.0.x issues|https://github.com/open-mpi/ompi/projects/3]
    • Issue 8983 - Nathan volunteered to put out a fix.
    • If we partially disable OSC/TCP BTL - Not breaking MPI compliance, just breaking One-sided performance badly.
    • Described approach of rc1 on Sept 23, disabling any functionality that are blockers to allow for the rc.
      • Worried that blockers might not be fixed in time, so will put in code to issue an error at runtime to prevent getting into those paths, and document it heavily.
  • MPIAlltoallw needs to go in. Is a PR from Giles George
  • Portals bugfixes incomming.
    • Todd's working on this. Hasn't posted yet. Will post this week.
    • 9391
  • https://github.com/open-mpi/ompi/pull/9326 should get into 5.0 too
    • This fixes a correctness issues, and George is concerned about performance.
    • Is argobots now unsupported?
      • no. Our integration allow users to call MPI withing a blocking argobot function and this still works.
      • What we think is a thread that will block in libevent, because libevent isn't aware of argobots, so libeven will block entire thread.
    • George joined about this time. I think he said this was ready or that he'd re-read.

Super Computing SC BoF

  • Was accepted for Open MPI
    • Our Hybrid BoF will be mostly VIRTUAL BoF
      • George may be there in person for tutorial (tho other tutorials will be fully-virtual)
    • Bird of a Feather will be Virtual.
    • George sent out an email to Amazon, Cisco, IBM, nVidia

Master

Documentation

  • No update
  • Don't do the old system, use this new system for v5.0.0

MPI 4.0 API

  • No discussion [Open MPI 4.0 API Compliance Github Project|https://github.com/open-mpi/ompi/projects/2]
  • Jeff's going to review PR 9246
  • Howard will review 7985
  • Need to decide what to do with 8057
  • Sessions branch, don't want to merge into master until possibly v5.0.1 gets out.
    • It will complicate things in finalize/initialize code.

MTT

  • Looking okay.
  • Looks like something was wrong with MTT.
    • That machine just got upgraded.
    • Install fail is kinda weird.

Longer Term discussions

  • No discussion.
Clone this wiki locally