Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enabling hugepage with ArgoDSM and MPI, UCX #148

Open
seungjinn opened this issue Jan 25, 2024 · 1 comment
Open

Enabling hugepage with ArgoDSM and MPI, UCX #148

seungjinn opened this issue Jan 25, 2024 · 1 comment

Comments

@seungjinn
Copy link

Hi, I'm working on a client-server style application with ArgoDSM and trying to optimize performance issues.

I'm wondering if it's possible to (1) use ArgoDSM with hugepage and also (2) how I can adjust cache line size.

It seems like cache line size is currently hard coded and I tried to give it different sizes (like 2 pages, 4 pages) and I got an error during argo::init at the start of a program.

I would appreciate any help! Thanks!

@seungjinn seungjinn changed the title Enabling hugepage with ArgoDSM and MPI, UCX things Enabling hugepage with ArgoDSM and MPI, UCX Jan 25, 2024
@kostis
Copy link
Contributor

kostis commented Feb 1, 2024

Thanks for your interest in ArgoDSM.

Brief answers to your questions:

  1. We have thought about it in the past and our recollection is that in principle it is possible to use hugepages, but (a) it may require many changes to the current code and (b) its performance may not be what you would desire (i.e., it may make the problem with false sharing significantly worse than what it is with 4K pages).
  2. Adjusting the cache line size is again something that in principle is doable -and in fact we have done this in the distant past- but the current code base may require major surgery to support this feature. But we would welcome a (fully or partially implemented) PR that enables this. If you make the first steps, we can help you take that PR "all the way" there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants