CFD Online Discussion Forums

CFD Online Discussion Forums (https://www.cfd-online.com/Forums/)
-   Siemens (https://www.cfd-online.com/Forums/siemens/)
-   -   HPC Infiband MPICH compatibility (https://www.cfd-online.com/Forums/siemens/56762-hpc-infiband-mpich-compatibility.html)

Dave August 13, 2008 11:54

HPC Infiband MPICH compatibility
 
I'm installing a new cluster system w/ infiniband innerconnectivity. The MPICH (1.2) supplied w/ the latest StarCD apparently doesn't support infiniband and the HPMPICH optional software provided with the distribution apparently requires a license.

Any tips on what will work?

Thanks.


BastiL August 13, 2008 13:34

Re: HPC Infiband MPICH compatibility
 
On later STAR-Versions HPMPI has been licensed by adapco. No more licenses needed.

James August 14, 2008 07:50

Re: HPC Infiband MPICH compatibility
 
For 3.26 it is 'version' 100 that has HPMPI.

One neat thing about HPMPI is that you can define the cpu affinity of the various threads - i.e. you can lock STAR to specific cores. This makes a huge difference especially in cases where, for example, you have a dual core dual CPU node running 4 threads. It can up to double overall throughput.

You activate it with the -mppflags option.as in

-mppflags='-cpu_bind=v,MAP_CPU:0,2'

which for a 2 thread per node run would put one thread on CPU 0 and one on CPU 2 - which in this case are different physical CPUS.

Obviously this requires careful management since it is possible to assign two jobs to one core if you are not careful. In this case everything will then progress very slowly.

CCM+ also uses HPMPI and you can do a similar thing with it when you fire up the server.

TG August 14, 2008 16:03

Re: HPC Infiband MPICH compatibility
 
In fact any version of STAR that comes with HPMPI has an embedded license to run HPMPI. Its quite possible though that you are trying to use an older version of HPMPI that is not compatible with the latest infiniband drivers. Call your CD-adapco support people.


All times are GMT -4. The time now is 16:21.