CFD Online Logo CFD Online URL
Home > Forums > Main CFD Forum


Register Blogs Members List Search Today's Posts Mark Forums Read

LinkBack Thread Tools Display Modes
Old   November 20, 2008, 13:12
Default ParMETIS
Rob Kunz
Posts: n/a
I have been using METIS for years in the front end of my face based cell centered unstructured CFD code. The front end reads the grid gereator file, builds the global vertex and adjacency list and runs METIS_PartGraph_Kway.

I have a large model now and METIS is exceeding the 32GB ram I have on our "fat" serial node, so I think I need to use ParMETIS.

Question is how does one "easily" build a starting graph for each processor? Simple spatial splitting? Put a edges each on n-1 procs and the rest on one proc?

Thanks! Rob
  Reply With Quote

Old   November 20, 2008, 14:42
Default Re: ParMETIS
Posts: n/a
How do you generate your huge meshes? Ideally the mesh generator provides a preliminary partition and you distribute parts based on that. If you can't have a preliminary partition, you can just assign a contiguous block of <code>n/p</code> elements to each process as a preliminary partition. Of course, this requires that your file format gives you a way to determine connectivity for the elements in a part without reading the entire thing. You can use MPI-IO (perhaps through an interface like HDF5), read sequentially from the first node, or read separate files on each node. Which is fastest depends on the filesystem and network of your cluster.
  Reply With Quote

Old   November 20, 2008, 17:20
Default Re: ParMETIS
Rob Kunz
Posts: n/a
Thanks Jed: I use ICEM which will not partition the mesh. Whatever my solution I qwill be faced with the I/O issue you mention and I will take your advise and look into MPI-IO Thank you Rob
  Reply With Quote


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
decomposePare error with parMetis tonyuprm OpenFOAM 7 July 5, 2011 15:49
ParMETIS with Fortran whumber Main CFD Forum 0 November 20, 2009 14:06
GPL license compatible with ParMetis guillaume OpenFOAM 2 February 16, 2009 05:20
ParMetis for parallel decomposing bastil OpenFOAM Running, Solving & CFD 0 May 12, 2008 09:54
BuildingLinking of ParMETIS and metis50pre2 mwild OpenFOAM Installation 0 January 28, 2008 05:55

All times are GMT -4. The time now is 10:38.