Parallel transient file input/output
I am running an LES simulation on a large scale research cluster with around 100 cores. I plan on writing out time-step result files at a fairly high frequency. The issue I am having is that the rules surrounding the use of the cluster discourage a lot of I/O with MANY SMALL FILES, so when openfoam is parallelized, having 100 files/timestep backed up will become a major issue. I was wondering if anyone knows whether or not it's possible to perform a sort of 'reconstructPar' command during output so that I only end up with 1 time directory per backup, instead of 100's.
|All times are GMT -4. The time now is 11:30.|