[Shawn_A]

I have a ~10M element case that is taking forever to write results (and transient results) for. Just wondered if anyone has an suggestions on compression settings or hardware.

The transient results files are about 4GB and I'm using a Western Digital 1.5TB Green drive (~5400 RPM). Yes, I'm aware that it's probably the slowest storage solution you could get, but it takes way less time to transfer a 4GB movie file (or equivalent amount in smaller sizes) on the same drive. I can't quite tell where the bottleneck is, if its the storage itself or the compression, but watching TskMgr I can see that the "solver-hpmpi.exe" is definitely not idle. In fact, during the write process, there is some pretty heavy CPU usage. I'm testing a few different compression options now - none and high - to see what impact that has. I initially was using the default setting. I didn't have the same problem (long ?write? time) on a cluster where the same simulation was running. I don't know how the storage was setup there, but most likely some sort of RAID configuration with faster 7200 rpm drives.

I'm currently running the no compression test and it is still taking a very long time and showing a lot of cpu usage on all my cores.

Am considering an SSD, but if my speed is cpu limited, then that's money I could spend on long-term data storage instead.

Any advice to speed this up?

Regards,
Shawn