CFD Online Discussion Forums

CFD Online Discussion Forums (https://www.cfd-online.com/Forums/)
-   STAR-CCM+ (https://www.cfd-online.com/Forums/star-ccm/)
-   -   Importing large .csv files to STARCCM+ (https://www.cfd-online.com/Forums/star-ccm/237821-importing-large-csv-files-starccm.html)

kermelosh August 6, 2021 14:57

Importing large .csv files to STARCCM+
 
Hi,

I am importing a very large instantaneous velocity .csv file into my simulation file (> 5 GB) using the table import option. The problem is that it is taking a really long time to import the table (days). Is there another way of doing this in a time efficient way?

Thanks

khw

LuckyTran August 7, 2021 04:20

By any chance is it still reading? Like, have you seen it finish reading ever?



Default Star launches with a java heap space of 768 mb and shouldn't be able to read any .csv larger than that. But it would throw an error as soon as it runs out of heap space which should happen rather quickly if the .csv has been successfully read from the disk.

cwl August 7, 2021 13:28

LuckyTran, I'm curious - is there a way to increase the heap size? - Through the command line parameter maybe?
I could not find anything related in the user guide.

kermelosh August 7, 2021 14:57

LuckyTran, It is still reading. There is no error indication suggesting it run out of heap space.

LuckyTran August 8, 2021 21:42

It should only take about 5-10 minutes to pull 5GB from the disk. If it takes longer than that, then your job is stuck in limbo.

The maximum heap space you can increase by passing -jvmargs -Xmx6G into the command line to increase it to 6GB just as an example. It's not specific to Star but all java virtual machine launchers. What's unique in Star is that Star automatically launches using a max heap space of 786 megabytes. It is very uncommon that you need to stream a file larger than this in one go. But then you run into the guy that has a 5GB .csv...


All times are GMT -4. The time now is 18:49.