CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > Siemens > STAR-CCM+

Importing large .csv files to STARCCM+

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   August 6, 2021, 15:57
Default Importing large .csv files to STARCCM+
  #1
New Member
 
agSilverMAN
Join Date: Aug 2018
Posts: 6
Rep Power: 5
kermelosh is on a distinguished road
Hi,

I am importing a very large instantaneous velocity .csv file into my simulation file (> 5 GB) using the table import option. The problem is that it is taking a really long time to import the table (days). Is there another way of doing this in a time efficient way?

Thanks

khw
kermelosh is offline   Reply With Quote

Old   August 7, 2021, 05:20
Default
  #2
Senior Member
 
Lucky Tran
Join Date: Apr 2011
Location: Orlando, FL USA
Posts: 4,436
Rep Power: 53
LuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura about
By any chance is it still reading? Like, have you seen it finish reading ever?



Default Star launches with a java heap space of 768 mb and shouldn't be able to read any .csv larger than that. But it would throw an error as soon as it runs out of heap space which should happen rather quickly if the .csv has been successfully read from the disk.
LuckyTran is offline   Reply With Quote

Old   August 7, 2021, 14:28
Default
  #3
cwl
Senior Member
 
Chaotic Water
Join Date: Jul 2012
Location: Elgrin Fau
Posts: 264
Rep Power: 14
cwl is on a distinguished road
LuckyTran, I'm curious - is there a way to increase the heap size? - Through the command line parameter maybe?
I could not find anything related in the user guide.
cwl is offline   Reply With Quote

Old   August 7, 2021, 15:57
Default
  #4
New Member
 
agSilverMAN
Join Date: Aug 2018
Posts: 6
Rep Power: 5
kermelosh is on a distinguished road
LuckyTran, It is still reading. There is no error indication suggesting it run out of heap space.
kermelosh is offline   Reply With Quote

Old   August 8, 2021, 22:42
Default
  #5
Senior Member
 
Lucky Tran
Join Date: Apr 2011
Location: Orlando, FL USA
Posts: 4,436
Rep Power: 53
LuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura aboutLuckyTran has a spectacular aura about
It should only take about 5-10 minutes to pull 5GB from the disk. If it takes longer than that, then your job is stuck in limbo.

The maximum heap space you can increase by passing -jvmargs -Xmx6G into the command line to increase it to 6GB just as an example. It's not specific to Star but all java virtual machine launchers. What's unique in Star is that Star automatically launches using a max heap space of 786 megabytes. It is very uncommon that you need to stream a file larger than this in one go. But then you run into the guy that has a 5GB .csv...
LuckyTran is offline   Reply With Quote

Reply

Tags
starccm+, starccm+ macro

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Workbench Parametric Runs - Obtaion .csv files Automatically nikos_ FLUENT 3 April 3, 2017 04:14
Problems in compiling paraview in Suse 10.3 platform chiven OpenFOAM Installation 3 December 1, 2009 08:21
Format for importing Plot3d files into Star-CCM+ Meredith Siemens 1 October 12, 2005 13:28
very large saved files jelle Phoenics 4 August 5, 2005 09:49
Results saving in CFD hawk Main CFD Forum 16 July 21, 2005 21:51


All times are GMT -4. The time now is 08:24.