CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Visualization & Post-Processing Software > ParaView

[OpenFOAM] How to increase the reading speed of Paraview with large data sets from OpenFoam

Register Blogs Members List Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   January 22, 2025, 18:01
Default How to increase the reading speed of Paraview with large data sets from OpenFoam
  #1
New Member
 
Brayan Manuel Guerrero Martinez
Join Date: Sep 2024
Location: Cali, Colombia
Posts: 2
Rep Power: 0
BGM28 is on a distinguished road
Hello,

I am working with LES simulations that generate large data files. I am working on a cluster with OpenFoam and Paraview 5.13.1, running natively on the cluster. Paraview runs in parallel and also uses a GPU. The problem is that it takes a long time to load an Openfoam case, about 20 minutes for each Time Step with a Decompose Case.

So the first question is: In your opinion, what is the most efficient way to load the case: with an OpenFoam Recompose Case, a Decompose Case or converting the files to VTK format?

I think the bottleneck is the HDD’s but seeing the usage, they are not working at their maximum reading capacity, so please give me your opinions on what else it could be.

Thanks for yours response.
BGM28 is offline   Reply With Quote

Old   January 23, 2025, 06:04
Default
  #2
Senior Member
 
Tom Fahner
Join Date: Mar 2009
Location: Breda, Netherlands
Posts: 653
Rep Power: 32
tomf will become famous soon enoughtomf will become famous soon enough
Send a message via MSN to tomf Send a message via Skype™ to tomf
Hi there,

Your struggles are similar to what I have seen. When I am running big cases, I prefer to create VTK (vtp) files during the run for thing that I would like to post-process (slices, iso-contours, streamlines, or maybe also some surfaces) as this is much faster and takes less data to store than the full 3D fields for all time steps. I don't think there is a huge difference between reading a decomposed case versus reconstructed, unless you can have ParaView read the data in parallel in the decomposed case as well. There may be a better solution if you can have Catalyst work, which can do some post-processing while running the case, but I have not been able to test this myself. It also helps if you do not need to load the internalMesh in ParaView, but just want to look at the surfaces.

Also note that version 5.13.2 has some bug fixed for slices on polyhedral meshes. I did compare 5.13.2 and 5.13.0, it was a huge difference for a 100 million cell mesh (from days to less than an hour).

Hope this helps, but I am interested if someone has a nice setup that works well.

Regards,
Tom
tomf is offline   Reply With Quote

Reply

Tags
hpc cluster, large data, les, openfoam, paraview

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
[Commercial meshers] Unknown error when converting fluent mesh to openfoam Yutao OpenFOAM Meshing & Mesh Conversion 0 April 23, 2023 03:30
[OpenFOAM] reading data from paraview -> Python.paraview -> numpy example? pattim ParaView 0 December 18, 2022 12:13
Reading Fluent data files in Visit or Paraview pranab_jha Main CFD Forum 0 February 15, 2016 16:51
[Commercial meshers] Problem converting fluent mesh vinz OpenFOAM Meshing & Mesh Conversion 28 October 12, 2015 07:37
[Other] How to create an MRF zone ? aminem OpenFOAM Meshing & Mesh Conversion 2 December 8, 2014 11:45


All times are GMT -4. The time now is 10:17.