|
[Sponsors] |
[OpenFOAM] How to increase the reading speed of Paraview with large data sets from OpenFoam |
![]() |
|
LinkBack | Thread Tools | Search this Thread | Display Modes |
![]() |
![]() |
#1 |
New Member
Brayan Manuel Guerrero Martinez
Join Date: Sep 2024
Location: Cali, Colombia
Posts: 2
Rep Power: 0 ![]() |
Hello,
I am working with LES simulations that generate large data files. I am working on a cluster with OpenFoam and Paraview 5.13.1, running natively on the cluster. Paraview runs in parallel and also uses a GPU. The problem is that it takes a long time to load an Openfoam case, about 20 minutes for each Time Step with a Decompose Case. So the first question is: In your opinion, what is the most efficient way to load the case: with an OpenFoam Recompose Case, a Decompose Case or converting the files to VTK format? I think the bottleneck is the HDD’s but seeing the usage, they are not working at their maximum reading capacity, so please give me your opinions on what else it could be. Thanks for yours response. |
|
![]() |
![]() |
![]() |
![]() |
#2 |
Senior Member
|
Hi there,
Your struggles are similar to what I have seen. When I am running big cases, I prefer to create VTK (vtp) files during the run for thing that I would like to post-process (slices, iso-contours, streamlines, or maybe also some surfaces) as this is much faster and takes less data to store than the full 3D fields for all time steps. I don't think there is a huge difference between reading a decomposed case versus reconstructed, unless you can have ParaView read the data in parallel in the decomposed case as well. There may be a better solution if you can have Catalyst work, which can do some post-processing while running the case, but I have not been able to test this myself. It also helps if you do not need to load the internalMesh in ParaView, but just want to look at the surfaces. Also note that version 5.13.2 has some bug fixed for slices on polyhedral meshes. I did compare 5.13.2 and 5.13.0, it was a huge difference for a 100 million cell mesh (from days to less than an hour). Hope this helps, but I am interested if someone has a nice setup that works well. Regards, Tom |
|
![]() |
![]() |
![]() |
Tags |
hpc cluster, large data, les, openfoam, paraview |
Thread Tools | Search this Thread |
Display Modes | |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
[Commercial meshers] Unknown error when converting fluent mesh to openfoam | Yutao | OpenFOAM Meshing & Mesh Conversion | 0 | April 23, 2023 03:30 |
[OpenFOAM] reading data from paraview -> Python.paraview -> numpy example? | pattim | ParaView | 0 | December 18, 2022 12:13 |
Reading Fluent data files in Visit or Paraview | pranab_jha | Main CFD Forum | 0 | February 15, 2016 16:51 |
[Commercial meshers] Problem converting fluent mesh | vinz | OpenFOAM Meshing & Mesh Conversion | 28 | October 12, 2015 07:37 |
[Other] How to create an MRF zone ? | aminem | OpenFOAM Meshing & Mesh Conversion | 2 | December 8, 2014 11:45 |