Local case configuration: Date: Mon 22 Nov 2021 16:37:49 GMT System: Linux 3.10.0-693.5.2.el7.x86_64 Machine: node05.swmgmt.eureka Processor: model name : Intel(R) Xeon(R) CPU E5-2660 v4 @ 2.00GHz Memory: 128658 MB Directory: /users/rw00793/Severac_test_parallel/28cores/RESU/20211122-1637 MPI ranks: 28 OpenMP threads: 1 Processors/node: 1 Compilers used for build: C compiler: gcc (GCC) 4.9.3 C++ compiler: g++ (GCC) 4.9.3 Fortran compiler: GNU Fortran (GCC) 4.8.5 20150623 (Red Hat 4.8.5-16) MPI version: 3.0 (MPICH 3.1.2) OpenMP version: 4.0 External libraries: I/O read method: collective MPI-IO (explicit offsets) I/O write method: collective MPI-IO (explicit offsets) I/O rank step: 1 -------------------------------------------------------------------------------- Partitioning: precompute cell centers: 0.947 s Morton (Z) curve: 0.297 s wall clock time: 1.24 s -------------------------------------------------------------------------------- Joining number 1: Determination of possible face intersections: bounding-box tree layout: 3D rank/call mean minimum maximum depth: 7 | 6 | 7 number of leaves: 1303 | 1051 | 1569 number of boxes: 3041 | 2702 | 3444 leaves over threshold: 0 | 0 | 0 boxes per leaf: 6 | 0 | 24 Memory footprint (kb): final search structure: 284 | 252 | 325 temporary search structure: 4550 | 4380 | 4678 Associated times: Face bounding boxes tree construction: 0.02 Face bounding boxes neighborhood query: 0.00372 Sorting possible intersections between faces: 0.00405 Definition of local joining mesh: 0.00241 Edge intersections: 0.018 Creation of new vertices: 1.18e-05 Merging vertices: 0.00545 Updating structures with vertex merging: 0.0656 Split old faces and reconstruct new faces: 0.144 Complete treatment for joining 1: wall clock time: 0.368 Joining operations time summary: wall clock time: 0.368 -------------------------------------------------------------------------------- Halo creation times summary Interface creation: 0.134 s Halo creation: 0.0558 s Total time for halo creation: 0.19 s -------------------------------------------------------------------------------- Partitioning: preparing graph: 0.0624 s SCOTCH_dgraphPart: 2.18 s wall clock time: 2.33 s -------------------------------------------------------------------------------- Halo creation times summary Interface creation: 0.129 s Halo creation: 0.036 s Total time for halo creation: 0.166 s -------------------------------------------------------------------------------- Total elapsed time for all gradient computations: 584.892 s Summary of gradient computations for "[cell mass flux divergence update]": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 6120 Total elapsed time: 115.792 Summary of gradient computations for "[face mass flux update]": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 2448 Total elapsed time: 45.957 Summary of gradient computations for "[momentum]": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 1224 Total elapsed time: 38.542 Summary of gradient computations for "[scalar convection-diffusion]": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 2 Total elapsed time: 0.028 Summary of gradient computations for "cromo_grad": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 1224 Total elapsed time: 17.552 Summary of gradient computations for "k": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 3672 Total elapsed time: 52.667 Summary of gradient computations for "omega": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 3672 Total elapsed time: 52.705 Summary of gradient computations for "pressure": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 2448 Total elapsed time: 49.454 Summary of gradient computations for "pressure_increment": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 1224 Total elapsed time: 23.530 Summary of gradient computations for "temperature": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 2456 Total elapsed time: 35.085 Summary of gradient computations for "velocity": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 4896 Total elapsed time: 153.522 Summary of gradient computations for "wall_distance": Reconstruction type: Green-Gauss, least-squares gradient face values Number of calls: 4 Total elapsed time: 0.057 -------------------------------------------------------------------------------- Total elapsed time for linear equation system solvers: 864.274 s Linear solver performance for fields ------------------------------------ Summary of resolutions for "Velocity" (field id 0) Solver type: Symmetric Gauss-Seidel Number of setups: 1224 Number of calls: 1224 Minimum number of iterations: 3 Maximum number of iterations: 11 Mean number of iterations: 4 Total setup time: 3.592 Total solution time: 74.686 Summary of resolutions for "Pressure" (field id 1) Solver type: Flexible Conjugate Gradient Preconditioning: Multigrid Number of setups: 1224 Number of calls: 2448 Minimum number of iterations: 7 Maximum number of iterations: 23 Mean number of iterations: 13 Total setup time: 76.242 Total solution time: 674.451 Multigrid: V-cycle Coarsening: default Smoother: Symmetric Gauss-Seidel Coarsest level solver: Conjugate Gradient mean minimum maximum Number of levels: 11 11 11 Number of cycles: 1 1 2 calls time Construction: 1224 148.363 Resolution: 35389 557.292 mean minimum maximum Grid level 0: Number of rows: 1920600 1920600 1920600 Number of active ranks: 28 28 28 Mean local rows: 68562 68562 68562 Mean local columns + ghosts: 79171 79171 79171 Mean local entries: 476995 476995 476995 Rows imbalance: 0.029 0.029 0.029 Columns + ghosts imbalance: 0.054 0.054 0.054 entries imbalance 0.033 0.033 0.033 Descent smoother iterations: 1 1 1 Grid level 1: Number of rows: 638711 638711 638711 Number of active ranks: 28 28 28 Mean local rows: 22686 22686 22686 Mean local columns + ghosts: 27786 27786 27786 Mean local entries: 185300 185300 185300 Rows imbalance: 0.036 0.036 0.036 Columns + ghosts imbalance: 0.175 0.175 0.175 entries imbalance 0.246 0.246 0.246 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 2: Number of rows: 213821 213821 213821 Number of active ranks: 28 28 28 Mean local rows: 7432 7432 7432 Mean local columns + ghosts: 9777 9777 9777 Mean local entries: 65001 65001 65001 Rows imbalance: 0.051 0.051 0.051 Columns + ghosts imbalance: 0.162 0.162 0.162 entries imbalance 0.329 0.329 0.329 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 3: Number of rows: 71563 71563 71563 Number of active ranks: 28 28 28 Mean local rows: 2487 2487 2487 Mean local columns + ghosts: 3444 3444 3444 Mean local entries: 27856 27856 27856 Rows imbalance: 0.093 0.093 0.093 Columns + ghosts imbalance: 0.359 0.359 0.359 entries imbalance 0.470 0.470 0.470 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 4: Number of rows: 23800 23800 23800 Number of active ranks: 28 28 28 Mean local rows: 857 857 857 Mean local columns + ghosts: 1458 1458 1458 Mean local entries: 10758 10758 10758 Rows imbalance: 0.134 0.134 0.134 Columns + ghosts imbalance: 0.340 0.340 0.340 entries imbalance 0.345 0.345 0.345 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 5: Number of rows: 8027 8027 8027 Number of active ranks: 28 28 28 Mean local rows: 321 321 321 Mean local columns + ghosts: 654 654 654 Mean local entries: 4436 4436 4436 Rows imbalance: 0.298 0.298 0.298 Columns + ghosts imbalance: 0.414 0.414 0.414 entries imbalance 0.303 0.303 0.303 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 6: Number of rows: 2794 2794 2794 Number of active ranks: 28 28 28 Mean local rows: 140 140 140 Mean local columns + ghosts: 339 339 339 Mean local entries: 1920 1920 1920 Rows imbalance: 0.804 0.804 0.804 Columns + ghosts imbalance: 0.763 0.763 0.763 entries imbalance 0.567 0.567 0.567 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 7: Number of rows: 1042 1042 1042 Number of active ranks: 28 28 28 Mean local rows: 80 80 80 Mean local columns + ghosts: 220 220 220 Mean local entries: 985 985 985 Rows imbalance: 1.553 1.553 1.553 Columns + ghosts imbalance: 1.019 1.019 1.019 entries imbalance 1.054 1.054 1.054 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 8: Number of rows: 445 445 445 Number of active ranks: 28 28 28 Mean local rows: 53 53 53 Mean local columns + ghosts: 152 152 152 Mean local entries: 604 604 604 Rows imbalance: 2.901 2.901 2.901 Columns + ghosts imbalance: 1.525 1.525 1.525 entries imbalance 2.122 2.122 2.122 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 9: Number of rows: 232 232 232 Number of active ranks: 28 28 28 Mean local rows: 27 27 27 Mean local columns + ghosts: 79 79 79 Mean local entries: 285 285 285 Rows imbalance: 4.914 4.914 4.914 Columns + ghosts imbalance: 2.196 2.196 2.196 entries imbalance 4.008 4.008 4.008 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 10: Number of rows: 165 165 165 Number of active ranks: 28 28 28 Mean local rows: 20 20 20 Mean local columns + ghosts: 54 54 54 Mean local entries: 176 176 176 Rows imbalance: 6.636 6.636 6.636 Columns + ghosts imbalance: 3.191 3.191 3.191 entries imbalance 6.287 6.287 6.287 Iterations for solving: 121 1 267 calls time Grid level 0: build: 1224 4.791 descent smoothe: 64288 359.350 restrict: 28899 5.159 prolong: 28899 9.053 Grid level 1: build: 1224 39.994 descent smoothe: 28899 46.039 ascent smoothe: 28899 32.760 restrict: 28899 1.668 prolong: 28899 1.804 Grid level 2: build: 1224 17.870 descent smoothe: 28899 19.041 ascent smoothe: 28899 9.300 restrict: 28899 0.500 prolong: 28899 0.416 Grid level 3: build: 1224 7.611 descent smoothe: 28899 9.034 ascent smoothe: 28899 4.144 restrict: 28899 0.246 prolong: 28899 0.141 Grid level 4: build: 1224 2.844 descent smoothe: 28899 3.868 ascent smoothe: 28899 1.812 restrict: 28899 0.101 prolong: 28899 0.060 Grid level 5: build: 1224 1.267 descent smoothe: 28899 1.823 ascent smoothe: 28899 0.925 restrict: 28899 0.069 prolong: 28899 0.040 Grid level 6: build: 1224 0.586 descent smoothe: 28899 1.057 ascent smoothe: 28899 0.605 restrict: 28899 0.055 prolong: 28899 0.033 Grid level 7: build: 1224 0.347 descent smoothe: 28899 0.804 ascent smoothe: 28899 0.493 restrict: 28899 0.044 prolong: 28899 0.028 Grid level 8: build: 1224 0.237 descent smoothe: 28899 0.716 ascent smoothe: 28899 0.432 restrict: 28899 0.037 prolong: 28899 0.028 Grid level 9: build: 1224 0.185 descent smoothe: 28899 0.723 ascent smoothe: 28899 0.338 restrict: 28899 0.040 prolong: 28899 0.040 Grid level 10: build: 1224 0.384 solve: 28899 43.903 Summary of resolutions for "k" (field id 2) Solver type: Symmetric Gauss-Seidel Number of setups: 1224 Number of calls: 1224 Minimum number of iterations: 1 Maximum number of iterations: 10 Mean number of iterations: 4 Total setup time: 0.543 Total solution time: 17.956 Summary of resolutions for "omega" (field id 3) Solver type: Symmetric Gauss-Seidel Number of setups: 1224 Number of calls: 1224 Minimum number of iterations: 2 Maximum number of iterations: 7 Mean number of iterations: 2 Total setup time: 0.542 Total solution time: 11.426 Summary of resolutions for "TempK" (field id 4) Solver type: Symmetric Gauss-Seidel Number of setups: 0 Number of calls: 0 Minimum number of iterations: 0 Maximum number of iterations: 0 Mean number of iterations: 0 Total setup time: 0.000 Total solution time: 0.000 Number of immediate solve exits: 1224 Summary of resolutions for "Wall distance" (field id 17) Solver type: Flexible Conjugate Gradient Preconditioning: Multigrid Number of setups: 1 Number of calls: 2 Minimum number of iterations: 6 Maximum number of iterations: 17 Mean number of iterations: 11 Total setup time: 0.068 Total solution time: 0.468 Multigrid: V-cycle Coarsening: default Smoother: Symmetric Gauss-Seidel Coarsest level solver: Conjugate Gradient mean minimum maximum Number of levels: 10 10 10 Number of cycles: 1 1 2 calls time Construction: 1 0.132 Resolution: 25 0.386 mean minimum maximum Grid level 0: Number of rows: 1920600 1920600 1920600 Number of active ranks: 28 28 28 Mean local rows: 68562 68562 68562 Mean local columns + ghosts: 79171 79171 79171 Mean local entries: 476995 476995 476995 Rows imbalance: 0.029 0.029 0.029 Columns + ghosts imbalance: 0.054 0.054 0.054 entries imbalance 0.033 0.033 0.033 Descent smoother iterations: 1 1 1 Grid level 1: Number of rows: 639183 639183 639183 Number of active ranks: 28 28 28 Mean local rows: 22702 22702 22702 Mean local columns + ghosts: 27766 27766 27766 Mean local entries: 185433 185433 185433 Rows imbalance: 0.035 0.035 0.035 Columns + ghosts imbalance: 0.175 0.175 0.175 entries imbalance 0.244 0.244 0.244 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 2: Number of rows: 214181 214181 214181 Number of active ranks: 28 28 28 Mean local rows: 7407 7407 7407 Mean local columns + ghosts: 9753 9753 9753 Mean local entries: 64686 64686 64686 Rows imbalance: 0.049 0.049 0.049 Columns + ghosts imbalance: 0.161 0.161 0.161 entries imbalance 0.322 0.322 0.322 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 3: Number of rows: 71337 71337 71337 Number of active ranks: 28 28 28 Mean local rows: 2501 2501 2501 Mean local columns + ghosts: 3484 3484 3484 Mean local entries: 27643 27643 27643 Rows imbalance: 0.085 0.085 0.085 Columns + ghosts imbalance: 0.367 0.367 0.367 entries imbalance 0.456 0.456 0.456 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 4: Number of rows: 23664 23664 23664 Number of active ranks: 28 28 28 Mean local rows: 873 873 873 Mean local columns + ghosts: 1492 1492 1492 Mean local entries: 10721 10721 10721 Rows imbalance: 0.118 0.118 0.118 Columns + ghosts imbalance: 0.332 0.332 0.332 entries imbalance 0.363 0.363 0.363 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 5: Number of rows: 8110 8110 8110 Number of active ranks: 28 28 28 Mean local rows: 341 341 341 Mean local columns + ghosts: 706 706 706 Mean local entries: 4471 4471 4471 Rows imbalance: 0.250 0.250 0.250 Columns + ghosts imbalance: 0.397 0.397 0.397 entries imbalance 0.279 0.279 0.279 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 6: Number of rows: 3033 3033 3033 Number of active ranks: 28 28 28 Mean local rows: 170 170 170 Mean local columns + ghosts: 389 389 389 Mean local entries: 2068 2068 2068 Rows imbalance: 0.588 0.588 0.588 Columns + ghosts imbalance: 0.655 0.655 0.655 entries imbalance 0.501 0.501 0.501 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 7: Number of rows: 1373 1373 1373 Number of active ranks: 28 28 28 Mean local rows: 114 114 114 Mean local columns + ghosts: 270 270 270 Mean local entries: 1167 1167 1167 Rows imbalance: 1.325 1.325 1.325 Columns + ghosts imbalance: 0.930 0.930 0.930 entries imbalance 0.932 0.932 0.932 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 8: Number of rows: 839 839 839 Number of active ranks: 28 28 28 Mean local rows: 90 90 90 Mean local columns + ghosts: 212 212 212 Mean local entries: 817 817 817 Rows imbalance: 2.004 2.004 2.004 Columns + ghosts imbalance: 1.442 1.442 1.442 entries imbalance 1.768 1.768 1.768 Descent smoother iterations: 1 1 1 Ascent smoother iterations: 1 1 1 Grid level 9: Number of rows: 646 646 646 Number of active ranks: 28 28 28 Mean local rows: 72 72 72 Mean local columns + ghosts: 159 159 159 Mean local entries: 595 595 595 Rows imbalance: 2.121 2.121 2.121 Columns + ghosts imbalance: 1.570 1.570 1.570 entries imbalance 2.222 2.222 2.222 Iterations for solving: 110 2 349 calls time Grid level 0: build: 1 0.001 descent smoothe: 45 0.251 restrict: 20 0.004 prolong: 20 0.007 Grid level 1: build: 1 0.034 descent smoothe: 20 0.032 ascent smoothe: 20 0.023 restrict: 20 0.001 prolong: 20 0.001 Grid level 2: build: 1 0.017 descent smoothe: 20 0.013 ascent smoothe: 20 0.006 restrict: 20 0.000 prolong: 20 0.000 Grid level 3: build: 1 0.006 descent smoothe: 20 0.006 ascent smoothe: 20 0.003 restrict: 20 0.000 prolong: 20 0.000 Grid level 4: build: 1 0.003 descent smoothe: 20 0.003 ascent smoothe: 20 0.001 restrict: 20 0.000 prolong: 20 0.000 Grid level 5: build: 1 0.001 descent smoothe: 20 0.001 ascent smoothe: 20 0.001 restrict: 20 0.000 prolong: 20 0.000 Grid level 6: build: 1 0.001 descent smoothe: 20 0.001 ascent smoothe: 20 0.000 restrict: 20 0.000 prolong: 20 0.000 Grid level 7: build: 1 0.000 descent smoothe: 20 0.001 ascent smoothe: 20 0.000 restrict: 20 0.000 prolong: 20 0.000 Grid level 8: build: 1 0.000 descent smoothe: 20 0.000 ascent smoothe: 20 0.000 restrict: 20 0.000 prolong: 20 0.000 Grid level 9: build: 1 0.000 solve: 20 0.029 -------------------------------------------------------------------------------- Mesh entity selections by criteria statistics: entity type evaluations time ----------------------------------------- cells 0 0.00000 interior faces 0 0.00000 boundary faces 1229 0.02364 -------------------------------------------------------------------------------- Writing of "results" (EnSight Gold) summary: Elapsed time for meshes: 0.897 Elapsed time for variables: 9.933 Elapsed time forcing output: 0.000 Writing of "" (time_plot) summary: Elapsed time for meshes: 0.001 Elapsed time for variables: 0.804 Elapsed time forcing output: 0.000 Writing of "joining" (EnSight Gold) summary: Elapsed time for meshes: 0.029 Elapsed time for variables: 0.000 Elapsed time forcing output: 0.000 -------------------------------------------------------------------------------- All-to-many operations: (MPI_Alltoall and MPI_Alltoallv): mean minimum maximum calls Total: 3.57355 s 1.90980 4.73596 s 787 Metadata exchange: 1.15163 s 0.31132 1.82847 s 310 Data exchange: 1.37369 s 0.40750 1.76642 s 467 -------------------------------------------------------------------------------- Code_Saturne IO files read: mesh_input.csm global: 1.42858 s, 2.073 KiB local: 5.15693 s, 339.983 MiB open: 5.35947 s, 2 open(s) Code_Saturne IO files written: checkpoint/auxiliary.csc global: 0.42824 s, 6.188 KiB local: 1.37140 s, 138.912 MiB open: 1.53560 s, 1 open(s) checkpoint/main.csc global: 0.18424 s, 3.697 KiB local: 1.20792 s, 117.224 MiB open: 1.28037 s, 1 open(s) mesh_output.csm global: 0.05370 s, 3.597 KiB local: 3.81380 s, 385.169 MiB open: 3.96157 s, 1 open(s) partition_output/domain_number_28 global: 0.00364 s, 0.500 KiB local: 0.07617 s, 7.327 MiB open: 0.08485 s, 1 open(s) -------------------------------------------------------------------------------- Calculation time summary: User CPU time: 1976.962 s System CPU time: 11.843 s Total CPU time: 55887.922 s Elapsed time: 2008.125 s CPU / elapsed time 0.990 -------------------------------------------------------------------------------- Memory use summary: Total memory used: 15.296 GiB local minimum: 503.125 MiB (rank 4) local maximum: 588.055 MiB (rank 27) Virtual memory used: local minimum: 603.930 MiB (rank 21) local maximum: 614.992 MiB (rank 27) Shared libraries memory used: local minimum: 29.793 MiB (rank 0) local maximum: 29.793 MiB (rank 0) --------------------------------------------------------------------------------