Problem when using FEnics in infiniband cluster
7 months ago by
I have some problem when I use FEniCS 2017.1.0 in infiniband cluster in University of Minnesota. I have questions to ask.
The first question: FEniCS work well when I use less than 200 cores in a node-sharing cluster. But when I increase the cores number to 480 cores, the program would be pretty slow in the compilation process. I wonder whether there is any problem with my compilation? I include the file I use to compile in cluster.
The second question: I find there is a waring in formal website of instant and dijitso(OFED-fork safe system call method might be required to avoid crashes on OFED-based (InfiniBand) clusters! If using python 2, installing subprocess32 is recommended.). I have tried both method, but still the program run slow in cluster with 480 cores.
The third question: Is there any big difference between mpich, openmpi and mvapich. I find that mpich3.2 also support infiniband. I wonder whether this would influence the speed of program.
Thank you for your help all the time.
File attached: build-pre.sh (4.87 KB)
File attached: build-dolfin.sh (6.21 KB)
Community: FEniCS Project
Please login to add an answer/comment or follow this question.