Shared Storage with NFS and SSHFS
HPC systems require shared filesystems to function effectively. Two really good choices for both small and large systems are NFS and SSHFS.
Environment Modules Using Lmod
The indispensable Lmod high-performance computing tool allows users to control their build and execution environment.
pdsh Parallel Shell
The pdsh parallel shell tool lets you run a command across multiple nodes in a cluster.
Building Containers with HPC Container Maker
Building HPC applications for production systems is never easy, especially when containers are involved, but with Python and HPC Container Maker, you can describe the container you want quickly and easily without having to worry about the details.
pyamgx – Accelerated Python Library
Sometimes your Python programs need a little more speed. The pyamgx library can help you speed up your Python code.
Autonomous File Recovery
Let users recover a deleted file without admin intervention by aliasing the rm command with mv or by writing your own script that moves the data to another location.
Linux I/O Schedulers
The Linux kernel has several I/O schedulers that can greatly influence performance. We take a quick look at I/O scheduler concepts and the options that exist within Linux.
What to Do with System Data: Think Like a Vegan
What do you do with all of the HPC data you harvested as a lumberjack? You think like a Vegan.
Log Everything
To be a good HPC system administrator for today’s environment, you need to be a lumberjack.
HPC Compilers
If you compile software on an expensive supercomputer, its a good idea to select the languages and compilers with particular care. We report on tried-and-proved tools used on SuperMUC, a supercomputer at the Leibniz Supercomputing Center in Germany.