Example slurm cluster on your laptop (multiple VMs via vagrant)


To anybody who's considering a switch to modern queuing systems, like slurm, this will be an useful guide. Rather than doing a roll out on production nodes, we'll try things out in vagrant. This text assumes you have vagrant installed on your local machine (it's very easy).

The ultimate aim will be to setup 2 servers (worker nodes) and one master/controller, and run a simple job on them.

There are multiple great guides out there: most of them are out of date, and won't work without some tweaking on Ubuntu 16.04 Xenial.

The entirety of the code is hosted at
https://github.com/jandom/gromacs-slurm-openmpi-vagrant

The README.md file will show you how to set it up, with checks on every step.

References
https://mussolblog.wordpress.com/2013/07/17/setting-up-a-testing-slurm-cluster/
https://github.com/gabrieleiannetti/slurm_cluster_wiki/wiki/Installing-a-Slurm-Cluster
http://philipwfowler.me/2016/04/14/how-to-setup-a-gramble/
https://github.com/dakl/slurm-cluster-vagrant/blob/master/slurm_vagrant_cluster/slurm.conf
https://github.com/mrahtz/mpi-vagrant

Comments

Post a Comment

Popular posts from this blog

React.js – edit and delete comments in CommentBox

It appears customary for high-intelligence, high-skills groups of engineers to "roll their own" whenever they have a chance to. Counter-intuitively to most managerial/MBA types out there, re-inventing the wheel can give you... a better wheel. Success is not guaranteed though – but these people may leave sooner rather than later if you don't let them...

Having looked at number of JS frameworks (ember, backbone, angular) there was no clear winner. They were all a mess, at least to me. So I approached React.js with no hopes – how much better could it possible be? It turns out, a lot!

This post will be an extension of the official React.js tutorial. The tutorial stops at the stage where you can add comments to a dynamic lists, that will grow as you add comments. This falls short of the functionality displayed on facebook: once you add a comment you can edit or delete it, so that's what're going to do. Full disclosure, I only started using React this weekendo so my gu…
Read more

ROCS-like shape overlap in rdkit

Image
One year ago, I gave a brief talk at the RDKit user group meeting in Cambridge. As usual, I ranted about how it would be fantastic to have robust open-source computational chemistry tools. In particular, a commonly used tool from the 80s – gaussian-based shape overlap for pairs of molecules – was only covered by a single open-source package. So, together with help from some friends (big shout out to Greg Landrum, rdkit) I set out to change that. Took almost a year but we're getting there!

The only open-source package doing shape overlap was shape-it from silicos-it. We basically ripped the code out of it and incorporated it into rdkit. The aim was to provide python-scriptable shape-overlap tool. The silicos-it is run by Hans de Winter – big thanks to him – I'm not sure what's going on now but the silicos-it webpage down.

Greg did most (or certainly a _lot_) of work cleaning up the code. Now, we're finally moving towards testing against standard benchmarking sets. Her…
Read more