Persistent processes on Sherlock
by Kilian CavalottiThere are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...
Running containers on Sherlock
by Kilian CavalottiHave you ever wanted to run Docker containers on Sherlock, and skip the hassle of figuring out your application dependencies, installing them, compiling the code, resolving compilation errors, finding missing libraries, or making sure...
You can now subscribe to Sherlock news and updates
by Kilian CavalottiYou can now subscribe to Sherlock news and updates, and automatically receive an email notification when a new post is published here. To subscribe to Sherlock updates, follow the steps below: go to https://news.sherlock.stanford.edu...
MySQL on Sherlock
by Kilian CavalottiHave you ever wondered how you could use a database server on Sherlock? Or wanted to run jobs that query data from a SQL database? Or even better, multiple jobs that would interact with the same database? Have you ever wanted to store...
Spark on Sherlock
by Kilian CavalottiApache Spark is now available on Sherlock, via the spark module: $ ml spark We also added some new documentation and example job scripts, so if you ever needed to run Spark jobs on Sherlock, please take a look at those and let us know...
Tensorflow 1.7.0 now available
by Sherlock TeamTensorflow 1.7.0, which features TensorRT integration, is now available on Sherlock 2.0. You can load it on Sherlock with: $ ml py-tensorflow/1.7.0_py27 > NB: As with all the other Tensorflow modules on Sherlock, Tensorflow 1.7.0...
Sherlock 2.0 limits increased
by Sherlock TeamWe started migrating compute nodes from Sherlock 1.0 to Sherlock 2.0, as part of the 2nd phase of the transition process described in the Sherlock 2.0 transition guide. That means that more nodes are now available on Sherlock 2.0, in...
Slurm version update
by Sherlock TeamSlurm has been updated to version 17.02.7. Full changelog is available here
by Sherlock TeamSlurm has been updated to version 17.02.5. The full changelog is available here. Of particular interest is a fix for a problem that affected users submitting jobs to multiple partitions on Sherlock 2.0, and who could receive errors...