Sherlock changelog

When setting an environment variable gives you a 40x speedup

by Kilian Cavalotti
Blog
Improvement
Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...

Persistent processes on Sherlock

by Kilian Cavalotti
There are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...
Scheduler
Documentation

Better error messages when submitting jobs

by Kilian Cavalotti
Sherlock now offers a better and more complete explanation when a job submission is rejected by the scheduler. What does it look like? In the most common cases, jobs that don't meet the requirements for the partition they're submitted...
Improvement
Scheduler

You can now subscribe to Sherlock news and updates

by Kilian Cavalotti
You can now subscribe to Sherlock news and updates, and automatically receive an email notification when a new post is published here. To subscribe to Sherlock updates, follow the steps below: go to https://news.sherlock.stanford.edu...
Improvement
Update

High priority QOS for owners

by Kilian Cavalotti
Today, we're introducing a new high-priority QOS for owner partitions. In groups which have purchased their own compute nodes on Sherlock, users can now submit jobs to their group partition using the --qos=high_p option: it will give...
Improvement
Scheduler

Tensorflow 1.7.0 now available

by Sherlock Team
Tensorflow 1.7.0, which features TensorRT integration, is now available on Sherlock 2.0. You can load it on Sherlock with: $ ml py-tensorflow/1.7.0_py27 > NB: As with all the other Tensorflow modules on Sherlock, Tensorflow 1.7.0...
Software
Update

Sherlock 2.0 limits increased

by Sherlock Team
We started migrating compute nodes from Sherlock 1.0 to Sherlock 2.0, as part of the 2nd phase of the transition process described in the Sherlock 2.0 transition guide. That means that more nodes are now available on Sherlock 2.0, in...
Update

Slurm version update

by Sherlock Team
Slurm has been updated to version 17.02.7. Full changelog is available here
Update

Slurm update

by Sherlock Team
Slurm has been updated to version 17.02.5. The full changelog is available here. Of particular interest is a fix for a problem that affected users submitting jobs to multiple partitions on Sherlock 2.0, and who could receive errors...
Update