Sherlock changelog

When setting an environment variable gives you a 40x speedup

by Kilian Cavalotti
Blog
Improvement
Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...

Out with the old, in with the new!

by Kilian Cavalotti
It's been a little over five years since Sherlock first entered production and ran its first jobs. A lot of time has passed, and with it, Sherlock grew ten-fold, its user base exploded and technology trends evolved significantly. The...
Hardware
Announce

Sherlock OnDemand

by Kilian Cavalotti
New
Announce
Today, we're announcing Sherlock OnDemand, a brand new way to use the Sherlock cluster. Hot on the heels of the SC18 Supercomputing Conference, and right in time for the long Thanksgiving week-end, we thought that a good way to thank...

Sherlock goes container-native

by Kilian Cavalotti
Software
Improvement
Announce
In recognition of the fast-moving software landscape and the emerging needs of our users, we're pleased to announce, from the SC18 Supercomputing conference in Dallas, TX, that Sherlock is going container-native. Starting today, users...

Persistent processes on Sherlock

by Kilian Cavalotti
There are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...
Scheduler
Documentation

Running containers on Sherlock

by Kilian Cavalotti
Documentation
Software
Have you ever wanted to run Docker containers on Sherlock, and skip the hassle of figuring out your application dependencies, installing them, compiling the code, resolving compilation errors, finding missing libraries, or making sure...

Better error messages when submitting jobs

by Kilian Cavalotti
Sherlock now offers a better and more complete explanation when a job submission is rejected by the scheduler. What does it look like? In the most common cases, jobs that don't meet the requirements for the partition they're submitted...
Improvement
Scheduler

Hours announced for the SRCF shutdown

by Kilian Cavalotti
Announce
Maintenance
As previously announced, the Stanford Research Computing Facility (SRCF) will undergo major power maintenance over the Labor Day week-end (Sep. 1-3, 2018). Because it's hosted in that datacenter, Sherlock will not be available for login...

High priority QOS for owners

by Kilian Cavalotti
Today, we're introducing a new high-priority QOS for owner partitions. In groups which have purchased their own compute nodes on Sherlock, users can now submit jobs to their group partition using the --qos=high_p option: it will give...
Improvement
Scheduler