Sherlock changelog

Easier connection to Sherlock's DTNs

by Kilian Cavalotti
Improvement
Data
We know that easy access to data is essential, and that moving data around is a key part of every user's workflow on Sherlock. We also know that two-factor authentication (2FA) can sometimes get in the way, and hinder the ability to get...

A better view at Sherlock's resources

by Kilian Cavalotti
Scheduler
Improvement
New
How many jobs are running? What partitions do I have access to? How many CPUs can I use? Where should I submit my jobs? Any of those sound familiar? We know it's not always easy to navigate the native scheduler tools, their syntax, and...

When setting an environment variable gives you a 40x speedup

by Kilian Cavalotti
Blog
Improvement
Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...

Next scheduled maintenance: Feb. 5

by Kilian Cavalotti
Sherlock will not be available on Tuesday, February 5th, 2019 from 8:00am to 6:00pm. System maintenance and upgrades will be performed during this time. Access to Sherlock will be unavailable, logins will be disabled and jobs won't run...
Maintenance

Next scheduled maintenance: Nov. 28

by Kilian Cavalotti
Sherlock will not be available on Wednesday, November 28th, 2018 from 8:00am to 6:00pm. System maintenance and upgrades will be performed during this time. Access to Sherlock will be unavailable, logins will be disabled and jobs won't...
Maintenance

Persistent processes on Sherlock

by Kilian Cavalotti
There are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...
Scheduler
Documentation

Running containers on Sherlock

by Kilian Cavalotti
Documentation
Software
Have you ever wanted to run Docker containers on Sherlock, and skip the hassle of figuring out your application dependencies, installing them, compiling the code, resolving compilation errors, finding missing libraries, or making sure...

Better error messages when submitting jobs

by Kilian Cavalotti
Sherlock now offers a better and more complete explanation when a job submission is rejected by the scheduler. What does it look like? In the most common cases, jobs that don't meet the requirements for the partition they're submitted...
Improvement
Scheduler

Hours announced for the SRCF shutdown

by Kilian Cavalotti
Announce
Maintenance
As previously announced, the Stanford Research Computing Facility (SRCF) will undergo major power maintenance over the Labor Day week-end (Sep. 1-3, 2018). Because it's hosted in that datacenter, Sherlock will not be available for login...