Sherlock changelog

More scratch space for everyone!

by Kilian Cavalotti
Announce
Data
Today, we're super excited to announce several major changes to the /scratch filesystem on Sherlock. What's /scratch already? /scratch is Sherlock's temporary, parallel and high-performance filesystem. It's available from all the...

🎉 Job #50,000,000!

by Kilian Cavalotti
Event
We just wanted to share that Sherlock recently ran job #50,000,000! 🎈🎉 This is a significant milestone since Sherlock, in its current form, started running its first job in January 2017. Fifty million jobs in less than 3 years is no...

Easier connection to Sherlock's DTNs

by Kilian Cavalotti
Improvement
Data
We know that easy access to data is essential, and that moving data around is a key part of every user's workflow on Sherlock. We also know that two-factor authentication (2FA) can sometimes get in the way, and hinder the ability to get...

When setting an environment variable gives you a 40x speedup

by Kilian Cavalotti
Blog
Improvement
Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...

Module versions get a facelift

by Kilian Cavalotti
If you're a Sherlock user who often needs to load specific module versions, but don't care or can't remember specific minor version numbers, you're in luck! Starting today, Sherlock allows loading modules via an extended default system...
Improvement
Software

Out with the old, in with the new!

by Kilian Cavalotti
It's been a little over five years since Sherlock first entered production and ran its first jobs. A lot of time has passed, and with it, Sherlock grew ten-fold, its user base exploded and technology trends evolved significantly. The...
Hardware
Announce

New GPU node available on Sherlock

by Kilian Cavalotti
New
Hardware
There's a new GPU node in the gpu partition! It's notable for a list of reasons. This is the first node on Sherlock to feature both: the latest generation of Intel CPUs (Skylake), the latest generation of computing-optimized NVIDIA GPUs...

Sherlock goes container-native

by Kilian Cavalotti
Software
Improvement
Announce
In recognition of the fast-moving software landscape and the emerging needs of our users, we're pleased to announce, from the SC18 Supercomputing conference in Dallas, TX, that Sherlock is going container-native. Starting today, users...

Persistent processes on Sherlock

by Kilian Cavalotti
There are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...
Scheduler
Documentation