timestamp1575415800001
More scratch space for everyone!
by Kilian Cavalotti
Today, we're super excited to announce several major changes to the /scratch filesystem on Sherlock. What's /scratch already? /scratch is Sherlock's temporary, parallel and high-performance filesystem. It's available from all the...
timestamp1572984000001
More (and easier!) GPU scheduling options
by Kilian Cavalotti
GPU scheduling is now easier and more powerful on Sherlock, with the addition of new job submission options especially targeted at GPU workloads. The most visible change is that you can now use the --gpus option when submitting jobs...
timestamp1560469140001
Easier connection to Sherlock's DTNs
by Kilian Cavalotti
We know that easy access to data is essential, and that moving data around is a key part of every user's workflow on Sherlock. We also know that two-factor authentication (2FA) can sometimes get in the way, and hinder the ability to get...
timestamp1556922960001
A better view at Sherlock's resources
by Kilian Cavalotti
How many jobs are running? What partitions do I have access to? How many CPUs can I use? Where should I submit my jobs? Any of those sound familiar? We know it's not always easy to navigate the native scheduler tools, their syntax, and...
timestamp1556307720001
When setting an environment variable gives you a 40x speedup
by Kilian Cavalotti
Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...
timestamp1553041260001
Out with the old, in with the new!
by Kilian Cavalotti
It's been a little over five years since Sherlock first entered production and ran its first jobs. A lot of time has passed, and with it, Sherlock grew ten-fold, its user base exploded and technology trends evolved significantly. The...timestamp1550277300001
New GPU node available on Sherlock
by Kilian Cavalotti
There's a new GPU node in the gpu partition! It's notable for a list of reasons. This is the first node on Sherlock to feature both: the latest generation of Intel CPUs (Skylake), the latest generation of computing-optimized NVIDIA GPUs...
timestamp1541457360001
Persistent processes on Sherlock
by Kilian Cavalotti
There are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...timestamp1537307580001
Better error messages when submitting jobs
by Kilian Cavalotti
Sherlock now offers a better and more complete explanation when a job submission is rejected by the scheduler. What does it look like? In the most common cases, jobs that don't meet the requirements for the partition they're submitted...