timestamp1576261740001
Secure TensorBoard sessions with Sherlock OnDemand
by Kilian Cavalotti
If you're into machine learning (and who isn't these days?), you probably know all about TensorBoard already. If you don't, TensorBoard is TensorFlow's visualization toolkit. It provides the visualization and tooling needed for machine...
timestamp1575415800001
Adventures in storage
by Kilian Cavalotti
_This is part of our blog series about behind-the-scenes things we do on a regular basis on Sherlock, to keep it up and running in the best possible conditions for our users. Now that Sherlock's old storage system has been retired, we...timestamp1575415800001
A newer, faster and better /scratch
by Kilian Cavalotti
As we just announced, Sherlock now features a brand new storage system for /scratch. But what was the old system, what does the new one look like, and how did the move happen? Read on to find out! The old Since its early days, Sherlock...timestamp1572984000001
More (and easier!) GPU scheduling options
by Kilian Cavalotti
GPU scheduling is now easier and more powerful on Sherlock, with the addition of new job submission options especially targeted at GPU workloads. The most visible change is that you can now use the --gpus option when submitting jobs...
timestamp1568310240001
🎉 Job #50,000,000!
by Kilian Cavalotti
We just wanted to share that Sherlock recently ran job #50,000,000! 🎈🎉 This is a significant milestone since Sherlock, in its current form, started running its first job in January 2017. Fifty million jobs in less than 3 years is no...
timestamp1556922960001
A better view at Sherlock's resources
by Kilian Cavalotti
How many jobs are running? What partitions do I have access to? How many CPUs can I use? Where should I submit my jobs? Any of those sound familiar? We know it's not always easy to navigate the native scheduler tools, their syntax, and...
timestamp1556307720001
When setting an environment variable gives you a 40x speedup
by Kilian Cavalotti
Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...
timestamp1556132100001
Module versions get a facelift
by Kilian Cavalotti
If you're a Sherlock user who often needs to load specific module versions, but don't care or can't remember specific minor version numbers, you're in luck! Starting today, Sherlock allows loading modules via an extended default system...timestamp1553041260001
Out with the old, in with the new!
by Kilian Cavalotti
It's been a little over five years since Sherlock first entered production and ran its first jobs. A lot of time has passed, and with it, Sherlock grew ten-fold, its user base exploded and technology trends evolved significantly. The...