Sherlock changelog

3.3 PFlops: Sherlock hits expansion milestone

by Kilian Cavalotti, Technical Lead & Architect, High Performance Computing
Hardware
Event
Sherlock is a traditional High-Performance Computing cluster in many aspects. But unlike most of similarly-sized clusters where hardware is purchased all at once, and refreshed every few years, it is in constant evolution. Almost like a

Job #1

by Kilian Cavalotti
If you've been submitting jobs on Sherlock over the last couple days, you probably noticed something different about your your job ids... They lost a couple digits! If you submitted a job last week, its job id was likely in the 67,000...
Event
Scheduler

🎉 Job #50,000,000!

by Kilian Cavalotti
Event
We just wanted to share that Sherlock recently ran job #50,000,000! 🎈🎉 This is a significant milestone since Sherlock, in its current form, started running its first job in January 2017. Fifty million jobs in less than 3 years is no...

Persistent processes on Sherlock

by Kilian Cavalotti
There are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...
Scheduler
Documentation

Running containers on Sherlock

by Kilian Cavalotti
Documentation
Software
Have you ever wanted to run Docker containers on Sherlock, and skip the hassle of figuring out your application dependencies, installing them, compiling the code, resolving compilation errors, finding missing libraries, or making sure...

You can now subscribe to Sherlock news and updates

by Kilian Cavalotti
You can now subscribe to Sherlock news and updates, and automatically receive an email notification when a new post is published here. To subscribe to Sherlock updates, follow the steps below: go to https://news.sherlock.stanford.edu...
Improvement
Update

MySQL on Sherlock

by Kilian Cavalotti
Have you ever wondered how you could use a database server on Sherlock? Or wanted to run jobs that query data from a SQL database? Or even better, multiple jobs that would interact with the same database? Have you ever wanted to store...
Improvement
Software
Documentation

Spark on Sherlock

by Kilian Cavalotti
Apache Spark is now available on Sherlock, via the spark module: $ ml spark We also added some new documentation and example job scripts, so if you ever needed to run Spark jobs on Sherlock, please take a look at those and let us know...
Improvement
Documentation
Software

Tensorflow 1.7.0 now available

by Sherlock Team
Tensorflow 1.7.0, which features TensorRT integration, is now available on Sherlock 2.0. You can load it on Sherlock with: $ ml py-tensorflow/1.7.0_py27 > NB: As with all the other Tensorflow modules on Sherlock, Tensorflow 1.7.0...
Software
Update