Sherlock changelog

www.sherlock.stanford.edu

timestamp1617408000000

3.3 PFlops: Sherlock hits expansion milestone

by Kilian Cavalotti, Technical Lead & Architect, High Performance Computing

Sherlock is a traditional High-Performance Computing cluster in many aspects. But unlike most of similarly-sized clusters where hardware is purchased all at once, and refreshed every few years, it is in constant evolution. Almost like a

3.3 PFlops: Sherlock hits expansion milestone

timestamp1612549200000

Tracking NFS problems down to the SFP level

by Kilian Cavalotti

When NFS problems turn out to be... not NFS problems at all.

Tracking NFS problems down to the SFP level

timestamp1589822580001

New Sherlock on-boarding sessions

by Kilian Cavalotti

One of the most requested improvements around Sherlock services, that came out of our recent user survey, was for more documentation and more training. This is why, to help new users get familiar with Sherlock's computing environment...

timestamp1589227740001

Job #1

by Kilian Cavalotti

If you've been submitting jobs on Sherlock over the last couple days, you probably noticed something different about your your job ids... They lost a couple digits! If you submitted a job last week, its job id was likely in the 67,000...

timestamp1586876640001

Sherlock is hard at work against COVID-19

by Kilian Cavalotti

About a month ago, we announced that we were dedicating a portion of Sherlock's computing resources to research projects around COVID-19. Since then, more than 15 PIs and research groups have reached out to share their projects, and...

timestamp1575415800001

Adventures in storage

by Kilian Cavalotti

_This is part of our blog series about behind-the-scenes things we do on a regular basis on Sherlock, to keep it up and running in the best possible conditions for our users. Now that Sherlock's old storage system has been retired, we...

timestamp1568310240001

🎉 Job #50,000,000!

by Kilian Cavalotti

We just wanted to share that Sherlock recently ran job #50,000,000! 🎈🎉 This is a significant milestone since Sherlock, in its current form, started running its first job in January 2017. Fifty million jobs in less than 3 years is no...

🎉 Job #50,000,000!

timestamp1556307720001

When setting an environment variable gives you a 40x speedup

by Kilian Cavalotti

Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...

When setting an environment variable gives you a 40x speedup

timestamp1541457360001

Persistent processes on Sherlock

by Kilian Cavalotti

There are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...