Sherlock changelog

www.sherlock.stanford.edu

timestamp1679706261451

A new tool to help optimize job resource requirements

by Kilian Cavalotti, Technical Lead & Architect, HPC

It’s not always easy to determine the right amount of resources to request for a computing job. Making sure that the application will have enough resources to run properly, but avoiding over-requests that would make the jobs spend too much

timestamp1670036242756

ClusterShell on Sherlock

by Kilian Cavalotti, Technical Lead & Architect, HPC

Ever wondered how your jobs were doing while they were running? Keeping a eye on a log file is nice, but what if you could quickly gather process lists, usage metrics and other data points from all the nodes your multi-node jobs are running

ClusterShell on Sherlock

timestamp1635528575955

Keep up to date with software updates

by Kilian Cavalotti, Technical Lead & Architect, HPC

To help users stay on top of software changes on Sherlock, we’ve recently introduced a new software updates RSS feed. It’s available from the Sherlock software list page, and you can directly add it to your RSS reader of choice. And if

timestamp1612549200000

Tracking NFS problems down to the SFP level

by Kilian Cavalotti

When NFS problems turn out to be... not NFS problems at all.

Tracking NFS problems down to the SFP level

timestamp1586876640001

Sherlock is hard at work against COVID-19

by Kilian Cavalotti

About a month ago, we announced that we were dedicating a portion of Sherlock's computing resources to research projects around COVID-19. Since then, more than 15 PIs and research groups have reached out to share their projects, and...

timestamp1576261740001

Secure TensorBoard sessions with Sherlock OnDemand

by Kilian Cavalotti

If you're into machine learning (and who isn't these days?), you probably know all about TensorBoard already. If you don't, TensorBoard is TensorFlow's visualization toolkit. It provides the visualization and tooling needed for machine...

Secure TensorBoard sessions with Sherlock OnDemand

timestamp1575415800001

Adventures in storage

by Kilian Cavalotti

_This is part of our blog series about behind-the-scenes things we do on a regular basis on Sherlock, to keep it up and running in the best possible conditions for our users. Now that Sherlock's old storage system has been retired, we...

timestamp1556307720001

When setting an environment variable gives you a 40x speedup

by Kilian Cavalotti

Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...

When setting an environment variable gives you a 40x speedup

timestamp1556132100001

Module versions get a facelift

by Kilian Cavalotti

If you're a Sherlock user who often needs to load specific module versions, but don't care or can't remember specific minor version numbers, you're in luck! Starting today, Sherlock allows loading modules via an extended default system...