Sherlock changelog

Sherlock changelog

www.sherlock.stanford.edu

SRCF is expanding

by Kilian Cavalotti, Technical Lead & Architect, HPC
Maintenance
In order to bring up a new building that will increase data center capacity, a full SRCF power shutdown is planned for late June 2023. It’s expected to last about a week, and Sherlock will be unavailable during that time.
SRCF is expanding

ClusterShell on Sherlock

by Kilian Cavalotti, Technical Lead & Architect, HPC
Software
New
Ever wondered how your jobs were doing while they were running? Keeping a eye on a log file is nice, but what if you could quickly gather process lists, usage metrics and other data points from all the nodes your multi-node jobs are running
ClusterShell on Sherlock

Keep up to date with software updates

by Kilian Cavalotti, Technical Lead & Architect, HPC
To help users stay on top of software changes on Sherlock, we’ve recently introduced a new software updates RSS feed. It’s available from the Sherlock software list page, and you can directly add it to your RSS reader of choice. And if
Software
Update

Tracking NFS problems down to the SFP level

by Kilian Cavalotti
Blog
Data
Hardware
When NFS problems turn out to be... not NFS problems at all.
Tracking NFS problems down to the SFP level

Sherlock is hard at work against COVID-19

by Kilian Cavalotti
About a month ago, we announced that we were dedicating a portion of Sherlock's computing resources to research projects around COVID-19. Since then, more than 15 PIs and research groups have reached out to share their projects, and...
Blog

Secure TensorBoard sessions with Sherlock OnDemand

by Kilian Cavalotti
Software
Improvement
If you're into machine learning (and who isn't these days?), you probably know all about TensorBoard already. If you don't, TensorBoard is TensorFlow's visualization toolkit. It provides the visualization and tooling needed for machine...
Secure TensorBoard sessions with Sherlock OnDemand

Adventures in storage

by Kilian Cavalotti
_This is part of our blog series about behind-the-scenes things we do on a regular basis on Sherlock, to keep it up and running in the best possible conditions for our users. Now that Sherlock's old storage system has been retired, we...
Blog
Hardware
Data

Next scheduled maintenance: Oct. 16

by Kilian Cavalotti
In order to prepare future improvements of the parallel /scratch file system, as well as performing some required work on the scheduler, Sherlock will not be available during the following times: Wednesday, October 16th, 2019 - from 8...
Maintenance

When setting an environment variable gives you a 40x speedup

by Kilian Cavalotti
Blog
Improvement
Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...
When setting an environment variable gives you a 40x speedup