Sherlock changelog

Sherlock changelog

www.sherlock.stanford.edu

A new tool to help optimize job resource requirements

by Kilian Cavalotti, Technical Lead & Architect, HPC
It’s not always easy to determine the right amount of resources to request for a computing job. Making sure that the application will have enough resources to run properly, but avoiding over-requests that would make the jobs spend too much
Documentation
Scheduler
Improvement

ClusterShell on Sherlock

by Kilian Cavalotti, Technical Lead & Architect, HPC
Software
New
Ever wondered how your jobs were doing while they were running? Keeping a eye on a log file is nice, but what if you could quickly gather process lists, usage metrics and other data points from all the nodes your multi-node jobs are running
ClusterShell on Sherlock

Keep up to date with software updates

by Kilian Cavalotti, Technical Lead & Architect, HPC
To help users stay on top of software changes on Sherlock, we’ve recently introduced a new software updates RSS feed. It’s available from the Sherlock software list page, and you can directly add it to your RSS reader of choice. And if
Software
Update

Tracking NFS problems down to the SFP level

by Kilian Cavalotti
Blog
Data
Hardware
When NFS problems turn out to be... not NFS problems at all.
Tracking NFS problems down to the SFP level

Sherlock facts

by Kilian Cavalotti
Data
Improvement
Ever wondered how many compute nodes is Sherlock made of? Or how many users are using it? Or how many Infiniband cables link it all together? Well, wonder no more: head to the Sherlock facts page and see for yourself! > hint: there are...
Sherlock facts

Secure TensorBoard sessions with Sherlock OnDemand

by Kilian Cavalotti
Software
Improvement
If you're into machine learning (and who isn't these days?), you probably know all about TensorBoard already. If you don't, TensorBoard is TensorFlow's visualization toolkit. It provides the visualization and tooling needed for machine...
Secure TensorBoard sessions with Sherlock OnDemand

Adventures in storage

by Kilian Cavalotti
_This is part of our blog series about behind-the-scenes things we do on a regular basis on Sherlock, to keep it up and running in the best possible conditions for our users. Now that Sherlock's old storage system has been retired, we...
Blog
Hardware
Data

A newer, faster and better /scratch

by Kilian Cavalotti
As we just announced, Sherlock now features a brand new storage system for /scratch. But what was the old system, what does the new one look like, and how did the move happen? Read on to find out! The old Since its early days, Sherlock...
Data
Hardware
New

More scratch space for everyone!

by Kilian Cavalotti
Announce
Data
Today, we're super excited to announce several major changes to the /scratch filesystem on Sherlock. What's /scratch already? /scratch is Sherlock's temporary, parallel and high-performance filesystem. It's available from all the...
More scratch space for everyone!