Sherlock changelog

www.sherlock.stanford.edu

Back to job #1, thrice

by Kilian Cavalotti, Technical Lead & Architect, HPC

Not once, not twice, but three times! For the third time in Sherlock’s history, the Slurm job ID counter was reset over the weekend, and went from job #67,043,327 all the way back to job #1! JobIDRaw Partition

Introducing a new service partition on Sherlock

by Kilian Cavalotti, Technical Lead & Architect, HPC

We’re very pleased to introduce a new service partition on Sherlock, specially designed to run non-computational management and administrative tasks. Jobs like data transfer tasks, backups, CI/CD pipelines, workflow managers, or

Introducing a new service partition on Sherlock

Final hours announced for the June 2023 SRCF downtime

by Kilian Cavalotti, Technical Lead & Architect, HPC

As previously announced, the Stanford Research Computing Facility (SRCF), where Sherlock is hosted, will be powered off during the last week of June, in order to safely bring up power to the new SRCF2 datacenter. Sherlock will not be

Final hours announced for the June 2023 SRCF downtime

A new tool to help optimize job resource requirements

by Kilian Cavalotti, Technical Lead & Architect, HPC

It’s not always easy to determine the right amount of resources to request for a computing job. Making sure that the application will have enough resources to run properly, but avoiding over-requests that would make the jobs spend too much

SRCF is expanding

by Kilian Cavalotti, Technical Lead & Architect, HPC

The Stanford Research Computing Facility (SRCF), where Sherlock is hosted, has been a highly effective data center since its opening in January of 2014, and demand has grown so much that we’re expanding it! Another identical building

SRCF is expanding

Job #1, again!

by Kilian Cavalotti, Technical Lead & Architect, HPC

This is not the first time, we’ve been through this already (not so long ago, actually) but today, the Slurm job id counter was reset and went from job #67043327 back to job #1. JobID Partition Start ------------

A new interactive step in Slurm

by Kilian Cavalotti, Technical Lead & Architect, HPC

A new version of the sh_dev tool has been released, that leverages a recently-added Slurm feature. Slurm 20.11 introduced a new“interactive step”, designed to be used with salloc to automatically launch a terminal on an allocated compute

Job #1

by Kilian Cavalotti

If you’ve been submitting jobs on Sherlock over the last couple days, you probably noticed something different about your your job ids… They lost a couple digits! If you submitted a job last week, its job id was likely in the 67,000,000s.

More (and easier!) GPU scheduling options

by Kilian Cavalotti

GPU scheduling is now easier and more powerful on Sherlock, with the addition of new job submission options especially targeted at GPU workloads. The most visible change is that you can now use the --gpus option when submitting jobs, like

More (and easier!) GPU scheduling options

Newer