Sherlock changelog

High priority QOS for owners

by Kilian Cavalotti
Today, we're introducing a new high-priority QOS for owner partitions. In groups which have purchased their own compute nodes on Sherlock, users can now submit jobs to their group partition using the --qos=high_p option: it will give...
Improvement
Scheduler

MySQL on Sherlock

by Kilian Cavalotti
Have you ever wondered how you could use a database server on Sherlock? Or wanted to run jobs that query data from a SQL database? Or even better, multiple jobs that would interact with the same database? Have you ever wanted to store...
Improvement
Software
Documentation

Spark on Sherlock

by Kilian Cavalotti
Apache Spark is now available on Sherlock, via the spark module: $ ml spark We also added some new documentation and example job scripts, so if you ever needed to run Spark jobs on Sherlock, please take a look at those and let us know...
Improvement
Documentation
Software

GPU compute modes

by Sherlock Team
We developed a new extension to allow users to change the compute mode of the GPUs allocated to their jobs. By default, GPUs are set in the "Exclusive Process" mode for best performance and ensure that only one process can use the GPU...
Improvement
New

New login nodes

by Sherlock Team
Two new login nodes, sh-ln03 and sh-ln04 are now available to connect to Sherlock 2.0. They've been added to the load-balanced DNS pool and will automatically be selected according to their load and the number of currently logged-in...
Improvement
Hardware
New

RSS feed

by Sherlock Team
To make it even easier to follow news and updates, the Sherlock Changelog now supports RSS feeds! Just add the following URL to your favorite RSS reader: > https://news.sherlock.stanford.edu/feeds and be sure to never miss an update...
Improvement
Announce

Cron jobs on Sherlock

by Sherlock Team
Cron jobs are not supported on Sherlock, and going forward they won't be allowed anymore. Due to various past incidents, we had to disable the functionality, to prevent runaway cron jobs to take out entire login nodes. Moreover, compute...
Improvement

New $SHERLOCK environment variable

by Sherlock Team
As users start trying out their job submission and application scripts on Sherlock 2.0, we figured it would be useful to easily determine on which platform those scripts are running. So we've added a new $SHERLOCK environment variable...
Improvement
New

New Lustre routers in production

by Sherlock Team
Two new Lustre routers have been put in production on Sherlock 2.0, one to serve /scratch, and the other one to serve /oak. Immediate benefits will be higher availability of the filesystems on Sherlock 2.0 clients, and doubled bandwidth...
Improvement
Hardware