Sherlock changelog

A new tool to help optimize job resource requirements

by Kilian Cavalotti, Technical Lead & Architect, HPC
It’s not always easy to determine the right amount of resources to request for a computing job. Making sure that the application will have enough resources to run properly, but avoiding over-requests that would make the jobs spend too much
Documentation
Scheduler
Improvement

New Sherlock on-boarding sessions

by Kilian Cavalotti
One of the most requested improvements around Sherlock services, that came out of our recent user survey, was for more documentation and more training. This is why, to help new users get familiar with Sherlock's computing environment...
New
Training

Persistent processes on Sherlock

by Kilian Cavalotti
There are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...
Scheduler
Documentation

Running containers on Sherlock

by Kilian Cavalotti
Documentation
Software
Have you ever wanted to run Docker containers on Sherlock, and skip the hassle of figuring out your application dependencies, installing them, compiling the code, resolving compilation errors, finding missing libraries, or making sure...

MySQL on Sherlock

by Kilian Cavalotti
Have you ever wondered how you could use a database server on Sherlock? Or wanted to run jobs that query data from a SQL database? Or even better, multiple jobs that would interact with the same database? Have you ever wanted to store...
Improvement
Software
Documentation

Spark on Sherlock

by Kilian Cavalotti
Apache Spark is now available on Sherlock, via the spark module: $ ml spark We also added some new documentation and example job scripts, so if you ever needed to run Spark jobs on Sherlock, please take a look at those and let us know...
Improvement
Documentation
Software