over 5 years ago
A better view at Sherlock's resources
by Kilian Cavalotti
How many jobs are running? What partitions do I have access to? How many CPUs can I use? Where should I submit my jobs? Any of those sound familiar? We know it's not always easy to navigate the native scheduler tools, their syntax, and...over 5 years ago
When setting an environment variable gives you a 40x speedup
by Kilian Cavalotti
Today, we'd like to share some of our recent work on Sherlock that allowed a pretty significant speedup when listing files in directories with a lot of entries. > Unlike our usual announcements, this post is more of a behind-the-scenes...almost 6 years ago
Out with the old, in with the new!
by Kilian Cavalotti
It's been a little over five years since Sherlock first entered production and ran its first jobs. A lot of time has passed, and with it, Sherlock grew ten-fold, its user base exploded and technology trends evolved significantly. The...about 6 years ago
Sherlock OnDemand
by Kilian Cavalotti
Today, we're announcing Sherlock OnDemand, a brand new way to use the Sherlock cluster. Hot on the heels of the SC18 Supercomputing Conference, and right in time for the long Thanksgiving week-end, we thought that a good way to thank...about 6 years ago
Sherlock goes container-native
by Kilian Cavalotti
Software
Improvement
Announce
In recognition of the fast-moving software landscape and the emerging needs of our users, we're pleased to announce, from the SC18 Supercomputing conference in Dallas, TX, that Sherlock is going container-native. Starting today, users...about 6 years ago
Persistent processes on Sherlock
by Kilian Cavalotti
There are many cases where having a persistent process (or service) running alongside computing jobs is of great benefit. For instance, when data is stored in a database format to allow for highly efficient queries, jobs that want to...over 6 years ago
Better error messages when submitting jobs
by Kilian Cavalotti
Sherlock now offers a better and more complete explanation when a job submission is rejected by the scheduler. What does it look like? In the most common cases, jobs that don't meet the requirements for the partition they're submitted...over 6 years ago
Hours announced for the SRCF shutdown
by Kilian Cavalotti
As previously announced, the Stanford Research Computing Facility (SRCF) will undergo major power maintenance over the Labor Day week-end (Sep. 1-3, 2018). Because it's hosted in that datacenter, Sherlock will not be available for login...over 6 years ago
High priority QOS for owners
by Kilian Cavalotti
Today, we're introducing a new high-priority QOS for owner partitions. In groups which have purchased their own compute nodes on Sherlock, users can now submit jobs to their group partition using the --qos=high_p option: it will give...