Apache Spark is now available on Sherlock, via the spark module:

$ ml spark

We also added some new documentation and example job scripts, so if you ever needed to run Spark jobs on Sherlock, please take a look at those and let us know how it works for you.