Enter ClusterShell, the best parallel shell application (and library!) of its kind.
With ClusterShell on Sherlock, you can quickly run a command on all the nodes your job is running on, to gather information about your applications and processes, in real time, and gather live output without having to wait for your job to end to see how it did. And with its tight integration with the job scheduler, no need to fiddle with manual node lists anymore, all it needs is a job id!
You allocated a few nodes in an interactive session and want to distribute some files on each node’s local storage devices? Check: ClusterShell has a copy mode just for this.
Want to double-check that your processes are correctly laid out? Check: you can run a quick command to check the process tree across the nodes allocated to your job with:
$ clush -w @job:$JOBID pstree -au $USERand verify that all your processes are running correctly.
You’ll find more details and examples in our Sherlock documentation, at https://www.sherlock.stanford.edu/docs/software/using/clustershell
Questions, ideas, or suggestions? Don’t hesitate to reach out to [email protected] to let us know!
Enter ClusterShell, the best parallel shell application (and library!) of its kind.
With ClusterShell on Sherlock, you can quickly run a command on all the nodes your job is running on, to gather information about your applications and processes, in real time, and gather live output without having to wait for your job to end to see how it did. And with its tight integration with the job scheduler, no need to fiddle with manual node lists anymore, all it needs is a job id!
You allocated a few nodes in an interactive session and want to distribute some files on each node’s local storage devices? Check: ClusterShell has a copy mode just for this.
Want to double-check that your processes are correctly laid out? Check: you can run a quick command to check the process tree across the nodes allocated to your job with:
$ clush -w @job:$JOBID pstree -au $USERand verify that all your processes are running correctly.
You’ll find more details and examples in our Sherlock documentation, at https://www.sherlock.stanford.edu/docs/software/using/clustershell
Questions, ideas, or suggestions? Don’t hesitate to reach out to [email protected] to let us know!
It’s available from the Sherlock software list page, and you can directly add it to your RSS reader of choice.
And if you’re already following our Slack channels, you can subscribe to the new #sherlock-software-updates channel to get automatically notified of new software updates on Sherlock, directly from Slack.
Happy computing! And as usual, please feel free to reach out if you have comments or questions.]]>
It’s available from the Sherlock software list page, and you can directly add it to your RSS reader of choice.
And if you’re already following our Slack channels, you can subscribe to the new #sherlock-software-updates channel to get automatically notified of new software updates on Sherlock, directly from Slack.
Happy computing! And as usual, please feel free to reach out if you have comments or questions.]]>