Both sides previous revision Previous revision | |
abstract:farber [2017-09-05 15:31] – sraskar | abstract:farber [2017-09-07 16:26] (current) – removed sraskar |
---|
====== Farber ====== | |
| |
This page will help you get started using the Farber cluster, UD's second Community Cluster. For general information and specifications about the Farber cluster, visit the [[itrc>farber-cluster|IT Research Computing website]]. To cite the Farber cluster for grants, proposals and publications, use these [[itrc>community-cluster-templates/|HPC templates]]. | |
| |
====== Getting started on Farber ====== | |
| |
===== Accessing Farber ===== | |
| |
You need a [[:clusters:farber:account|Farber account]] to access the login node. For example, [[[:general:userguide:02_access#logging-on-the-cluster| using SSH to connect]] to the Farber login node with account ''traine'', type: | |
| |
<code bash> | |
ssh traine@farber.hpc.udel.edu | |
</code> | |
| |
===== Using Farber ===== | |
| |
Your account is configured as a member of an investing-entity group name (workgroup) which determines access to your group's compute nodes, queues and storage resources on Farber. Setting your workgroup environment is required in order to submit jobs to the Farber cluster. For example, the ''traine'' account is a member of the ''it_css'' workgroup. To start a shell in the ''it_css'' workgroup, type: | |
| |
<code bash> | |
workgroup -g it_css | |
</code> | |
| |
You will need to know [[:general:training#linuxunix1|Unix/Linux]] before using Farber. The [[:general:userguide:start|getting started guide]] will provide the basics about using IT-supported HPC systems, from accessing the cluster to running applications. The [[http://www.udel.edu/it/research/files/cluster/workshop/Farber-HPC-Basics.pdf|Farber HPC Basics]] presentation is an overview about Farber focusing on the differences from a standard Linux system. | |
| |
| |
====== Systems overview ====== | |
===== System information ===== | |
| |
== == | |
[[http://farber.hpc.udel.edu|farber.hpc.udel.edu]] has live resources: system status, job stats, system alerts. | |
| |
[[http://www.hpc.udel.edu/systems/farber|UD IT HPC]] has Farber machine information: attributes including a database of node information, milestones, offline nodes and nodes disabled for maintenance. | |
| |
[[http://farber.hpc.udel.edu/ganglia/|Cluster monitoring]] for Farber uses [[http://ganglia.sourceforge.net/|Ganglia]] to monitor its hardware components. | |
| |
[[http://www.hpc.udel.edu/mantis/default/project_page.php?project_id=4|System alerts]]: Check here first if you are experiencing problems with the cluster. | |
| |
[[:clusters:farber:node-status-notification|Node status notification]] for Farber is an opt-in service notifying you about the status changes on any of your workgroup's nodes. | |
| |
[[http://farber.hpc.udel.edu/jobstats/|Job statistics]]: Check here for the total number of jobs that ended on each day over a range (week, 2 weeks, month, 6 months, year) with an overlay of the total number of jobs which the job scheduler classified as "failed." | |
| |
| |
| |
| |
===== Software ===== | |
| |
* [[http://farber.hpc.udel.edu/software.php|IT-managed software]]: A list of installed software that IT builds and maintains for Farber users. | |
* IT's [[farber:udbuild]] process for building and installing software on the Farber cluster. | |
| |
===== Configuration ==== | |
| |
<box round right width 18em|Farber community cluster overview [available formats]> | |
{{:clusters:farber:overview_large.png?linkonly|[PNG]}} | |
{{:clusters:farber:overview.svg?linkonly|[SVG]}} | |
</box> | |
[[itrc>farber-cluster|{{:clusters:farber:overview.png|Farber community cluster overview}}]] | |
===== Filesystems ===== | |
| |
* [[filesystems| Using Farber's filesystems]] | |
| |
| |
====== Transferring files to/from Farber ====== | |
| |
For general information on file transfer see [[:general:userguide:03_filetransfer|Transferring files]] | |
| |
====== Computing environment ====== | |
| |
For general information see [[:general:userguide:04_compute_environ|Computing environment]] | |
| |
| |
====== Application development ====== | |
There are two 64-bit compiler suites on Farber with Fortran, C and C++: | |
| |
^ Intel | Composer XE | | |
^ GCC | GNU Compiler Collection| | |
| |
In addition, IT has installed OpenJDK (Open Java Development Kit), which can only be used on the compute nodes. | |
| |
<note warning>IT has also installed the Portland Compiler Suite (PGI) at the request of the HPC community since some applications must be compiled with it, however it is not officially supported.</note> | |
| |
Farber is based on Intel (code name "Ivy Bridge"): See [[http://www.intel.com/content/dam/doc/manual/64-ia-32-architectures-optimization-manual.pdf|Intel 64 and IA-32 Architectures Optimization Reference Manual]] | |
and [[https://software.intel.com/en-us/mkl_cookbook|Intel Math Kernel Library Cookbook]]. | |
| |
For general information, see [[:general:userguide:05_development|Application development]] | |
| |
====== Running applications ====== | |
| |
General information about [[general:userguide:06_runtime_environ|running applications]] is applicable to all software. Additional help for specific software may be found on the general [[software:start]] page. | |
| |
Review the [[http://www.nvidia.com/content/PDF/gpu-accelerated-applications.pdf|nVidia'a GPU-Accelerated Applications list]] for applications optimized to work with GPUs. These applications would be able to take advantage of nodes equipped with nVidia Tesla K20X coprocessors. | |
| |
<note important> | |
Use of some commercial software on Mills may require that your research group purchase a right-to-use license (e.g. ANSYS, IDL and COMSOL). | |
</note> | |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
====== Help ====== | |
| |
===== Node status notification ===== | |
Opt-in to Farber [[clusters:farber:node-status-notification|node status notification]] service to receive one email if any of your workgroup's nodes transition from being offline, online or accepting-jobs. | |
| |
===== System problems or can't find an answer on this wiki ===== | |
If you are experiencing a system related problem, first check Farber [[http://farber.hpc.udel.edu/ganglia/|cluster monitoring]] and [[http://www.hpc.udel.edu/mantis/default/project_page.php?project_id=4|system alerts]]. To report a new problem, or you just can't find the help you need on this wiki, then send an e-mail to consult@udel.edu with subject=“Farber Help” and make the first line of the message body be | |
Type=Cluster | |
| |
or submit a [[http://www.udel.edu/deptforms/it/research_computing/index.html|Research Computing Help Request]] specifying ''High-Performance Computing'' and ''Farber cluster'' for the problem details. . | |
===== Ask or tell the HPC community ===== | |
[[https://groups.google.com/a/udel.edu/d/forum/hpc-ask?hl=en-US|hpc-ask]] is a Google group established to stimulate interactions within UD’s broader HPC community and is based on members helping members. This is a great venue to post a question, start a discussion or share an upcoming event with the community. Anyone may request membership. Messages are sent as a daily summary to all group members. This list is archived, public, and searchable by anyone. | |
| |