Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Most usage is centered around a dozen or so commands:

ls, more, less, cat, nano, pwd, cd, man, bsub, bkill, bjobs, ps, scp, ssh, cp, chmod, rm, mkdir, passwd, history, zip, unzip, tar, df, du, head, tail, grep

 

See the man pages for complete documentation. Here is a short description of some.

...

What text editors are available?

nano, nedit, vi, vim, emacs

 

How do I strip out ^M embedded characters in my files I transferred from my PC?

Use the dos2unix command on the file. There is man page documentation available for further info.  Also check this page  for additional tips.

> man dos2unix


What is a man page?

man pages are linux/unix style text based documentation. For example, to obtain documentation on the command cat:

...

How can I verify that my requested storage is mounted?
Use the df command.

How can I view my most recent files?

> ls -lt 

 

I sometime notice that my job duration can vary when I rerun a program with exactly the same inputs, condition, etc... Why?
The cluster has a mix of several different Intel CPUs and motherboard combinations. The absolute performance potential is similar among them but given the mix of other jobs sharing nodes, your results will vary. This is not something that is predictable when the cluster is well loaded.

...

Issue the following in the directory of interest:

> find . -name "A-Z" | cut -c 3- - | awk '{print $1,tolower($1)}' | xargs -i echo "mv {}" | csh

 

This will find everything with uppercase letters and rename it to the
same thing with all lowercase.

How do I uncompress and extract many .gz and corresponding tar files?

> ls -1 *.gz | xargs -n 1 -r -I {} tar zxf {}


Sometimes I get a cryptic message about too many open files, what is that?
There are several resource settings associated with a default account. To see the settings:

...

Since jobs execute on compute nodes you should include this in a simple shell script along with your sbatch command, so that the new setting takes effect on the compute node as well.

Sometimes I would like to have multiple shells available on the login node, how to proceeddo I do this?

There are many ways. Most often you may just login two or more times from your desktop.  Do not Or, refer to the slurm section with examples using srun. 

It is best not to ssh into the cluster while you are on the login node of the  cluster.

 

I compiled a program locally in my account and I would like to add the location of the executables to my PATH, how do I do this?

Suppose your software directory is located in you home directory and your username is jdoe02.  Your software directory is flight_program/  and there is a bin subdirectory  located within containing executables.

$PATH is a global environmental variable defined for the cluster  for general access to important locations.  You may add to it by pre-pending the path you wish to be searched.

PATH=/cluster/home/j/d/jdoe02/flight_program/bin:$PATH

export PATH

To see if it got updated:

> printenv  | grep  PATH