User Guide
Logging on to the system
ssh $USER@derecho.hpc.ucar.edu
Queues
Ben Kirk posted to Slack to use the following command to test queue access:
qcmd -l select=2:ncpus=128:mpiprocs=128:mem=200G -A A####### -l walltime=0:05:00 -- "date && hostname"
Waiting on job launch; 1230726.desched1 with qsub arguments:
qsub -l select=2:ncpus=128:mpiprocs=128:mem=200G -A A####### -q main@desched1 -l walltime=0:05:00
Thu 15 Jun 2023 10:45:21 PM MDT
dec0476
This command gives an overview of the queues:
qstat -Qf
MPI Job Example
#!/bin/bash
#PBS -A project_code
#PBS -N mpi_job
#PBS -q main
#PBS -l walltime=01:00:00
#PBS -l select=2:ncpus=128:mpiprocs=128
# load necessary module environment
module purge
module load ncarenv craype cce cray-mpich
# Run application using cray-mpich MPI
mpiexec -n 256 -ppn 128 ./executable_name