PBS job queue creation

From Notes_Wiki
Revision as of 08:54, 8 July 2022 by Saurabh (talk | contribs) (Created page with "Home > CentOS > CentOS 7.x > CentOS 7.x Rocks cluster 7.0 > PBS job queue creation =Adding compute or execution nodes to PBS queue management= To Add the nodes in pbs login to master node and use: <pre> qmgr create node master create node compute-0-0 create node compute-0-1 quit </pre> * On each and every node ensure that *:<pre> *:: ping <master-hostname> (eg ping rocks) *:</pre> *: results in master private IP and not public IP. In...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Home > CentOS > CentOS 7.x > CentOS 7.x Rocks cluster 7.0 > PBS job queue creation

Adding compute or execution nodes to PBS queue management

To Add the nodes in pbs login to master node and use:

qmgr

create node master
create node compute-0-0
create node compute-0-1
quit
  • On each and every node ensure that
    ping <master-hostname> (eg ping rocks)
    results in master private IP and not public IP. In case of rocks cluster we might have to edit /etc/hosts on client for this to happen.

After adding the node, restart the pbs service in all nodes (Master + All compute nodes)

/root/restart-pbs.sh

#Repeat below for all compute nodes
ssh compute-0-0 "systemctl restart pbs"    


Looking at PBS nodes information

  • List of all nodes present in PBS
    pbsnodes -a
    For working setup, In the output, state should be free and able to see the resources.
  • To get details of all nodes and vnodes
    pbsnodes -av
  • To get specific node or vnode information
    pbsnodes <node-or-vnode-name>
    For example
    pbsnodes compute-0-0


Create job queue for submitting jobs

  1. Login to master server
  2. Create execution queue
    qmgr -c "create queue nongpu queue_type=execution"
    qmgr -c "set queue nongpu started=true"
    qmgr -c "set queue nongpu enabled=true"
    qmgr -c "set queue nongpu resources_default.nodes=1"
    qmgr -c "set queue nongpu resources_default.walltime=3600"
  3. Set server default queue
    qmgr -c "set server default_queue = nongpu"
  4. Enable the scheduling
    qmgr -c "set server scheduling=true"
  5. Enable job history
    qmgr -c "set server job_history_enable=true"
  6. We can see the list of all parameters and their values using:
    qmgr -c "print server"

Refer:


Enable jobs submission as root user

By default Jobs cannot be submitted by root user. To submit jobs as root, please run the below command:

qmgr -c “set server acl_roots=root”


Home > CentOS > CentOS 7.x > CentOS 7.x Rocks cluster 7.0 > PBS job queue creation