Difference between revisions of "PBS job queue creation"

From Notes_Wiki
(Created page with "Home > CentOS > CentOS 7.x > CentOS 7.x Rocks cluster 7.0 > PBS job queue creation =Adding compute or execution nodes to PBS queue management= To Add the nodes in pbs login to master node and use: <pre> qmgr create node master create node compute-0-0 create node compute-0-1 quit </pre> * On each and every node ensure that *:<pre> *:: ping <master-hostname> (eg ping rocks) *:</pre> *: results in master private IP and not public IP. In...")
 
m
 
Line 39: Line 39:
*:: pbsnodes -av
*:: pbsnodes -av
*:</pre>
*:</pre>
To get only state information for all nodes, we can filter for state and node name via grep:
<pre>
pbsnodes -a | grep '^[^ ]\|state' | grep -v last
</pre>


* To get specific node or vnode information
* To get specific node or vnode information

Latest revision as of 04:33, 18 April 2023

Home > CentOS > CentOS 7.x > CentOS 7.x Rocks cluster 7.0 > PBS job queue creation

Adding compute or execution nodes to PBS queue management

To Add the nodes in pbs login to master node and use:

qmgr

create node master
create node compute-0-0
create node compute-0-1
quit
  • On each and every node ensure that
    ping <master-hostname> (eg ping rocks)
    results in master private IP and not public IP. In case of rocks cluster we might have to edit /etc/hosts on client for this to happen.

After adding the node, restart the pbs service in all nodes (Master + All compute nodes)

/root/restart-pbs.sh

#Repeat below for all compute nodes
ssh compute-0-0 "systemctl restart pbs"    


Looking at PBS nodes information

  • List of all nodes present in PBS
    pbsnodes -a
    For working setup, In the output, state should be free and able to see the resources.
  • To get details of all nodes and vnodes
    pbsnodes -av

To get only state information for all nodes, we can filter for state and node name via grep:

pbsnodes -a | grep '^[^ ]\|state' | grep -v last
  • To get specific node or vnode information
    pbsnodes <node-or-vnode-name>
    For example
    pbsnodes compute-0-0


Create job queue for submitting jobs

  1. Login to master server
  2. Create execution queue
    qmgr -c "create queue nongpu queue_type=execution"
    qmgr -c "set queue nongpu started=true"
    qmgr -c "set queue nongpu enabled=true"
    qmgr -c "set queue nongpu resources_default.nodes=1"
    qmgr -c "set queue nongpu resources_default.walltime=3600"
  3. Set server default queue
    qmgr -c "set server default_queue = nongpu"
  4. Enable the scheduling
    qmgr -c "set server scheduling=true"
  5. Enable job history
    qmgr -c "set server job_history_enable=true"
  6. We can see the list of all parameters and their values using:
    qmgr -c "print server"

Refer:


Enable jobs submission as root user

By default Jobs cannot be submitted by root user. To submit jobs as root, please run the below command:

qmgr -c “set server acl_roots=root”


Home > CentOS > CentOS 7.x > CentOS 7.x Rocks cluster 7.0 > PBS job queue creation