Difference between revisions of "Ubuntu HPC Setup PBS master on master node"

From Notes_Wiki
 
m
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
[[Main Page|Home]] > [[Ubuntu]] > [[Ubuntu HPC setup with openpbs and openmpi|HPC setup with openpbs and openmpi]] > [[Ubuntu HPC Setup PBS master on master node|Setup PBS master on master node]]
[[Main Page|Home]] > [[Ubuntu]] > [[Ubuntu HPC setup with openpbs and openmpi|HPC setup with openpbs and openmpi]] > [[Ubuntu HPC Setup PBS master on master node|Setup PBS master on master node]]
To setup OpenPBS master on HPC master node use following steps:
#Install postgresql
#:<pre>
#:: apt install postgresql postgresql-server-dev-all postgresql-contrib
#:</pre>
#Download and install PBS using: <source type="shell">
cd /export/apps/temp
wget https://github.com/openpbs/openpbs/releases/download/v20.0.1/openpbs_20.0.1.ubuntu_1804.zip
unzip openpbs_20.0.1.ubuntu_1804.zip
cd /export/apps/temp/openpbs_20.0.1.ubuntu_1804/
dpkg -i openpbs-server_20.0.1-1_amd64.deb
</source>
#Edit '<tt>/etc/pbs.conf</tt>' file should be look like below: <source type="shell">
PBS_EXEC=/opt/pbs
PBS_SERVER=<master-hostname>
PBS_START_SERVER=1
PBS_START_SCHED=1
PBS_START_COMM=1
PBS_START_MOM=0
PBS_HOME=/var/spool/pbs
PBS_CORE_LIMIT=unlimited
PBS_SCP=/bin/scp
PBS_LEAF_NAME=<master-hostname>
</source>
#: Here '<tt>PBS_START_MOM=0</tt>' and not having master in nodes list (Point below) ensures that jobs execute only on compute nodes.  If we want jobs to execute on master node then we should have '<tt>PBS_START_MOM=1</tt>' and also master should be part of node list '<tt>/var/spool/pbs/server_priv/nodes</tt>'.
#Set the environment
#:<pre>
#::source /etc/profile.d/pbs.sh
#::source /etc/pbs.conf
#:</pre>
#Enter master hostname in /var/spool/pbs/mom_priv/config file
#:<pre>
#::$clienthost <rocks-master-hostname>      //Ex: master
#:</pre>
#In pbs server, needs to specify all the compute/gpu nodes in /var/spool/pbs/server_priv/nodes
#:<pre>
#::node1
#::node2
#:</pre>
#Start and enable pbs
#:<pre>
#:: systemctl start pbs
#:: systemctl enable pbs
#:</pre>





Latest revision as of 10:04, 28 February 2023

Home > Ubuntu > HPC setup with openpbs and openmpi > Setup PBS master on master node

To setup OpenPBS master on HPC master node use following steps:

  1. Install postgresql
    apt install postgresql postgresql-server-dev-all postgresql-contrib
  2. Download and install PBS using:
    cd /export/apps/temp
    wget https://github.com/openpbs/openpbs/releases/download/v20.0.1/openpbs_20.0.1.ubuntu_1804.zip
    unzip openpbs_20.0.1.ubuntu_1804.zip
    cd /export/apps/temp/openpbs_20.0.1.ubuntu_1804/
    dpkg -i openpbs-server_20.0.1-1_amd64.deb
  3. Edit '/etc/pbs.conf' file should be look like below:
    PBS_EXEC=/opt/pbs
    PBS_SERVER=<master-hostname>
    PBS_START_SERVER=1
    PBS_START_SCHED=1
    PBS_START_COMM=1
    PBS_START_MOM=0
    PBS_HOME=/var/spool/pbs
    PBS_CORE_LIMIT=unlimited
    PBS_SCP=/bin/scp
    PBS_LEAF_NAME=<master-hostname>
    Here 'PBS_START_MOM=0' and not having master in nodes list (Point below) ensures that jobs execute only on compute nodes. If we want jobs to execute on master node then we should have 'PBS_START_MOM=1' and also master should be part of node list '/var/spool/pbs/server_priv/nodes'.
  4. Set the environment
    source /etc/profile.d/pbs.sh
    source /etc/pbs.conf
  5. Enter master hostname in /var/spool/pbs/mom_priv/config file
    $clienthost <rocks-master-hostname> //Ex: master
  6. In pbs server, needs to specify all the compute/gpu nodes in /var/spool/pbs/server_priv/nodes
    node1
    node2
  7. Start and enable pbs
    systemctl start pbs
    systemctl enable pbs



Home > Ubuntu > HPC setup with openpbs and openmpi > Setup PBS master on master node