Hugonweb | Dell Poweredge Setup

Updating Firmware/BIOS/etc.

First, download the appropriate ISO

https://www.dell.com/support/article/us/en/04/sln296511/updating-dell-poweredge-servers-via-bootable-media-iso?lang=en#1

then run

sudo mkfs -t vfat -I <dev>

on your usb device. Next:

sudo apt-get install syslinux-utils

On the ISO, e.g. linuxISO.iso, run:

isohybrid linuxISO.iso

Finally, write the ISO to your usb key:

sudo dd if=linuxISO.iso of=<dev> bs=8M
sync

Then boot it up on the server in BIOS mode.

F2 is system setup, F11 is the boot menu.

Hardware Setup

Hit F2 on boot to enter the system setup. Setup iDRAC with static IP addresses on the dedicated port.

Setup the disks to pass through.

OS Installation

Assuming a >= 2 GiB internal USB for boot and an NVMe SSD and UEFI boot: Use regular partitions and make 200 MiB /boot/efi and a 1 GiB /boot on the USB then make a 64 GiB / on the NVMe. Leave the rest of each for later.

Configuring Static Networking

ip address add <address>/<bits> dev <dev>
ip route add default via <gateway address>
echo "nameserver <address>" >> /etc/resolv.conf

Now networking should work. You can test with:

dig google.com
host google.com
ping google.com

If that works, then you can configure networking on the next boot, open up /etc/sysconfig/network-scripts/ifcfg-<dev>

and make sure the following lines are in there:

DEVICE=<dev>
BOOTPROTO=none
ONBOOT=yes
PREFIX=<address bits>
IPADDR=<address>
PEERDNS=no
DNS1=<DNS address>
GATEWAY=<gateway address>

You can also install NTP:

yum install ntp

If you have a local NTP server, then modify /etc/ntp.conf so that it is the first server <your server address> iburst line, and remove iburst from the other servers.

then enable it:

systemctl enable ntpd
systemctl start ntpd

You can check on its status with ntp -p

Install and Update Software

yum install -y epel-release
yum update -y

Install OSG Software

https://opensciencegrid.org/docs/common/yum/

https://opensciencegrid.org/docs/worker-node/install-cvmfs/

yum install -y yum-plugin-priorities
rpm  -Uvh https://repo.opensciencegrid.org/osg/3.4/osg-3.4-el7-release-latest.rpm
yum clean all --enablerepo=*
yum update
yum install osg-oasis
systemctl enable autofs
systemctl start autofs
echo "/cvmfs /etc/auto.cvmfs" >> /etc/auto.master.d/cvmfs.autofs
systemctl restart autofs
echo "CVMFS_REPOSITORIES=config-osg.opensciencegrid.org,dune.opensciencegrid.org,lariat.opensciencegrid.org,larsoft.opensciencegrid.org,fermilab.opensciencegrid.org,oasis.opensciencegrid.org,uboone.opensciencegrid.org,grid.cern.ch,cms.cern.ch,atlas.cern.ch" >> /etc/cvmfs/default.local
echo "CVMFS_HTTP_PROXY=DIRECT" >> /etc/cvmfs/default.local
echo "CVMFS_QUOTA_LIMIT=16000" >> /etc/cvmfs/default.local
cvmfs_config probe

ZFS

Add the appropriate repo for your version of linux here https://github.com/zfsonlinux/zfs/wiki/RHEL-and-CentOS

Then run:

yum install -y kernel-devel zfs

Now you\'ll have to restart (and check networking still works).

Now create your zpool:

zpool create zfs1 mirror <dev> <dev> mirror <dev> <dev> cache <l2arc ssd> spare <dev> <dev>

and create the datasets:

zfs create zfs1/home
zfs create zfs1/cvmfs_cache
zfs create zfs1/data