Sign inSign up

fermilab/fnal-wn-el9

Sponsored OSS

By Fermilab

Updated 2 months ago

Image
0

9.6K

fermilab/fnal-wn-el9 repository overview

worker

This folder holds various Dockerfiles for worker nodes images

fnal-wn-sl6, fnal-wn-sl7, fnal-wn-el8 and fnal-wn-el9 are container images that provide an environment similar to the one on FermiGrid. It includes a base Scientific Linux or AlmaLinux with the xrootd client from OSG and a few other commonly used packages. They will help to provide a portable, reliable and consistent environment anywhere in the distributed computing infrastructure.

fnal-dev-sl7 is a more complete image to provide a development environment to experiments requiring the now obsolete SL7.

These images are made available on Docker Hub and as expanded Apptainer/Singularity images on OSG's CVMFS. To add a container to the OSG images it should be added to the docker_images.txt file in the OSG CVMFS Singularly Image Repository.

We have also base-sl7, a base SL7 image with OS and Fermilab repos pointing to the obsolete URLs and the EPEL and OSG 3.6 repos set up. It is used for our SL7 images and available for anyone creating SL7 images.

Here are more information about adding your image to CVMFS and on using Singularity images on CVMFS.

How to use the workers and other images

You can run containers using these images on your workstation via Docker or Podman:

# Docker
docker run -it --name my-fancy-name fermilab/fnal-wn-sl7:latest /bin/bash
# Podman
podman pull docker.io/fermilab/fnal-wn-sl7
podman run -it fnal-wn-sl7 /bin/bash

You may base your containers on the Fermilab worker nodes by including it inside your Dockerfile (pick your desired worker):

FROM fermilab/fnal-wn-sl7:latest

On the distributed computing resources (Grid, Cloud, HPC, ...) you can use the same images via Apptainer/Singularity. This is an alternative virtualization product that by default runs in user space, exposes more of the OS, and mounts some local disks, making it more suitable for running unprivileged on shared computing resources.
Apptainer/Singularity can access the images out of Docker Hub or CVMFS:

# From Docker
apptainer shell docker://fermilab/fnal-wn-sl7:latest
# CVMFS
apptainer run -B/cvmfs -B/mu2e/data /cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest df -h

You can make the request by sending mail to [email protected] or For OSG-connect read more about how it works here. When you submit your job, add these options:

--lines='+SingularityImage=\"/cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest\"'
--append_condor_requirements='(TARGET.HAS_SINGULARITY==true)'

When using GlidienWMS the worker images are normally selected by your experiment and you don't have to worry. You may anyway choose your own, e.g. by adding to your HTCondor submit file:

+SingularityImage="/cvmfs/singularity.opensciencegrid.org/fermilab/fnal-wn-sl7:latest"
# And possibly append to the requirements '&& (TARGET.HAS_SINGULARITY==true)'

HSF, the HEP Software Foundation, has some Carpentry-style training on how to use Docker and Apptainer/Singularity:

Tag summary

Content type

Image

Digest

sha256:a0bdaf92d

Size

682.8 MB

Last updated

2 months ago

docker pull fermilab/fnal-wn-el9

This week's pulls

Pulls:

34

Sep 7 to Sep 13