The UK Web Archive

A Dockerised version of Solr, including a core based on the webarchive-discovery schema.

Dockerized build of our current production Heritrix

ClamD in a docker container.

Apache Airflow container with some additional dependencies

Robot Framework environment for UKWA

Python scripts for working with the W3ACT service

Docker deployment of our collections front-end.

Internal reporting apps based on Jupyter notebooks run with Voila.

WWW Annotation and Curation Tool for web archiving.

A Dockerised Apache Superset including Solr support.

Tools for working with our crawl event streams

UKWA crawl lifecycle management tasks.

UKWA's version of pywb, with UKWA-specific code and configuration.

Dockerized version of our Python command line client for Heritrix3 API operations.

Service for discovering and interacting with APIs that allow access to UKWA content.

Web page rendering utility based on Google's Puppeteer

Routes WARC requests to the right place

Hadoop running in a Docker container, with HttpFS enabled.

A Dockerized version of the Archival Acid Test: http://acid.matkelly.com/