Continuous Integration / Continuous Development (CI/CD): Introduction

Prerequisites

This assumes that you’ll have some basic background with your command line, for example:

  1. How to execute custom shell scripts
  2. How to run python scripts

as well as having gone through all previous sessions in this workshop.

Introduction

At CERN, we use GitLab to host our code. GitLab is bundled with a built-in CI/CD system that we’ll learn how to develop on to make our code robust to errors, preserved, and reproducible.

The aim of this module is to:

The skills we’ll focus on:

  1. Making scripts exit correctly
  2. Building a CI/CD workflow of unlimited potential
  3. Understanding how job runners work (and get access to your clones)
  4. The GitLab permissions model
  5. Protecting secret information while allowing jobs to run

The HSF Training Curriculum

HSF Logo
This training module is part of the Training Curriculum, a series of training modules that serves HEP newcomers the software skills needed as they enter the field, and in parallel, instill best practices for writing software.

Video Tutorials

The video tutorials for this lesson are uploaded to a playlist on YouTube.

Schedule

Setup Make sure GitLab works for you, and create a repo!
00:00 1. Introduction What is continuous integration / continuous deployment?
00:05 2. Exit (light) Codes What is an exit code?
00:25 3. Understanding Yet Another Markup Language What is YAML?
00:30 4. YAML and CI What is the GitLab CI specification?
00:35 5. Coffee break! Get up, stretch out, take a short break.
00:50 6. Hello CI World How do I run a simple GitLab CI job?
01:05 7. Adding CI to Your Existing Code I have code already in GitLab, how can I add CI to it?
01:20 8. Eins Zwei DRY How can we make job templates?
01:35 9. Coffee break! Get up, stretch out, take a short break.
01:50 10. All the World's a Stage How do you make some jobs run after other jobs?
02:00 11. A Skimmer Higgs How can I run my skimming code in the GitLab CI/CD?
02:15 12. Getting into the Spy Game How can I give my GitLab CI job private information?
02:30 13. Making Plots to Take Over The World How do we make plots?
02:45 14. Let's Actually Make A Test (For Real) I’m out of questions.
I’ve been here too long. Mr. Stark, I don’t feel too good.
03:10 15. Homework If you have any, ask on mattermost!
03:40 Finish

The actual schedule may vary slightly depending on the topics and exercises chosen by the instructor.