GCloud Branch of SCC Training Material

This project will take a team of students through the process of setting up a basic cloud-based infrastructure simulating a High-Performance Computing (HPC) environment. The setup will involve preparing cloud instances, configuring networking and applications. The project is divided into 5 weeks, each with specific tasks aimed at building a functional system with a head node and a compute node.

You will use virtual machines and all relevant equivalent resources to achieve building fully functional HPC clusters then install, configure and run all relevant HPC systems services as well as HPC applications.

Week 1: Revisiting the Student Cluster Competition Selection Round

• Topics: Prepare your head node and compute node virtual machines
• Tasks:
  • Redeploy your cluster infrastructure on Sebowa
  • Familiarize yourself with GitHub Project Management tools

Week 2: Use GCloud Free Account to Deploy VM's

• Topics: Use GCloud Free Account to launch instances and install and configure software on your nodes
• Tasks:
  • Create the necessary free accounts or make use of those provided to you through your institution.
  • Redeploy the cloud infrastructure from the Selection Round content, onto your new GCloud Instances.
  • Make sure to document all the steps that you've taken, and ensure you have accompanying screenshots.
  • Make sure to take note of and document the limited resources that are available to you.

Week 3: Use CI / CD Pipelines to Trigger Workflows to Deploy and Configure your 3rd Compute Node

• Topics: Configure CI / CD workflows that use the Ansible playbooks you’ve prepared
• Tasks:
  • Configure CI / CD pipelines that utilize Ansible and Terraform to configure, install and deploy your compute nodes

Week 4: Prepare GitHub Markdown Documentation

• Topics: Document the steps involved in your cloud infrastructure deployment.
• Tasks:
  • Prepare user documentation for someone else to be able to reproduce your steps.

Week 5: Submit a Pull Request to the Selection Round Project

• Topics: Amend the following sections of the Selection Round Training material, in an appropriately named branch:
  • Tutorial 1: Section 3 - Launching your first GCloud Instance
  • Tutorial 3, Section 8 - Spinning up a Second Compute Node Using a Snapshot
  • Tutorial 4, Section 4 - Automating the Deployment of Your GCloud Instances Using Terraform
• Tasks:
  • Create a feature branch that adds a section with pictures to the tutorial content
  • Submit a PR

Week 6: Final Project Poster Presentations and Discussions

• Tasks:
  • Students will present their findings on Cloud Infrastructure Deployment.
  • Discuss challenges and insights gained throughout the project