Overview

Active practitioners in deep learning primarily develop and train their networks on local computing devices. Nonetheless, the accuracy of such networks is dependent on their depth and the amount of training data. Moreover, since local computing devices such as laptops or clusters provide limited computational capacity, training a deep neural network (NN) requires access to large clusters, i.e., supercomputers.

In this workshop, we will learn the basics of containers, how to work with Docker and Singularity, and how to run distributed training using the Horovod framework on a supercomputer.

The workshop will be entirely online using zoom.

Outcomes

You will be able to create, deploy, and update containers locally or on a cluster.
You will train, and upscale traditional Convolutional NN (CNN) in TensorFlow.
You will learn to upscale CNN using Horovod.

Prerequisites

Basic knowledge of UNIX OS and familiarity with NNs are required.

Agenda

For updated agenda please visit  https://enccs.se/events/2022-02-upscaling-ai-with-containers
https://events.prace-ri.eu/event/1292/