e-learning

Running Jobs on Remote Resources with Pulsar

Abstract

Pulsar is the Galaxy Project's remote job running system. It was written by John Chilton (@jmchilton) of the Galaxy Project. It is a python server application that can accept jobs from a Galaxy server, submit them to a local resource and then send the results back to the originating Galaxy server.

About This Material

This is a Hands-on Tutorial from the GTN which is usable either for individual self-study, or as a teaching material in a classroom.

Questions this will address

  • How does pulsar work?
  • How can I deploy it?

Learning Objectives

  • Have an understanding of what Pulsar is and how it works
  • Install and configure a RabbitMQ message queueing server
  • Install and configure a Pulsar server on a remote linux machine
  • Be able to get Galaxy to send jobs to a remote Pulsar server

Licence: Creative Commons Attribution 4.0 International

Keywords: Galaxy Server administration, ansible, git-gat, jobs

Competency level: • Beginner

Target audience: Galaxy Administrators

Resource type: e-learning

Version: 59

Status: Active

Prerequisites:

  • A server/VM on which to deploy Pulsar
  • Ansible
  • Connecting Galaxy to a compute cluster
  • Galaxy Installation with Ansible
  • Mapping Jobs to Destinations using TPV
  • Reference Data with CVMFS

Learning objectives:

  • Have an understanding of what Pulsar is and how it works
  • Install and configure a RabbitMQ message queueing server
  • Install and configure a Pulsar server on a remote linux machine
  • Be able to get Galaxy to send jobs to a remote Pulsar server

Date modified: 2026-01-23

Date published: 2019-01-28

Authors: Marius van den Beek, Gianmauro Cuccuru, Helena Rasche, Mira Kuntz, Nate Coraor, Simon Gladman

Contributors: Catherine Bromhead, Enis Afgan, Marius van den Beek, Nuwan Goonasekera, Armin Dadras, Björn Grüning, Bérénice Batut, Gianmauro Cuccuru, Helena Rasche, Lucille Delisle, Martin Čech, Mira Kuntz, Nate Coraor, Nicola Soranzo, Paul De Geest, Saskia Hiltemann, Simon Gladman


Activity log