Jülich Supercomputing Centre, Forschungszentrum Jülich GmbH

Project

Forschungszentrum Jülich (FZJ) – Supercomputing as a driver of science

The Forschungszentrum Jülich (FZJ) – a member of the Helmholtz Association – is one of the largest research centres in Europe with almost 7000 employees. It conducts cutting-edge interdisciplinary research on the challenges facing society in the fields of health, energy and the environment, and information technologies. Within the research centre, the Jülich Supercomputing Centre (JSC), as part of the Gauss Centre for Supercomputing (GCS), is one of the three national supercomputing centres in Germany. Currently, the JSC operates the most powerful computing system in Europe (JUWELS) and makes it available to the broad scientific community.

High Performance Computing Enables Large Language Models

JSC brings to OpenGPT-X its expertise in high performance computing (HPC), focused on three aspects:
i) development of methods for upscaling language models on supercomputers;
ii) optimisation of language models on hundreds of GPU compute nodes; and
iii) identification of the requirements of language models on future HPC architectures.