High Performance Computing in a GRID Environment
Institut for Scientific Computing
Frank Schmitz and Olaf Schneider
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
1
Ideen
werden
Realität
IWR
Agenda
•
•
•
•
•
•
•
•
•
•
•
The merger of University and Forschungszentrum Karlsruhe
What is Grid computing
Example for a data grid
Architecture
Focus of Grid projects
Grid history at Forschungszentrum Karlsruhe
GridKa (www.gridka.de)
INT.EU.GRID (www.interactive-grid.eu)
CampusGrid (www.campusgrid.de)
D-Grid (www.d-grid.de)
Conclusion
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
2
Ideen
werden
Realität
IWR
Karlsruhe Institute of Technology (KIT)
University
11
120
4,000
18,500
250 mio €
KIT…
Forschungszentrum
science
fakulties
10 programs (research areas)
education
10 km
institutes
21 large institutes
structures
for the
15 min
employees administration
4,000 employees
students
institutes
budget
310 mio € budget
services
infrastructure
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
3
Ideen
werden
Realität
IWR
What is Grid Computing
• Foster's three point checklist: A Grid is a system that
– coordinates resources that are not subject to centralized control
– using standard, open, general-purpose protocols and interfaces
– to deliver nontrivial qualities of service
Grid Computing is not
Cluster Computing!
Analogy World Wide Web
The World Wide Web provides seamless
access to information stored in different
geographical locations and different formats.
The Grid provides seamless access to any kind
of computing power and data storage capacity
distributed over the globe.
analogy with the
electric power grid
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
Word Wide Grid
4
Ideen
werden
Realität
IWR
A motivating example (Data Grid)
•
CERN is building the Large Hadron Collider
(LHC) the most powerful instrument ever
built to investigate elementary particles
physics
• Data Challenge:
– One Megabyte of data digitised for each
collision
– 1010 collisions recorded each year
= 10 Petabytes/year of data !!!
– LHC data correspond to about 20
million CDs each year!
• Simulation, reconstruction, analysis: LHC
data handling requires a computing power
equivalent to ~100,000 of today's fastest PC
processors!
• (106 mega; 109 giga; 1012 tera; 1015 peta)
→ LHC Computing Grid (LCG)
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
5
Ideen
werden
Realität
IWR
Grid Architecture
Middleware
Storage
Resources
Compute
Resources
Data Grid
Compute Grid
Security & VO Management
Collective Services
(Information Index,
File Replica Catalog)
Applications (Portals)
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
6
Ideen
werden
Realität
IWR
Focus of Grid projects
• Software Development
–
–
–
–
–
applications
high level services
portals and clients
middleware components
build of middleware
distributions
• Infrastructure
– build up dedicated resources
for a Grid
– integration of legacy systems
into existing Grids
– deploy additional software on
an existing Grid
– operation of a Grid
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
7
Ideen
werden
Realität
IWR
History of Grid at FZK
GridKa (part of WLCG 2001 – 2015+)
RDCCG
Enabling Grids for E-SciencE
EGEE I
EGEE III
EGEE II
ISSeG
int.eu.grid
CrossGrid
g-Eclipse
start of the
D-Grid Initiative
DGI 2
DGI 1
Community Projects
CampusGrid
2001
2002
2003
2004
2005
2006
2007
2008
2009
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
8
Ideen
werden
Realität
IWR
GridKa, the Tier-1 computer center for LHC
Deliver yearly
12 PB measured data
Atlas
Have already
“real” data
(SLAC, USA)
(FermiLab ,USA)
LHC experiments & LCG
(FermiLab
,USA)
(CERN)
non-LHC experiments
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
9
Ideen
werden
Realität
IWR
Aachen (4)●
Bielefeld (2)●
Bochum (2)●
Bonn (3)●
Darmstadt (1)▲
Dortmund (1)●
Dresden (2)●
Erlangen (1)●
Frankfurt (1)●
Freiburg (2)●
Hamburg (1)▲
Heidelberg (1)▲(6)●
Karlsruhe (2)●
Mainz (3)●
Mannheim (1)●
München (1)●(5)▲
Münster (1)●
Rostock (1)●
Siegen (1)●
Wuppertal (2)●
▲
22 Research Centers
44 Working Groups
350 Scientists
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
10
Ideen
werden
Realität
IWR
FZK has signed the WLCG MoU and is able to
deliver resources for the LHC experiment up to
2022 as the Tier-1 center
12
10
Disk (PB)
Tape (PB)
CPU (MSI2k)
8
6
4
2
0
2005
2006
2007
2008
2009
resources for WLCG
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
11
Ideen
werden
Realität
IWR
Interactive European Grid (int.eu.grid)
•
•
•
•
sponsored by the European Union
13 full partners coming from 13 countries
2 FTE at FZK/IWR
objectives
– a huge parallel computer (MPI) across Europe
• no special network → high latency, small bandwith
– interactive access to the Grid
– user friendly access
• applications
–
–
–
–
–
–
medicien
ultrasonic-CT (FZK)
cerebral aneurysm
high energy physics
catastrophe precaution
nuclear fusion
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
12
Ideen
werden
Realität
IWR
int.eu.grid – key aspects of FZK activities
• NA2: Applications
– interactive access to Grid resources from within MATLAB
– gridification of ultrasonic applications
– user friendly access to the Migratiing Desktop (DataGrid project)
• SA1: infrastructure
–
–
–
–
developer Center: https://savannah.fzk.de
dokumentations Center: https://wiki.fzk.de/i2g
automatic releasebuilds
coordination of the deployment
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
13
Ideen
werden
Realität
IWR
CampusGrid
A fast and easy-to-use intra-site Grid infractructure for HPC
Vision:
The Scientists at KIT use
the Grid as convenient and
natural as they use email
and the Web today.
WSRF
OGSA
R & D Project
OpusIB
BladeCenter
pSeries
Initial situation (of HPC at FZK):
• a wide range of computer architectures,
operating systems, schedulers etc.
• Application of various scientific domains
(proteomics, climate, material sciences, …)
• User requirements: single-sign-on, global
view of the data, easy access
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
14
Ideen
werden
Realität
IWR
Parts of the CampusGrid
Project
watercooled Infiniband cluster with 32 SUN V20z
and 64 FSC RX220 nodes (more than 190 cores and >1
TByte main memory)
2 Infinicon 9100, Infiniband
switches, MPI latency 4.0 μs
between nodes
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
15
Ideen
werden
Realität
IWR
D-Grid (the German Grid initiative)
• starting September 2005 to build a sustainable Grid infrastructure,
IWR is one of the founder of the project idea
• six Community Grid projects an the D-Grid Integration Project
(DGI), IWR leads the DGI part
• funded by BMBF, the Federal Ministry of Education and Research
• astronomy, climate research, high energy physics, engineering
research, medical research, humanities
• gLite, GT4, UNICORE
• SRM/dCache for the data access
• heterogeneous CPU access (AIX, Linux, Solaris, SuperUX)
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
16
Ideen
werden
Realität
IWR
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
17
Ideen
werden
Realität
IWR
Conclusion
Are there possibilities for HPC users in a Grid environment?
• Using DEISA (www.deisa.eu) because it’s the EU Grid project
for HPC.
• Accessing HPC cluster infrastructure by Grid based
middleware like GT4, gLite or UNICORE (D-Grid).
• Building a local HPC cluster and integrate the hardware into a
global Grid infrastructure (D-Grid).
• Running applications in the CampusGrid environment to
become much more familiar in using Grid based
heterogeneous infrastructure.
Why Grid?
• In case of growing problem size, you will find hardware
resources in the Grid.
mit der Universität Karlsruhe
verbunden in
Freiberg, 28.06.2007
18
Ideen
werden
Realität
IWR

the Grid