Skip to main content
Make Data Work
Oct 15–17, 2014 • New York, NY

Unlocking Big Data at CERN

Matthias Braeger (CERN), Manish Devgan (Software AG)
4:15pm–4:55pm Thursday, 10/16/2014
Hadoop in Action
Location: 1 C03/1 C04
Average rating: ***..
(3.86, 7 ratings)
Slides:   1-PDF 

CERN is at the forefront of fundamental research and technology – from running the world’s Largest Particle Accelerator to Grid Computing to Medicine. This session will unbox the architecture of CERN projects that leverage Hadoop and Terracotta In-Memory Data platform to gain real-time insights from sensor data – one of which is C2MON, CERN’s Control & Monitoring Platform.

In complex operational environments that includes sensors of CERN’s technical infrastructure, monitoring and control systems unlock key insights from machine data. As both data volumes and rates increase, non-functional requirements such as performance, availability, and maintainability become very important. C2MON is a generic toolbox developed at CERN over the past few years for building extremely resilient and highly scalable In-Memory Data Fabric for handling Big Data in real-time. Combining maintainability and high-availability within a portable architecture is the focus of this work. Making use of modern Java caching, in-memory data management, and clustering technologies, the platform supports multiple deployment architectures.

Attendees of this presentation will get an overview about how Hadoop is being used at CERN for analytics. The presentation will focus on C2MON considering various monitoring scenarios and how the C2MON deployment strategy can be adapted to meet them. The talk will also give an overview of two highly successful data projects based on C2MON – “Technical Infrastructure Monitoring” (TIM) project and DIAMON.

References:
ICALEPCS 2013: http://c2mon.web.cern.ch/c2mon/downloads/C2MON-ICALEPCS13-Paper.pdf
C2MON Home Page: http://cern.ch/c2mon

Photo of Matthias Braeger

Matthias Braeger

CERN

Matthias Braeger is Software Engineer (staff) at CERN, the European Organization for Nuclear Research. He is responsible for the Technical Infrastructure Monitoring (TIM) system which is a 24/7 service used by many different user groups to supervise and control a variety of infrastructure spread across the CERN site. He also heads the CERN Control and Monitoring Platform C2MON [C-2-MON] (http://cern.ch/c2mon) which allows the rapid development of highly reliable, scalable and flexible monitoring solutions.

Before joining CERN, Matthias worked for Logica and helped developing the Spacecraft Control & Operation System for ESA.

Matthias is author of several scientific papers and a featured speaker at industry conferences and training seminars.

Photo of Manish Devgan

Manish Devgan

Software AG

Manish Devgan heads Terracotta Product Management and Strategy. He has more than a decade of experience leading Product Management and R&D at companies building enterprise class technology products and solutions.

Prior to Terracotta, Manish led Product Management and Strategy for WebCenter products for Oracle as well as R&D for Weblogic Portal at BEA Systems, Inc.

Manish has authored books, is a featured speaker at industry conferences, and holds 10 patents in the areas of Enterprise Applications, Identity Management, Portals, and Personalization technologies.

Manish holds a Masters in Computer Science from The University of Nebraska, Lincoln.