Presented By O'Reilly and Cloudera
Make Data Work
September 25–26, 2017: Training
September 26–28, 2017: Tutorials & Conference
New York, NY

Spark clinical surveillance: Saving lives and improving patient care

Charles Boicey (Clearsense)
4:35pm5:15pm Wednesday, September 27, 2017
Business case studies, Strata Business Summit
Location: 1E 10/11 Level: Intermediate
Secondary topics:  Healthcare

Who is this presentation for?

  • Data architects, data engineers, and healthcare data scientists

Prerequisite knowledge

  • A basic understanding of Spark

What you'll learn

  • Learn how Clearsense, a leader in healthcare technology, uses data science solutions built in Spark Streaming to provide real-time updates to healthcare providers for critical healthcare needs


Charles Boicey explains how Clearsense uses Spark Streaming to provide real-time updates to healthcare providers for critical healthcare needs, helping clinicians make timely decisions from the assessment of a patient’s risk based on information gathered from streaming physiological monitoring along with streaming diagnostic data and the patient historical record. This technology is also used to monitor operational and financial processes for efficiency and cost savings.

Charles focuses on two specific areas:

  1. How this technology stack has led to the development of patient situational awareness applications that allow for the monitoring of streaming data, picking up subtle changes that could lead to an undesirable outcome and passing the information off to clinicians in near real time
  2. The architecture, which includes Apache NiFi, Kafka, Spark, and Spark Streaming, and the tools required to provide 100% uptime and real-time service-level agreements (SLAs) in a multitenant data lake architecture that runs a variety of workloads concurrently
Photo of Charles Boicey

Charles Boicey


Charles Boicey is the chief innovation officer for Clearsense, a healthcare analytics organization specializing in bringing big data technologies to healthcare. Previously, Charles was the enterprise analytics architect for Stony Brook Medicine, where he developed the analytics infrastructure to serve the clinical, operational, quality, and research needs of the organization; was a founding member of the team that developed the Health and Human Services award-winning application NowTrending to assist in the early detection of disease outbreaks by utilizing social media feeds; and is a former president of the American Nursing Informatics Association.