Analyze IoT sensor data with machine learning and advanced analytics

Get the code

Summary

In this code pattern, we’ll use Jupyter notebooks to load IoT sensor data into IBM Db2 Event Store. From there, we’ll query and analyze the data using Jupyter notebooks with Spark SQL and Matplotlib. Finally, we’ll use Spark Machine Learning Library to create a model that will predict the temperature when given the power consumption and ambient temperature.

Description

This code pattern demonstrates the use of a Jupyter notebooks to interact with IBM Db2 Event Store — from the creation of database objects to advanced analytics and machine learning model development and deployment.

The sample data used in this code pattern simulates data collected by real industry IoT sensors. The IoT sample data includes sensor temperature, ambient temperature, power consumption, and timestamp for a group of sensors identified with unique sensor IDs and device IDs.

Db2 Event Store is an in-memory database designed for massive structured data volumes and real-time analytics, built on Apache Spark and Apache Parquet Data Format. The solution is optimized for event-driven data processing and analysis. It can support emerging applications that are driven by events such as IoT solutions, payments, logistics and web commerce. It’s flexible, scalable and can adapt quickly to your changing business needs over time.

After completing this code pattern, you’ll understand how to:

  • Interact with Db2 Event Store using Python and a Jupyter notebook.
  • Visualize data using Matplotlib charts.
  • Build and test a machine learning model.
  • Deploy and use the model with Watson Machine Learning.

Flow

flow

  1. Add the sample IoT dataset as a project asset.
  2. Create the Db2 Event Store database and table.
  3. Query the table using Spark SQL.
  4. Analyze the data with Matplotlib charts.
  5. Create and deploy a machine learning model.

Instructions

Find the detailed steps for this pattern in the readme file. The steps will show you how to:

  1. Clone the repo.
  2. Install IBM Db2 Event Store.
  3. Add the sample IoT data asset.
  4. Create an IBM Db2 Event Store database and table.
  5. Query the table.
  6. Analyze the data.
  7. Create and deploy a machine learning model.