by Vishal Chahal and Manjula G. Hosurmath
Every organization is navigating a sea of data. That sea can get rough if you can’t spot the tides, currents, and rocks just below the surface.
The new IBM Code developer journey Detect change points in IoT sensor data gives you a map to navigate by. By detecting change points, you can spot any behavioral change in time series data. A time series is simply a set of data points gathered over a specified time period. When you spot the changes you can adjust course … before it’s too late.
IoT sensor data can provide a treasure trove of information if you know how to find it. Traditional change point detection with rule-based methods compare two data points or sets of two time series to discover any significant change that’s taken place. In Detect change points in IoT sensor data, you’ll use a statistical approach to detect change points. You’ll learn how to use Node-RED and the R statistical analysis project along with IBM Data Science Experience to detect even small changes in your specified time series, putting you in the navigator’s seat. And that’s a good place to be.
Each of the journey components are designed to be reused, either as a complete flow or as individual components. Each component is completely configurable, giving you the ability to perform multiple experiments by tweaking the parameters. You can use the output — statistical metrics — in applications further downstream.
The architecture and flow of the developer journey can be split into two main modules. The first module collects data from an IoT sensor source and injects the data into a DB2 database in the cloud. The second module leverages R statistical functions written in R Spark and Jupyter Notebooks in IBM Data Science Experience to read the data from DB2. You then compute the statistics to detect if any change point had occurred.
If you need to programmatically detect change points for your organization, the Detect change points in IoT sensor data developer journey is the perfect starting point. It’ll give you the knowledge and skills to find the change points, adjust course, and sail into smooth waters.