Using Streams Studio to develop applications with consistent regions

As announced in the What's New in Streams V4 post, one of the key features in InfoSphere Streams V4 is application resiliency. The concept of consistent regions was introduced, which provides an SPL application the ability to recover from failures and guarantee at-least-once tuple processing. This is described in...  Continue reading Using Streams Studio to develop applications with consistent regions

How to submit a Consistent Region application using Redis as the checkpoint store

If you are planning to use Consistent Region Applications in Streams 4.0, you will need to setup the Checkpoint Repository Store. There are 2 options : file system or Redis. If your Streams installation does not use a shared file system you will need to Redis. Also, you might prefer to use Redis to take...  Continue reading How to submit a Consistent Region application using Redis as the checkpoint store

How to setup Redis replication with InfoSphere Streams 4.0

In InfoSphere Streams 4.0, you can use Redis replication as a part of your HA strategy. Although Redis itself supports master-slave replication (http://redis.io/topics/replication ) , this is NOT supported in Streams. Streams needs to manage the replication instead of using Redis' own replication. Below is an example how to setup this up. 1.First you will...  Continue reading How to setup Redis replication with InfoSphere Streams 4.0

Guaranteed tuple processing in InfoSphere Streams v4 with consistent regions

As described in this previous streamsdev post, one of the new features of Streams V4 is the concept of  consistent regions. Consistent regions provide resiliency to an SPL application by providing the ability to recover from failures. We name these regions consistent because the SPL runtime periodically establishes a consistent state for a...  Continue reading Guaranteed tuple processing in InfoSphere Streams v4 with consistent regions

Application High Availability in IBM® InfoSphere® Streams with Active Replicas – Part 2

This article outlines a technique for supporting redundant flows that only generate a single external effect. The technique is described in terms of an application that generates alerts using text messages (SMS) with a theoretical SMSSink operator, though it can be applied to any sink operator.  Continue reading Application High Availability in IBM® InfoSphere® Streams with Active Replicas – Part 2

Application High Availability in IBM® InfoSphere® Streams with Active Replicas – Part 1

Application High Availability in IBM® InfoSphere® Streams with Active Replicas - Part 1 Overview An SPL application submitted to an IBM® InfoSphere® Streams instance represents a dataflow graph or flow, processing continuous data streams. Streams provides capabilities to restart processing elements that have failed due to host or process failure. However, while the processing element (PE) is...  Continue reading Application High Availability in IBM® InfoSphere® Streams with Active Replicas – Part 1