Running Streams on Yarn using PAM Authentication

There are two parts to setting up and running Streams on Yarn using PAM authentication: installing Yarn and then installing Streams and configuring it to use Yarn. All the steps are described in this article. Setup instructions are the same for Streams 4.0.1 and  Streams 4.1. Installing and configuring Yarn Install Yarn Download latest version of hadoop from...  Continue reading Running Streams on Yarn using PAM Authentication

Using an External Resource Manager with InfoSphere Streams

InfoSphere Streams 4.0.1 introduced support for an external resource manager to supply resources for running InfoSphere Streams services and applications. This allows services and applications to run on resources other than traditional physical hosts, such as virtual machines or Linux containers.  Continue reading Using an External Resource Manager with InfoSphere Streams

Streams, Spark, YARN & Java. Using Streams in your Big Data environment

IBM has made a series of announcements recently showing its commitment to Big Data communities including the Open Data Platform (ODP) and Spark.  As part of that commitment Streams is adding a number of new capabilities to make it easier to use Streams within your Big Data environment.  These include the ability to write Streams applications in Java, using...  Continue reading Streams, Spark, YARN & Java. Using Streams in your Big Data environment