At times it is necessary to have configuration or static files bundled into the application bundle so that they are available on all of the hosts that the application runs on. The Java Application API provides 3 methods for adding external resources to the application bundle:
This document describes how create a source stream with the Java Application API so that we can read files from Hdfs. The document first shows how to generate the source stream, and then shows how to build a reader that takes the input filename from a stream.
The Java Application API allows streaming applications to be written in Java for IBM Streams. Tuples on a stream can be any Java object that is serializable. A stream, represented by the interface TStream, is processed using a functional programming style, when a function transforms the stream by being called on each tuple, and the returned value drives the contents of the new stream.
IBM has made a series of announcements recently showing its commitment to Big Data communities including the Open Data Platform (ODP) and Spark. As part of that commitment Streams is adding a number of new capabilities to make it easier to use Streams within your Big Data environment. These include the ability to write Streams applications in Java, using Spark MLlib analytics in Streams and running Streams in an Apache Hadoop Yarn cluster.