This post has a series of videos to help you get started with the Streams Runner for Apache Beam.
Apache Beam is a programming model that allows you to create streaming applications that are platform independent. This means that you can create your streaming applications once and then decide which platform is best suited for your business needs. Streams is one of the supported plaftorms, so you can use the Streams runner for Apache Beam to execute Beam applications. Your applications will run in the IBM Cloud on the Streaming Analytics service.
This post will walk you through the steps required to launch a sample Beam application using the Streams runner.
Here are the steps you need to complete:
- Create an instance of the Streaming Analytics service.
- Download and install the Streams runner.
- Save credentials for the Streaming Analytics service in a file.
- Launch the
- Monitor the running application in the Streams console.
Create an instance of the service
Since the Streams runner for Beam is cloud based, you need an instance of the Streaming Analytics service to use it. If you do not already have an instance of the service, create one here.
Download and install the runner
Next, download the Streams Runner from your service instance as shown in this video:
Create a credentials file
Once you have downloaded and installed the runner, you can use it to run an application in the cloud. The application is submitted from your local machine to the service. You thus need to create authentication credentials so that the application can be sent to the service. This next video shows how to create and save credentials for your service in a file.
Launch a sample application
Now that you have installed and set up the runner, you are ready to launch one of the samples.
Launch the Temperature sample application:
Monitor the running application
You can use the Streams Console to monitor your Beam application. You can create dashboards to observe metrics, and it is also used to terminate the application.
This final video demonstrates using the Console.