Deploying and using a basic Kafka instance

To get started quickly using Apache Kafka, you need to deploy a Kafka instance and be able to connect and run a sample Kafka application.

While you can certainly download and install an Apache Kafka instance on your local system, the IBM Event Streams on IBM Cloud service is a fully managed Apache Kafka instance.

In this tutorial, we’ll show you just how easy it is to deploy a Kafka instance using IBM Event Streams on IBM Cloud service and then connect and run one of the sample applications.

Prerequisites

Estimated time

You can complete the steps in this tutorial in about 30-45 minutes.

Steps

For this tutorial, for our Kafka instance, we use the Event Streams on IBM Cloud, which has a Lite plan that lets you get started quickly.

To deploy a Kafka instance and connect and use a Kafka app, you’ll need to complete these steps:

  1. To deploy a managed Kafka instance, create an Event Streams on IBM Cloud service instance.

  2. To connect and use a Kafka app in your managed Kafka instance, you need to:

    • Create a topic
    • Create credentials
    • Clone the Github repo for the sample app
    • Run the consuming app
    • Run the producing app
  3. Delete the topic

These steps are demonstrated for you in the following video:

These steps are also detailed in the IBM Event Streams for IBM Cloud getting started tutorial.

Summary and next steps

Congratulations! You have now successfully created an instance of IBM Event Streams on Cloud and run your first sample Kafka application.

In general, for ongoing development, you will need to run against a standard instance of IBM Event Streams on Cloud. You can upgrade the Lite instance you created in this tutorial to a Standard instance.

Next, you are ready to get some hands on experience with an IBM Event Streams Java sample application by reviewing its code to learn how to write client code that produces and consumes messages from Apache Kafka.