Apache Flume can be used to efficiently collect, aggregate, and move large amounts of log data from many different sources to a centralized data store. Ambari provides an intuitive, easy-to-use Hadoop management web interface backed by its RESTful APIs. You can use the Ambari web interface to configure Flume and to start, stop, or monitor Flume agents.
IBM Message Hub is a service on Bluemix that is based upon Apache Kafka. Flume 1.6.0 can support a Kafka source, sink, and channel. Can it connect to Message Hub? The answer is “yes”, and this article shows you how to use Flume in IBM Open Platform (IOP) 4.2 with Message Hub.