The Apache Hadoop Insight Pack gives customers support to ingest data from various various Apache Hadoop logs into IBM Operations Analytics – Log Analysis. They can then use a rich set of analytical dashboards to visualize metadata and derived metrics from log content, along with performing additional queries on the content.
Apache Hadoop Insight Pack Health Dashboard
This dashboard displays charts for all the Apache Hadoop hosts. First two charts display all the hosts with log severity FATAL and ERROR over a configured time period. One chart displays the jobs failed for all the hosts configured time period. One chart also displays exception that occurred for all hosts.
Apache Hadoop Daemon Log Level Dashboard
This dashboard displays charts based on the log severity level. The first two charts depict the overall data related to Hadoop Cluster messages categorized by log severity level. Other two charts depict the overall data related to Hadoop Cluster categorized by daemon services log file path.
Apache Hadoop Insight Pack Job Status Dashboard
This dashboard displays charts based on the map reduce job data and memory utilization data of the container. Two charts display map reduce job data categorized by job status. Other two charts display five containers with minimum memory utilization.
Apache Hadoop daemons (NameNode, SecondaryNameNode, DataNode, NodeManager and ResourceManager) generate logs. The logs include records related to normal daemon operation, as well as configuration logs, statistics, standard error, standard out, and internal diagnostic information. The Insight Pack includes support for ingesting and performing metadata searches against the default Apache Hadoop Daemon Logs.
Refer to the User Guide included in the Apache Hadoop Insight Pack for additional information on the Insight Packs and steps for installing and configuring.
Review the following video for information on using and setting up the Insight Pack.
IBM Operations Analytics-Log Analysis Insight Packs for Infrastructure-Standard Install License.
Cost: License Fee
- IBM Operations Analytics â€“ Log Analysis version 1.3.0 or above
- Apache Hadoop 2.5.x
- Apache Hadoop 2.6.0
- Purchased â€śIBM Operations Analytics-Log Analysis Insight Packs for Infrastructure-Standard Install Licenseâ€ť for each installed Insight Pack.
This package is subject to the License terms included with the Insight Pack, along with those displayed upon download.
To report a problem with deploying this entry, entitled customers may contact the country specific IBM support channel, reference the IBM Worldwide Directory. Also use the “Support” link to access the support site for IBM Operations Analytics – Log Analysis information.