Create a cognitive news search app

Get the code View the demo

Summary

Enriched news data can help your application make dynamic connections across current events faster. This developer journey demonstrates how to build your own news mining web application using JavaScript, Node.js, and the Watson Discovery service. Use the Watson Node.js SDK to build your news app to search the latest news, find trends, and even integrate it with other applications, such as Slack.

Description

The web is home to massive amounts of data, with more being created every moment of every day. Organizations that can harness this constant stream of information to gain understanding, plan strategies, and find opportunities will be successful. Developers who can help them do it will be essential.

The Watson Discovery service enables developers to create cloud-native applications for cognitive search and content analytics. Watson Discovery News is available as pre-enriched data collection within Watson Discovery, offering a ready-to-use dataset of the latest news that is updated continuously, with approximately 300,000 new articles and blogs added daily.

This developer journey shows you how to tap into that massive data set to mine insight. You’ll build a news mining web application with the Watson Discovery service using the Watson Node.js SDK. The journey demonstrates two use cases using Watson Discovery News:

  • Search: Query for the most relevant new articles about a specific topic or subject. Because the news collection is pre-enriched with natural language processing, you can query not just on keywords or categories but also on concepts, sentiment, and relations to get richer search responses.

  • Trending topics in the news: Identify popular topics over the past 24 hours. Topics can be general, or specific to an industry or category.

This pattern will help you hone your app development and services skills. When you complete it, you’ll understand how to:

  • Create a news mining web application with Watson Discovery using Node.js
  • Use basic Watson Discovery features, like how to search and find trending results
  • Build an RSS News Feed generator to push trending topic news to your favorite RSS reader
  • Build a SlackBot to access the search feature from Slack

Flow

flow

  1. The user interacts with the app UI to request relevant news content.
  2. The app sends user requests to Watson Discovery News.
  3. The Watson Discovery Service is continually crawling the web to update its Discovery News collection.
  4. The Watson Discovery Service responds to Slack search requests.
  5. The Watson Discovery Service seeds news articles to the RSS Reader.

Instructions

Ready to put this code pattern to use? Complete details on how to get started running and using this application are in the README.