CC BY-SA 4.0 XML

Forum Summarization

Randomly sampled 100 threads from the dataset of discussion threads from Ubuntu Forums used in previous research; Ubuntu Forums: Official forum of the Ubuntu Linux distribution

Get this dataset

By Sumit Bhatia & Prakhar Biyani | Published July 16, 2019

Natural Language Processing Internet Forum

Overview

The crawled web-pages were preprocessed and all the pages belonging to the same thread were identified and processed to identify different structural units and their associated metadata (title, posts, user IDs etc.). Stemming was performed using Porter’s stemmer and stop words were removed using a general stop word list of 429 words used in the Onix Test Retrieval Toolkit.

Dataset Metadata

Format License Domain Number of Records Size
XML
 CC BY-SA 4.0 Natural Language Processing 113,277 discussion threads
25 queries
 118 MB (compressed)

Citation

@conference{Bhatia2012,
author="Sumit Bhatia
and Prakhar Biyani
and Prasenjit Mitra",
title="Classifying User Messages For Managing Web Forum Data",
booktitle="International Work- shop on the Web and Databases",
year="2012",
pages="13-18
}