Smart text-classification of user-generated data in educational social networks

Di Wang, Ahmad Al-Rubaie, Ahmed Al Dhanhani, Jason Ng

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations


Nowadays, face-to-face interpersonal communication has been gradually replaced by communications via virtual social network platforms, which applies to the new generation of education. The amount of user-generated data in social networking sites is increasing day by day. Understanding and consuming this great amount of data has become a harder task. Classifying the user-generated data (mainly text) can help simplify the user experience by providing them dynamic personalized recommender. Filtering the data, and providing users with what is relevant to them, will help them utilize this data more effectively. In education, recommending relevant learning content to learners in educational social networking sites saves them the arduous task of sifting through a huge amount of information. This paper introduces the partial-supervised learning for Hierarchical Dirichlet Process (HDP) for text classification with inherent hierarchical structure in education. This enables the use of partial known model structure and labels as expert knowledge to guide the model learning procedure from the text without labels. Compared with the existing partial/semi-supervised HDP, the proposed method is able to make use of the known labels for not only structure construction, but also parameter learning. This enhancement provides a more flexible way and better guide for the model learning from the unlabelled documents. We experimentally investigate the contribution of partial knowledge to guide the model learning process. The proposed partial-supervision for HDP is applied to student micro-blog automatic classification and adds intelligence to our student social media platform (ELSE).

Original languageBritish English
Title of host publication2015 IEEE Frontiers in Education Conference
Subtitle of host publicationLaunching a New Vision in Engineering Education, FIE 2015 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479984534
StatePublished - 2 Dec 2015
Event2015 IEEE Frontiers in Education Conference, FIE 2015 - El Paso, United States
Duration: 21 Oct 201524 Oct 2015

Publication series

NameProceedings - Frontiers in Education Conference, FIE
ISSN (Print)1539-4565


Conference2015 IEEE Frontiers in Education Conference, FIE 2015
Country/TerritoryUnited States
CityEl Paso


  • document classification
  • Hierarchical Dirichlet Process (HDP)
  • informal learning
  • partially-supervised learning
  • semi-supervised learning
  • social netwroks
  • text mining


Dive into the research topics of 'Smart text-classification of user-generated data in educational social networks'. Together they form a unique fingerprint.

Cite this