Incremental technique with set of frequent word item sets for mining large Indonesian text data

Maylawati, Dian Sa'adillah and Ramdhani, Muhammad Ali and Rahman, Ali and Darmalaksana, Wahyudin (2017) Incremental technique with set of frequent word item sets for mining large Indonesian text data. In: International Conference on Cyber and IT Service Management (CITSM), 2017, 8-10 Aug. 2017, Denpasar.

[img]
Preview
Text
IEEE-Incremental technique.pdf

Download (182kB) | Preview
Official URL: http://doi.org/10.1109/CITSM.2017.8089224

Abstract

Indonesian text data from social media is one of large text data that interesting to be mined. Mining the insight knowledge from large text data need more effort and time to processed. Moreover, Indonesian text data from social media contains natural language, including slang that require special treatment. We propose incremental technique for more efficient mining process of large text data with Set of Frequent Word Itemset (SFWI) representation that had been proven capable to keep the meaning of Indonesian text well. We compared Frequent Pattern Growth (FP-Growth) algorithm for not incremental mining and Compact Pattern Growth (CP-Tree) algorithm for incremental mining. The result of experiment with 3,200, 5,000, 110,000, and 239,496 text data form Twitter showed that the incremental technique capable to reduce time process and memory usage for mining Indonesian large text data. Incremental technique with CP-Tree could decrease time process and memory usage so that time process was about 1.66 times faster and 1.84 times more efficient for memory usage than with FP-Growth which was not incremental.

Item Type: Conference or Workshop Item (Paper)
Subjects: Engineering
Divisions: Fakultas Sains dan Teknologi > Program Studi Teknik Informatika
Depositing User: Muhammad Ali Ramdhani
Date Deposited: 09 Jan 2018 07:39
Last Modified: 14 May 2018 04:42
URI: http://digilib.uinsgd.ac.id/id/eprint/5109

Actions (login required)

View Item View Item