Bidirectional and Auto-Regressive Transformer (BART) for Indonesian abstractive text summarization

Hartawan, Gaduh and Maylawati, Dian Sa'adillah and Uriawan, Wisnu (2024) Bidirectional and Auto-Regressive Transformer (BART) for Indonesian abstractive text summarization. Jurnal Informatika Polinema, 10 (4). pp. 535-542. ISSN 2614-6371

Full text not available from this repository.
Official URL: https://jurnal.polinema.ac.id/index.php/jip/articl...

Abstract

Automatic summarization technology is developing rapidly to reduce reading time and obtain relevant information in Natural Language Processing technology research. There are two main approaches to text summarization: abstractive and extractive. The challenge of abstractive summarization results is higher than abstractive because abstractive summarization produces new and more natural words. Therefore, this research aims to produce abstractive summaries from Indonesian language texts with good readability. This research uses the Bidirectional and Auto Regressive Transformer (BART) model, an innovative Transformers model combining two leading Transformer architectures, namely the BERT encoder and GPT decoder. The dataset used in this research is Liputan6, with model performance evaluation using ROUGE evaluation. The research results show that BART can produce good abstractive summaries with ROUGE-1, ROUGE-2, and ROUGE-L values of 37.19, 14.03, and 33.85, respectively.

Item Type: Article
Uncontrolled Keywords: Abstractive summarization; BART; Natural Language Processing; Transformers
Subjects: Data Processing, Computer Science
Divisions: Fakultas Sains dan Teknologi > Program Studi Teknik Informatika
Depositing User: Ilham Nurfauzi
Date Deposited: 02 Sep 2024 07:57
Last Modified: 02 Sep 2024 07:57
URI: https://digilib.uinsgd.ac.id/id/eprint/95315

Actions (login required)

View Item View Item