Identification of Potential Causes of User Complaints about New Jconnect Mobile using BERTopic and Fishbone Diagram

Azarine Nadya Arfionika, Muhammad Iqbal Akbar

Abstract


The growing demand for high-quality mobile banking applications has not been fully matched by user satisfaction, as various complaints continue to emerge regarding New JConnect Mobile. This study aims to identify user complaint topics, classify them into problem areas, determine priority areas, and identify potential problem causes using a Fishbone Diagram. A total of 2,488 reviews posted on the Google Play Store between April 10 and August 3, 2026, were collected through web scraping. Following preprocessing, 2,266 reviews were classified using an Indonesian RoBERTa model, yielding 826 negative reviews, which were subsequently analyzed using BERTopic. After outlier handling and manual inspection, 64 reviews containing praise only were excluded, leaving 762 reviews. Of these, 761 reviews were assigned to 13 topics, which were further grouped into six problem areas, while one review remained an outlier. The three highest-priority problem areas were Application Stability and Performance (365 reviews), Transaction and Balance Integrity (159 reviews), and Connectivity and Service Reliability (100 reviews). Together, these areas accounted for 624 reviews, representing 82% of the clustered reviews. A Fishbone Diagram based on the 6M categories was used to map potential problem causes based on evidence from user reviews and to formulate improvement recommendations. The integration of BERTopic and Fishbone Diagram analysis provides a structured mapping of user complaints that can be traced back to individual reviews. However, the identified factors remain potential causes and require further technical verification.

Keywords


BERTopic; digital banking app; Fishbone Diagram; potential problem causes; user reviews

Full Text:

PDF

References


N. Palamidovska-Sterjadovska et al., “Service Quality in Mobile Banking,” International Journal of Bank Marketing, Vol. 43, No. 6. Emerald Publishing, pp. 1195–1230, 23-May-2025.

“BI-Rate Tetap 4,75%: Mempertahankan Stabilitas, Mendorong Pertumbuhan Ekonomi.” [Online]. Available: https://www.bi.go.id/id/publikasi/ruang-media/news-release/Pages/sp_288426.aspx.

C. Rachel Pirie and J. J. Tambotoh, “Usability Analysis using Usefulness, Satisfaction, and Ease-of-use Questionnaire on the Digital Banking,” SISTEMASI, Vol. 12, No. 1, pp. 154–165, Jan. 2023.

A. Timotheus Piisi and B. Kristianto, “Heuristic Analysis of Functionality and UI/UX in Five Digital Finance Applications,” SISTEMASI, Vol. 14, No. 6, pp. 2832–2845, Nov. 2025.

BCA Sekuritas, “Bank Jatim Luncurkan JConnect Versi Baru Guna Perkuat Digitalisasi.” [Online]. Available: https://bcasekuritas.co.id/latest-news/news/bank-jatim-luncurkan-jconnect-versi-baru-guna-perkuat-digitalisasi.

L. Çallı, “Exploring Mobile Banking Adoption and Service Quality Features through User-Generated Content: The Application of a Topic Modeling Approach to Google Play Store Reviews,” Int. J. Bank Mark., Vol. 41, No. 2, pp. 428–454, Mar. 2023.

A. Syaifudin Agil Rafsanjani, D. Laily Fithri, and Supriyono, “Sentiment Analysis of User Reviews of the KitaLulus Application on Google Play Store using the Support Vector Machine (SVM) Algorithm,” SISTEMASI, Vol. 14, No. 5, pp. 2519–2530, Sep. 2025.

O. Grljević, M. Marić, and R. Božić, “Exploring Mobile Application User Experience through Topic Modeling,” Sustain., Vol. 17, No. 3, Feb. 2025.

M. Grootendorst, “BERTopic: Neural Topic Modeling with a Class-based TF-IDF Procedure,” ArXiv, Mar. 2022.

Edwina and T. Mauritsius, “Data-Driven Insights for Mobile Banking App Improvement: A Sentiment Analysis and Topic Modelling Approach for SimobiPlus User Reviews,” Int. J. Eng. Trends Technol., Vol. 72, No. 6, pp. 347–360, Jun. 2024.

M. Uncovska, B. Freitag, S. Meister, and L. Fehring, “Rating Analysis and BERTopic Modeling of Consumer Versus Regulated mHealth App Reviews in Germany,” npj Digit. Med., Vol. 6, No. 1, Dec. 2023.

N. W. Pinilih, I. N. Dewi, and F. Alzami, “An Integrated Topic–Sentiment Analysis of User Reviews in Vidio Application using BERTopic and IndoRoBERTa,” J. Appl. Informatics Comput., Vol. 10, No. 3, pp. 2685–2698, Jun. 2026.

Y. Sagama, A. Alamsyah, and D. Tricahyono, “Generating Mobile App Improvement Recommendations through User Review Analysis using BERTopic and GPT,” ICONDBTM 2024 - Proc. Int. Conf. Digit. Bus. Technol. Manag., 2024.

A. R. Putra and D. E. Ratnawati, “Analisis Sentimen berbasis Aspek pada Aplikasi Mobile menggunakan Naïve Bayes berdasarkan Ulasan Pengguna Playstore (Studi Kasus : Jconnect Mobile),” J. Teknol. Inf. dan Ilmu Komput., Vol. 12, No. 2, pp. 293–300, Apr. 2025.

M. M. B. A. Gopur, S. Hadi Wijoyo, and B. Trias Hanggara, “Root Cause Analysis (RCA) berdasarkan Data Ulasan Pengguna untuk Analisis dan Evaluasi Kinerja Aplikasi Kejaksaan Mobile menggunakan Metode Naïve Bayes,” J. Pengemb. Teknol. Inf. dan Ilmu Komput., Jul. 2025.

N. B. D. Ardha, N. I. Riwajanti, and Z. A. Haris, “Fishbone Diagram: Application of Root Cause Analysis in Internal Audit Planning,” Int. J. Financ. Accounting, Manag., Vol. 5, No. 3, pp. 297–309, Dec. 2023.

V. Anggraini, I. Budi, A. B. Santoso, and P. K. Putra, “Measuring Mobile Banking Service Quality using Topic Modeling and Term Ranking: A Case Study of an Indonesian Digital Bank,” Indones. J. Comput. SCI., Vol. 13, No. 6, Dec. 2024.

A. S. Albesher and B. Alsanousi, “Retrieval-Augmented Generation Analysis of User Reviews in Saudi Mobile Banking Apps: A Comparative User Experience Study of IOS and Android,” PeerJ Comput. SCI., vol. 12, 2026.

K. Kusumaningtyas, A. R. Lahitani, I. Dwijayanti, M. Habibi, and A. Yani Yogyakarta, “Mapping User Dissatisfaction in Mobile Banking Applications using Ensemble Clustering LDA and LSA,” Int. J. New Media Technol., Vol. 12, No. 1, p. 32, 2025.

B. L. Myrto, M. Muça, and K. Bani, “Analyzing User Experience in Mobile Banking Applications through Text Mining,” Int. J. Adv. Comput. SCI. Appl., Vol. 17, No. 6, pp. 114–119, 2026.

N. A. Putri, A. A. Pravitasari, and S. Winarni, “Topic-based Sentiment Analysis of JAMSOSTEK Mobile Application Reviews using the BERTopic Method,” Commun. Math. Biol. Neurosci., Vol. 2026, 2026.

N. A. Adrielvino and A. T. Ayunda, “Penerapan IndoBERT dan BERTopic dalam ABSA untuk Evaluasi Kualitas Aplikasi E-Government Indonesia,” Rabit J. Teknol. dan Sist. Inf. Univrab, Vol. 11, No. 1, pp. 847–868, Jan. 2026.

S[23] T. A. Prasetyo, N. Sulistiyowati, and A. Voutama, “Evaluasi Layanan Mobile JKN berbasis 100.000 Ulasan Google Play Store dan COBIT 5,” J. Inform. dan Tek. Elektro Terap., Vol. 14, No. 2, Apr. 2026.

“w11wo/Indonesian-Roberta-base-Sentiment-Classifier• Hugging Face.” [Online]. Available: https://huggingface.co/w11wo/indonesian-roberta-base-sentiment-classifier.

L. Wang, N. Yang, X. Huang, L. Yang, R. Majumder, and F. Wei, “Multilingual E5 Text Embeddings: A Technical Report,” ArXiv, Feb. 2024.

A. Kwilinski and M. Kardas, “The Role of the Pareto Principle in Quality Management within Industry 4.0: A Comprehensive Bibliometric Analysis,” Virtual Economics, Vol. 7, No. 3. The London Academy of Science and Business, pp. 7–24, 30-Sep-2024.




DOI: https://doi.org/10.32520/stmsi.v15i11.7029

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.