Performance Evaluation of Relational, JSON, and Hybrid Models in MariaDB for Dynamic Form Builders

Muhammad Salmansyah Mousavi Akhyar, Triyanna Widiyaningtyas

Abstract


Dynamic form builders require database structures that can accommodate variable attributes while maintaining efficient query performance. However, the performance implications of different storage representations within the same database management system remain insufficiently characterized, particularly for relational, raw JSON, and hybrid relational-JSON models. This study evaluates the performance of these three storage representations for dynamic-form data using MariaDB 10.6.19. A controlled quantitative experiment was conducted using datasets of 10,000, 50,000, and 100,000 records and six read and aggregation workloads covering point retrieval, dynamic-field search, multi-field filtering, counting, averaging, and grouping. Each workload was executed using 10 warm-up iterations followed by 30 measured repetitions. Query latency, storage consumption, execution plans, and statistical differences among representations were analyzed. The results show that performance varied according to workload and dataset scale. Statistically significant differences were observed in 13 of 18 workload-dataset combinations. The representation with the lowest median latency also varied across conditions, indicating that no single storage representation consistently provided the lowest query latency. Execution-plan analysis for DYNAMIC_FIELD_SEARCH at 100,000 records showed indexed access for relational storage and full-table scans for the evaluated raw JSON and hybrid configurations. Raw JSON required the lowest storage consumption, followed by the hybrid representation. These findings indicate that storage representation should be selected according to workload characteristics, dataset scale, and structural requirements rather than based on a single overall performance criterion.

Keywords


database benchmarking; dynamic form builder; JSON storage; query performance; relational database

Full Text:

PDF

References


T. Taipalus, “Database Management System Performance Comparisons: A Systematic Literature Review,” Journal of Systems and Software, Vol. 208, hlm. 111872, Feb 2024, DOI: 10.1016/j.jss.2023.111872.

K. ElDahshan, E. Selim, A. Ismail Ebada, M. Abouhawwash, Y. Nam, dan G. Behery, “Handling Big Data in Relational Database Management Systems,” Computers, Materials & Continua, Vol. 72, No. 3, hlm. 5149–5164, 2022, DOI: 10.32604/cmc.2022.028326.

S. Bimonte, E. Gallinucci, P. Marcel, dan S. Rizzi, “Data Variety, Come as You are in Multi-Model Data Warehouses,” Information Systems, Vol. 104, hlm. 101734, Feb 2022, DOI: 10.1016/j.is.2021.101734.

S. Bimonte, E. Gallinucci, P. Marcel, dan S. Rizzi, “Logical Design of Multi-Model Data Warehouses,” Knowl Inf Syst, Vol. 65, No. 3, hlm. 1067–1103, Mar 2023, DOI: 10.1007/s10115-022-01788-0.

G. Yuan, J. Lu, Z. Yan, dan S. Wu, “A Survey on Mapping Semi-Structured Data and Graph Data to Relational Data,” ACM Comput. Surv., Vol. 55, No. 10, hlm. 1–38, Okt 2023, DOI: 10.1145/3567444.

L. Zhang, K. Pang, J. Xu, dan B. Niu, “JSON-based Control Model for SQL and NoSQL data Conversion in Hybrid Cloud Database,” J Cloud Comp, vol. 11, no. 1, hlm. 23, Des 2022, doi: 10.1186/s13677-022-00302-9.

A. H. Chillón, M. Klettke, D. S. Ruiz, dan J. G. Molina, “A Generic Schema Evolution Approach for NoSQL and Relational Databases,” IEEE Trans. Knowl. Data Eng., Vol. 36, No. 7, hlm. 2774–2789, Jul 2024, DOI: 10.1109/TKDE.2024.3362273.

T. Whairit, B. Phadermrod, dan V. Attasena, “JINDEX: JSON and Index Search System for Plant Germplasm Database,” Journal of King Saud University - Computer and Information Sciences, Vol. 35, No. 8, hlm. 101701, Sep 2023, DOI: 10.1016/j.jksuci.2023.101701.

A. J. Langerak, F. Frasincar, dan J. Klinkhamer, “JAL: An Algebra for JSON Query Optimization,” World Wide Web, Vol. 28, No. 3, hlm. 28, Mei 2025, DOI: 10.1007/s11280-025-01336-0.

K. Wellenzohn, M. H. Böhlen, S. Helmer, A. Pietri, dan S. Zacchiroli, “Robust and Scalable Content-and-Structure Indexing,” The VLDB Journal, Vol. 32, No. 4, hlm. 689–715, Jul 2023, DOI: 10.1007/s00778-022-00764-y.

M. Hewasinghage, S. Nadal, A. Abelló, dan E. Zimányi, “Automated Database Design for Document Stores with Multicriteria Optimization,” Knowl Inf Syst, Vol. 65, No. 7, hlm. 3045–3078, Jul 2023, DOI: 10.1007/s10115-023-01828-3.

Q. Guo, C. Zhang, S. Zhang, dan J. Lu, “Multi-Model Query Languages: Taming the Variety of Big Data,” Distrib Parallel Databases, Vol. 42, No. 1, hlm. 31–71, Mar 2024, DOI: 10.1007/s10619-023-07433-1.

L. Chen, A. Davoudian, dan M. Liu, “A Workload-Driven Method for Designing Aggregate-Oriented NoSQL Databases,” Data & Knowledge Engineering, Vol. 142, hlm. 102089, Nov 2022, DOI: 10.1016/j.datak.2022.102089.

W. Khan, T. Kumar, C. Zhang, K. Raj, A. M. Roy, dan B. Luo, “SQL and NoSQL Database Software Architecture Performance Analysis and Assessments—A Systematic Literature Review,” BDCC, Vol. 7, No. 2, hlm. 97, Mei 2023, DOI: 10.3390/bdcc7020097.

S. V. Salunke dan A. Ouda, “A Performance Benchmark for the PostgreSQL and MySQL Databases,” Future Internet, Vol. 16, No. 10, hlm. 382, Okt 2024, DOI: 10.3390/fi16100382.

S. Weng dkk., “Lauca: A Workload Duplicator for Benchmarking Transactional Database Performance,” IEEE Trans. Knowl. Data Eng., Vol. 36, No. 7, hlm. 3180–3194, Jul 2024, DOI: 10.1109/TKDE.2024.3360116.

A. Ouared, M. Amrani, A. Chadli, dan P.-Y. Schobbens, “Deep Variability Modeling to Enhance Reproducibility of Database Performance Testing,” Cluster Comput, Vol. 27, No. 8, hlm. 11683–11708, Nov 2024, DOI: 10.1007/s10586-024-04533-0.

M. Grambow, D. Kovalev, C. Laaber, P. Leitner, dan D. Bermbach, “Using Microbenchmark Suites to Detect Application Performance Changes,” IEEE Trans. Cloud Comput.,Vol. 11, No. 3, hlm. 2575–2590, Jul 2023, DOI: 10.1109/TCC.2022.3217947.

C. A. Győrödi, D. V. Dumşe-Burescu, D. R. Zmaranda, dan R. Ş. Győrödi, “A Comparative Study of MongoDB and Document-based MySQL for Big Data Application Data Management,” BDCC, Vol. 6, No. 2, hlm. 49, Mei 2022, DOI: 10.3390/bdcc6020049.

J. Urnikienė, V. Steponavičienė, dan S. Atanasov, “Comparative Read Performance Analysis of PostgreSQL and MongoDB in E-Commerce: An Empirical Study of Filtering and Analytical Queries,” BDCC, Vol. 10, No. 2, hlm. 66, Feb 2026, DOI: 10.3390/bdcc10020066.

I. Carvalho, F. Sá, dan J. Bernardino, “Performance Evaluation of NoSQL Document Databases: Couchbase, CouchDB, and MongoDB,” Algorithms, Vol. 16, No. 2, hlm. 78, Feb 2023, DOI: 10.3390/a16020078.

S. Huang, Y. Qin, X. Zhang, Y. Tu, Z. Li, dan B. Cui, “Survey on Performance Optimization for Database Systems,” SCI. China Inf. SCI., Vol. 66, No. 2, hlm. 121102, Feb 2023, DOI: 10.1007/s11432-021-3578-6.

S. Currim, R. T. Snodgrass, dan Y.-K. Suh, “Identifying the Root Causes of DBMS Suboptimality,” ACM Trans. Database Syst., Vol. 49, No. 1, hlm. 1–40, Mar 2024, DOI: 10.1145/3636425.

D. Chicco, A. Sichenze, dan G. Jurman, “A Simple Guide to the use of Student’s t-Test, Mann-Whitney U Test, Chi-Squared Test, and Kruskal-Wallis Test in Biostatistics,” BioData Mining, Vol. 18, No. 1, hlm. 56, Agu 2025, DOI: 10.1186/s13040-025-00465-6.

O. J. M. Guilbaud, “Note on a Stepwise Procedure for Rejecting at Least k out of m Hypotheses: A Simple Holm‐Type Formulation and Proof,” Biometrical J, Vol. 64, No. 2, hlm. 377–383, Feb 2022, DOI: 10.1002/bimj.202000206.

F. Fiel Peres, “Effect Sizes for Nonparametric Tests,” Biochem. med. (Online), Vol. 36, No. 1, hlm. 5–16, Feb 2026, DOI: 10.11613/BM.2026.010101.




DOI: https://doi.org/10.32520/stmsi.v15i10.6988

Article Metrics

Abstract view : 220 times
PDF - 37 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.