Methodology and Experimental Implementation of a Hybrid BERT–Quantum Model for Text Classification


Date Published : 20 November 2026

Contributors

Dr. E.Chandra Blessie

KG College of Arts and Science, Coimbatore, Tamil Nadu
Author

Dr.P.Rubini

School of Engineering and Technology, CMR University Bengaluru - 562149 Bangalore.
Author

Keywords

Natural Language Processing (NLP) Quantum State Embedding Attention (QSEA) Quantum-based LSTM (QLSTM) Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM)

Proceeding

Track

General Track

License

Copyright (c) 2026 Sustainable Global Societies Initiative

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Abstract

Text classification plays a significant part in inevitably establishing and examining huge volumes of textual information. This paper proposes a hybrid quantum-classical text classification framework that merges Bidirectional Encoder Representations from Transformers (BERT), Principal Component Analysis (PCA), Variational Quantum Circuits (VQC), and a Hybrid Attention mechanism for multi-class news classification. The AG News dataset comprises 6,000 balanced news articles over four classes: World, Sports, Business, and Sci/Tech. We use BERT to extract contextual representations of the news text, producing 768-dimensional feature vectors.

PCA reduces these features to eight dimensions to enable efficient processing using an eight-qubit quantum circuit.  The reduced features are encoded into quantum states and processed using a VQC with trainable parameters and entangling operations. The proposed hybrid attention mechanism combines and emphasizes informative classical and quantum features before classification.  The performance is compared with classical BERT, PCA-based classical, quantum, and VQC-based models.  The proposed approach demonstrates the potential of integrating transformer-based language representations with quantum computing and attention mechanisms for effective text classification.

References

No References

Downloads

How to Cite

Edwin, C. B., & P, R. . (2026). Methodology and Experimental Implementation of a Hybrid BERT–Quantum Model for Text Classification. Sustainable Global Societies Initiative, 1(15). https://vectmag.com/sgsi/paper/view/1489