Multimodal Accessibility Engine: A Proposed Methodology for Semantic and Personalized Braille Generation


Date Published : 16 November 2026

Contributors

Ajantha Devi

Author

Prof. (Dr.) Anand Nayyar

Author

Keywords

Multimodal accessibility; Braille; large language models; multimodal AI; adaptive Braille; semantic representation; assistive technology; digital accessibility

Proceeding

Track

General Track

License

Copyright (c) 2026 Sustainable Global Societies Initiative

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Abstract

Digital information is increasingly presented in several modalities such as text, speech, images, charts, diagrams, tables, mathematical expressions and structured documents. While there are important technologies already in place to make digital content accessible to users, they often do not adequately interpret multimodal information, maintain the semantic connections and the structure of information, or create representations that are tailored to individual Braille users. In this paper, the authors introduce a Multimodal Accessibility Engine (MAE), a solution to make digital content accessible, from a semantic perspective and personalized, in the form of Braille. The proposed methodology is not based on a text-to-Braille conversion but, rather, is based on a semantic transformation paradigm. It is composed of 8 phases: requirement analysis, preparation of multimodal datasets, modality specific preprocessing, semantic understanding and multimodal fusion, Braille-aware language modelling, semantic-to-tactile conversion, adaptive personalization, and accessible output delivery accompanied by iterative validation. The proposed Braille-aware language model is placed in the middle of the intelligence layer and is designed to be used in the process of contextual interpretation, semantic reasoning, document structure, domain knowledge, and accessibility constraints, before it generates Braille. A user-adaptation layer then modifies the representation based on the user's Braille knowledge, reading preferences, content complexity and presentation. The methodology is intended to facilitate the creation of text, graphics, charts, tables, diagrams, speech, equations, and image-heavy documents, especially those related to STEM materials. A semantic, Braille, structural, personalization, and user-centered validation framework is also established to plan the framework. The contribution of the paper is then a unified research methodology that goes beyond static accessibility and direct translation to semantic and multimodal and adaptive Braille generation

References

No References

Downloads

How to Cite

Ajantha Devi, A. D., & Prof. (Dr.) Anand Nayyar, P. (Dr.) A. N. (2026). Multimodal Accessibility Engine: A Proposed Methodology for Semantic and Personalized Braille Generation. Sustainable Global Societies Initiative, 1(15). https://vectmag.com/sgsi/paper/view/1413