Development of an AI-based object detection tool for the visually impaired using Raspberry Pi and a camera. Case study: Griya Harapan Social Service Center for the Disabled, Cimahi, Jawa Barat
DOI:
https://doi.org/10.35568/abdimas.v8i4.7204Keywords:
visually impaired, Raspberry Pi, CNN, Assistive device, Community serviceAbstract
The limitation of identifying Objects in the surrounding environment is a major problem for blind people, especially those with low vision (who cannot see at all), which impacts their independence and participation in socio-economic life. To address this problem, the Community Service Team of the Faculty of Informatics at Telkom University conducted community service activities funded by Diktisaintek to develop and implement an AI-based visual aid for the blind. This aid utilizes a Raspberry Pi, camera, and headset that can recognize approximately 80 objects. The implementation method includes observation at the Griya Harapan Difabel Social Service Center as a partner, technology design, socialization and training on its use, field assistance, and evaluation. The evaluation model was carried out by implementing direct interviews with users to determine the objects that can be detected by the aid when using the device. The implementation results showed that the recognition accuracy level reached 80%. The social impacts achieved include increased independence for people who are blind, reduced risk of accidents, and new opportunities to participate in socio-economic activities. Obstacles encountered include limited datasets, variations in initial user skills, and the relatively high cost of the device. However, there are still ample opportunities for development, such as integration with mobile applications, improving CNN accuracy, and adding GPS features. This program demonstrates that technological innovation can be a sustainable solution to support the well-being and independence of people with disabilities.
Downloads
References
Hakobyan, L., Lumsden, J., O’Sullivan, D., & Bartlett, H. (2013). Mobile assistive technologies for the visually impaired.. Survey of ophthalmology, 58 6, 513-28. https://doi.org/10.1016/j.survophthal.2012.10.004
Kral, R., Jacko, P., & Vince, T. (2025). Low-Cost Multifunctional Assistive Device for Visually Impaired Individuals. IEEE Access, 13, 56326-56337. https://doi.org/10.1109/ACCESS.2025.3554366
Manjari, K., Verma, M., & Singal, G. (2020). A survey on Assistive Technology for visually impaired. Internet Things, 11, 100188. https://doi.org/10.1016/j.iot.2020.100188
Naayini, P., Myakala, P., Bura, C., Jonnalagadda, A., & Kamatala, S. (2025). AI-Powered Assistive Technologies for Visual Impairment. ArXiv, abs/2503.15494. https://doi.org/10.48550/arXiv.2503.15494
Elmannai, W., & Elleithy, K. (2017). Sensor-Based Assistive Devices for Visually-Impaired People: Current Status, Challenges, and Future Directions. Sensors (Basel, Switzerland), 17. https://doi.org/10.3390/s17030565
Beingolea, J., Zea-Vargas, M., Huallpa, R., Vilca, X., Bolivar, R., & Rendulich, J. (2021). Assistive Devices: Technology Development for the Visually Impaired. Designs. https://doi.org/10.3390/designs5040075
Zhang, Q., & Zhou, Y. (2024). Embodied Intelligence Applications in Assistive Technologies for the Visually Impaired. 2024 6th International Conference on Robotics, Intelligent Control and Artificial Intelligence (RICAI), 105-109. https://doi.org/10.1109/RICAI64321.2024.10911190
Lavric, A., Beguni, C., Zadobrischi, E., Căilean, A., & Avătămăniței, S. (2024). A Comprehensive Survey on Emerging Assistive Technologies for Visually Impaired Persons: Lighting the Path with Visible Light Communications and Artificial Intelligence Innovations. Sensors (Basel, Switzerland), 24. https://doi.org/10.3390/s24154834
Balakrishnan, M. (2022). Computing and assistive technology solutions for the visually impaired. Communications of the ACM, 65, 44 - 47. https://doi.org/10.1145/3551634
Kathiria, P., Mankad, S., Patel, J., Kapadia, M., & Lakdawala, N. (2024). Assistive systems for visually impaired people: A survey on current requirements and advancements. Neurocomputing, 606, 128284. https://doi.org/10.1016/j.neucom.2024.128284
Katke, S., & Pacharaney, U. (2024). Smart Solutions for Visual Impairment by AI-Based Assistive Devices. 2024 2nd DMIHER International Conference on Artificial Intelligence in Healthcare, Education and Industry (IDICAIEI), 1-5. https://doi.org/10.1109/idicaiei61867.2024.10842872
Zafar, S., Asif, M., Ahmad, M., Ghazal, T., Faiz, T., Ahmad, M., & Khan, M. (2022). Assistive Devices Analysis for Visually Impaired Persons: A Review on Taxonomy. IEEE Access, PP, 1-1. https://doi.org/10.1109/ACCESS.2022.3146728
Manirajee, L., Shariff, S., & Rashid, S. (2024). Assistive Technology for Visually Impaired Individuals: A Systematic Literature Review (SLR). International Journal of Academic Research in Business and Social Sciences. https://doi.org/10.6007/ijarbss/v14-i2/20827
Madake, J., Bhatlawande, S., Solanke, A., & Shilaskar, S. (2023). A Qualitative and Quantitative Analysis of Research in Mobility Technologies for Visually Impaired People. IEEE Access, 11, 82496-82520. https://doi.org/10.1109/ACCESS.2023.3291074
Sandler, M., Howard, A., G., Zhu, M., Zhmoginov, A., Chen, L., C. (2017). “MobileNetV2: Inverted Residuals and Linear Bottlenecks”, Google Inc.
Reddy, K. G., & Basha, S. S. (2025, March). Real Time Object Identification: A Study on COCO Dataset. In International Conference on Advanced Materials, Manufacturing and Sustainable Development (ICAMMSD 2024) (pp. 860-870). Atlantis Press.






