Development of an AI-based object detection tool for the visually impaired using Raspberry Pi and a camera. Case study: Griya Harapan Social Service Center for the Disabled, Cimahi, Jawa Barat

Authors

  • Achmad Lukman School of Computing, Telkom University, Bandung, Indonesia
  • Aaz Muhammad Hafidz Azis School of Computing, Telkom University, Bandung, Indonesia
  • I Wayan Palton Anuwiksa School of Computing, Telkom University, Bandung, Indonesia

DOI:

https://doi.org/10.35568/abdimas.v8i4.7204

Keywords:

visually impaired, Raspberry Pi, CNN, Assistive device, Community service

Abstract

The limitation of identifying Objects in the surrounding environment is a major problem for blind people, especially those with low vision (who cannot see at all), which impacts their independence and participation in socio-economic life. To address this problem, the Community Service Team of the Faculty of Informatics at Telkom University conducted community service activities funded by Diktisaintek to develop and implement an AI-based visual aid for the blind. This aid utilizes a Raspberry Pi, camera, and headset that can recognize approximately 80 objects. The implementation method includes observation at the Griya Harapan Difabel Social Service Center as a partner, technology design, socialization and training on its use, field assistance, and evaluation. The evaluation model was carried out by implementing direct interviews with users to determine the objects that can be detected by the aid when using the device. The implementation results showed that the recognition accuracy level reached 80%. The social impacts achieved include increased independence for people who are blind, reduced risk of accidents, and new opportunities to participate in socio-economic activities. Obstacles encountered include limited datasets, variations in initial user skills, and the relatively high cost of the device. However, there are still ample opportunities for development, such as integration with mobile applications, improving CNN accuracy, and adding GPS features. This program demonstrates that technological innovation can be a sustainable solution to support the well-being and independence of people with disabilities.

Downloads

Download data is not yet available.

References

Hakobyan, L., Lumsden, J., O’Sullivan, D., & Bartlett, H. (2013). Mobile assistive technologies for the visually impaired.. Survey of ophthalmology, 58 6, 513-28. https://doi.org/10.1016/j.survophthal.2012.10.004

Kral, R., Jacko, P., & Vince, T. (2025). Low-Cost Multifunctional Assistive Device for Visually Impaired Individuals. IEEE Access, 13, 56326-56337. https://doi.org/10.1109/ACCESS.2025.3554366

Manjari, K., Verma, M., & Singal, G. (2020). A survey on Assistive Technology for visually impaired. Internet Things, 11, 100188. https://doi.org/10.1016/j.iot.2020.100188

Naayini, P., Myakala, P., Bura, C., Jonnalagadda, A., & Kamatala, S. (2025). AI-Powered Assistive Technologies for Visual Impairment. ArXiv, abs/2503.15494. https://doi.org/10.48550/arXiv.2503.15494

Elmannai, W., & Elleithy, K. (2017). Sensor-Based Assistive Devices for Visually-Impaired People: Current Status, Challenges, and Future Directions. Sensors (Basel, Switzerland), 17. https://doi.org/10.3390/s17030565

Beingolea, J., Zea-Vargas, M., Huallpa, R., Vilca, X., Bolivar, R., & Rendulich, J. (2021). Assistive Devices: Technology Development for the Visually Impaired. Designs. https://doi.org/10.3390/designs5040075

Zhang, Q., & Zhou, Y. (2024). Embodied Intelligence Applications in Assistive Technologies for the Visually Impaired. 2024 6th International Conference on Robotics, Intelligent Control and Artificial Intelligence (RICAI), 105-109. https://doi.org/10.1109/RICAI64321.2024.10911190

Lavric, A., Beguni, C., Zadobrischi, E., Căilean, A., & Avătămăniței, S. (2024). A Comprehensive Survey on Emerging Assistive Technologies for Visually Impaired Persons: Lighting the Path with Visible Light Communications and Artificial Intelligence Innovations. Sensors (Basel, Switzerland), 24. https://doi.org/10.3390/s24154834

Balakrishnan, M. (2022). Computing and assistive technology solutions for the visually impaired. Communications of the ACM, 65, 44 - 47. https://doi.org/10.1145/3551634

Kathiria, P., Mankad, S., Patel, J., Kapadia, M., & Lakdawala, N. (2024). Assistive systems for visually impaired people: A survey on current requirements and advancements. Neurocomputing, 606, 128284. https://doi.org/10.1016/j.neucom.2024.128284

Katke, S., & Pacharaney, U. (2024). Smart Solutions for Visual Impairment by AI-Based Assistive Devices. 2024 2nd DMIHER International Conference on Artificial Intelligence in Healthcare, Education and Industry (IDICAIEI), 1-5. https://doi.org/10.1109/idicaiei61867.2024.10842872

Zafar, S., Asif, M., Ahmad, M., Ghazal, T., Faiz, T., Ahmad, M., & Khan, M. (2022). Assistive Devices Analysis for Visually Impaired Persons: A Review on Taxonomy. IEEE Access, PP, 1-1. https://doi.org/10.1109/ACCESS.2022.3146728

Manirajee, L., Shariff, S., & Rashid, S. (2024). Assistive Technology for Visually Impaired Individuals: A Systematic Literature Review (SLR). International Journal of Academic Research in Business and Social Sciences. https://doi.org/10.6007/ijarbss/v14-i2/20827

Madake, J., Bhatlawande, S., Solanke, A., & Shilaskar, S. (2023). A Qualitative and Quantitative Analysis of Research in Mobility Technologies for Visually Impaired People. IEEE Access, 11, 82496-82520. https://doi.org/10.1109/ACCESS.2023.3291074

Sandler, M., Howard, A., G., Zhu, M., Zhmoginov, A., Chen, L., C. (2017). “MobileNetV2: Inverted Residuals and Linear Bottlenecks”, Google Inc.

Reddy, K. G., & Basha, S. S. (2025, March). Real Time Object Identification: A Study on COCO Dataset. In International Conference on Advanced Materials, Manufacturing and Sustainable Development (ICAMMSD 2024) (pp. 860-870). Atlantis Press.

Downloads

Published

2025-10-31

How to Cite

Development of an AI-based object detection tool for the visually impaired using Raspberry Pi and a camera. Case study: Griya Harapan Social Service Center for the Disabled, Cimahi, Jawa Barat. (2025). ABDIMAS: Jurnal Pengabdian Masyarakat, 8(4), 2264-2274. https://doi.org/10.35568/abdimas.v8i4.7204