吉林大学学报(理学版) ›› 2025, Vol. 63 ›› Issue (1): 99-0106.

• • 上一篇    下一篇

面向安卓应用GUI的视障用户可访问性测试方法

何振涛, 徐一放, 张梦玺, 刘华虓   

  1. 吉林大学 计算机科学与技术学院, 长春 130012
  • 收稿日期:2023-11-29 出版日期:2025-01-26 发布日期:2025-01-26
  • 通讯作者: 刘华虓 E-mail:liuhuaxiao@jlu.edu.cn

Accessibility Testing Method for Visually Impaired Users of Android Application GUI

HE Zhentao, XU Yifang, ZHANG Mengxi, LIU Huaxiao   

  1. College of Computer Science and Technology, Jilin University, Changchun 130012, China
  • Received:2023-11-29 Online:2025-01-26 Published:2025-01-26

摘要: 提出一种自动识别安卓应用中可读文本缺失问题组件的方法, 以提高应用的可访问性. 首先, 利用UI Automator提取应用的图形用户页面, 并对无关组件进行裁剪, 同时补全组件属性, 以生成相应的视图树; 其次, 设计3种启发式规则, 以识别视图树中存在可读文本缺失的组件, 通过对6个热门应用的评估实验, 该方法以平均97%的准确率成功识别了问题组件; 最后, 生成的测试报告通过在源码与截图中标记问题组件, 帮助应用开发者清晰定位并修复缺失的可读文本. 该研究成果不仅能有效改善视障用户的使用体验, 使他们更顺畅地与应用进行交互, 还为开发者提供了一种实用的工具, 促进安卓应用的整体可访问性提升. 通过这样的方式, 开发者可以更好地理解和解决可访问性问题, 为所有用户创造一个更友好的数字环境.

关键词: 可访问性, 可读文本, 替代文本, 问题组件识别

Abstract: We proposed a  method for automatically identifying components with missing readable text in Android applications to improve the accessibility of these applications. Firstly, We used UI Automator to extract the graphical user interface of the application,  prune  irrelevant components and  complete  component attributes to generate the corresponding view tree. Secondly, we designed three heuristic rules  to identify components with missing readable text in the view tree. Through evaluation experiments on six popular applications, the proposed method successfully identified problematic components with an average accuracy  of 97%. Finally, a generated test report helped application developers  clearly locate and rectify the missing readable text by marking the problematic components in both the source code and screenshots. The  research achievement not only effectively improves the user experience for visually impaired users, enabling them to  interact with the applications more smoothly, but also provides developers with a practical tool to promote the overall accessibility of Android applications. Through  this approach, developers can better understand and address accessibility issues, creating a more user-friendly digital environment for all users.

Key words: accessibility, readable text, alternative text, problematic component recognition

中图分类号: 

  • TP311.5