research-article

Open access

Toward supporting quality alt text in computing publications

Authors:

Candace Williams,

Lilian de Greef,

Ed Harris, III,

Leah Findlater,

Cynthia BennettAuthors Info & Claims

W4A '22: Proceedings of the 19th International Web for All Conference

Article No.: 20, Pages 1 - 12

https://doi.org/10.1145/3493612.3520449

Published: 27 April 2022 Publication History

Abstract

Abstract

While researchers have examined alternative (alt) text for social media and news contexts, few have studied the status and challenges for authoring alt text of figures in computing-related publications. These figures are distinct, often conveying dense visual information, and may necessitate unique accessibility solutions. Accordingly, we explored how to support authors in creating alt text in computing publications---specifically in the field of human-computer interaction (HCI). We conducted two studies: (1) an analysis of 300 recently published figures at a general HCI conference (ACM CHI), and (2) interviews with 10 researchers in HCI and related fields who have varying levels of experience writing alt text. Our findings characterize the prevalence, quality, and patterns of recent figure alt text and captions. We further identify challenges authors encounter, describing their workflow barriers and confusions around how to compose alt text for complex figures. We conclude by outlining a research agenda on process, education, and tooling opportunities to improve alt text in computing-related publications.

AI Summary

AI-Generated Summary (Experimental)

This summary was generated using automated tools and was not authored or reviewed by the article's author(s). It is provided to support discovery, help readers assess relevance, and assist readers from adjacent research areas in understanding the work. It is intended to complement the author-supplied abstract, which remains the primary summary of the paper. The full article remains the authoritative version of record. Click here to learn more.

Click here to comment on the accuracy, clarity, and usefulness of this summary. Doing so will help inform refinements and future regenerated versions.

To view this AI-generated plain language summary, you must have Premium access.

Formats available

You can view the full content in the following formats:

Supplementary Material

This file includes the data tables for Figure 2 in the paper. (figure-2-data-tables.zip)

Download
2.13 KB

References

[1]

Maneesh Agrawala, Wilmot Li, and Floraine Berthouzoz. "Design principles for visual communication." Communications of the ACM 54.4 (2011): 60--69.

[2]

Apple. Use VoiceOver Recognition on your iPhone or iPad. Retrieved 1/6/2022 from https://support.apple.com/en-sa/HT211899

[3]

Apple Developer Documentation. Audio Graphs. Retrieved 1/6/2022 from https://developer.apple.com/documentation/accessibility/audio_graphs

[4]

Terry Barrett. "A comparison of the goals of studio professors conducting critiques and art education goals for teaching criticism." Studies in art education 30.1 (1988): 22--27.

[5]

Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, and Tom Yeh. 2010. VizWiz: nearly real-time answers to visual questions. In Proceedings of the 23rd annual ACM symposium on User interface software and technology (UIST '10). Association for Computing Machinery, New York, NY, USA, 333--342.

Digital Library

[6]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (January 2006), 77--101.

[7]

Richard Burns, Sandra Carberry, and Stephanie Elzer. 2010. Visual and Spatial Factors in a Bayesian Reasoning Framework for the Recognition of Intended Messages in Grouped Bar Charts. In Workshops at the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI Workshops '10). Available at https://www.aaai.org/ocs/index.php/WS/AAAIW10/paper/view/2017/2428

[8]

Amy Cesal. 2020. Writing Alt Text for Data Visualization. (July 2020). Retrieved December 2, 2021 from https://medium.com/nightingale/writing-alt-text-for-data-visualization-2a218ef43f81

[9]

CFPB Design System. 2021. Data visualization guidelines. (December 2021). Retreived December 2, 2021 from https://cfpb.github.io/design-system/guidelines/data-visualization-guidelines

[10]

Charles Chen, Ruiyi Zhang, Eunyee Koh, Sungchul Kim, Scott Cohen, Ryan Rossi. 2020. Figure Captioning with Relation Maps for Reasoning. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV '20). 1537--1545.

[11]

CHI 2019. Guide to an Accessible Submission. Retrieved 1/6/2022 from https://chi2019.acm.org/authors/papers/guide-to-an-accessible-submission/

[12]

CHI 2020. Guide to an Accessible Submission. Retrieved 1/6/2022 from https://chi2020.acm.org/authors/papers/guide-to-an-accessible-submission/

[13]

CHI 2021. Guide to an Accessible Submission. Retrieved 1/6/22 from https://chi2021.acm.org/for-authors/presenting/papers/guide-to-an-accessible-submission

[14]

CHI 2021. Making Your Final PDF Accessible. Retrieved 1/6/2022 from https://chi2021.acm.org/for-authors/presenting/papers/making-your-final-pdf-accessible

[15]

Jinho Choi, Sanghun Jung, Deok Gun Park, Jaegul Choo, Niklas Elmqvist. 2019. Visualizing for the Non-Visual: Enabling the Visually Impaired to Use Visualization. In Proceedings of the Annual Visualization Conference organized by the Eurographics Working Group on Data Visualization (EuroVis '19). Computer Graphics Forum, 38: 249--260.

[16]

Deanna P. Dannels, and Kelly Norris Martin. "Critiquing critiques: A genre analysis of feedback across novice to expert design studios." Journal of Business and Technical Communication 22.2 (2008): 135--159.

[17]

Seniz Demir, Sandra Carberry, Kathleen F. McCoy. 2012. Summarizing Information Graphics Textually. In Computational Linguistics 2012. 38 (3): 527--574.

[18]

The Diagram Center. Image Description Guidelines. Retrieved December 1, 2021 from http://diagramcenter.org/table-of-contents-2.html

[19]

The Diagram Center. Poet Image Description Tool. Retrieved 1/6/2022 from http://diagramcenter.org/poet.html

[20]

Leo Ferres, Petro Verkhogliad, Gitte Lindgaard, Louis Boucher, Antoine Chretien, and Martin Lachance. 2007. Improving accessibility to statistical graphs: the iGraph-Lite system. In Proceedings of the 9th international ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '07). Association for Computing Machinery, New York, NY, USA, 67--74.

Digital Library

[21]

Leo Ferres, Gitte Lindgaard, Livia Sumegi, and Bruce Tsuji. 2013. Evaluating a Tool for Improving Accessibility to Charts and Graphs. ACM Trans. Comput.-Hum. Interact. 20, 5, Article 28 (November 2013), 32 pages.

Digital Library

[22]

Matthew Fisher, Vineet Agarwal, and Tarun Beri. 2021. Automatic Hierarchical Arrangement of Vector Designs. (2021).

[23]

Joseph Fleiss. "Statistical methods for rates and proportions." Statistical methods for rates and proportions. 1981. 321--321.

[24]

Darren Guinness, Edward Cutrell, and Meredith Ringel Morris. 2018. Caption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Paper 518, 1--11.

Digital Library

[25]

Cole Gleason, Patrick Carrington, Cameron Cassidy, Meredith Ringel Morris, Kris M. Kitani, and Jefrey P. Bigham. 2019. "It's Almost like They're Trying to Hide It": How User-Provided Image Descriptions Have Failed to Make Twitter Accessible. In The World Wide Web Conference (San Francisco, CA, USA) (WWW '19). Association for Computing Machinery, New York, NY, USA, 549--559.

Digital Library

[26]

Cole Gleason, Amy Pavel, Xingyu Liu, Patrick Carrington, Lydia B. Chilton, and Jeffrey P. Bigham. 2019. Making Memes Accessible. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '19). Association for Computing Machinery, New York, NY, USA, 367--376.

Digital Library

[27]

Cole Gleason, Amy Pavel, Emma McCamey, Christina Low, Patrick Carrington, Kris M. Kitani, and Jeffrey P. Bigham. 2020. Twitter A11y: A Browser Extension to Make Twitter Images Accessible. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--12.

Digital Library

[28]

Bryan Gould, Trisha O'Connell and Geoff Freed. 2008. Effective Practices for Description of Science Content within Digital Talking Book (December 2008). In The WGBH National Center for Accessible Media (NCAM). Retrieved December 2, 2021 from http://ncamftp.wgbh.org/ncam-old-site/experience_learn/educational_media/stemdx.html

[29]

Crescentia Jung, Shubham Mehta, Atharva Kulkarni, Yuhang Zhao, and Yea-Seul Kim. 2021. Communicating Visualizations without Visuals: Investigation of Visualization Alternative Text for People with Visual Impairments. In IEEE Transactions on Visualization and Computer Graphics (VIS '21).

Digital Library

[30]

David Lindlbauer, Michael Haller, Mark Hancock, Stacey D. Scott, and Wolfgang Stuerzlinger. 2013. Perceptual grouping: selection assistance for digital sketching. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS '13). Association for Computing Machinery, New York, NY, USA, 51--60.

Digital Library

[31]

Alan Lundgard and Arvind Satyanarayan. 2021. Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content. In IEEE Transactions on Visualization and Computer Graphics (VIS '21).

Digital Library

[32]

Kelly Mack, Edward Cutrell, Bongshin Lee, and Meredith Ringel Morris. 2021. Designing Tools for High-Quality Alt Text Authoring. The 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21). Association for Computing Machinery, New York, NY, USA, Article 23, 1--14.

Digital Library

[33]

Haley MacLeod, Cynthia L. Bennett, Meredith Ringel Morris, and Edward Cutrell. 2017. Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 5988--5999.

Digital Library

[34]

Microsoft. Seeing AI App from Microsoft. Retrieved 1/6/2022 from https://www.microsoft.com/en-us/ai/seeing-ai

[35]

Priscilla S. Moraes, Sandra Carberry, and Kathleen McCoy. 2013. Providing access to the high-level content of line graphs from online popular media. In Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A '13). Association for Computing Machinery, New York, NY, USA, Article 11, 1--10.

Digital Library

[36]

Priscilla Moraes, Gabriel Sina, Kathleen McCoy, and Sandra Carberry. 2014. Evaluating the accessibility of line graphs through textual summaries for visually impaired users. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility (ASSETS '14). Association for Computing Machinery, New York, NY, USA, 83--90.

Digital Library

[37]

Valerie S. Morash, Yue-Ting Siu, Joshua A. Miele, Lucia Hasty, and Steven Landau. 2015. Guiding Novice Web Workers in Making Image Descriptions Using Templates. ACM Trans. Access. Comput. 7, 4, Article 12 (November 2015), 21 pages.

Digital Library

[38]

Meredith Ringel Morris, Jazette Johnson, Cynthia L. Bennett, and Edward Cutrell. 2018. Rich Representations of Visual Content for Screen Reader Users. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Paper 59, 1--11.

Digital Library

[39]

Amy Pavel, Gabriel Reyes, and Jeffrey P. Bigham. 2020. Rescribe: Authoring and Automatically Editing Audio Descriptions. Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, New York, NY, USA, 747--759.

Digital Library

[40]

Yi-Hao Peng, Jeffrey P Bigham, and Amy Pavel. 2021. Slidecho: Flexible Non-Visual Exploration of Presentation Videos. The 23rd International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, New York, NY, USA, Article 24, 1--12.

Digital Library

[41]

Pennsylvania State University. 2021. Accessibility and Usability at Penn State: Charts & Accessibility. Retrieved December 2, 2021 from https://accessibility.psu.edu/images/charts/

[42]

Jason Obeid, Enamel Hoque. 2020. Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Model. In Proceedings of the 13th International Conference on Natural Language Generation (INLG '20). Association for Computational Linguistics, 138--147

[43]

Sujeath Pareddy, Anhong Guo, and Jeffrey P. Bigham. "X-Ray: Screenshot Accessibility via Embedded Metadata." The 21st International ACM SIGACCESS Conference on Computers and Accessibility. 2019.

Digital Library

[44]

Helen Petrie, Chandra Harrison, and Sundeep Dev. 2005. Describing images on the web: a survey of current practice and prospects for the future. In Proceedings of Human Computer Interaction International (HCII '05) 71

[45]

Jorge Poco, Jeffrey Heer. 2017. Reverse-Engineering Visualizations: Recovering Visual Encodings from Chart Images. In Proceedings of the Annual Visualization Conference organized by the Eurographics Working Group on Data Visualization (EuroVis '17). Computer Graphics Forum, 36: 353--363.

Digital Library

[46]

Emma Sadjo, Leah Findlater, and Abigale Stangl. 2021. Landscape Analysis of Commercial Visual Assistance Technologies. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21). Association for Computing Machinery, New York, NY, USA, Article 76, 1--4.

Digital Library

[47]

Elliot Salisbury, Ece Kamar, and Meredith Morris. 2017. Toward Scalable Social Alt Text: Conversational Crowdsourcing as a Tool for Refining Vision-to-Language Technology for the Blind. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. 5, 1 (AAAI '17), 147--156.

[48]

SAS. SAS Graphics Accelerator. Retrieved 1/6/2022 from https://chrome.google.com/webstore/detail/sas-graphics-accelerator/ockmipfaiiahknplinepcaogdillgoko?hl=en

[49]

Manolis Savva, Nicholas Kong, Arti Chhajta, Li Fei-Fei, Maneesh Agrawala, and Jeffrey Heer. 2011. ReVision: automated classification, analysis and redesign of chart images. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). Association for Computing Machinery, New York, NY, USA, 393--402.

Digital Library

[50]

Ather Sharif, Sanjana Shivani Chintalapati, Jacob O. Wobbrock, and Katharina Reinecke. 2021. Understanding Screen-Reader Users' Experiences with Online Data Visualizations. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21). Association for Computing Machinery, New York, NY, USA, Article 14, 1--16.

Digital Library

[51]

Bruno Splendiani, Mireia Ribera, and Miquel Centelles Velilla. 2014. Are figures accessible in mathematics academic journals?. Comunicació presentada a: 29th Annual International Technology and Persons with Disabilities Conference (San Diego, CA, USA) (CSUN '14).

[52]

Abigale Stangl, Meredith Ringel Morris, and Danna Gurari. 2020. "Person, Shoes, Tree. Is the Person Naked?" What People with Vision Impairments Want in Image Descriptions. Association for Computing Machinery, New York, NY, USA, 1--13.

Digital Library

[53]

Abigale Stangl, Nitin Verma, Kenneth R. Fleischmann, Meredith Ringel Morris, and Danna Gurari. 2021. Going Beyond One-Size-Fits-All Image Descriptions to Satisfy the Information Wants of People Who are Blind or Have Low Vision. The 23rd International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, New York, NY, USA, Article 16, 1--15.

Digital Library

[54]

Shari Trewin. 2019. Describing Figures. In Special Intrest Group on Accessible Computing (SIGACCESS) Resources. Retrieved on December 21, 2021 from https://www.sigaccess.org/welcome-to-sigaccess/resources/describing-figures/

[55]

W3C Web Accessibility Initiative. 2019. Web Accessibility Tutorials: Guidance on how to create websites that meet WCAG (July 2019). Retrieved December 2, 2021 from https://www.w3.org/WAI/tutorials/images/complex/

[56]

Jayne Wallace, John McCarthy, Peter C. Wright, and Patrick Olivier. 2013. Making design probes work. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). Association for Computing Machinery, New York, NY, USA, 3441--3450.

Digital Library

[57]

Web Accessibility in Mind (WebAIM). Alternative Text. Retrieved 1/6/2022 from https://webaim.org/techniques/alttext/

[58]

Web Accessibility in Mind (WebAIM). 2021. The WebAIM Million: An annual accessibility analysis of the top 1,000,000 home pages. (April 2021). Retrieved on December 2, 2021 from https://webaim.org/projects/million/

[59]

Shaomei Wu, Jeffrey Wieland, Omid Farivar, and Julie Schiller. 2017. Automatic Alt-text: Computer-generated Image Descriptions for Blind Users on a Social Network Service. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). Association for Computing Machinery, New York, NY, USA, 1180--1192.

Digital Library

Cited By

Iwamoto YRaees MHeard JTigwell G(2025)Exploring Generative AI to Support Disability Service Professionals in Writing Image Descriptions for HCI Science FiguresProceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663547.3759763(1-6)Online publication date: 26-Oct-2025
https://dl.acm.org/doi/10.1145/3663547.3759763
Cardia MBuzzi MGalesi GLeporini B(2025)A Descriptive Review of Image Datasets for Accessible Alternative Descriptions in STEM DomainsProceedings of the 16th Biannual Conference of the Italian SIGCHI Chapter10.1145/3750069.3750122(1-7)Online publication date: 6-Oct-2025
https://dl.acm.org/doi/10.1145/3750069.3750122
Froehlich JFiannaca AJaber NTsaran VKane S(2025)StreetViewAI: Making Street View Accessible Using Context-Aware Multimodal AIProceedings of the 38th Annual ACM Symposium on User Interface Software and Technology10.1145/3746059.3747756(1-22)Online publication date: 28-Sep-2025
https://dl.acm.org/doi/10.1145/3746059.3747756
Show More Cited By

Recommendations

Comments

View Table of Contents