dc.contributor.author |
Kruger, Rynhardt P
|
|
dc.contributor.author |
De Wet, F
|
|
dc.contributor.author |
Niesler, T
|
|
dc.date.accessioned |
2024-01-18T10:06:43Z |
|
dc.date.available |
2024-01-18T10:06:43Z |
|
dc.date.issued |
2023-05 |
|
dc.identifier.citation |
Kruger, R.P., De Wet, F. & Niesler, T. 2023. Mathematical content browsing for print-disabled readers based on virtual-world exploration and audio-visual sensory substitution. <i>ACM Transactions on Accessible Computing (TACCESS), 16(2).</i> http://hdl.handle.net/10204/13525 |
en_ZA |
dc.identifier.issn |
1936-7228 |
|
dc.identifier.uri |
https://doi.org/10.1145/3584365
|
|
dc.identifier.uri |
http://hdl.handle.net/10204/13525
|
|
dc.description.abstract |
Documents containing mathematical content remain largely inaccessible to blind and visually impaired readers because they are predominantly published as untagged PDF which does not include the semantic data necessary for effective accessibility. We present a browsing approach for print-disabled readers specifically aimed at such mathematical content. This approach draws on the navigational mechanisms often used to explore the virtual worlds of text adventure games with audio-visual sensory substitution for graphical content. The relative spatial placement of the elements of an equation are represented as a virtual world, so that the reader can navigate from element to element. Text elements are announced conventionally using synthesised speech while graphical elements, such as roots and fraction lines, are rendered using a modification of the vOICe algorithm. The virtual world allows the reader to interactively discover the spatial structure of the equation, while the rendition of graphical elements as sound allows the shape and identity of elements that cannot be synthesised as speech to be discovered and recognised. The browsing approach was evaluated by eleven blind and fourteen sighted participants in a user trial that included the identification of twelve equations extracted from PDF documents. Overall, equations were identified completely correctly in 78% of cases (74% and 83% respectively for blind and sighted subjects). If partial correctness is considered, the performance is substantially higher. We conclude that the integration of a spatial model represented as a virtual world in conjunction with audio-visual sensory substitution for non-textual elements can be an effective way for blind and visually impaired readers to read currently inaccessible mathematical content in PDF documents. |
en_US |
dc.format |
Abstract |
en_US |
dc.language.iso |
en |
en_US |
dc.relation.uri |
https://dl.acm.org/doi/10.1145/3584365 |
en_US |
dc.source |
ACM Transactions on Accessible Computing (TACCESS), 16(2) |
en_US |
dc.subject |
Accessible computing |
en_US |
dc.subject |
Mathematics |
en_US |
dc.subject |
Sensory substitution |
en_US |
dc.subject |
Visually impaired readers |
en_US |
dc.subject |
Virtual worlds |
en_US |
dc.title |
Mathematical content browsing for print-disabled readers based on virtual-world exploration and audio-visual sensory substitution |
en_US |
dc.type |
Article |
en_US |
dc.description.pages |
27pp |
en_US |
dc.description.note |
© 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM. Due to copyright restrictions, the attached PDF file only contains the abstract of the full text item. For access to the full text item, please consult the publisher's website: https://dl.acm.org/doi/10.1145/3584365 |
en_US |
dc.description.cluster |
Next Generation Enterprises & Institutions |
en_US |
dc.description.impactarea |
Voice Computing |
en_US |
dc.identifier.apacitation |
Kruger, R. P., De Wet, F., & Niesler, T. (2023). Mathematical content browsing for print-disabled readers based on virtual-world exploration and audio-visual sensory substitution. <i>ACM Transactions on Accessible Computing (TACCESS), 16(2)</i>, http://hdl.handle.net/10204/13525 |
en_ZA |
dc.identifier.chicagocitation |
Kruger, Rynhardt P, F De Wet, and T Niesler "Mathematical content browsing for print-disabled readers based on virtual-world exploration and audio-visual sensory substitution." <i>ACM Transactions on Accessible Computing (TACCESS), 16(2)</i> (2023) http://hdl.handle.net/10204/13525 |
en_ZA |
dc.identifier.vancouvercitation |
Kruger RP, De Wet F, Niesler T. Mathematical content browsing for print-disabled readers based on virtual-world exploration and audio-visual sensory substitution. ACM Transactions on Accessible Computing (TACCESS), 16(2). 2023; http://hdl.handle.net/10204/13525. |
en_ZA |
dc.identifier.ris |
TY - Article
AU - Kruger, Rynhardt P
AU - De Wet, F
AU - Niesler, T
AB - Documents containing mathematical content remain largely inaccessible to blind and visually impaired readers because they are predominantly published as untagged PDF which does not include the semantic data necessary for effective accessibility. We present a browsing approach for print-disabled readers specifically aimed at such mathematical content. This approach draws on the navigational mechanisms often used to explore the virtual worlds of text adventure games with audio-visual sensory substitution for graphical content. The relative spatial placement of the elements of an equation are represented as a virtual world, so that the reader can navigate from element to element. Text elements are announced conventionally using synthesised speech while graphical elements, such as roots and fraction lines, are rendered using a modification of the vOICe algorithm. The virtual world allows the reader to interactively discover the spatial structure of the equation, while the rendition of graphical elements as sound allows the shape and identity of elements that cannot be synthesised as speech to be discovered and recognised. The browsing approach was evaluated by eleven blind and fourteen sighted participants in a user trial that included the identification of twelve equations extracted from PDF documents. Overall, equations were identified completely correctly in 78% of cases (74% and 83% respectively for blind and sighted subjects). If partial correctness is considered, the performance is substantially higher. We conclude that the integration of a spatial model represented as a virtual world in conjunction with audio-visual sensory substitution for non-textual elements can be an effective way for blind and visually impaired readers to read currently inaccessible mathematical content in PDF documents.
DA - 2023-05
DB - ResearchSpace
DP - CSIR
J1 - ACM Transactions on Accessible Computing (TACCESS), 16(2)
KW - Accessible computing
KW - Mathematics
KW - Sensory substitution
KW - Visually impaired readers
KW - Virtual worlds
LK - https://researchspace.csir.co.za
PY - 2023
SM - 1936-7228
T1 - Mathematical content browsing for print-disabled readers based on virtual-world exploration and audio-visual sensory substitution
TI - Mathematical content browsing for print-disabled readers based on virtual-world exploration and audio-visual sensory substitution
UR - http://hdl.handle.net/10204/13525
ER -
|
en_ZA |
dc.identifier.worklist |
27341 |
en_US |