A System to Generate SignWriting for Video Tracks Enhancing Accessibility of Deaf People
DOI:
https://doi.org/10.9781/ijimai.2017.09.002Keywords:
Accessibility, Deaf, Machine Translation, Sign Language, SignWritingAbstract
Video content has increased much on the Internet during last years. In spite of the efforts of different organizations and governments to increase the accessibility of websites, most multimedia content on the Internet is not accessible. This paper describes a system that contributes to make multimedia content more accessible on the Web, by automatically translating subtitles in oral language to SignWriting, a way of writing Sign Language. This system extends the functionality of a general web platform that can provide accessible web content for different needs. This platform has a core component that automatically converts any web page to a web page compliant with level AA of WAI guidelines. Around this core component, different adapters complete the conversion according to the needs of specific users. One adapter is the Deaf People Accessibility Adapter, which provides accessible web content for the Deaf, based on SignWritting. Functionality of this adapter has been extended with the video subtitle translator system. A first prototype of this system has been tested through different methods including usability and accessibility tests and results show that this tool can enhance the accessibility of video content available on the Web for Deaf people.Downloads
References
Shiver, B. N., & Wolfe, R. J. (2015). Evaluating Alternatives for Better Deaf Accessibility to Selected Web-Based Multimedia. Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (pp. 231–238). New York, NY, USA: ACM Press. doi: 10.1145/2700648.2809857
Cordero, A., Lluch, C.J., Sanabria-Codesal, E., & Torregrosa, J.R. (2015). Towards a better learning models through OCWs and MOOCs. International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 3, No. 4. pp. 26-30. doi: 10.9781/ijimai.2015.345
Caldwell, B., Cooper, M., Guarino Reid, L., & Vanderheiden, G. (Eds.). (2008). Web Content Accessibility Guidelines (WCAG) 2.0. W3C Recommendation. Retrieved from http://www.w3.org/TR/WCAG20/
Fulton, C. (2011). Web Accessibility, Libraries, and the Law. Information Technology and Libraries, Vol. 30, No. 1, pp. 34-43. doi: 10.6017/ital.v30i1.3043
Crespo, R.G., Espada, J.P., Burgos, D., & Verdú, E. (2016). Social4All: Collaborative Platform for Improving Web Accessibility. In Proceedings of the XVII International Conference on Human Computer Interaction (pp. 33:1-33:2). New York, NY, USA: ACM. doi: 10.1145/2998626.2998629
Crespo, R.G., Aguilar, L.J., & Martínez, O. S. (2012). Improving access to IT services for people with disability through software aids. Journal of Ambient Intelligence and Smart Environments, Vol. 4, No. 6, pp. 563-564. doi: 10.3233/AIS-2012-0181
Crespo, R. G., Martíne, O. S., Lovelle, J. M., García-Bustelo, B. C., Díaz, V. G., & Ordoñez de Pablos, P. (2012). Improving Cognitive Load on Students with Disabilities through Software Aids. In Cakir, A., & Ordóñez de Pablos, P. (Eds.), Social Development and High Technology Industries: Strategies and Applications (pp. 163-175). Hershey, PA, USA: IGI Global. doi: 10.4018/978-1-61350-192-4.ch011
Pascual, A., Ribera, M., & Granollers, T. (2015). Impact of web accessibility barriers on users with a hearing impairment. DYNA, Vol. 82, No. 193, pp. 233–240. doi: 10.15446/dyna.v82n193.53499
Báez-Montero, I., & Fernández Soneira, A.M. (2010). Spanish deaf people as recipients of closed captioning. In A. Matamala & P. Orero (Eds.), Listening to Subtitles: Subtitles for the Deaf and Hard of Hearing. (pp. 25-44). Bern (Switzerland): Peter Lang.
Oliveira, F. C. de M.B., Gomes, G.N.C., de Freitas, A.T., de Oliveira, A.C., Silva, L.C., & Queiroz, B. (2015). A Comparative Study of the Acceptability of Signs for the Brazilian Sign Language Created in Person and Remotely. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education (pp. 207-211). New York, NY, USA: ACM. doi: 10.1145/2676723.2677293
Fromkin, V., Rodman, R., & Hyams, N. M. (2014). An introduction to language (Tenth edition). Boston, MA, USA: Wadsworth/Cengage Learning.
Bianchini, C.S., Borgia, F., & de Marsico, M. (2012). SWift - A SignWriting Editor to Bridge between Deaf World and E-learning. In 2012 IEEE 12th International Conference on Advanced Learning Technologies (ICALT) (pp. 526-530). IEEE. doi: 10.1109/ICALT.2012.235
Parkhurst, S., & Parkhurst, D. (2010) A Cross-Linguistic Guide to SignWriting: A Phonetic Approach. Retrieved from http://www.signwriting.org/archive/docs7/sw0617_Cross_Linguistic_Guide_SignWriting_Parkhurst.pdf
San-Segundo, R., Montero, J. M., Córdoba, R., Sama, V., Fernández, F., D’Haro, L. F., López-Ludeña, V., Sánchez, D., & García, A. (2012). Design, development and field evaluation of a Spanish into sign language translation system. Pattern Analysis and Applications, Vol. 15, No. 2, pp. 203-224.
de Araújo, T.M.U., Ferreira, F.L.S., Silva, D.A.N.S., Oliveira, L.D., Falcão, E.L., Domingues, L.A., Martins, V.F., Portela, I.A.C., Nóbrega, Y.S., Lima, H.R.G., Filho, G.L.S., Tavares, T.A., & Duarte, A. N. (2014). An approach to generate and embed sign language video tracks into multimedia contents. Information Sciences, Vol. 281, pp. 762-780. doi: 10.1016/j.ins.2014.04.008
López-Ludeña, V., González-Morcillo, C., López, J. C., Ferreiro, E., Ferreiros, J., & San-Segundo, R. (2014). Methodology for developing an advanced communications system for the Deaf in a new domain. Knowledge-Based Systems, Vol. 56, pp. 240–252. doi: 10.1016/j.knosys.2013.11.017
López-Ludeña, V., González-Morcillo, C., López, J. C., Barra-Chicote, R., Cordoba, R., & San-Segundo, R. (2014). Translating bus information into sign language for deaf people. Engineering Applications of Artificial Intelligence, Vol. 32, pp. 258–269. doi: 10.1016/j.engappai.2014.02.006
Crespo, R.G., Fernández, G.G., Martínez, O.S., Franco, E.T., & Aguilar, L.J. (2009). Intelligent Streaming Server for Non Accessible Contents Stored on Web Servers to Disabled People: Signwritting Case. In J.M. Cochado et al. (Eds.), International Symposium on Distributed Computing and Artificial Intelligence 2008 (DCAI 2008) (pp. 512-520). Berlin Heidelberg: Springer-Verlag.
da Rocha Costa, A. C., & Pereira Dimuro, G. (n.d.). Supporting Deaf Sign Languages in Written Form on the Web. Retrieved from: http://www.signwriting.org/forums/software/swml/swml01.html
Cazenave, F., Quint, V., & Roisin, C. (2011). Timesheets.js: when SMIL meets HTML5 and CSS3. In Proceedings of the 11th ACM symposium on Document engineering (pp. 43-52). New York, NY, USA: ACM. doi: 10.1145/2034691.2034700
Bulterman, D., Jansen, J., Cesar, P., Mullender, S., Hyche, E., DeMeglio, M., Quint, J., Kawamura, H., Weck, D., García-Pañeda, X., Melendi, D., Cruz-Lara, S., Hanclik, M., Zucker, D.F., & Michel, T. (2008). Synchronized Multimedia Integration Language (SMIL 3.0), W3C Recommendation. W3C. Retrieved from: http://www.w3.org/TR/RECsmil/
Jalava, T., Honkala, M., Pohja, M., & Vuorimaa, P. (2005). Timesheets: XML Timing Language. W3C. Retrieved from: http://www.w3.org/Submission/xml-timing/
WAVE. (2017). WAVE Web accessibility evaluation tool. Retrieved from: http://wave.webaim.org
Section 508. (2017). Section 508 Standards. Retrieved from: https://www.section508.gov/summary-section508-standards
Hassan, Y., & Martín, F.J. (2003). Guía de Evaluación Heurística de Sitios Web. Retrieved from: http://www.nosolousabilidad.com/articulos/heuristica.htm
.
Schrepp, M., Hinderks, A., & Thomaschewski, J. (2017). Construction of a Benchmark for the User Experience Questionnaire (UEQ). International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 4, No. 4, pp. 40-44. doi: 10.9781/ijimai.2017.445
Bader, F., Schön, E.M., & Thomaschewski, J. (2017). Heuristics Considering UX and Quality Criteria for Heuristics. International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 4, No. 6, pp. 48-53. doi: 10.9781/ijimai.2017.05.001
Bouzid, Y., & Jemni, M. (2013). An animated avatar to interpret signwriting transcription. 2013 International Conference on Electrical Engineering and Software Applications (ICEESA) (pp. 1-5). doi: 10.1109/ICEESA.2013.6578394
Crespo, R.G. & Martínez, O.S. (2010). The Web 3.0 in the service of the people with severe deafness through the accessibility guidelines 2.0. Sociedad y Utopía, No. 36, pp. 153-172.
Downloads
Published
-
Abstract87
-
PDF20
Submit Article
Information
