Desarrollo de un juego didáctico mediante sensores Leap Motion para estimular el aprendizaje del lenguaje básico de señas ecuatoriano

In this project of degree the development of a didactic game for the teaching-learning of the basic language of Ecuadorian signs, for people with hearing impairment is presented without discarding that the system can be used by children, youth and adults that have or not this disability and with int...

Descripción completa

Autor Principal: Parreño Alvarez, Mateo Alejandro
Formato: bachelorThesis
Idioma: spa
Publicado: 2018
Materias:
Acceso en línea: http://dspace.ups.edu.ec/handle/123456789/15289
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
Sumario: In this project of degree the development of a didactic game for the teaching-learning of the basic language of Ecuadorian signs, for people with hearing impairment is presented without discarding that the system can be used by children, youth and adults that have or not this disability and with interest in learning the basic language of Ecuadorian signs. The input device is a Leap Motion, which detects the gestural signals through the recognition of the bones and joints of each finger in the Unity3D software. For the processing of gestural signals, there is a classification system implemented in MatLab for the two types of signal configuration: static and dynamic; Correlation is used if the configuration is static (without movement) and the DTW algorithm for dynamic configurations (with movement). The communication between Unity3D and MatLab is bidirectional so that both environments can read and write data simultaneously in real time using shared memory. This application develops a didactic use with two games, implemented in Unity3D for a single player and multiplayer. The interface of the game consists of an interactive menu that allows to select two games which are; flight of letters that presents an image and a word, the objective is to complete the missing letters in the word and the game three in a row; It is a turn-based game, you must put an X or an O, trying to make a vertical, horizontal or diagonal line.