Paper The following article is Open access

Research and Discovery of Smart Dumb Gloves

, , and

Published under licence by IOP Publishing Ltd
, , Citation Xiaoshuang Yu et al 2021 J. Phys.: Conf. Ser. 1865 042054 DOI 10.1088/1742-6596/1865/4/042054

1742-6596/1865/4/042054

Abstract

According to the statistics of China's health organization, there are a large number of deaf-mute people in the whole country. Sign language is used to communicate between deaf and dumb people. When they communicate with people who don't know sign language, it will bring a lot of inconvenience. Based on the above problems, we propose a sign language gesture recognition system based on data glove. The overall architecture is composed of stnm32 MCU, flex4.5 bending sensor, mpu6050 six axis sensor, Bluetooth transmission module and mobile phone voice app. It collects the user's hand movement information through flex4.5 bending sensor and mpu6050 six axis sensor, Then the STM32 microcontroller processes the data and compares it with the action data in the database. Then the action voice command is sent to the mobile phone through the Bluetooth transmission module, and finally the voice playback and text display are carried out through the mobile phone app. The software of sign language gesture recognition system is developed by using processing software based on Java language, which is connected with it to complete the recognition of sign language actions, and then output the words to be said through the intelligent voice system.

Export citation and abstract BibTeX RIS

Content from this work may be used under the terms of the Creative Commons Attribution 3.0 licence. Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.

Please wait… references are loading.
10.1088/1742-6596/1865/4/042054