Ai Converts Sign Language And Speech To Text: Fukuoka Launches Trial

At Fukuoka Hearing Special Needs School in Sawara Ward, Fukuoka City, children with hearing impairments participated in a demonstration of 'SureTalk,' an AI-powered communication tool that converts sign language into text.

On February 20th, 51 elementary and middle school students experienced the software firsthand.

Reporter Teruya: 'With this software, conversations can be conducted using both speech and sign language. Let’s try it out. What’s your favorite food?'

Student (via sign language): 'I like ramen.'

Reporter Teruya: 'As you can see, the sign language response appears as text on the screen.'

Developed by telecom giant SoftBank, SureTalk recognizes both spoken words and sign language, displaying them as text to facilitate communication between hearing and non-hearing individuals.

Since December last year, Fukuoka Prefecture has been conducting trials of the software, though challenges remain in sign language recognition. In some cases, adjustments in movement are necessary for accurate interpretation.

To improve recognition accuracy, SoftBank is gathering more sign language data, including recordings taken during the demonstration event.

Children who participated in the trial shared their impressions:

'It was fascinating to see sign language converted into text.'

'I’d love to use it if it becomes available on my mother’s phone.'

Nao Saito of SoftBank’s SureTalk division expressed enthusiasm: 'It was heartening to see the children engage with the technology so positively. While it’s still in development, we hope it will become a useful tool for them as they grow up.'

Fukuoka Prefecture will continue its trials until the end of October. A prefectural official emphasized the importance of raising awareness, stating, 'With this being the Deaflympics year, we hope more residents develop a deeper understanding of sign language.'

Source: FBS