System disruptions
There are recurring service disruptions on some of the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Sign Language Detection Using an Apple Watch and Machine Learning: Integrating Apple Watch sensors and Machine Learning for development of Hand Sign Recognition application
Jönköping University, School of Engineering, JTH, Department of Computer Science and Informatics.
Jönköping University, School of Engineering, JTH, Department of Computer Science and Informatics.
2024 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

This thesis introduces an innovative application designed for the Apple Watch that aims to bridge the communication gap between hearing impaired individuals and those who can hear and speak by translating Swedish sign language into text and sound. Leveraging the growing popularity of smartwatches and their advanced sensors, the application utilizes the accelerometer, gyroscope, and rotation rate sensors from Apple's Core Motion framework. The application has been tested with eleven static hand gestures representing letters from the Swedish alphabet and seven moving hand gestures representing words from Swedish sign language. Two different machine learning models were employed: Random Forest for letter detection and an Activity Classifier model developed by Apple for word detection, both implemented using Create ML. In an experiment involving five participants who each performed the gestures and words ten times, the application achieved a letter detection accuracy rate of over 36%, with an average correct detection rate of 61.6%. For word detection, the success rate was above 88%, with an average detection accuracy of 96%.

Place, publisher, year, edition, pages
2024. , p. 50
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:hj:diva-65502OAI: oai:DiVA.org:hj-65502DiVA, id: diva2:1880636
Subject / course
JTH, Computer Engineering
Supervisors
Examiners
Available from: 2024-07-22 Created: 2024-07-01 Last updated: 2025-10-13Bibliographically approved

Open Access in DiVA

fulltext(1348 kB)771 downloads
File information
File name FULLTEXT01.pdfFile size 1348 kBChecksum SHA-512
1adc98f3614d3127cc104ce0a929fce2e7ac87e84ed4b782f5069f79a9330749107089810d759b504e2e493f93d88e41de6351521a0a4bb0c538f446cf7fe16e
Type fulltextMimetype application/pdf

By organisation
JTH, Department of Computer Science and Informatics
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 774 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1054 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf