Problem
Learning sign language can be difficult. Sure, there are lots of resources out there, be it YouTube videos, books, classes, et cetera. Most all of these (personal instruction excluded) are one-way streets. They demonstrate 2-dimensionally the finger positions and movement you need. That's great, but it lacks feedback. There is an element of interactivity that is elementally missing.
Proposed Solution
By utilizing 3D printable hands (most notably - the Parloma Hand) along with hand-sensing 3D vision systems (in my initial suggestion, a LeapMotion controller), one could both demonstrate visually a sign and track a learner's attempt at reproducing that sign.
By incorporating this method of demonstration and hand tracking, a feedback system could be instituted. First, a learner is displayed a simple sign and written/auditory equivalent. Then, the learner makes an attempt. Based on that, the system could give an accuracy reading. Depending on the reproduction accuracy, the demonstration hand could either repeat the movement normally, or potentially with an exaggeration of the movements that the learner needs to hone in on.
This system of continuous feedback could foster a very effective learning system. With just a hand and wrist, only basic signs could be used. However, getting the basics down and perfected is a major stepping stone in learning a new language (be it visual, written, or spoken).
Given the affordability of 3D printing, an entire solution could be built for around $200 (material cost - software development not factored in). This affordability would make it appeal to those hoping to learn sign language, as well as in clinical settings.
Potential Problems
Creating a learning system is hard! Software like RosettaStone has been developed for years and still costs hundreds, if not thousands of dollars. Research around interactive learning is prevalent, however taking that research in suggested teaching methods and actually implementing it into a practical and easy-to-use system is time consuming to say the least. That being said, a proof of concept could potentially be made quickly by utilizing projects already in development (such as the Parloma hand and libraries people have built for ASL tracking via the LeapMotion).
3D printed hands are great, there is no doubt. That being said, the cost of cheap rapid development-quality is much less than the cost of something with the durability required for clinical or consumer settings. I can print a hand on my printer in PLA in a matter of hours (I've printed about 5 of them so far - go ahead, ask me anything :) - however PLA is not strong enough to be a viable product. Something like Nylon or other high-impact materials would be preferred. On top of that, higher quality printing and/or injection molding would need to be used to get something with a production-ready finish. Both of these raise the price.
On top of this, the LeapMotion is a great place to start, however it lacks some of the abilities that higher-cost alternatives offer. Namely, it is very sensitive to ambient IR light. Hand and finger tracking also doesn't always have the highest confidence (rating of how sure it is that the learner's hand truly is making the movement the LeapMotion is picking up).
Suggested Reading
Translating sign language in real time
A Cognitive Approach to Language Learning
Problem
Learning sign language can be difficult. Sure, there are lots of resources out there, be it YouTube videos, books, classes, et cetera. Most all of these (personal instruction excluded) are one-way streets. They demonstrate 2-dimensionally the finger positions and movement you need. That's great, but it lacks feedback. There is an element of interactivity that is elementally missing.
Proposed Solution
By utilizing 3D printable hands (most notably - the Parloma Hand) along with hand-sensing 3D vision systems (in my initial suggestion, a LeapMotion controller), one could both demonstrate visually a sign and track a learner's attempt at reproducing that sign.
By incorporating this method of demonstration and hand tracking, a feedback system could be instituted. First, a learner is displayed a simple sign and written/auditory equivalent. Then, the learner makes an attempt. Based on that, the system could give an accuracy reading. Depending on the reproduction accuracy, the demonstration hand could either repeat the movement normally, or potentially with an exaggeration of the movements that the learner needs to hone in on.
This system of continuous feedback could foster a very effective learning system. With just a hand and wrist, only basic signs could be used. However, getting the basics down and perfected is a major stepping stone in learning a new language (be it visual, written, or spoken).
Given the affordability of 3D printing, an entire solution could be built for around $200 (material cost - software development not factored in). This affordability would make it appeal to those hoping to learn sign language, as well as in clinical settings.
Potential Problems
Creating a learning system is hard! Software like RosettaStone has been developed for years and still costs hundreds, if not thousands of dollars. Research around interactive learning is prevalent, however taking that research in suggested teaching methods and actually implementing it into a practical and easy-to-use system is time consuming to say the least. That being said, a proof of concept could potentially be made quickly by utilizing projects already in development (such as the Parloma hand and libraries people have built for ASL tracking via the LeapMotion).
3D printed hands are great, there is no doubt. That being said, the cost of cheap rapid development-quality is much less than the cost of something with the durability required for clinical or consumer settings. I can print a hand on my printer in PLA in a matter of hours (I've printed about 5 of them so far - go ahead, ask me anything :) - however PLA is not strong enough to be a viable product. Something like Nylon or other high-impact materials would be preferred. On top of that, higher quality printing and/or injection molding would need to be used to get something with a production-ready finish. Both of these raise the price.
On top of this, the LeapMotion is a great place to start, however it lacks some of the abilities that higher-cost alternatives offer. Namely, it is very sensitive to ambient IR light. Hand and finger tracking also doesn't always have the highest confidence (rating of how sure it is that the learner's hand truly is making the movement the LeapMotion is picking up).
Suggested Reading
Translating sign language in real time
A Cognitive Approach to Language Learning