Apparatus and method for aiding learning
10186160 ยท 2019-01-22
Inventors
Cpc classification
G09B13/04
PHYSICS
G09B23/285
PHYSICS
G09B5/02
PHYSICS
International classification
G09B5/02
PHYSICS
G09B13/04
PHYSICS
Abstract
Apparatus for aiding learning by a person comprises a cover or shield (1) for concealing from the person a part of the person's body, and a webcam (6) and a screen (10) for visually displaying to the person, during concealment of the concealed body part, images of a part of the person's body not in direct view of the person. The apparatus may be used in the learning of a skill, such as hand-writing. In another embodiment, the shield is a collar worn to conceal part of the wearer's body, and the webcam and screen display the concealed body part in real time to the wearer. This apparatus can be used in many applications, such as to learn sports activities or to correct body image, posture or movement.
Claims
1. Apparatus for aiding learning by a person, said apparatus comprising a shield being arranged to conceal from the person a part of the body of the person, and a display assembly being arranged to visually display to the person during concealment of the concealed body part one or more images of a part of the body of the person not in direct view of the person, wherein the display assembly includes a camera operatively coupled to a display screen arranged within direct view of the person, and the shield is arranged to enable the camera to capture images of a body part not in direct view of the person and relay the captured images to the display screen to be viewed by the person, and wherein the shield arranged to be positioned around a neck area of the person and arranged to conceal from direct view of the person a part of the body of the person below the shield, the shield comprising a collar having a support arranged to support the collar so that a front portion of the collar extends outwardly generally perpendicular to a chest of the person even when a head of the person inclines.
2. Apparatus as claimed in claim 1, wherein the apparatus is intended to aid a person in the learning of a skill, the shield is arranged to conceal at least parts of the body of the person used to perform the skill, and the display assembly is arranged to display images of the concealed body parts in real time during performance of the skill by the person.
3. Apparatus as claimed in claim 2, including a monitor that monitors accuracy of the performance and arranged for transmitting to the person, verbally or otherwise, evaluative information relating to the accuracy.
4. Apparatus as claimed in claim 3, wherein the information is arranged to be transmitted to the person in real time during the performance.
5. Apparatus as claimed in claim 2, wherein the performance of the skill involves use of an implement by the person, the shield is arranged also to conceal the implement during its use, and the display screen is arranged also to display images of said implement in real time during said performance.
6. Apparatus as claimed in claim 1, wherein the shield positioned around the neck area comprises a collar made from a self-supporting material, whereby said part of the body of the person below the collar can remain out of direct view of the person regardless of the movements of the person during wearing of the collar.
7. Apparatus as claimed in claim 1, wherein the shield positioned around the neck area is arranged to be supported from the head or ears of the person.
8. A shield for aiding learning of a person and being arranged to be positioned around the neck area of the person, said shield being arranged so that, when worn by the person, the shield being arranged to shield at least part of the body of the person from a direct visual field of the person, said shield being intended to be used, when worn by the person, in combination with a camera being arranged to capture images of the body of the person below the shield and a display screen arranged within direct view of the person for displaying said captured images to the person, said shield comprising a collar having a support being arranged to support the collar so that a front portion of the collar extends outwardly generally perpendicular to a chest of the person even when a head of the person inclines.
9. A shield as claimed in claim 8, wherein the shield is arranged to be supported from the person's head or ears.
10. A shield for aiding learning of speech by a person, such as learning a foreign language or speech therapy, said shield being arranged to be worn between the eyes and mouth of the person, said shield being intended to be used, when worn by the person, in combination with a video camera and a display screen, the video camera and the shield being arranged so that the video camera can capture images of only the lower part of the face of the person, in particular the mouth of the person below the shield during performance of speech by the person, and the display screen being arranged within direct view of the person so that said captured images can be displayed in real time to said person.
11. Apparatus for aiding learning of speech by a person, such as learning a foreign language or for speech therapy, said apparatus comprising a shield that conceals from the person a part of the body of the person, and a display assembly that visually displays to the person during concealment of the concealed body part one or more images of a part of the body of the person not in direct view of the person, wherein the display assembly includes a camera operatively coupled to a display screen arranged within direct view of the person, and the shield is arranged to enable the camera to capture images of a body part not in direct view of the person and relay the captured images to the display screen to be viewed by the person, and wherein the shield is arranged to be worn between the eyes and mouth of the person with the display assembly being arranged to display images of only the lower part of the face of the person, in particular the mouth of the person, below the shield in real time to the person during performance of speech by the person.
Description
(1) The invention will now be further described by way of examples only with reference to the accompanying drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8) Referring firstly to
(9) The camera 6 is connected, preferably by a USB cable 9, to a personal computer screen 10, or some other visual display means. The screen 10 is positioned to be within the direct view of the student.
(10) The personal computer 10 is configured to record, display and replay the images taken by the camera 6 from within the cover 1, as the student writes.
(11) By use of verbal coaching activated, for example, by the hand movement, the computer software may be able to monitor accuracy of letter formation, speed of writing, flow, etc. The coaching reinforces the knowledge that the style or neatness of writing is not the most important aspect of this exercise. It is all to do with how it feels for the brain to directly control the hand when writing; that slowing the writing down, gives the brain time to control the hand; and that the student's eyes do not need to directly see the hand. Writing whilst using the apparatus is intended to be more complex so that the student's ability to write will be reduced, and then when they return to writing normally (with hand seen), writing will be easier than it was before.
(12) The computer may provide on screen template paper for use with the camera, including for example a pen placement indicator and ruled lines or lines with shading. It may also include instructions to use the other hand to push the paper up after a line has been written on, once a point on the line has been reached.
(13) The size of the visual feedback on the screen should preferably be life-size, or smaller. A smaller screen forces the student to concentrate on the small image and focus more on the task.
(14) The display and feedback on the screen in real time can include a time delay. However any such delay in the visual feedback on the screen makes the activity harder to undertake. Minimal or no time delay is preferred for optimal effectiveness.
(15) The student writes a sample of text; either copied or made up, or alternatively a co-ordinated up/down movement or pattern with a pencil or pen, and watches the activity on the screen whilst being unable to directly see their hand.
(16) Student's writing posture would be naturally correct whilst using the apparatus, because it is too difficult to use the apparatus without sitting properly. The student's head is upright so that the student can see the screen, thereby preventing the student from slouching or leaning on to the table with their head on one side when writing. The cover/video camera position is such that the arm has to be extended in front of the student as per a proper posture required for writing.
(17) If the student's natural pen/pencil grip is incorrect, it would be corrected whilst using the apparatus, because an incorrect grip will result in the student not being able to see the point or nib of the pen/pencil on the screen and the student can only carry out the activity properly when the point or nib can be seen. Once the student has focussed on the feeling of a correct grip, this can be repeated without the apparatus.
(18) The provision of a disconnected real-time image of hand movement on the screen ensures the student can focus more on the feel of the brain/hand co-ordination whilst the eyes watch the screen. It proves to the student that they can think of a letter, recall its shape and write it, without their eyes seeing their hand and without their eyes causing the movements involved.
(19) By illustrating the movement in real-time on the screen, the student's learning ability is strengthened. They can feel, as well as see on screen, their hand moving but the two are disconnected or separated, and therefore the visual processing does not override the movement processing. In using the apparatus, the fine motor movement aspect of writing is highlighted. The apparatus enables the student to see their hand writing but with their hand being detached from their self. As the student's confidence in their hand's ability to write increases, so the visual need or desire to watch their hand decreases.
(20) This enables the development of automaticity of hand-writing. When the student resumes normal writing, i.e. being able to see their hand, the conscious awareness of the hand/brain movement for writing can still be felt, thought and noticed. The product forces the student to write in a more complex setting; the actual movements required remain unchanged, but carrying out the task is more difficult. The success of this apparatus is realized after having used it; writing is easier, posture is easier to correct as the student wrote with the correct posture, pen grip is easier to correct as the student has written with a proper pen grip. The apparatus forces the specific hand/brain co-ordination aspect of learning handwriting skills to be felt, and once the student has experienced these movements and knows what they feel like, then they can repeat them without the apparatus.
(21) The second embodiment shown in
(22)
(23) In this embodiment, the use of verbal coaching from the computer is activated by typing. The coaching reinforces the need to slow down, feel the fingers moving, enjoy getting to know where the fingers need to be by movement and not by sight.
(24) As in the first embodiment, the size of the visual feedback on the screen should preferably be life size, or smaller.
(25) The display on the computer screen can be split in half horizontally, one half showing visual relay of hands, and the other half showing touch typing software being used to learn to touch type. The user can position either product in either half as per their preference. The display is preferably real time, as a time delay in the visual feedback will make this activity very hard and will affect its effectiveness.
(26) Current methods for learning how to touch type rely on software programmes or games enabling the student to repetitively practice typing letters. Keyboard letters are often hidden to ensure the student remembers the positions of the keys without the visual prompt.
(27) The use of the correct finger for the correct key is checked by the teacher. However, in a classroom situation with many students learning, the use of incorrect fingers is an error which even the most vigilant teacher will often not be in a position to see.
(28) The method described here ensures that the correct finger has typed the correct key, and assists in the student learning to type by movement memory and not by sight.
(29) One method of use of the apparatus is as follows:
(30) Step 1
(31) The student types with their hands exposed, but with the camera mount 11 over their hands to enable videoing of the movement. The screen shows only the touch typing software that is being used. The product software uses finger recognition software with a webcam to monitor finger movement and checks that the correct finger is used to type the key specified. The typed key is only correct when the correct finger and key are used.
(32) Step 2
(33) The student's hands are still exposed, but in addition to the computer accuracy check, the screen is now split in half horizontallyone half shows visual relay of hands, other half shows touch typing software being used to learn to touch type. The student can position either product in either half as per their preference.
(34) The speed at which the user moves from step 1 to step 2 depends on their ability to cope with the information being displayed.
(35) Step 2 is complete only when the student can locate each of the keys, and position their hands in the proper starting position (i.e. with index fingers on the f and j keys with the other fingers placed on the adjacent keys).
(36) Once the student is fairly competent in using the keyboard, they can proceed to Step 3.
(37) Step 3
(38) The cover 15 is used so that the hands are concealed from direct view of the student. The screen display is as per Step 2.
(39) The modified embodiment shown in
(40) The embodiment shown in
(41) In this embodiment, the cover or shield is in the form of a collar 22 worn by the student in the neck area and shaped and dimensioned to conceal the student's body below the collar from the student's direct view. The collar 21 is preferably made from a self-supporting material so that it only shields the student's body from the student's own direct visual field. In this way, the concealed student's body and it's movements can still be captured by a video camera 6, and the captured images can be displayed on a computer screen 10 in the direct view of the student in the same way as the previous embodiments. The collar is preferably made from a material which is flexible as well as self-supporting. The collar 22 may have means for supporting the collar so that the front portion of the collar extends outwardly generally perpendicular to the wearer's chest even when the wearer inclines their head. This enables the wearer's body to remain out of direct view regardless of the wearer's movements during wearing of the collar. The supporting means may be a supporting strut 26 formed integrally with the collar 22. The strut 26 extends from the front portion into neck aperture 27 and is flexed downwards to abut the wearer's chest when the collar is worn, as shown in
(42) By using the collar 22, the breaking down of activities and learning components perfectly, with the use of real time visual feedback, can be applied to many physical activities.
(43) Athletes have a tendency to rely on vision for the coordination of movement instead of experience of the movement. The use of the visual feedback apparatus prevents this from happening, and promotes experiencing the movement specifically.
(44) Student (and coach where required) can work on one isolated component at a time taken from the overall movement, using the following steps: 1. Focus on the movement slowly in isolation, with the student watching the real time video relay, with that part of the body having been removed from their direct visual field. The student can see and learn the movement required, repetitively practice it perfectly at lower and then higher speeds. 2. Once confident that the student can perfectly replicate the movement, the screen is withdrawn (or the student closes their eyes). 3. ovement is again practiced but without the screen. 4. Provided movement is being performed properly, the student can resume the whole activitystarting easily so that they can concentrate on getting the component that they were working on right, i.e. if the student was playing tennis, they would not resume practice with a full on challenging relay to practice the new skill.
(45) The cover 1 or the shield 22 can be used in other applications in which the student is learning a particular manual activity, such as sewing, cake decorating, painting, etc. In those applications, the manual activity is carried out concealed from direct view of the student either in the cover or below the shield. The performance is captured by the camera and the images are displayed on the screen for the student to view. Forcing the student to view the activity on the screen and not directly by looking at their hand makes the activity more complicated and therefore requires the student to use a higher level of concentration than when viewing the activity directly. This teaches the student to improve their levels of concentration. Although the activity is displayed on the screen effectively in real time, the minute or very short delay caused by the electronic processing of the images through the camera to the screen, as opposed to viewing the activity directly, increases the degree of difficulty in performing the activity, thereby increasing the necessary level of concentration.
(46) Another embodiment of a shield worn by a person is shown in
(47) Learning languages is often challenging for many, and it is known that even for fluent bi/multi-lingual language speakers they will always be better in their mother tongue than the secondary languages.
(48) This embodiment uses real time video imagery of the student with video imagery of the teacher to enhance the learning process.
(49) The apparatus is preferably used as follows: 1. Teacher Video imagerythe mouth of a person for whom the language is their native language is shown speaking the words to be learntthese could be single or multiple words or sentences. It is important that the speaker is native to the country of the language being learnt as their mouth movements will naturally create the sounds particular to that language. Not all of the face is shownonly the lower half of the faceshowing the whole face provides more information than is necessary, and would create an irrelevant mental distraction. 2. The student learning the language wears the shield 28 on their face. The webcam 6 is positioned to show only the lower part of the students face and the shield ensures that, even if they move, their whole face will never be visible on the screen 10. The viewing of the whole face would be too distracting as their natural tendency would be to self-critique what they look like as they speak. Furthermore, as the shield is limiting the users visual field, their mental capacity will be enhanced as the amount of visual information needing to be processed is reduced. 3. Words, pictures etc. may also be shown on the screen 10 to enhance the learning processas per typical current language software programmes. 4. As the words to be learnt are announced (and displayed on the screen), they will be repeated (visually and verbally) giving the student the opportunity to match the visual movement and sounds of their mouth and voice to the visual movement and sounds of the teacher's mouth.
(50) Thus, this embodiment makes use of the real time visual image of part of the face of the teacher with the simultaneous partial face image of the student coinciding with the audio pronouncement of the word or words, in order to learn a language, or assist in other speech therapy applications.
(51) The shield is used to constantly restrict the amount of the wearer's face that is visible to them on the screen (seeing oneself facially often distracts the brain as many people focus on how they look, not how their face/mouth is moving). Wearing the shield removes any possibility of the wearer seeing their entire face. This removes any stress from the potential of seeing ones face, and negates the need of the wearer to try to ignore their face both of which take up valuable mental capacity.
(52) The apparatus according to the present invention could be used for learning skills other than those mentioned herein above. In particular, the apparatus of
(53) The present invention advantageously facilitates the isolation of a particular activity of a skill and helps the student to memorize the learnt activity successfully. This is achieved by forcing the student to carry out the learnt activity in a more complex manner, whilst the actual difficulty of the activity remains unchanged. If the student struggles to achieve the movement when using the apparatus then the student is not readythe repetition needs to be repeated. When the student uses the apparatus successfully without any negative impact on the movements required, they will subsequently find that when they return to carrying out the activity without the apparatus, the activity will feel easier than it was before they used the apparatus.
(54) This secures the automaticity of the movement. The student memorizes the easier actions required, and the repetition becomes the prediction.
(55) When we learn to move, we are learning a muscle motor movement skill, our brain is learning the movements required to perform the movement. Typically however, we rely on the visual input of what our eyes are seeing to dominate the learning process. For example athletes were found to overly rely on vision for the coordination of movement, instead of the experience of the movement.
(56) In removing the body from the visual field of the student, the student will be able to fully focus on the feeling of the movement. If the body (or body part) is left within the direct visual field, then it is still within the mind's eye and it cannot be ignored. Even if the user is trying to ignore that part, if it can still be seen, the brain will still expend some concentration on it, whether we want to or not. This spreads the focus too thinly, and overloads the brain. It is only by removing that part from the visual field, that it can really be ignored and the visual processing which normally pertains to that movement will not occur.
(57) By illustrating the movements on the screen in real-time, the learning experience is strengthenedthe student can feel the movement, and they can see the movement being performed on the screen. As the two activities are disconnected but experienced simultaneously, the visual processing does not override the movement processing; rather the two compound each other.
(58) Additionally, the present invention could be used in other applications, such as to aid the correction of body movements or posture, for example in the field of physiotherapy or sports, or for correcting perception of body image. More specifically, the collar could be used to focus the wearer on an aspect of their movement or posture, or image of a part of their body.
(59) The present invention can also be used when changing a mental perception, whenever that change in perception can be visually represented. For example, our ability to comprehend depth of perception matures within the brain sometime after approximately eight years of age. Before this time, we are less able to comprehend the depth and scale of 3D images. Taking this into account, the 2D image from the perspective of our eyes, is not how the image looks in 2D from another more appropriate angle. Misperceptions may have arisen from a younger age when the brain was too immature to comprehend the 3D depth of perception. Using the present invention the real image can be illustrated and the misperception can be corrected.
(60) For example, video footage could be obtained of the person before a coaching session using the present invention. This footage would then be shown to them, whilst wearing the shield or collar. The moment a user puts the shield on the amount of non-conscious visual information being processed is reduced. This enables more brain capacity to be used to process/take on the new visual image being seen.
(61) Possible other applications of the present invention are: Building self-esteem/confidence Improving perception of self, including body image, reduction of impact of personal dislikes e.g. loss of hair, facial distortion Stress management (including exam stress) and including alleviating headaches caused by muscle tension.
(62) Often it is difficult to image something which is unknown. Sometimes we imagine something that is incorrect.
(63) The present invention can therefore also be used in conjunction with a third party coach to correct misperceptions of body image; for example in the treatment of anorexia nervosa.
(64) This combination of the apparatus with a coach can also be used to learn movements and postures and how to maintain those movements/postures naturally and without causing incorrect tension in other muscles/parts of the body to compensate, such as in the treatment of scoliosis or other such diseases, or of alleviating pain and/or promoting healing of physical injuries.
(65) Use of the shield thus restricts the visual field of the wearer. It removes enough information yet not too much, so it does not make the task of seeing any more complex, as can be the case when wearing video goggles.
(66) The removal of non-relevant/misinformation from the visual field gives the wearer greater mental capacity to focus on the task at hand. Relevant information, which may be images of the person's thighs or back for example, is then displayed to the wearer. This may be via a live webcam feeding real time information to a screen viewed by the wearer. By concentrating on viewing the images on the screen of the relevant body part without being able to see other parts of their body, the wearer can learn to overcome mental and/or physical problems that they have concerning their body.
(67) As an alternative to the camera and display screen, one or more suitably positioned mirrors could be used to display the required body part to the person. However, mirrors may be too typical, as the brain is too used to seeing reflections in mirrors and seeing it is too automatic. The screen makes this complex, because the brain is seeing an angle that it is not used to seeing, and it has to concentrate and focus to do it properly. Also, the electronic processing of the image when using a camera and screen causes a minute or very short time delay which is not present in the typical visual processing speed of a person, which adds to the complexity. In contrast, there is no such delay when mirrors are used.
(68) The image displayed on the screen can be viewed as a true image or a mirror image by using known software to reverse the image. Whether a true or mirror image is used depends on the application of the apparatus. For instance, in the application of learning handwriting, the true image needs to be viewed, whereas in the application of learning sporting skills, such as a golf swing, a mirror image is needed. True or mirror images can also be obtained by the appropriate arrangement of mirrors, if this is used as an alternative to the camera and screen.
(69) As an alternative to the collar, a shield positioned in the neck area of the wearer but supported from the wearer's head or ears may be used.
(70) The main benefit of the present invention is that it simultaneously changes the typical neuroprocessing sequencing, the amount of visual information being streamed in to the brain for processing, in a manner which is familiar and minimises the learning load. This provides an opportunity for the brain to accurately understand the situation presented and to learn the neuroprocesses required to repeat with automaticity.
(71) According to another aspect of the present invention, there is provided a method of learning core literacy skills with automaticity, in particular handwriting and reading skills involving the shape, formation, sound and name of characters of a language, such as letters of the alphabet and words, or other language characters, such as Chinese or Arabic characters. This method can be used in combination with the apparatus for learning handwriting, such as the arrangement shown in
(72) Step 1
(73) A symbol 23, such as an infinity symbol shown in
(74) Step 2.
(75) The symbol 23 is traced as in step 1, whilst the student simultaneously performs a different task or action, preferably talking. The student continues for a sufficient length of time until a desired level of proficiency with consistent speed and accuracy for both activities is attained.
(76) Step 3.
(77) The symbol 23 with a language character 24 overlaid, as shown by the letter b in
(78) Step 4.
(79) This is an optional step. The student carries out the actions in step 3 whilst simultaneously performing another task or action, preferably talking. This is repeated until the required level of proficiency in accuracy and speed is attained.
(80) Step 5.
(81) Using the symbol 23 overlaid by the character 24, step 1 is carried out immediately followed by step 3. This sequence includes a pause after tracing the character. The sequence is repeated until the required level of proficiency in speed and accuracy is reached, especially without any hesitation in transitioning from the character 24 to the symbol 23.
(82) Step 6.
(83) Using the symbol and character arrangement shown in
(84) Step 7.
(85) This step is carrying out step 6 whilst simultaneously performing another task or action, preferably talking, again until the required level of proficiency in speed and accuracy for both activities is reached.
(86) Step 8.
(87) This step involves tracing as in step 7, and also co-ordinating verbal announcement of the starting position of the character 24 with the hand/pencil position for the starting point of that character. This is repeated until the required level of proficiency in consistent speed and accuracy is maintained reached.
(88) Step 9.
(89) The symbol 23 alone, as shown in
(90) Step 10.
(91) This step uses substantially parallel guide lines 25 as shown in
(92) After successfully writing one language character, the student can repeat steps 3 to 10 with one or more other language characters until, for example, the complete alphabet has been learnt. Combinations of characters, for example forming words, can be practiced using this method. This can be done by using the symbol 23 shown in
(93) The order for learning letters can be varied according to the needs and knowledge of the student. The repetitive multi-tasking of verbalising the phonic letter sound or name and recalling and physically recreating the shape and formation of the character secures this information in the non-conscious part of the brain. This information will then be automatically retrieved when doing another task like reading or writing.
(94) This method could also be used to aid the teaching of the character names/sounds. The continuous repetition and verbalisation of letter names, whilst physically tracing or writing the letter, increases the student's letter knowledge. Inserting a verbal I am writing the letter a and it makes the sound a would extend that letter learning. This method increases a student's ability to recall character name and/or sound by announcing the letter name and/or sound. Depending on the student's ability, it is likely that only the name or sound will be announced, but the step may be repeated to cover both letter name and letter sound separately.
(95) If the method specifies the verbalisation string (e.g. I am going to write the letter a, then the method teaches handwriting as well as increasing letter awareness/knowledge.
(96) Verbalising the appropriate letter names or letter sounds is required for the method to aid spelling knowledge.
(97) The method then starts to use the phoneme knowledge and the letter name knowledge that a student requires to be able to write. Handwriting is not just the ability to accurately move the pencil, the phonic recall etc. is a component when the student writes.
(98) The size of the symbol and characters are initially much larger than conventional size for handwriting. If the student is able, and they have learnt a few characters well, the size of symbol 23 can be made smaller, which results in the learning exercise taking less time.