An approach is provided that detect a section of a document that is currently being read by a user on a display device as well as the user's current emotional state. In response to determining, based on the detected current emotional state, that reading assistance would be helpful to the user, the approach identifies terminology within the section of the document that is currently being read by the user, retrieves assistive texts related to the identified terminology, and provides the assistive texts to the user at the display screen.

A software application for teaching literacy through customized stories with gamification elements. Existing or new stories are created and customized for particular audiences and include text, animations, images, and sounds to produce an interactive multimedia story for presentation on a computing device with a display and audio output. Reading comprehension questions and games are provided to accompany the stories and the reader of the stories can earn rewards based on performance. The reader's performance is analyzed and reported to track progress.

A system for teaching is disclosed, comprising a symbol identification dock and a plurality of symbol manipulatives, a computing device connected to the symbol identification dock, and a database, wherein the database comprises lexical data and an adaptive learning curriculum.

A method includes obtaining a speech proficiency value indicator indicative of a speech proficiency value associated with a user of the electronic device. The method further includes in response to determining that the speech proficiency value satisfies a threshold proficiency value: displaying training text via the display device; obtaining, from the audio sensor, speech data associated with the training text, wherein the speech data is characterized by the speech proficiency value; determining, using a speech classifier, one or more speech characterization vectors for the speech data based on linguistic features within the speech data; and adjusting one or more operational values of the speech classifier based on the one or more speech characterization vectors and the speech proficiency value.

The present invention is directed to interactive training, and in particular, to methods and systems for computerized interactive skill training. An example embodiment provides a method and system for providing skill training using a computerized system. The computerized system receives a selection of a first training subject. Several related training components can be invoked, such as reading, watching, performing, and/or reviewing components. In addition, a scored challenge session is provided, wherein a training challenge is provided to a user via a terminal, optionally in video form.

A reading aid system including a computer configured to connect to a text storage means; a computer screen; a headset operably connected to the computer; a user interface device operably connected to the computer; and a microphone operably connected to the computer. The computer includes a speech analysis and editing module configured to perform any or all of the following: (a) analyze the intonation and/or breathing of the narrator; (b) synchronize and edit to provide automatic synchronization between the narrator's reading and highlighting of the words; (c) edit a sentence to convert long sentences to shorter sentences; (d) synchronize the shorter sentences in the text and the narration, or vice versa; and (e) combine sentences and synchronization between the speech and the text.

Disclosed are a method, a device, a system, and/or manufacture of electronic enhancement of a book for shared learning and/or interactive experience. In one embodiment a method includes designating a set of two or more enhancement units, e.g., a book GUID corresponding to a unique printed copy of a book and/or an enhancement device UID in combination with a book UID corresponding to any printed copy. The method generates a group UID and associates two or more enhancement units to form a group. The method generates an audio dataset through selecting the page UID of a page, receiving a first audio signal, storing the first audio signal, generating the audio dataset, and associating the page UID and the audio file such that the book can be sound enhanced for a user of the group. The method detects a network connection from an enhancement unit and transmits the audio dataset.

In one embodiment, an instructional method for assisting a student to learn at least one skill comprises selecting an interactive tutorial, the interactive tutorial including a plurality of images that represent a series of actions to be performed to learn the at least one skill; identifying a virtual character to be instantiated in the interactive tutorial; presenting the interactive tutorial to the student on a display; monitoring an ability of the student to follow the interactive tutorial, the monitoring being concurrent with the presenting of the interactive tutorial; and dynamically adapting the interactive tutorial based on the ability of the student to follow the interactive tutorial.

This invention offers a unique multisensory, linguistically-based approach and for simultaneously facilitating instruction in speaking and reading skills. The approach incorporates unique methods, strategies, procedures, processes, materials, items, tools, and kit components for the teaching of speaking and reading using auditory, verbal, visual, gestural, proprioceptive, tactile, and kinesthetic treatment of sounds (spoken and read) and means of presenting said sounds. Speech sounds, combinations of speech sounds, and sound patterns, are uniquely presented in spoken, visual, and written forms. This invention introduces integrated components that contain new concepts and new ways of teaching and learning about sounds. These components which incorporate the various aspects of the invention include: the Sound Symbols Sound Circle; the Sound Symbols Visual Prompts; the Sound Symbols Consonant Chart; the Sound Symbols Vowel Chart; the Sound Symbols Tracking Form; the Sound Symbols Feedback System; the Sound Prosody concept; and the Sound Symbols Processes, Procedures, Strategies, and Activities. The Sound Symbols processes, procedures, strategies and activities apply to the learning and use of sounds in reading. Specific processes, procedures, strategies and activities also apply to use of the Sound Symbols Sound Circle. Included in the invention are associated materials and tools that address specific processes, procedures and related instructional aspects of the invention pertaining to speaking, reading, writing, spelling, and use of feedback (including external and internal feedback, self cueing, self-monitoring and self-correcting).

Visually, sounds are represented by unique hand, finger and arm positions, gestures and movements (in person and/or through various media) identified in the invention as Sound Symbols Visual Prompts. These Visual Prompts are paired with additional information, including: lip, tongue and orofacial positions and movements; with verbally produced and auditorily perceived sound productions; with written letters and aids that provide information on the target sounds; and with directions for forming the target sounds. The invention involves and is conveyed through the use of specific processes and procedures, through the use of directions, specific activities, and related supports or tools.

Technology and systems to develop reading fluency through an interactive, multi-sensory reading experience, include a computing platform that receives position data associated with motion of a user, periodically computes position, speed, and direction of the motion of the user based on the position data, correlates the position and the direction to a sequence of pronounceable characters of a textual passage presented to the user, and performs an action with respect to the sequence of pronounceable characters, contemporaneous with the motion of the user, based on the correlation. The action may include audibly presenting the sequence of pronounceable characters contemporaneous with the motion of the user and/or visually accentuating the sequence of pronounceable characters contemporaneous with the motion of the user. The computing platform may visually demarcate sections of the textual passage to indicate where a reader is to pause or slow down.