An electronic device is provided. The electronic device includes at least one processor, and at least one memory configured to store instructions executable by the at least one processor, wherein when the instructions are executed by the at least one processor, the at least one processor is configured to perform sensing an occurrence of a trigger event, based on an input to the electronic device and an input to at least one Internet of Things (IoT) device connected to the electronic device, collecting weather information in response to the occurrence of the trigger event, estimating an emotion of a user, based on at least one of context information stored for the user and the weather information, receiving, from the user, an audiovisual impairment state of the user or estimating the audiovisual impairment state based on the context information, determining audiovisual content for a disabled to output, based on at least one of the estimated emotion and the audiovisual impairment state, among the at least one IoT device, determining a target IoT device to output the determined audiovisual content for the disabled, and outputting the determined audiovisual content for the disabled through the target IoT device.

A system and method of automatic transcription using a visual display device and an ear-wearable device. The system is configured to process an input audio signal at the display device to identify a first voice signal and a second voice signal from the input audio signal. A representation of the first voice signal and the second voice signal can be displayed on the display device and input can be received comprising the user selecting one of the first voice signal and the second voice signal as a selected voice signal. The system is configured to convert the selected voice signal to text data and display a transcript on the display device. The system can further generate an output signal sound at the first transducer of the ear-wearable device based on the input audio signal.

This present invention relates to a face mask communication system having a face mask equipped with a built-in speaker, amplifier and microphone to enable a wearer to more clearly communicate with others without having to remove his or her face mask. More specifically, the wearer can speak into the microphone, which is amplified through the speaker to project the voice of the wearer to other people in the vicinity of the mask wearer.

A wearable auditory feedback device includes a frame, a plurality of microphone arrays, a plurality of feedback motors, and a processor. The frame is wearable on a user's head or neck. The microphone arrays are embedded in the frame on a left side, a right side, and a rear side with respect to the user. The feedback motors are also embedded in the frame on the left side, the right side, and the rear side with respect to the user. The processor is configured to receive a plurality of sound waves collected with the microphone arrays from a sound wave source, determine an originating direction of the sound waves, and activate a feedback motor on a side the frame corresponding to the originating direction.

Vibratory motors are used to generate a haptic language for music or other sound that is integrated into wearable technology. The disclosed system enables the creation of a family of devices that allow people with hearing impairments to experience sounds such as music or other auditory input to the system. For example, a “sound vest” or one or more straps comprising a set of motors transforms musical input to haptic signals so that users can experience their favorite music in a unique way, and can also recognize auditory cues in the user's everyday environment and convey this information to the user using haptic signals.

A method to transcribe a video communication session may include obtaining, at a communication system, a request from a first communication device for a video communication session and determining a currently available second communication device from among multiple second communication devices registered with the communication system. The method may also include establishing the video communication session between the first communication device and the currently available second communication device. After establishing the video communication session, the method may include receiving media data from the currently available second communication devices, the media data including audio data and video data and capturing, at the communication system, the audio data for generation of a transcription of the audio data. The method may also include routing the media data to the first communication device, generating the transcription of the audio data, and routing the transcription to the first communication device for presentation.

A wearable device is provided that includes a microphone, a display, and a controller. The controller analyzes sound picked up by the microphone, identifies a direction from which sound was emitted, and performs control so as to cause information indicating the identified emitted direction to be displayed on the display.

A wearable device is provided that includes a microphone, a display, and a controller. The controller controls to identify a direction of emitted sound based on sound picked up by the microphone, and to display information corresponding to the sound at a position on the display corresponding to the identified direction of the emitted sound.

Apparatuses and methods for notifying a group of communication devices about a missed call are disclosed. Each communication device is associated with a group identifier that is shared with all the communication devices in a group. Each communication device is also associated with an individual identifier that is unique to that communication device. An unanswered communication to the group identifier is received on all the communication devices in the group. A first communication device transmits to a remote server an acknowledgement notification that the unanswered communication related to the group identifier has been acknowledged by the user. A clear indicator indicating that the unanswered communication has been acknowledged is transmitted from the remote server to all the devices in the group except the first communication device. Each of the communication devices receiving the clear indicator can then clear its indicator that notifies the user of a missed call.

Disclosed are methods, apparatus and systems for real-time gesture recognition. One exemplary method for the real-time identification of a gesture communicated by a subject includes receiving, by a first thread of the one or more multi-threaded processors, a first set of image frames associated with the gesture, the first set of image frames captured during a first time interval, performing, by the first thread, pose estimation on each frame of the first set of image frames including eliminating background information from each frame to obtain one or more areas of interest, storing information representative of the one or more areas of interest in a shared memory accessible to the one or more multi-threaded processors, and performing, by a second thread of the one or more multi-threaded processors, a gesture recognition operation on a second set of image frames associated with the gesture.