A computer-based system and method for generating a current pain assessment of a neonate using facial expressions along with crying sounds, body movement, and vital signs changes and for using the current pain objective assessment to predict future pain objective assessment and assign a future pain probability score by incorporation spatiotemporal data into the multimodal assessment.

An electronic apparatus is disclosed. The apparatus includes a memory configured to store at least one pre-registered voiceprint and a first voiceprint cluster including the at least one pre-registered voiceprint, and a processor configured to, based on a user recognition command being received, obtain information of time at which the user recognition command is received, change the at least one pre-registered voiceprint included in the first voiceprint cluster based on the obtained information of time, generate a second voiceprint cluster based on the at least one changed voiceprint, and based on a user's utterance being received, perform user recognition with respect to the received user's utterance based on the first voiceprint cluster and the second voiceprint cluster.

Systems and methods are disclosed. A digitized human vocal expression of a user and digital images are received over a network from a remote device. The digitized human vocal expression is processed to determine characteristics of the human vocal expression, including: pitch, volume, rapidity, a magnitude spectrum identify, and/or pauses in speech. Digital images are received and processed to detect characteristics of the user face, including detecting if any of the following is present: a sagging lip, a crooked smile, uneven eyebrows, and/or facial droop. Using the human vocal expression characteristics and face characteristics, a determination is made as to what action is to be taken. A cepstrum pitch may be determined using an inverse Fourier transform of a logarithm of a spectrum of a human vocal expression signal. The volume may be determined using peak heights in a power spectrum of the human vocal expression.

Disclosed herein is an interaction monitoring system, comprising an environment collection module, interaction monitoring module, interaction segmentation module, and display module. The environment collection module detects surrounding environment and generates a data stream. The interaction monitoring module generates a feature data stream by extracting feature value of the data stream. The interaction segmentation module determines a target situation, which indicates a user's state or condition, from the feature data stream and generates a target image or video stream, which indicates the target situation. The display module displays the target image. Other embodiments are described and shown.

Systems and methods for assisting user with hearing by amplifying sound using an amplifier with gain and amplitude controls for a plurality of frequencies; and applying a learning machine to identify an aural environment and adjust the amplifiers for optimum hearing.

The invention relates to a device, a method, a computer program product and an application for establishing a current load level of a user. The device and the method comprise a mobile terminal, which comprises at least one sensor generating signal data and a plurality of available applications for use by the user and also an evaluation unit. According to the invention, provision is made for the mobile terminal to comprise an application, which is configured as further application and establishes a plurality of biometric data in respect of the user, at least from the signal data or from available applications used by the user, and to make said data available to the evaluation unit, and for the evaluation unit to determine the current load level of the user from the biometric data.

Provided is a pathological condition analysis system using voice, the pathological condition analysis system allowing anyone to perform measurement and estimate a disease anywhere, in a short time, non-invasively, and without being known to others. A pathological condition analysis system according to the present invention analyzes a pathological condition of a subject, and includes: an input means that acquires voice data of the subject; an estimation means that estimates a disease of the subject based on a voice feature amount extracted from the voice data acquired by the input means; and a display means that displays an estimation result by the estimation means, in which the voice feature amount includes the intensity of voice.

An information processing device that determines a psychological state of a member in a meeting, includes: a voice processor that extracts a predetermined feature amount from a voice of a part corresponding to a speech of the member among voices collected during the meeting by a microphone; an estimator that receives an input of a feature amount and estimates a likelihood that the member is in a predetermined psychological state; and a determiner that determines a likelihood that the member is in the predetermined psychological state during the meeting on a basis of the likelihood estimated by the estimator and an index value according to a purpose of the meeting.

Techniques are described for cognitive analysis for directed control transfer for autonomous vehicles. In-vehicle sensors are used to collect cognitive state data for an individual within a vehicle which has an autonomous mode of operation. The cognitive state data includes infrared, facial, audio, or biosensor data. One or more processors analyze the cognitive state data collected from the individual to produce cognitive state information. The cognitive state information includes a subset or summary of cognitive state data, or an analysis of the cognitive state data. The individual is scored based on the cognitive state information to produce a cognitive scoring metric. A state of operation is determined for the vehicle. A condition of the individual is evaluated based on the cognitive scoring metric. Control is transferred between the vehicle and the individual based on the state of operation of the vehicle and the condition of the individual.

A method for determining a user wellbeing profile, the method including using a processor to detect a change in physiological data of the user, based on input from a sensor unit and selecting, in accordance with the detected change in physiological data, a specific question relating to psychological data of the user, where user's wellbeing profile can be calculated based on a response from the user to the specific question which was selected in accordance with a specific change in physiological data.