An expression feedback method and a smart robot, belonging to smart devices. The method comprises: step S1, a smart robot using an image collection apparatus to collect image information; step S2, the smart robot detecting whether human face information representing a human face exists in the image information; if so, acquiring position information and size information associated with the human face information, and then turning to step S3; and if not, returning to step S1; step S3, according to the position information and the size information, obtaining, by prediction, a plurality of pieces of feature point information in the human face information and outputting same; and step S4, using a first identification model formed through pre-training, determining whether the human face information represents a smiling face according to the feature point information, and then exiting from this step; if so, the smart robot outputting preset expression feedback information; and if not, exiting from this step. The beneficial effect of the method is: enriching an information interaction content between a smart robot and a user, so as to improve usage experience of the user.

A method for toy robot programming, the toy robot including a set of sensors, the method including, at a user device remote from the toy robot: receiving sensor measurements from the toy robot during physical robot manipulation; in response to detecting a programming trigger event, automatically converting the sensor measurements into a series of puppeted programming inputs; and displaying graphical representations of the set of puppeted programming inputs on a programming interface application on the user device.

A robotic companion device (10) configured for capturing and analysing affective information and semantic information and elicit response accordingly is disclosed herein. It comprises a processor (20) for managing emotional processing and responses configured for capturing and analysing semantic and affective information from sensory devices and communicating with users as well as external world using multitude of actuators and communication devices; a facial arrangement (11) configured for capturing visual information and displaying emotions; a locomotor arrangement (13) enabling movement of the robotic companion device; and microphone/speaker arrangement (15) configured for receiving auditory signal and emitting vocal response. The facial arrangement (11), the locomotor arrangement (13) and the microphone/speaker arrangement (15) are all in communication with the processor (20).

A control device includes a recognizing unit that recognizes the external environment based on sensing information; an action decision managing unit that, based on the recognized external environment, decides on the actions to be taken; a behavior managing unit that, based on at least either the difficulty level of recognition for the recognizing unit or the difficulty level of action decision for the action decision managing unit, determines about whether or not to exhibit emotional expressions; and a drive control unit that, based on the determination performed by the behavior control unit, controls the execution of the actions corresponding to emotional expressions.

The disclosed system uses facial expressions and upper body movement patterns to detect autism spectrum disorder. Emotionally expressive robots participate in sensory experiences by reacting to stimuli designed to resemble typical everyday experiences, such as uncontrolled sounds and light or tactile contact with different textures. The robot-child interactions elicit social engagement from the children, which is captured by a camera. A convolutional neural network, which has been trained to evaluate multimodal behavioral data collected during those robot-child interactions, identifies children that are at risk for autism spectrum disorder. Because the robot-assisted framework effectively engages the participants and models behaviors in ways that are easily interpreted by the participants, the disclosed system may also be used to teach children with autism spectrum disorder to communicate their feelings about discomforting sensory stimulation (as modeled by the robots) instead of allowing uncomfortable experiences to escalate into extreme negative reactions (e.g., tantrums or meltdowns).

An object of the invention is to carry out communication wherein linguistic communication is reduced during speech communication with another party carried out by a robot outputting speech. A robot includes a sensing unit that senses an external environment and generates an input signal, a phoneme acquisition unit that acquires first phonological information formed of a multiple of phonemes based on the input signal, a phoneme generating unit that generates second phonological information differing from the first phonological information based on at least one portion of phonemes included in the first phonological information, a speech synthesizing unit that synthesizes speech in accordance with the second phonological information, and a speech output unit that, outputs the speech.

To activate communication between an autonomous operation body and a user. Providing an information processing device that includes: an application control unit that controls operation of an application relating to communication between an autonomous operation body and a user; and a reflection unit that causes the autonomous operation body to reflect an operation performed by the user in the application. In the information processing device, the application control unit controls operation of an avatar imitating the autonomous operation body, and the reflection unit causes the autonomous operation body to reflect a reward obtained by the avatar on the basis of the operation performed by the user.

A robot for outputting various reactions according to user behaviors is disclosed. A control method for a robot using an artificial intelligence model, according to the present disclosure, comprises the steps of: acquiring data related to at least one user; inputting the data related to the at least one user into the artificial intelligence model as learning data so as to learn a user state for each user of which there is at least one; determining representative reactions corresponding to the user states learned on the basis of the data related to the at least one user; and inputting the input data into the artificial intelligence model so as to determine a user state of a first user and controlling the robot on the basis of a representative reaction corresponding to the determined user state, when input data related to the first user among the users, of which there is a least one, is acquired.

Systems and methods for human-machine interaction. An adaptive behavioral control system of a human-machine interaction system controls an interaction sub-system to perform a plurality of actions for a first action type in accordance with a computer-behavioral policy, each action being a different alternative action for the action type. The adaptive behavioral control system detects a human reaction of an interaction participant to the performance of each action of the first action type from data received from a human reaction detection sub-system. The adaptive behavioral control system stores information indicating each detected human reaction in association with information identifying the associated action. In a case where stored information indicating detected human reactions for the first action type satisfy an update condition, the adaptive behavioral control system updates the computer-behavioral policy for the first action type.

A control method of an interaction robot according to an embodiment of the present invention comprises the steps of: receiving a user input, by the interaction robot; determining a robot response corresponding to the received user input, by the interaction robot; and outputting the determined robot response, by the interaction robot, wherein the step of outputting the determined robot response includes the steps of: outputting a color matching to the received user input or the determined robot response to a light emitting unit, by the interaction robot; and outputting a motion matching to the received user input or the determined robot response to any one or more among a first driving unit and a second driving unit, by the interaction robot.