G06V40/174

Systems and methods to adapt and optimize human-machine interaction using multimodal user-feedback

Systems and methods for human-machine interaction. An adaptive behavioral control system of a human-machine interaction system controls an interaction sub-system to perform a plurality of actions for a first action type in accordance with a computer-behavioral policy, each action being a different alternative action for the action type. The adaptive behavioral control system detects a human reaction of an interaction participant to the performance of each action of the first action type from data received from a human reaction detection sub-system. The adaptive behavioral control system stores information indicating each detected human reaction in association with information identifying the associated action. In a case where stored information indicating detected human reactions for the first action type satisfy an update condition, the adaptive behavioral control system updates the computer-behavioral policy for the first action type.

Message output apparatus, learning apparatus, message output method, learning method, and program

Provided are a message output apparatus, a learning apparatus, a message output method, a learning method, and a program that allow a user to feel as if communication is being performed. An input section inputs, to a learned machine learning model that has been learned using learning data that includes learning input data including a plurality of consecutive frames of learning images and teaching data including a message associated with the learning input data, target input data including at least a plurality of consecutive frames of target images. A message identification section identifies a message according to output produced when the target input data is input to the machine learning model. A message output section outputs the identified message.

MULTIPURPOSE CONTROLLERS AND METHODS
20230004232 · 2023-01-05 ·

Method and apparatus is disclosed for a user to communicate with an electronic device. A processor receives user intention actions comprising facial expression (FE) information indicative of facial expressions and body information indicative of motion or position of one or more body parts of the user. When the FE or body information crosses a first level, the processor starts generating first signals based on the FE or body information to communicate with the electronic device. When the FE or body information crosses a second level, the processor can end generation of the first signals or modify the first signals. An image processing or eye gaze tracking system can provide some FE information or body information. The signals can modify attributes of an object of interest. Use of thresholds that are independent of sensor position or orientation with respect to the user's body are also disclosed.

SYSTEMS AND METHODS FOR GENERATING EMOTIONALLY-ENHANCED TRANSCRIPTION AND DATA VISUALIZATION OF TEXT
20230237242 · 2023-07-27 ·

Generating emotionally enhanced transcription of non-textual data and an enriched visualization of transcribed data by capturing non-textual data of a speaker using bio-feedback technology, transcribing it into to a textual format, combining transcribed textual data with emotional state of the speaker to generate the emotionally enhanced transcribed textual data, and presenting emotionally enhanced transcribed textual data through an enriched visualization including color-coding transcribed textual data to identify mistakes in the transcribed data.

INFORMATION PROCESSING DEVICE
20230237843 · 2023-07-27 · ·

An information processing device includes a camera interface and a processor, the camera interface acquiring a moving image from a first camera that is installed at a production site and that images a worker and surroundings of the worker and from a second camera that is installed at the production site and that images a face of the worker. The processor detects an operation section of work performed by the worker from a predetermined number of consecutive frames included in the moving image acquired from the first camera using an inference model. The processor detects the emotion and the line-of-sight direction of the worker included in each frame of the moving image acquired from the second camera. Further, the processor provides a detection result.

Digital zoom conferencing
11570401 · 2023-01-31 · ·

Methods, apparatuses, and techniques for security and/or automation systems are described. In one embodiment, the method including identifying a presence of a first person at a first location, capturing a first video related to the first person at the first location, and initiating an adjustment of a display of the first video based at least in part on identifying the presence of the first person.

Generating synthetic photo-realistic images

The disclosure relates to tools and methods for creating synthetic images with photo-realistic images. The disclosed face generation technology focuses on photo-realistic results by leveraging analysis of a pool of pre-selected images based on a user selection and preferences. The tools and methods as described herein include limiting the pool of pre-selected images by one or more criteria, including, for example, but not limited to gender, age, skin color, expression, etc. The pre-selection of a more curated pool of images allows a user to include a desired set of criteria and specifications that the user would want in a generated synthetic image or images.

Image processing apparatus, image processing method, and storage medium to select an image to be arranged in an added page in an album
11570312 · 2023-01-31 · ·

An image processing apparatus includes: a receiving unit configured to receive an addition instruction for adding a page to album data including a plurality of pages; an image obtaining unit configured to obtain a user selection image as an image to be arranged in the page to be added in response to the addition instruction, the user selection image being selected by a user; a first analysis information obtaining unit configured to obtain analysis information of the user selection image; and a selecting unit configured to select an image to be arranged in the added page other than the user selection image, based on the analysis information of the user selection image.

SUGGESTION ENGINE FOR DATA CENTER MANAGEMENT AND MONITORING CONSOLE

Systems and methods support a console for use in managing data center operations and in suggesting notifications to present to an administrator issuing a query to the console. Upon detecting a user query, the data center administrator that issued the query is identified. A data center asset that is a subject of the query is also identified. One or more data center assets are identified that are related to the asset that is the subject of the query. Any the related data center assets currently operating with an elevated status designation are identified. Suggested notifications are generated regarding the elevated status designations of the related data center assets. Based on the context of the administrator issuing the query and of the data center status, the administrator may be presented with a portion of the suggested notifications regarding the related data center assets currently operating with an elevated status designation.

Face verification method and apparatus

Disclosed is a face verification method and apparatus. The method including analyzing a current frame of a verification image, determining a current frame state score of the verification image indicating whether the current frame is in a state predetermined as being appropriate for verification, determining whether the current frame state score satisfies a predetermined validity condition, and selectively, based on a result of the determining of whether the current frame state score satisfies the predetermined validity condition, extracting a feature from the current frame and performing verification by comparing a determined similarity between the extracted feature and a registered feature to a set verification threshold.