A switching method and system of interactive modes of a head-mounted device is provided. The interactive modes include gamepad tracking interactive mode and bare hand tracking interactive mode. A standard deviation of position data, a standard deviation of attitude data and a standard deviation of accelerometer data among IMU data are acquired, respectively. Whether the standard deviation of the position data, the standard deviation of the attitude data and the standard deviation of the accelerometer data meet a first preset condition is determined. Moreover, the standard deviation of the accelerometer data within a second preset duration is acquired in real time, and whether the standard deviation of the accelerometer data meets a second preset condition is determined. In cases where the standard deviation of the accelerometer data meets the second preset condition, the bare hand tracking interactive mode is paused, and the gamepad tracking interactive mode is started.

Systems and methods for human-machine interaction. An adaptive behavioral control system of a human-machine interaction system controls an interaction sub-system to perform a plurality of actions for a first action type in accordance with a computer-behavioral policy, each action being a different alternative action for the action type. The adaptive behavioral control system detects a human reaction of an interaction participant to the performance of each action of the first action type from data received from a human reaction detection sub-system. The adaptive behavioral control system stores information indicating each detected human reaction in association with information identifying the associated action. In a case where stored information indicating detected human reactions for the first action type satisfy an update condition, the adaptive behavioral control system updates the computer-behavioral policy for the first action type.

An apparatus and method are provided for controlling an operation of an electronic device by using a fingerprint image in the electronic device. The electronic device includes a display and a processor configured to detect a fingerprint image corresponding to a user input; determine an input direction of the user input based on the fingerprint image; determine a motion direction of the user input based on the input direction of the user input in response to a motion of the user input; and execute a first function corresponding to the motion direction of the user input.

A portable electronic device (100) having a touch screen (112) with a floating soft trigger icon (175) for enabling various functions of the electronic device (100), such as bar code reading, capturing RFID data, capturing video and images, calling applications, and/or placing phone calls. The floating trigger icon (175) is displayed on the touch screen (112) to enable easy identification and access of the trigger icon (175). The trigger icon (175) may be selected via application of any one of various unique control gestures (200, 210, 220, 230, 240, 250, 260) to configure the electronic device (100). Based on the selected mode or function of the device (100), the trigger icon (175) may alter its appearance to facilitate use of the device (100). The operation and functionality of the trigger icon (175) may be programmed to customize operation of the device (100).

Provided are a message output apparatus, a learning apparatus, a message output method, a learning method, and a program that allow a user to feel as if communication is being performed. An input section inputs, to a learned machine learning model that has been learned using learning data that includes learning input data including a plurality of consecutive frames of learning images and teaching data including a message associated with the learning input data, target input data including at least a plurality of consecutive frames of target images. A message identification section identifies a message according to output produced when the target input data is input to the machine learning model. A message output section outputs the identified message.

Various implementations disclosed herein include devices, systems, and methods that use an object as a background for virtual content. Some implementations involve obtaining an image of a physical environment. A location of a surface of an object is detected based on the image. A virtual content location to display virtual content is determined, where the virtual content location corresponds to the location of the surface of the object. Then, a view of the physical environment and virtual content displayed at the virtual content location is provided.

This disclosure enables various technologies for analyzing behaviors of objects or with respect to objects based on stereo imageries thereof. For example, such analysis may be useful in enforcement of certain actions by objects or with respect to objects, surveillance of objects or with respect to objects, or other situations involving analyzing behaviors of objects or with respect to objects.

Methods and systems are described for maintaining hygienic conditions in automatic teller machines by detecting whether or not a user is not in compliance with a hygienic standard. If a user is not in compliance, then the automatic teller machine may execute a hygienic action to cleanse the automatic teller machine. For example, the hygienic action may comprise automatically cleansing the automatic teller machine, disabling the automatic teller machine from service, transmitting a sanitation service request to an automatic teller machine provide, and/or initiating an alternative control scheme (e.g., voice controls, gesture-based controls, etc.) for the automatic teller machine.

Sunshading louver control system and method based on gesture recognition are provided. Indoor images are collected in real time. Based on the indoor images, an action region of gesture motion is positioned and feature extraction is performed thereon to obtain hand motion parameters. The hand motion parameters are analyzed to obtain gesture information. The gesture information is compared with preset gesture information. When the preset gesture information contains the gesture information, corresponding adjustment is performed on a sunshading louver according to a preset operation logic corresponding to the gesture information. When the preset gesture information does not contain the gesture information, the gesture information is determined to be invalid. The lifting and rotation angles of the louver can be automatically controlled according to various gestures of indoor personnel, thereby rapidly realizing regulation of indoor illumination and natural ventilation quantity, and meeting the change of personnel's demand for indoor environment.

Disclosed are apparatus and methods of detecting user interaction with a respiratory therapy device and effecting an action in response to the detection. The apparatus comprises a sensor which is positioned so as to detect the presence of a user's hand or fingers near to the apparatus, such as a surface or handle. In embodiments the apparatus may be configured to detect gestures or movement of the user. On detection of a user, the apparatus may be configured to effect one or more actions, such as disabling a feature of an input or output device or alerting a user.