An augmented reality or virtual reality (AR/VR) device pairs with a companion device to augment input interfaces associated with an AR/VR application at the AR/VR device. In implementations, an AR/VR device determines a portion of a markup file that corresponds to an AR/VR scene of a plurality of AR/VR scenes in an AR/VR environment, and communicates the portion of the markup file to the companion device to cause the companion device to configure a companion user interface associated with initiating an action as part of the AR/VR scene. In response to receiving user input via the companion user interface, the companion device communicates the action to the AR/VR device to initiate the action. The AR/VR device receives input data from the companion device, and initiates the action for the AR/VR scene.

An intuitive interface may allow users of a computing device (e.g., children, etc.) to create imaginary three dimensional (3D) objects of any shape using body gestures performed by the users as a primary or only input. A user may make motions while in front of an imaging device that senses movement of the user. The interface may allow first-person and/or third person interaction during creation of objects, which may map a body of a user to a body of an object presented by a display. In an example process, the user may start by scanning an arbitrary body gesture into an initial shape of an object. Next, the user may perform various gestures using his body, which may result in various edits to the object. After the object is completed, the object may be animated, possibly based on movements of the user.

A texture recognition device and a display device are provided. The texture recognition device includes a backlight element, configured to provide first backlight; a light constraint element, configured to perform a light divergence angle constraint process on the first backlight to obtain second backlight with a divergence angle within a preset angle range, the second backlight being transmitted to a detection object; and a photosensitive element, configured to detect the second backlight reflected by a texture of the detection object to recognize a texture image of the texture of the detection object.

An electronic device having an authentication method with a high security level is provided. The electronic device includes a pixel portion, a sensor portion, an authentication portion, and a housing. The pixel portion includes a display element and a light-receiving element. The pixel portion has a function of turning on the display element. The pixel portion has a function of obtaining authentication information by capturing an image of a target object touching the pixel portion. The sensor portion has a function of detecting attachment or detachment to a living body or an object. The authentication portion has a function of performing authentication processing with the use of the authentication information. The housing includes a first surface and a second surface opposite to the first surface. The pixel portion is positioned on the first surface and the sensor portion is positioned on the second surface.

An electronic device having an authentication method with a high security level is provided. The electronic device includes a pixel portion, a sensor portion, an authentication portion, and a housing. The pixel portion includes a display element and a light-receiving element. The pixel portion has a function of turning on the display element. The pixel portion has a function of obtaining authentication information by capturing an image of a target object touching the pixel portion. The sensor portion has a function of detecting attachment or detachment to a living body or an object. The authentication portion has a function of performing authentication processing with the use of the authentication information. The housing includes a first surface and a second surface opposite to the first surface. The pixel portion is positioned on the first surface and the sensor portion is positioned on the second surface.

A display apparatus having a noncontact input function is provided. The display apparatus has a first function of detecting, with a light-receiving device, light irradiated from a light source outside a display portion and blocked by a pointing object to recognize the position pointed by the pointing object, and a second function of detecting, with the light-receiving device, light irradiated from a light source inside or outside the display portion and reflected by the pointing object to recognize the position pointed by the pointing object. The display apparatus can operate by switching the first function and the second function in accordance with the intensity of the light irradiated from the light source outside the display portion.

A method for obtaining a handwriting trajectory is provided. The method includes the following steps: capturing images of handwriting that is written with a writing brush on a piece of paper on a writing platform; obtaining positions where pixels in each of the images are lower than a threshold according to the threshold; and outputting handwriting images according to the positions.

A detection device according to the present disclosure includes: an irradiation unit configured to emit an infrared ray toward an infusion tube; an imaging unit configured to generate a captured image obtained by imaging the infusion tube irradiated with the infrared ray by the irradiation unit; and a control unit configured to detect blockage of the infusion tube and air bubbles in the infusion tube based on a light intensity distribution in the captured image.

A contactless touchscreen interface has a digital display to display digital information; the proximity detector and a proximity detector comprising an image sensor to detect user interaction at a virtual touch intersection plane offset a distance from the digital display and to resolve the interaction into XY offset-plane interaction coordinates with reference to the digital display. A gaze determining imaging system comprising an image sensor determines a gaze relative offset with respect to the digital display using facial image data captured by the image sensor. An interface controller comprising a parallax adjustment controller to convert the XY offset-plane interaction coordinates to XY on-screen apparent coordinates using the gaze relative offset and the distance and an input controller generates an input at the XY on-screen apparent coordinates accordingly.

A contactless touchscreen interface has a digital display to display digital information; the proximity detector and a proximity detector comprising an image sensor to detect user interaction at a virtual touch intersection plane offset a distance from the digital display and to resolve the interaction into XY offset-plane interaction coordinates with reference to the digital display. A gaze determining imaging system comprising an image sensor determines a gaze relative offset with respect to the digital display using facial image data captured by the image sensor. An interface controller comprising a parallax adjustment controller to convert the XY offset-plane interaction coordinates to XY on-screen apparent coordinates using the gaze relative offset and the distance and an input controller generates an input at the XY on-screen apparent coordinates accordingly.