Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

A reference position setting method includes: a process of displaying at least three markers on an operation surface; a process of acquiring coordinate values of a sensor coordinate system; a process of transforming the acquired coordinate value into coordinate values of a temporary coordinate system; and a process of transforming the transformed coordinate values into coordinate values of a screen coordinate system. At least one of parallel movement and rotation is performed with respect to the sensor coordinate system to transform the sensor coordinate system into the temporary coordinate system. Movement of the temporary coordinate system in a direction parallel to a plane including a second X-axis and a second Y-axis, and enlargement or reduction of the temporary coordinate system are performed to transform the temporary coordinate system into the screen coordinate system.

An image display device includes a display panel having a plurality of pixels, and a photoresistor pattern formed in a non-light emitting area between the plurality of pixels; a panel driving controller to drive light-emission control lines of the display panel; and a bio-signal detector that detects an output voltage of the photoresistor pattern which resistance is variable based on light reflected from the target object, and detects a bio-signal of the target object based on the detected output voltage, thereby, detecting the bio-signal of the target object using the image display light from the display panel may allow efficiently detecting the bio-signal without a separate light source or light source operation circuit for detecting the bio-signal.

Examples of the present disclosure relate to a device, method, and system for optical input diodes. A liquid crystal display (LCD) backlight device may include a processor and a color filter of a pixel including at least one of a red filter, a green filter, or a blue filter. The LCD backlight device may also include a diode to emit light through the color filter in response to being driven by the processor. The diode may generate a voltage in response to light passing through the color filter and arriving on the diode, where an image value may be calculated as a function of the voltage generated and a color filter value of the color filter.

Examples of the present disclosure relate to a device, method, and system for optical input diodes. A liquid crystal display (LCD) backlight device may include a processor and a color filter of a pixel including at least one of a red filter, a green filter, or a blue filter. The LCD backlight device may also include a diode to emit light through the color filter in response to being driven by the processor. The diode may generate a voltage in response to light passing through the color filter and arriving on the diode, where an image value may be calculated as a function of the voltage generated and a color filter value of the color filter.

Systems and methods for through-display imaging. An optical imaging sensor is positioned at least partially behind a display and is configured to emit shortwave infrared light at least partially through the display to illuminate an object, such as a fingerprint, in contact with an outer surface of the display. Surface reflections from the object are received and an image of the object can be assembled.

An electronic device has pixels that form an active area of a display for displaying images for a user. A layer of black ink or other opaque material may be formed on an inner surface of a display cover layer in an inactive area of the display that does not overlap pixels. The housing may have sidewalls such as a rear housing wall that faces away from the display. Ambient light sensor windows may be formed from tapered holes or other holes. The tapered holes may be formed in the opaque material on the display cover layer, may be formed in a rear housing wall or other hosing structure, or may be formed in other portions of the electronic device. Non-tapered holes may also form windows. Tapered holes may have sidewalls with portions that run parallel to their longitudinal axes and portions that are angled relative to their longitudinal axes.

A control method for an optical fingerprint sensor and a touch controller is provided, for canceling or reducing capacitive loading. The optical fingerprint sensor includes a plurality of pixels, and each of the pixels has a first control signal line and a second control signal line. Each of the pixels is further coupled to a first voltage source line, a second voltage source line and a sensing line. The control method includes the step of configuring at least one of the first control signal line, the second control signal line, the first voltage source line, the second voltage source line and the sensing line to be floating when the touch controller is in a touch operation period.

A silver nanowire (SNW) protection layer structure includes a substrate; a SNW layer, disposed on the substrate and covering only a partial region of a surface of the substrate, the SNW layer including a plurality of SNW channels; and a SNW protection layer, disposed on the SNW layer and covering a region corresponding to the plurality of SNW channels, the SNW protection layer including a light-resistant antioxidant. A manufacturing method for the SNW protection layer structure above is further provided. The SNW protection layer structure and the manufacturing method thereof are applicable in a touch sensor.

A method for controlling an image display system includes detecting a position to which a pointing element is pointing on a fourth image, identifying first coordinates in a coordinate system of the fourth image, the first coordinates represent the position in the fourth image, acquiring first information representing resolution of a second image and second information representing a position of a third image relative to the second image on an image supplier, converting the first coordinates into second coordinates in a coordinate system of a first image, which represent a position in the first image, based on the first information and the second information, and transmitting the second coordinates to the image supplier and carrying out a process based on the second coordinates when the image supplier receives the second coordinates from a display apparatus.