Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

Embodiments of the disclosure relate to an input apparatus and a controlling method thereof, more particularly, to an input device for displaying a graphic in a detected color and an input touch form by detecting a color and a touch shape of an input tool for inputting a touch command. An input apparatus according to an embodiment includes a display: a first sensor configured to detect a touch position of a touch command input to the display from an input tool; a second sensor configured to detect a color of the input tool; and a controller configured to control a graphic corresponding to the input touch command to be displayed in the detected color at the detected touch position.

A sensor determining coordinates of a proximal object, including a one-dimensional array of alternating light emitters and detectors, including a plurality of light emitters projecting light along a detection plane, and a plurality of light detectors detecting reflections of the projected light, by a reflective object in the detection plane, and a plurality of lenses mounted and oriented relative to the emitters and the detectors such that the light detectors receive maximum intensity when light enters a corresponding lens at a first particular angle, whereby for each emitter-detector pair, light emitted by the emitter of that pair passes through one of the lenses and is reflected by the object back through one of the lenses to the detector of that pair when the object is located at one of a set of positions in the detection plane, that position being associated with that emitter-detector pair.

An electronic device is provided. The electronic device includes a substrate and the electronic device also includes a light-emitting element, a sensing element and a black matrix disposed on the substrate. The sensing element is disposed adjacent to the light-emitting element. The black matrix has a plurality of openings and a light-shielding portion. The electronic device further includes a driving element disposed adjacent to and electrically connected to the light-emitting element. The sensing element includes a first thin-film transistor, and the driving element includes a second thin-film transistor. In a normal direction of the substrate, one of the openings is disposed corresponding to the sensing element, and the light-shielding portion is disposed corresponding to the driving element.

A signal detection method applied in an electronic device includes: resetting each optical sensor at a first time point; collecting a first signal output by the optical sensor at the first time point, a second signal output by the optical sensor at a second time point, a third signal output by the optical sensor at a third time point, and a fourth signal output by the optical sensor at a fourth time point; obtaining a first difference value between the first signal and the second signal and a second difference value between the third signal and the fourth signal, and determining a sum of the first difference value and the second difference value as a signal variation amount in a current cycle. Also disclosed are an associated electronic device and a non-transitory computer readable storage medium.

A tactile touch sensor (TTS) system and method allowing physical augmentation of a high-resolution touch sensor array (TSA) is disclosed. Physical augmentation is accomplished using a TSA physical overlay (TPO) placed on top of the TSA. The TPO is constructed to transmit forces to the underlying TSA. Force transmission is accomplished by either using a flexible overlay or with a rigid mechanical overlay that transmits user forces exerted on the overlay to the underlying TSA. Incorporation of TPO identifiers (TPI) within the TPO permits identification of the TPO by a TPO detector (TPD) allowing operational characteristics of the TSA to be automatically reconfigured to conform to the currently applied TPO structure by a user computing device (UCD). The UCD may be configured to automatically load an appropriate application software driver (ASD) in response to a TPI read by the TPD from the currently applied TPO.

A tactile touch sensor (TTS) system and method allowing physical augmentation of a high-resolution touch sensor array (TSA) is disclosed. Physical augmentation is accomplished using a TSA physical overlay (TPO) placed on top of the TSA. The TPO is constructed to transmit forces to the underlying TSA. Force transmission is accomplished by either using a flexible overlay or with a rigid mechanical overlay that transmits user forces exerted on the overlay to the underlying TSA. Incorporation of TPO identifiers (TPI) within the TPO permits identification of the TPO by a TPO detector (TPD) allowing operational characteristics of the TSA to be automatically reconfigured to conform to the currently applied TPO structure by a user computing device (UCD). The UCD may be configured to automatically load an appropriate application software driver (ASD) in response to a TPI read by the TPD from the currently applied TPO.

A finger position sensitive HMI for handling a user input of a user. The HMI includes an EDPU and includes a finger-position sensitive display. The display is arranged to display a generated button at the generated display location, to detect touch coordinates of a touched location on the display to provide the detected touch coordinates to the HMI OS, and to detect a force signal caused by pressure being applied to the display. The display is further arranged to provide the detected force signal to a supervising element. A check unit connected to the supervising element is arranged to observe a displayed button, and to generate an observed button bitmap content indicator of a pixel area related to the observed displayed button. The supervising element is arranged to release the provided service request related to the displayed button.

The present disclosure relates to an optical sensor for use in an image recognition device, such as a fingerprint detector. The presently disclosed optical sensor has improved light transmittance in a compact and cost-efficient structure. In particular the presently disclosed optical sensor can be placed under a display panel of an electronic device, such as a smartphone. One embodiment relates to an optical sensor system for placement under a display panel for detecting/imaging light returned from a fingerprint on top of the display panel, the optical sensor comprising a microlens structure having a front side with an array of light focusing elements and an opaque back side with an array of optically transparent apertures aligned with the focusing elements, and a sensor array of optical detectors facing the back side of the microlens structure. The optical sensor system is preferably configured such that light returned from the object can be focused by the microlens structure onto the sensor array through the transparent apertures.

An optical detection device is applied to an optical finger navigation apparatus and suitable for a variety of appearance demands in order to simplify product qualification procedure. The optical detection device includes a substrate, a housing, an optical sensor and a cover. The housing is disposed on the substrate and comprising a first aperture. The optical sensor is disposed on the substrate and adapted to receive an optical signal through the first aperture. The cover is disposed on the housing to cover the first aperture. The cover has a first surface and a second surface opposite to each other. The first surface with a contour matched with a shape of the housing is attached to the housing, and the second surface with a contour manufactured for a predefined appearance demand does not affect conjunction between the housing and the cover.