An electronic device includes a communicator configured to perform communication with an external device, a display configured to display a UI (User Interface) element in a screen, and a processor. The processor receives through the communicator, touch panel information of the external device and first data according to a first input of a user detected on the touch panel of the external device, and changes a location of the UI element displayed on the screen based on the touch panel information and the first data.

An imaging method is provided for a modular mixed reality (MR) device having an MR calculation module, an MR optical path module and an MR posture module. The MR calculation module is configured to adjust display content according to data from the MR posture module. The MR optical path module comprises a virtual-image optical path and a mixed optical path. A semi-transparent semi-reflective mirror is provided in the mixed optical path. One surface of the mirror is a real-image introduction surface facing a real environment, while the other is a virtual-image introduction surface facing the virtual-image optical path. Virtual-image light is reflected by the virtual-image introduction surface onto an observation end and mixed with real environment light transmitted to the observation end by the real-image introduction surface to form a mixed reality image.

In one implementation, a non-transitory computer-readable storage medium stores program instructions computer-executable on a computer to perform operations. The operations include presenting, on a display of an electronic device, first content representing a standard view of a physical setting depicted in image data generated by an image sensor of the electronic device. While presenting the first content, an interaction with an input device of the electronic device is detected that is indicative of a request to present an enriched view of the physical setting. In accordance with detecting the interaction, second content is formed representing the enriched view of the physical setting by applying an enrichment effect that alters or supplements the image data generated by the image sensor. The second content representing the enriched view of the physical setting is presented on the display.

A method which makes it possible to immerse a user in a virtual reality application is described. The method includes controlling the movement of an avatar of a user in a synthetic scene and controlling the movements of a video acquisition system depending on the detected movements of the head of the user. The method also includes playing back content on a screen of a virtual reality helmet of the user, the content being a video stream acquired by the video acquisition system if the position of the eyes of the avatar is in a synthetic object whose volume can be included in a volume in which the video acquisition system is likely to move.

Disclosed herein is an image processing method executed by an image processing apparatus. The image processing method includes designating a distribution of pixels whose charge is to be added and read out from among pixels an image sensor has, and acquiring data of a captured image in which an area of a region that is a unit from which charge is to be read out differs depending upon a position by the designation.

Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Embodiments of the invention provide a camera array imaging architecture that computes depth maps for objects within a scene captured by the cameras, and use a near-field sub-array of cameras to compute depth to near-field objects and a far-field sub-array of cameras to compute depth to far-field objects. In particular, a baseline distance between cameras in the near-field subarray is less than a baseline distance between cameras in the far-field sub-array in order to increase the accuracy of the depth map. Some embodiments provide an illumination near-IR light source for use in computing depth maps.

Images perceived to be substantially full color or multi-colored may be formed using component color images that are distributed in unequal numbers across a plurality of depth planes. The distribution of component color images across the depth planes may vary based on color. In some embodiments, a display system includes a stack of waveguides that each output light of a particular color, with some colors having fewer numbers of associated waveguides than other colors. The stack of waveguides may include by multiple pluralities (e.g., first and second pluralities) of waveguides, each configured to produce an image by outputting light corresponding to a particular color. The total number of waveguides in the second plurality of waveguides is less than the total number of waveguides in the first plurality of waveguides, and may be more than the total number of waveguides in a third plurality of waveguides, in embodiments where three component colors are utilized.

A screening platform enables comprehensive ocular evaluations. The screening platform includes a harness that is configured to fit a head of a patient and that includes one or more electronic components that are operable to power an interchangeable module, a central processing unit (CPU) with a graphical processing unit (GPU), and the interchangeable module with communication capabilities to external computational devices, multiple display output devices, and several types of input devices from both an operator and a patient at-hand, wherein the interchangeable module is separable from the screening platform.