A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.

There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.

A wide field of view night vision system is described. The system comprises a head attachment apparatus configured to attach to a user's head and a night vision subsystem. The night vision subsystem comprises one or more night vision image sensors attached to the head attachment apparatus. Each sensor receives input light and produces a digital image of the input light. A processor processes the digital image(s) to produce a wide-field image. The wide-field image spans at least 60 degrees of a user's horizontal field of view. A display and eyepiece attached to the head attachment apparatus receives and displays the wide-field image. The eyepiece is positionable between the display and the user's eye to image the wide-field image into the user's eye.

Embodiments that relate to interacting with a physical object in a mixed reality environment via a head-mounted display are disclosed. In one embodiment a mixed reality interaction program identifies an object based on an image from captured by the display. An interaction context for the object is determined based on an aspect of the mixed reality environment. A profile for the physical object is queried to determine interaction modes for the object. A selected interaction mode is programmatically selected based on the interaction context. A user input directed at the object is received via the display and interpreted to correspond to a virtual action based on the selected interaction mode. The virtual action is executed with respect to a virtual object associated with the physical object to modify an appearance of the virtual object. The modified virtual object is then displayed via the display.

Method of controlling an active filtering device comprising an active filter and a filter controller arranged to control the active filter, the method comprising: a wearer location providing step, during which a location of a wearer is provided, a luminous cartography providing step, during which a luminous cartography relating to the light sources in the environment of the wearer is provided, the luminous cartography depending at least on the location of the wearer, a light exposure profile determining step, during which at least one part of the light exposure profile of the wearer is determined based at least on the luminous cartography and on the wearer location, and an active filter controlling step, during which the active filter is controlled by the filter controller according to the determined light exposure profile of the wearer.

A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.

The various embodiments set forth a method for displaying information on one or more surfaces of a vehicle, the method comprising acquiring position data associated with a driver of the vehicle, calculating a current field-of-view of the driver based on the position data, determining a suitable surface for displaying visual information within the vehicle based on the current field-of-view of the driver, and projecting an element of visual information on the suitable surface.

Systems and methods are provided for discerning the intent of a device wearer primarily based on movements of the eyes. The system may be included within unobtrusive headwear that performs eye tracking and controls screen display. The system may also utilize remote eye tracking camera(s), remote displays and/or other ancillary inputs. Screen layout is optimized to facilitate the formation and reliable detection of rapid eye signals. The detection of eye signals is based on tracking physiological movements of the eye that are under voluntary control by the device wearer. The detection of eye signals results in actions that are compatible with wearable computing and a wide range of display devices.

A method and apparatus for outputting a three-dimensional (3D) image are provided. To output a 3D image, a stereo image is generated based on viewpoints of a user and rendered into a 3D image. Since the stereo image is generated based on the viewpoints of the user, the user views a different side of an object appearing in the 3D image depending on a viewpoint of the user.

A wearable terminal device capable of wirelessly communicating with a mobile terminal device having a display unit, the wearable terminal device comprising receiving status information of the mobile terminal device from the mobile terminal device when status of the mobile terminal device changes, determining whether or not to select display of the wearable terminal device based on the status information, and controlling the display of the wearable terminal device based on a determination result by the determining.