A method and a system for user interaction with a hologram includes displaying the hologram inside a passenger compartment of the vehicle, after displaying the hologram inside the passenger compartment of the vehicle, monitoring a vehicle user inside the passenger compartment of the vehicle to determine whether the vehicle user provided a user command, determining that the vehicle user provided the user command, and in response to determining that the vehicle user provided the user command, manipulating the hologram in accordance with the user command.

Aspects of the present invention provide an approach for authentication of a user of a computer system by displaying holographic objects in a bounded field of view of a user, identifying movement of the user interacting with the holographic objects, comparing the interacting movement to authentication information linking user authentication to a movement defined within confidence limits, and when the identified user movement indicates the user interacted with the displayed holographic objects within the defined confidence limits, authenticating the user on the computer system.

A volumetric display system including a volumetric display for displaying a scene viewable as a three-dimensional floating-in-the-air scene in a display space, enabling a user to reach a first object into the display space, a location determination unit locating real objects in the display space, providing a location of the first object when the first object is inserted into the display space, and a computer for receiving the location of the first object, detecting when the location of the first object is at a location where an object is displayed in the three-dimensional scene, thereby determining that the first object is viewable as touching the displayed object following a detection of the first object viewable as touching the displayed object, producing a new three-dimensional scene displaying the displayed object as if manipulated by the first object. Related apparatus and methods are also described.

Disclosed are methods and systems for displaying images, and for implementing volumetric user interfaces. One exemplary embodiment provides a system comprising: a light source; an image producing unit, which produces an image upon interaction with light approaching the image producing unit from the light source; an eyepiece; and a mirror, directing light from the image to a surface of the eyepiece, wherein the surface has a shape of a solid of revolution formed by revolving a planar curve at least 180 around an axis of revolution.

Implementations of various computer methods to couple a computerized ball device which acts as a mobile computing device to record the users environment and project light towards waveguide eyeglasses or contacts which then allows a user to view imbedded light structure holograms in the waveguide while viewing the actual world. The computer ball device additionally has the ability to be docked in a drone cradle which creates a database map of the user's environment while not being utilized by the user for an immediate task. The device may also attach to a wrist band for mobility. The device also has the ability to couple the projected light structures so that a plurality of users may view the same light structure content to build an environment of trust. The device decouples the traditional design of head mounted virtual and mixed reality that place together the camera with the head mounted device.

The holographic interface for manipulation includes a holographic display unit for constructing and displaying a hologram and a motion detector for detecting movement and location of a physical command object, such as a user's finger or hand, relative to the displayed hologram. The motion detector is in communication with a controller for converting the detected location of the physical command object relative to its position with respect to the displayed hologram into a command signal. The command signal is then transmitted to an external device, such as a robotic arm in a remote plant, or any other suitable external system. Alternatively, the hologram may be a holographic image of physical controls for an external system, for example, and the command signal may be a command for the external device to perform an act corresponding to manipulation of the holographic image of a physical control by the command object.

A display apparatus including a display; a holographic projector a fingerprint scanner to read a fingerprint from a user's finger spaced from the fingerprint scanner when placed in proximity to the holographic object; a camera to image the holographic object and the user's finger; a non-transitory storage medium that stores instructions; and a processor that executes the instructions to: responsive to the receipt of images from the camera, perform image analysis to: identify a position of the user's finger with respect to the display surface and the holographic object, identify a position of the holographic object with respect to the display surface and identify the proximity of the user's finger with the holographic object; and responsive to the image analysis to identify the proximity of the user's finger with the holographic object, provide an input to the fingerprint scanner to read the fingerprint of the user's finger.

A method of creating a 3D holographic display in a device having a camera, holographic projectors and display surface, the method including: tracking by the camera an interactive device over the display; determining by the camera a distance from the interactive device to the display; responsive to an action by the interactive device, visually displaying by the holographic projectors a unit holographic object proximate to the interactive device; responsive to one or more additional actions by the interactive device, visually displaying by the holographic projectors additional unit holographic objects proximate to the unit holographic object so as to be visually displaying a plurality of unit holographic objects; accumulating by the holographic projectors the plurality of unit holographic objects proximate to the display surface; and determining an amount of accumulated unit holographic objects visually displayed by the holographic projectors until a resultant shape of holographic objects is formed.

A method that includes: recognizing by an object recognition device a physical object; comparing by the object recognition device the physical object with a fully completed object; identifying by the object recognition device a spatial position, an orientation and physical dimensions of the partially-completed physical object; creating by a three-dimensional (3D) modeling program a 3D model of the partially-completed physical object using the spatial position, the orientation and physical dimensions of the partially-completed physical object; inputting by the 3D modeling program to a holographic creation system a missing shape of the partially-completed physical object, the missing shape being a complementary portion of the partially-completed physical object; creating by the holographic creation system a 3D hologram of the complementary portion; displaying by a holographic projector the 3D hologram of the complementary portion adjacent to the partially-completed physical object.

A virtual control system that includes a control unit, a gesture recognition device, and a hologram generation device. The hologram generation device is configured to generate a hologram in a first volume of space. The gesture recognition device is configured to recognize a proper gesture within the first volume of space. The control unit is configured to send a signal to a component to be controlled when the gesture recognition device recognizes the proper gesture.