A portable device (e.g., a wireless device such as a cell phone) is provided with a flexible keyboard and a flexible display screen. Such flexible components may be stored in the housing of the portable device when not in use. The flexible display screen and flexible keyboard may be expanded from the housing when the flexible components are utilized by a user. Non-flexible display and input components may be provided on the exterior of the portable device such that the device may be used, in some form, while the flexible components are stored. In one embodiment, a portion of the flexible display (or flexible keyboard) may be utilized when the flexible display (or flexible keyboard) is stored in said first housing.

A free space input standard is instantiated on a processor. Free space input is sensed and communicated to the processor. If the free space input satisfies the free space input standard, a touch screen input response is invoked in an operating system. The free space input may be sensed using continuous implicit, discrete implicit, active explicit, or passive explicit approaches. The touch screen input response may be invoked through communicating virtual touch screen input, a virtual input event, or a virtual command to or within the operating system. In this manner free space gestures may control existing touch screen interfaces and devices, without modifying those interfaces and devices directly to accept free space gestures.

Smart glasses are provided in the present disclosure, including a housing, a fixing bracket, a left lens barrel, a right lens barrel, an object distance adjustment mechanism including a left-eye object distance adjustment gear, a right-eye object distance adjustment gear, an object distance adjustment driving gear engaged with the left-eye object distance adjustment gear and the right-eye object distance adjustment gear and a driving motor driving the object distance adjustment driving gear to rotate and being capable of moving back and forth on the fixing bracket along a second direction; a pupil distance adjustment mechanism connected to at least one lens barrel, and configured to drive the lens barrel to move in the first direction when an external force is applied, and a linkage member arranged between the at least one lens barrel and the driving motor.

Systems, methods, and media for displaying interactive augmented reality presentations are provided. In some embodiments, a system comprises: a plurality of head mounted displays, a first head mounted display comprising a transparent display; and at least one processor, wherein the at least one processor is programmed to: determine that a first physical location of a plurality of physical locations in a physical environment of the head mounted display is located closest to the head mounted display; receive first content comprising a first three dimensional model; receive second content comprising a second three dimensional model; present, using the transparent display, a first view of the first three dimensional model at a first time; and present, using the transparent display, a first view of the second three dimensional model at a second time subsequent to the first time based one or more instructions received from a server.

There is provided an optical device, including an input aperture, an output aperture, at least first and second light-transmitting substrates each having two major surfaces and edges, an input surface for coupling light waves into the substrate for effecting total internal reflection inside the substrate, and an output surface for coupling light waves out of the substrate, a major surface of the first substrate is attached to a major surface of the second substrate and the input surface of the first substrate is a partially reflecting surface, such that part of the light waves passing through the input aperture is partially reflected by the partially reflecting input surface and coupled into the first substrate and another part passes through the partially reflecting input surface and is coupled by the input surface of the second substrate into the second substrate.

A method, includes saving in-flight data from an aircraft during a simulated training exercise, wherein the in-flight data includes geospatial locations of the aircraft, positional attitudes of the aircraft, and head positions of a pilot operating the aircraft, saving simulation data relating to a simulated virtual object presented to the pilot as augmented reality content in-flight, wherein the virtual object was programmed to interact with the aircraft during the simulated training exercise and representing the in-flight data from the aircraft and the simulation data relating to the simulated virtual object as a replay of the simulated training exercise.

A robot system includes a mobile robot configured to move, a portable teaching device including a display section configured to display information, the portable teaching device teaching the mobile robot, a first detecting section configured to detect a present position of the portable teaching device, a second detecting section configured to detect a present position of the mobile robot, and a display control section configured to cause, based on a detection result of the first detecting section and a detection result of the second detecting section, the display section to display the present position of the portable teaching device and the present position of the mobile robot.

Disclosed are systems, methods, and non-transitory computer readable media for making virtual colored markings on objects. Instructions may include receiving an indication of an object; receiving from an image sensor an image of a hand of an individual holding a physical marking implement; detecting in the image a color associated with the marking implement; receiving from the image sensor image data indicative of movement of a tip of the marking implement and locations of the tip; determining from the image data when the locations of the tip correspond to locations on the object; and generating, in the detected color, virtual markings on the object at the corresponding locations.

A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.

More realistic experiences can be provided to a user through the use of a wearable suit. The xR wearable suit may include materials with adjustable characteristics, such as friction, and electronics for controlling the materials to provide feedback to the user wearing the xR suit. In an xR game, the materials may be used to translate virtual damage to physical constraints on the user. For example, when an avatar gets shot in the leg and is debilitated, the user's leg motion can be constricted to understand that shortcoming and stay in sync with the avatar. Examples of such feedback materials include inflating ribs, sheet jamming, and mechanical devices.