Embodiments disclose an augmented reality-based remote guidance method and apparatus, terminal, and storage medium. The method comprises the following steps: acquiring a two-dimensional video of a target scene, and sending the two-dimensional video to a remote terminal; if a guidance mode of the remote guidance is marking mode, acquiring two-dimensional pixel coordinates corresponding to a marked point in a marked image frame of the two-dimensional video at the remote terminal; determining current camera coordinates corresponding to the marked point, according to first three-dimensional coordinate estimation rules and the two-dimensional pixel coordinates, wherein the current camera coordinates are current three-dimensional space coordinates corresponding to the marked point in a camera coordinate system; and according to a presentation mode and the current camera coordinates rendering a three-dimensional virtual model corresponding to the marked point so as to display the three-dimensional virtual model in the target scene.

The invention discloses a multi-human tracking system and method with single Kinect for supporting mobile virtual reality applications. The system can complete the real-time tracking of users occluded in different degrees with a single Kinect capture device to ensure smooth and immersive experience of players. The method utilizes the principle that the user's shadow is not occluded when the user is occluded under certain lighting conditions, and converts the calculation of the motion of the occluded user into a problem of solving the movement of the user's shadow, and can accurately detect the position of each user, rather than just predicting the user's position, thereby actually realizing tracking.

A near-eye display apparatus for displaying a three-dimensional image to a user. The apparatus includes an image projecting means to project pairs of images associated with different cross-sectional planes of the three-dimensional image; at least one optical display arrangement including a plurality of optical elements, wherein each of the plurality of optical elements is operable to be switched between a first optical state and a second optical state; a control arrangement that is operable to control the at least one optical display arrangement to separately switch each optical element from the first optical state to the second optical state, and the image projecting means to project a separate pair of images on each optical element in the second optical state; and at least one optical device that allows display of the three-dimensional image to each eye of the user.

A digital loupe system is provided which can include a number of features. In one embodiment, the digital loupe system can include a stereo camera pair and a distance sensor. The system can further include a processor configured to perform a transformation to image signals from the stereo camera pair based on a distance measurement from the distance sensor and from camera calibration information. In some examples, the system can use the depth information and the calibration information to correct for parallax between the cameras to provide a multi-channel image. Ergonomic head mounting systems are also provided. In some implementations, the head mounting systems can be configurable to support the weight of a digital loupe system, including placing one or two oculars in a line of sight with an eye of a user, while improving overall ergonomics, including peripheral vision, comfort, stability, and adjustability. Methods of use are also provided.

A method of determining an image capture timestamp offset or error includes generating optical flashes at an optical flash rate. A set of images of the optical flashes are captured at an image capture rate. The image capture rate is different from the optical flash rate, and each image includes an associated image timestamp. Signals associated with the generation of the optical flashes are also timestamped. The intensity of each image in the set of images is determined, and the image having the greatest intensity in the set of images is identified. The timestamp offset or error is determined as the difference between the timestamp of the image having the greatest intensity and the timestamp of the corresponding optical flash.

An electrically controlled spectacle includes a spectacle frame and optoelectronic lenses housed in the frame. The lenses include a left lens and a right lens, each of the optoelectrical lenses having a plurality of states, wherein the state of the left lens is independent of the state of the right lens. The electrically controlled spectacle also includes a control unit housed in the frame, the control unit being adapted to control the state of each of the lenses independently.

A method of digital continuous and simultaneous three-dimensional painting, drawing and three-dimensional object navigating with steps of providing a digital electronic display capable of presenting two pictures for a right eye and a left eye; providing means for creating a continuous 3D virtual canvas by digitally changing a value and sign of horizontal disparity between two images for the right eye and the left eye and their scaling on the digital electronic display corresponding to instant virtual distance between the user and an instant image within the virtual 3D canvas; providing at least one multi-axis input control device allowing digital painting or object navigating within virtual 3D canvas by providing simultaneous appearance of a similar objects on the images for the right eye and the left eye on the digital electronic display.

Using two or more cameras attached to the eyewear, three-dimensional views with accurate and natural depth perception of the working area can be displayed for users, so that the user can maintain healthy sitting or standing posture while working on patients or objects located below horizontal eye level. Additional functions including eye protection, zoom-in, zoom-out, on-off, lighting control, overlapping, and teleconference capabilities are also supported using electronic, video and audio devices attached to the eyewear. The eyewear can also comprise a face shield designed to protect the user from hazardous droplets, aerosols, harmful wavelengths of light, heat, sparks, flash burn, debris and/or flying objects.

A method to determine a binocular alignment includes measuring a disassociated phoria of a patient at a first simulated distance by presenting fusible images including targets with a first parallax corresponding to the first simulated distance, using a headset stereo display at a screen distance; presenting non-fusible images by presenting the target for a first eye with the first parallax and presenting a disassociated targetless image for a second eye, and measuring the disassociated phoria in response to the presenting of non-fusible images, using an eye tracker of the headset; and determining a vergence of the patient at the first simulated distance by presenting fusible images for the first and second eyes with the first parallax, corrected with the measured disassociated phoria; measuring an associated phoria in response to the presenting of fusible images; and determining the vergence as a combination of the disassociated phoria and the associated phoria.

[Problem] The present invention provides a stereoscopic image display device, stereoscopic image display method, and a program capable of displaying the display target with a constant size and a constant aspect ratio even when the distance between the stereoscopic image display device and the user changes.

[Solution to Problem] The present invention provides a stereoscopic image display device comprising: a display part; an acquisition part configured to acquire an observation viewing distance that is a viewing distance from the display part to a user; and an adjustment part configured to adjust a display state of a display image based on a reference viewing distance and the observation viewing distance, wherein the display part is configured to display a stereoscopic image based on the display state.