In various implementations, a method of presenting video streams at a head-mountable device (HMD) includes generating a first video stream at a first frame rate for a first display portion. In some implementations, the first frame rate indicates a rate at which frames are presented by the first display portion. In various implementations, the method includes generating a second video stream at a second frame rate for a second display portion. In some implementations, the second frame rate indicates a rate at which frames are presented by the second display portion. In some implementations, the second frame rate is within a threshold relative to the first frame rate. In various implementations, the method includes temporally shifting the second video stream relative to the first video stream so that a majority of refresh times of the first display portion are different from refresh times of the second display portion.

In various implementations, a method of presenting video streams at a head-mountable device (HMD) includes generating a first video stream at a first frame rate for a first display portion. In some implementations, the first frame rate indicates a rate at which frames are presented by the first display portion. In various implementations, the method includes generating a second video stream at a second frame rate for a second display portion. In some implementations, the second frame rate indicates a rate at which frames are presented by the second display portion. In some implementations, the second frame rate is within a threshold relative to the first frame rate. In various implementations, the method includes temporally shifting the second video stream relative to the first video stream so that a majority of refresh times of the first display portion are different from refresh times of the second display portion.

Provided is an image that is comfortably viewed and operated by a user. An electronic device acquires user information related to a relative position between a user and a display unit. Then, the electronic device transmits the user information to an information processing device. The information processing device includes a communication unit and a control unit. The communication unit receives the user information related to the relative position of the user and a display unit which is acquired by the electronic device from the electronic device. Further, the control unit performs control to decide a display mode of an image transmitted from a source device on the display unit on the basis of the user information received from the electronic device.

The present invention includes computer vision based driver assistance devices, systems, methods and associated computer executable code (hereinafter collectively referred to as: “ADAS”). According to some embodiments, an ADAS may include one or more fixed image/video sensors and one or more adjustable or otherwise movable image/video sensors, characterized by different dimensions of fields of view. According to some embodiments of the present invention, an ADAS may include improved image processing. According to some embodiments, an ADAS may also include one or more sensors adapted to monitor/sense an interior of the vehicle and/or the persons within. An ADAS may include one or more sensors adapted to detect parameters relating to the driver of the vehicle and processing circuitry adapted to assess mental conditions/alertness of the driver and directions of driver gaze. These may be used to modify ADAS operation/thresholds.

A digital twin modeling method to assemble a robotic teleoperation environment, including: capturing images of the teleoperation environment; identifying a part being assembled; querying the assembly assembling order to obtain a list of assembled parts according to the part being assembled; generating a three-dimensional model of the current assembly from the list and calculating position pose information of the current assembly in an image acquisition device coordinate system; loading a three-dimensional model of the robot, determining a coordinate transformation relationship between a robot coordinate system and an image acquisition device coordinate system; determining position pose information of the robot in an image acquisition device coordinate system from the coordinate transformation relationship; determining a relative positional relationship between the current assembly and the robot from position pose information of the current assembly and the robot in an image acquisition device coordinate system; establishing a digital twin model of the teleoperation environment.

A digital twin modeling method to assemble a robotic teleoperation environment, including: capturing images of the teleoperation environment; identifying a part being assembled; querying the assembly assembling order to obtain a list of assembled parts according to the part being assembled; generating a three-dimensional model of the current assembly from the list and calculating position pose information of the current assembly in an image acquisition device coordinate system; loading a three-dimensional model of the robot, determining a coordinate transformation relationship between a robot coordinate system and an image acquisition device coordinate system; determining position pose information of the robot in an image acquisition device coordinate system from the coordinate transformation relationship; determining a relative positional relationship between the current assembly and the robot from position pose information of the current assembly and the robot in an image acquisition device coordinate system; establishing a digital twin model of the teleoperation environment.

A method and system for determining if an individual is impaired. In one embodiment, physical and cognitive testing of the individual are conducted in the field or at the scene of an event. The test results are compared to previously stored baseline test results taken for the specific individual while the individual is known to be in an unimpaired state or condition. The current test results are electronically compared to the baseline test results and if the results differ or deviate beyond a predetermined level or amount the individual is considered to be impaired. If no baseline test results exist for the specific individual, the current test results can alternatively be compared to previously determined or known scientifically accepted or minimums for the specific tests given to the individual.

One embodiment provides a method for three-dimensional imaging by determining distances of objects within scenes, the method including: emitting a light onto an object within a scene for a predetermined length of time; receiving a plurality of reflections of the light from the object, wherein each of the plurality of reflections is received for a predetermined length of time less than an exposure time for a frame of the scene, wherein the photon detector generates an electrical signal; determining depth location information of at least a portion of the object within the scene corresponding to the given of the electrical signals; and generating, from the depth location information of portions of the object within the scene, a three-dimensional image for the frame of the scene.

One embodiment provides a method for three-dimensional imaging by determining distances of objects within scenes, the method including: emitting a light onto an object within a scene for a predetermined length of time; receiving a plurality of reflections of the light from the object, wherein each of the plurality of reflections is received for a predetermined length of time less than an exposure time for a frame of the scene, wherein the photon detector generates an electrical signal; determining depth location information of at least a portion of the object within the scene corresponding to the given of the electrical signals; and generating, from the depth location information of portions of the object within the scene, a three-dimensional image for the frame of the scene.

A method for estimating tightly enclosing bounding boxes by a computing system includes: controlling a scanning system including one or more depth cameras to capture visual information of the scene including one or more objects; detecting the one or more objects of the scene based on the visual information; singulating each the one or more objects from the frame of the scene to generate one or more 3D models corresponding to the one or more objects, the one or more 3D models including a partial 3D model of a corresponding one of the one or more objects; extrapolating a more complete 3D model of the corresponding one of the one or more objects based on the partial 3D model; and estimating a tightly enclosing bounding box of the corresponding one of the one or more objects based on the more complete 3D model.