G06T2207/10028

Three-dimensional reconstruction method and apparatus for material pile, electronic device, and computer-readable medium

Embodiments of the present disclosure relate to a three-dimensional reconstruction method and apparatus for a material pile, an electronic device, and a computer-readable medium. The method may include: acquiring, in response to an instruction for controlling an excavator body of an excavator to rotate to transport materials being detected, a sequence of depth images of an excavated material pile collected by a binocular camera provided on a side of the excavator; and performing three-dimensional reconstruction based on the sequence of depth images of the material pile, to generate a three-dimensional model of the material pile.

Automated supervision and inspection of assembly process
11568597 · 2023-01-31 · ·

A method and apparatus for performing automated supervision and inspection of an assembly process. The method is implemented using a computer system. Sensor data is generated at an assembly site using a sensor system positioned relative to the assembly site. A three-dimensional global map for the assembly site and an assembly being built at the assembly site is generated using the sensor data. A current stage of an assembly process for building an assembly at the assembly site is identified using the three-dimensional global map. A context for the current stage is identified. A quality report for the assembly is generated based on the three-dimensional global map and the context for the current stage.

Multichannel, multi-polarization imaging for improved perception

In one embodiment, a method includes accessing first image data generated by a first image sensor having a first filter array that has a first filter pattern. The first filter pattern includes a number of first filter types. The method also includes accessing second image data generated by a second image sensor having a second filter array that has a second filter pattern different from the first filter pattern. The second filter pattern includes a number of second filter types, the number of second filter types and the number of first filter types have at least one filter type in common. The method also includes determining a correspondence between one or more first pixels of the first image data and one or more second pixels of the second image data based on a portion of the first image data associated with the filter type in common.

Compensating radio tracking with comparison to image based tracking

The present disclosure provides an error detector for determining an error vector between a radio trajectory and an image trajectory. The error detector includes: an input for monitoring a radio trajectory of an object from a radio signal and an image trajectory of an object from an image over an observation area; a correlation module arranged to correlate the radio trajectory with the image trajectory; an error module arranged to determine an error vector between the radio trajectory and the image trajectory; and an output arranged to transmit the error vector for use in determining an estimated trajectory of a target based on a target trajectory from a radio signal.

SLAM SYSTEM AND METHOD FOR VEHICLES USING BUMPER-MOUNTED DUAL LIDAR

There is provided a simultaneous localization and mapping (SLAM) system including a first LiDAR and a second LiDAR mounted on a vehicle bumper; a LiDAR data merge unit receiving data from the first LiDAR and the second LiDAR, aligning LiDAR times through time synchronization, and then converting the data into a point cloud type and merging the data; an electronic control unit (ECU) providing inertial data of the vehicle for correcting the data merged in the LiDAR data merge unit; and an SLAM unit correcting the data merged in the LiDAR data merge unit by using the inertial data of the vehicle received from the ECU to obtain LiDAR odometry for estimating a movement of the vehicle, generating a 3D map of a road on which the vehicle travels, and extracting a location and a traveling route of the vehicle inside a road.

METHOD AND SYSTEM FOR INSPECTING A BUILDING CONSTRUCTION SITE USING A MOBILE ROBOTIC SYSTEM

A method of inspecting a building construction site using a mobile robotic system includes a mobile platform and a sensor system mounted on the mobile platform and configured to generate one or more types of sensor data. The method includes: receiving object identification information identifying at least one building object to be inspected by the mobile robotic system in the building construction site; obtaining a robot navigation map covering the at least one building object based on a building information model for the building construction site; and determining at least one goal point in the robot navigation map for the at least one building object, each goal point being a position in the robot navigation map for the mobile robotic system to navigate autonomously to for inspecting corresponding one or more building objects of the at least one building object. A corresponding inspection system is also provided.

Pose estimation and applications using computer imaging
11568563 · 2023-01-31 · ·

Embodiments describe a method for positioning a hinged vehicle including a primary part and a secondary part coupled to the primary part at a project site. The method includes receiving, from an image capturing device, digital image data representing one or more features of the secondary part; performing image analysis on the digital image data to identify positions of the one or more features of the secondary part; identifying an angle of at least a portion of the secondary part; calculating a current position of the secondary part based on the angle; calculating a positional difference between a correct position at the project site for the secondary part and a current position of the secondary part at the project site; and initiating a change in a position of the primary part to compensate for the positional difference and to position the secondary part on the correct position.

Systems and methods for navigating a vehicle among encroaching vehicles

Systems and methods use cameras to provide autonomous navigation features. In one implementation, a method for navigating a user vehicle may include acquiring, using at least one image capture device, a plurality of images of an area in a vicinity of the user vehicle; determining from the plurality of images a first lane constraint on a first side of the user vehicle and a second lane constraint on a second side of the user vehicle opposite to the first side of the user vehicle; enabling the user vehicle to pass a target vehicle if the target vehicle is determined to be in a lane different from the lane in which the user vehicle is traveling; and causing the user vehicle to abort the pass before completion of the pass, if the target vehicle is determined to be entering the lane in which the user vehicle is traveling.

Apparatus and method for efficient point cloud feature extraction and segmentation framework
11567207 · 2023-01-31 · ·

A computer implemented scheme for a light detection and ranging (LIDAR) system where point cloud feature extraction and segmentation by efficiently is achieved by: (1) data structuring; (2) edge detection; and (3) region growing.

Depth-based image stitching for handling parallax

A solution to the problem of image and video stitching is disclosed that compensates for the effects of lens distortion, camera misalignment, and parallax in combining multiple images. The disclosed image stitching technique includes depth or disparity estimation, alignment, and blending processes configured to be computationally efficient and produce quality results by limiting the presence of noticeable seams and artifacts in the final stitched image. An inter-frame approach applies image stitching to video frames to maintain temporal continuity between successive frames across a stitched video output having a 360-degree viewing perspective. A temporal adjustment is configured to improve temporal continuity between a subsequent frame and a previous frame in a sequence of video frames.