An apparatus and the like for controlling a mobile body that are capable of adjusting a detection result by a radar device in accordance with a three-dimensional shape for each region of a three-dimensional map generated from an image captured by an image-capturing device are provided. A mobile body control unit 105 is an apparatus for controlling the vehicle (mobile body) including an image-capturing device 101 and a millimeter wave radar device 102 (radar device). A three-dimensional map generation unit 203 generates a three-dimensional map around the vehicle from an image captured by the image-capturing device 101. A radar weight map estimation unit 204 (weight estimation unit) estimates the weight of the detection result by the millimeter wave radar device 102 for each region of the three-dimensional map from the three-dimensional shape for each region of the three-dimensional map. A weight adjustment unit 205 (adjustment unit) adjusts a detection result by the millimeter wave radar device 102 on the basis of a weight.

An electronic control device is connected via a cable to each of a plurality of sensors which outputs a sensor output for each data acquisition cycle determined in advance in accordance with a clock signal. The electronic control device includes a power supply unit configured to supply power to the sensor via the cable, an acquisition unit configured to acquire a feature amount directly or indirectly indicating a magnitude of radiation noise from at least one sensor among the plurality of sensors, a phase difference decision unit configured to decide a phase difference of a data acquisition cycle for each of the plurality of sensors based on the feature amount, and a control unit configured to transmit the phase difference to each of the plurality of sensors.

A plurality of images can be acquired from a plurality of sensors and a plurality of flattened patches can be extracted from the plurality of images. An image location in the plurality of images and a sensor type token identifying a type of sensor used to acquire an image in the plurality of images from which the respective flattened patch was acquired can be added to each of the plurality of flattened patches. The flattened patches can be concatenated into a flat tensor and add a task token indicating a processing task to the flat tensor, wherein the flat tensor is a one-dimensional array that includes two or more types of data. The flat tensor can be input to a first deep neural network that includes a plurality of encoder layers and a plurality of decoder layers and outputs transformer output. The transformer output can be input to a second deep neural network that determines an object prediction indicated by the token and the object predictions can be output.

An intelligent control method and system using a radar security camera are disclosed, wherein a target is detected by 360° radar sensing regardless of the rotation radius of a camera by using the security camera having a built-in radar, and the camera is enabled to track the target according to the moving direction and specific signs of the target after the target is identified as a person and a vehicle sequentially according to a decision priority order.

A method for forming 3D image data representative of the subsurface of infrastructure located in the vicinity of a moving vehicle. The method includes: rotating a directional antenna, mounted to the moving vehicle, about an antenna rotation axis; performing, using the directional antenna whilst it is rotated about the antenna rotation axis, a plurality of collection cycles in which the directional antenna emits RF energy and receives reflected RF energy; collecting, during each of the plurality of collection cycles performed by the directional antenna.

A method for forming 3D image data representative of the subsurface of infrastructure located in the vicinity of a moving vehicle. The method includes: rotating a directional antenna, mounted to the moving vehicle, about an antenna rotation axis; performing, using the directional antenna whilst it is rotated about the antenna rotation axis, a plurality of collection cycles in which the directional antenna emits RF energy and receives reflected RF energy; collecting, during each of the plurality of collection cycles performed by the directional antenna.

A method and apparatus with vehicle radar control is disclosed. An apparatus with vehicle radar control includes a radio frequency (RF) transceiver including a transmitting antenna array and a receiving antenna array, and at least one processor configured to collect environmental information of the vehicle, determine a radar mode of the vehicle based on the collected environmental information, generate one or more control signal configured to control one or more of the transmitting antenna array and the receiving antenna array based on the determined radar mode, and provide the generated one or more control signals to the RF transceiver, wherein one or more of the transmitting antenna array and the receiving antenna array operate according to the one or more generated control signals.

Systems, methods, and other embodiments relate to determining the speed of a vehicle. In one embodiment, a method includes receiving a first frame of data generated by a first sensor of a vehicle, the first frame of data including a first set of angular positions associated with a first set of objects in the environment. The method includes receiving a second frame of data generated by a second sensor of the vehicle, the second frame of data including a second set of angular positions associated with a second set of objects in the environment. The method includes generating a speed estimate for the vehicle in relation to the first set of objects and the second set of objects based at least in part on the first set of angular positions of the first frame of data and the second set of angular positions of the second frame of data.

The present disclosure provides an error detector for determining an error vector between a radio trajectory and an image trajectory. The error detector includes: an input for monitoring a radio trajectory of an object from a radio signal and an image trajectory of an object from an image over an observation area; a correlation module arranged to correlate the radio trajectory with the image trajectory; an error module arranged to determine an error vector between the radio trajectory and the image trajectory; and an output arranged to transmit the error vector for use in determining an estimated trajectory of a target based on a target trajectory from a radio signal.

Generally, the present disclosure is directed to systems and methods for streaming processing within one or more systems of an autonomy computing system. When an update for a particular object or region of interest is received by a given system, the system can control transmission of data associated with the update as well as a determination of other aspects by the given system. For example, the system can determine based on a received update for a particular aspect and a priority classification and/or interaction classification determined for that aspect whether data associated with the update should be transmitted to a subsequent system before waiting for other updates to arrive.