The technology relates to cargo vehicles. National, regional and/or local regulations set requirements for operating cargo vehicles, including how to distribute and secure cargo, and how often the cargo should be inspected during a trip. However, such regulations have been focused on traditional human-driven vehicles. Aspects of the technology address various issues involved with securement and inspection of cargo before a trip, as well as monitoring during the trip so that corrective action may be taken as warranted. For instance, imagery and other sensor information may be used to enable proper securement of cargo before starting a trip. Onboard sensors along the vehicle monitor the cargo and securement devices/systems during the trip to identify issues as they arise. Such information is used by the onboard autonomous driving system (or a human driver) to take corrective action depending on the nature of the issue.

A pupil detection device includes an eye area image obtaining unit that obtains image data representing an eye area image in a captured image obtained by a camera; a luminance gradient calculating unit that calculates luminance gradient vectors corresponding to respective individual image units in the eye area image, using the image data; an evaluation value calculating unit that calculates evaluation values corresponding to the respective individual image units, using the luminance gradient vectors; and a pupil location detecting unit that detects a pupil location in the eye area image, using the evaluation values.

An image is received from a camera built into a cabin of a vehicle. The image is demosaiced and its noise is reduced. A segmentation algorithm is applied to the image. A global illumination for the image is solved. Based on the segmentation of the image and the global illumination, a bidirectional reflectance distribution function (BRDF) for color and/or reflectance information of material in the cabin area of the vehicle is solved for. A white balance matrix and a color correction matrix for the image are computed based on the BRDF. The white balance matrix and the color correction matrix are applied to the image, which is then displayed or stored for addition image processing.

Driver attention and hand placement systems and methods are disclosed herein. An example method includes providing warning messages to a driver of a vehicle based on steering wheel input or hand-wheel contact by the driver. The warning messages are provided according to a first scheme when the steering wheel input is above a threshold value and according to a second scheme when the steering wheel input is below a threshold value and images obtained by a camera in the vehicle indicate that at least one hand of the driver is on the steering wheel.

Methods for improving compliance with regulations pertaining to vehicle driving records are disclosed. One or more digital images from a camera mounted in a vehicle are received. Based on a determination that the vehicle has hours of service that have not been assigned to a driver, a subset of the one or more digital images corresponding to the hours of service are identified based on the timestamps. The subset of the one or more digital images are processed to identify a correspondence between a face of a person included in the one or more digital images and a face of a known person. Based on the correspondence transgressing a threshold level of correspondence, a user interface is generated for presentation on a device. The user interface includes an interactive user interface element for accepting a recommendation to assign the known person as the driver for the unassigned hours of service.

The present invention includes computer vision based driver assistance devices, systems, methods and associated computer executable code (hereinafter collectively referred to as: “ADAS”). According to some embodiments, an ADAS may include one or more fixed image/video sensors and one or more adjustable or otherwise movable image/video sensors, characterized by different dimensions of fields of view. According to some embodiments of the present invention, an ADAS may include improved image processing. According to some embodiments, an ADAS may also include one or more sensors adapted to monitor/sense an interior of the vehicle and/or the persons within. An ADAS may include one or more sensors adapted to detect parameters relating to the driver of the vehicle and processing circuitry adapted to assess mental conditions/alertness of the driver and directions of driver gaze. These may be used to modify ADAS operation/thresholds.

Computer implemented method for detecting an occupancy of a seat, comprising capturing, by means of an imaging device, a first image of a seat, the image comprising depth data, determining, by means of a processing device, a first height profile along a first line in the first image from the depth data, and comparing, by means of the processing device, the first height profile with a first reference height profile taken along the same first line to determine whether the seat is occupied.

An abnormal physical condition determination system includes: an extraction unit that extracts a plurality of feature quantities indicating a condition of a target person from an image of the target person; an accumulation unit that accumulates the plurality of feature quantities as time series data; a calculation unit that calculates a relationship between each feature quantity from the plurality of feature quantities accumulated in the accumulation unit; and a determination unit that determines an abnormal physical condition of the target person on the basis of the relationship. According to such an abnormal physical condition determination system, it is possible to appropriately determine the abnormal physical condition of the target person.

A display controlling device includes a position detecting unit for detecting a position of the head of a driver and a position of an eye of the driver; a region adjusting unit for adjusting the position of a region, to be displayed on a display, in an outside image, depending on the detection result by the position detecting unit; and a display controlling unit for displaying, on the display, a region corresponding to the region of the position adjusted by the region adjusting unit. When there is a change in the position of the head so as to move in both the vertical direction in the crosswise direction of the vehicle, the region adjusting unit prevents adjustment of the position of the region to a position corresponding to the change, in the vertical direction, of the position of the eye, and adjusts the position of the region to a position corresponding to a change in the position of the eye in the crosswise direction and/or the front/rear direction.

Related methods are provided for establishing a baseline value to represent an eyelid opening dimension for a person engaged in an activity, where the activity may be driving a vehicle, operating industrial equipment, or performing a monitoring or control function; and for operating a system for monitoring eyelid opening values with real time video data.