H04N25/443

Smart sensor scheduler
11700459 · 2023-07-11 · ·

A system includes an image sensor having a plurality of pixels that form a plurality of regions of interest (ROIs), image processing resources, and a scheduler configured to perform operations including determining a priority level for a particular ROI of the plurality of ROIs based on a feature detected by one or more image processing resources of the image processing resources within initial image data associated with the particular ROI. The operations also include selecting, based on the feature detected within the initial image data, a particular image processing resource of the image processing resources by which subsequent image data generated by the particular ROI is to be processed. The operations further include inserting, based on the priority level, the subsequent image data into a processing queue of the particular image processing resource to schedule the subsequent image data for processing by the particular image processing resource.

Smart sensor scheduler
11700459 · 2023-07-11 · ·

A system includes an image sensor having a plurality of pixels that form a plurality of regions of interest (ROIs), image processing resources, and a scheduler configured to perform operations including determining a priority level for a particular ROI of the plurality of ROIs based on a feature detected by one or more image processing resources of the image processing resources within initial image data associated with the particular ROI. The operations also include selecting, based on the feature detected within the initial image data, a particular image processing resource of the image processing resources by which subsequent image data generated by the particular ROI is to be processed. The operations further include inserting, based on the priority level, the subsequent image data into a processing queue of the particular image processing resource to schedule the subsequent image data for processing by the particular image processing resource.

VISION SENSOR, IMAGE PROCESSING DEVICE INCLUDING THE SAME, AND OPERATING METHOD OF THE VISION SENSOR

Provided is a vision sensor including a pixel array including a plurality of pixels disposed in a matrix form, an event detection circuit configured to detect whether an event has occurred in the plurality of pixels and generate event signals corresponding to pixels from among the plurality of pixels in which an event has occurred, a map data processor configured to generate a timestamp map based on the event signals, and an interface circuit configured to transmit vision sensor data including at least one of the event signals and the timestamp map to an external processor, wherein the timestamp map includes timestamp information indicating polarity information, address information, and an event occurrence time of a pixel included in an event signal corresponding to the pixel.

Digital foveation for machine vision

A machine vision method includes obtaining a first representation of an image captured by an image sensor array, analyzing the first representation for an assessment of whether the first representation is sufficient to support execution of a machine vision task by the processor, if the first representation is not sufficient, determining, based on the first representation, a region of the image of interest for the execution of the machine vision task, reusing the image captured by the image sensor array to obtain a further representation of the image by directing the image sensor array to sample the image captured by the image sensor array in a manner guided by the determined region of the image of interest and by the assessment, and analyzing the further representation to assess whether the further representation is sufficient to support the execution of the machine vision task by implementing a procedure for the execution of the machine vision task in accordance with the further representation.

Image capturing apparatus, image capturing system, and moving body
11695022 · 2023-07-04 · ·

An image capturing apparatus includes a plurality of photoelectric conversion elements, a first selection unit, and a second selection unit. Each of the photoelectric conversion elements includes an avalanche diode and a counter. The photoelectric conversion elements have a first photoelectric conversion element and a second photoelectric conversion element. The first selection unit controls the first photoelectric conversion element. The second selection unit controls the second photoelectric conversion element. The first and second selection units are controlled by a first control line and a second control line. In a first mode, the second selection unit controls the second photoelectric conversion element to be brought into a state where no signal is read from the second photoelectric conversion element. In a second mode, the second selection unit controls the second photoelectric conversion element to be brought into a state where a signal is read from the second photoelectric conversion element.

Image capturing apparatus, image capturing system, and moving body
11695022 · 2023-07-04 · ·

An image capturing apparatus includes a plurality of photoelectric conversion elements, a first selection unit, and a second selection unit. Each of the photoelectric conversion elements includes an avalanche diode and a counter. The photoelectric conversion elements have a first photoelectric conversion element and a second photoelectric conversion element. The first selection unit controls the first photoelectric conversion element. The second selection unit controls the second photoelectric conversion element. The first and second selection units are controlled by a first control line and a second control line. In a first mode, the second selection unit controls the second photoelectric conversion element to be brought into a state where no signal is read from the second photoelectric conversion element. In a second mode, the second selection unit controls the second photoelectric conversion element to be brought into a state where a signal is read from the second photoelectric conversion element.

Image sensor and sensor device for imaging temporal and spatial contrast
11546543 · 2023-01-03 · ·

An image sensor for detecting time-dependent image data, comprising multiple photovoltaic converters and multiple electronic converters arranged in arrays and linked by switching elements. Each of the photovoltaic converters and one of the electronic converters form a pair that generates digital information dependent on light intensity on the photovoltaic converter. The switching elements are arranged to selectively connect at least two of the photovoltaic converters to one of the electronic converters and at least two of the electronic converters to one of the photovoltaic converters.

PPG sensor and method of operating the same

A photoplethysmogram (PPG) sensor includes a pixel array that collects light, a pixel sampler that converts the light collected through the pixel array into a plurality of pixel data, an effective area determiner that determines an effective area and a non-effective area of the pixel array based on the pixel data, a power controller that is operable to cut off power to the non-effective area of the pixel array, and a PPG data generator that generates PPG data from pixel data corresponding to the effective area among the pixel data.

Image sensing device and operating method thereof
11544862 · 2023-01-03 · ·

An image sensing device includes an analysis module suitable for analyzing, based on pixel values of a kernel, an image texture of the kernel including a target pixel group and one or more adjacent pixel groups, a sum module suitable for generating any one of a first target sum value and a second target sum value based on an analysis result of the analysis module, wherein first target sum value is obtained by applying texture characteristics of the kernel in target pixel values of the target pixel group and the second target sum value is obtained without applying the texture characteristics of the kernel in the target pixel values, and a processing module suitable for generating a sum image based on any one of the first and second target sum values.

Imaging element, imaging apparatus, image data processing method, and program that performs imaging in a first frame rate and outputs data in a second frame rate

An imaging element includes: a memory that stores captured image data obtained by imaging a subject at a first frame rate; an image processing circuit that performs processing on the captured image data; and an output circuit that outputs output image data obtained by performing the processing on the captured image data to an exterior of the imaging element at a second frame rate, wherein the image processing circuit performs cut-out processing with respect to one frame of the captured image data, the cut-out processing including cutting out partial image data indicating an image of a part of the subject in the captured image data from a designated address in the memory, the output image data includes image data based on the partial image data that is cut out from the captured image data, and the first frame rate is a frame rate higher than the second frame rate.