An endoscope includes: an image sensor in which a color filters having two or more colors is disposed at an imaging position and has a predetermined array pattern; and a correction processing unit configured to repeatedly perform processing of changing a target pixel value at a target imaging position to a median value between a neighboring pixel value and the target pixel value, while changing the target imaging position, when a pixel value at a neighboring imaging position near the target imaging position including at least two most neighboring imaging positions on a row closest to the target imaging position with the target imaging position interposed therebetween at an imaging position of a color filter, which is on a row along one direction identical to the target imaging position in image data output from the image sensor, and has a same color as a color filter at the target imaging position, is set as a neighboring pixel value.

At least one feature pertains to an image sensor having an array of pixels with a configuration that includes a first pixel type configured to detect red light, a second pixel type configured to detect green light, a third pixel type configured to detect blue light and a fourth pixel type configured to detect green light and an array of lenses overlaying the array of pixels that comprises a first lens type, a second lens type, a third lens type and a fourth lens type where the first lens type is configured to pass red light and refract blue light and green light, the second lens type is configured to pass green light and refract blue light and red light, the third lens type is configured to pass blue light and refract red light and green light, and the fourth lens type is configured to pass green light and refract blue light and red light.

A method and an apparatus for capturing a high quality dynamic image by setting a different row-wise exposure value when capturing a scene are provided. The dynamic image capturing method includes: generating an image by pre-capturing a scene via an event sensor; generating event data from the image; determining a row-wise exposure value of the image based on the event data; and determining a row-wise readout priority order of the image based on the row-wise exposure value of the image.

A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.

A system includes a processor, a light source controlled by the processor and configured to emit a light, and an event based vision sensor controlled by the processor. The sensor includes a plurality of pixels. At least one of the plurality of pixels includes a photosensor configured to detect incident light and first circuitry configured to output a first signal based on an output from the photosensor. The first signal indicates a change of amount of incident light. The sensor includes a comparator configured to output a comparison result based on the first signal and at least one of a first reference voltage and a second reference voltage. The processor is configured to apply one of the first reference voltage and the second reference voltage to the comparator selectively based on an operation of the light source.

Power consumption in realizing a convolutional neural network (CNN) is reduced.

A solid-state imaging element according to the present technology includes a photoelectric conversion element that photoelectrically converts received light into signal charge corresponding to the amount of received light, a floating diffusion that holds the signal charge obtained by the photoelectric conversion element, a transfer control element that controls transfer of the signal charge from the photoelectric conversion element to the floating diffusion, and a control unit that controls application of a drive voltage to the transfer control element on the basis of a convolution coefficient in a CNN.

Devices, methods, and non-transitory program storage devices (NPSDs) are disclosed to compensate for the predicted color changes experienced by camera modules after certain amounts of time of real world use. Such color changes may be caused by prolonged exposure of optical components of the camera module to one or more of: solar radiation, high temperature conditions, or high humidity conditions, each of which may, over time, induce deviation in the color response of optical components of the camera module. The techniques disclosed herein may first characterize such predicted optical change to components over time based on particular environmental conditions, and then implement one or more time-varying color models to compensate for predicted changes to the camera module's color calibration values due to the characterized optical change. In some embodiments, optical changes in other types of components, e.g., display devices, caused by prolonged environmental stresses may also be modeled and compensated.

A method of detecting a risk of collision between a boat and an object in a water area using a camera module mounted on said boat, said camera module having a RGB camera, said boat being characterized by its course, said method having the steps of generating at least one sequence of images using said camera, detecting at least one light source in the images of the at least one sequence of images, said at least one light source being mounted on a luminous object located in the water area, calculating a series of polar angles between the boat and the at least one light source using the images of the at least one sequence of images, estimating the course direction of the object with regard to the boat by deriving said series of calculated polar angles with respect to time, detecting a risk of collision between the boat and the object when the estimated course direction of the object leads said object towards the course of the boat.

An image sensor includes a pixel array including a plurality of pixels; a row driver configured to control the plurality of pixels; and an analog-to-digital converter configured to digitize a result sensed by the pixel array to generate a first image, wherein the pixel array includes: first pixel groups, wherein each first pixel group of the first pixel groups includes first white pixels and first color pixels among the plurality of pixels; and second pixel groups, wherein each second pixel group of the second pixel groups includes second white pixels and second color pixels among the plurality of pixels, and wherein first pixel data of the first image are generated based on the first white pixels and the first color pixels, and second pixel data of the first image are generated based on the second color pixels.

Image rotation in an endoscopic hyperspectral, fluorescence, and/or laser mapping imaging system is described. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system includes a rotation sensor for detecting an angle of rotation of a lumen relative to a handpiece of an endoscope. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of a hyperspectral emission, a fluorescence emission, and/or a laser mapping pattern.