An electrical device includes: a camera assembly that includes an image sensor configured to capture an image of an object and to generate color image data, wherein the image sensor has the green element blocks, the blue element blocks, and the red element blocks arranged in an array of the Bayer format at each pixel position in order to generate color image data, the green element blocks, the blue element blocks, and the red element blocks includes Multiple physical pixel elements respectively, the green element block includes two green physical pixel elements and two white physical pixel elements, the blue element block includes two blue physical pixel elements and two white physical pixel elements, and the red element block includes two red physical pixel elements and two white physical pixel elements; and a main processor that performs image process.

This application provides an image sensor (702) and image light sensing method. The image sensor (702) includes a red pixel (R), a green pixel (G), a blue pixel (B), and an invisible light pixel, where the red pixel (R), the green pixel (G), and the blue pixel (B) are large pixels, the invisible light pixel is a small pixel, and a light sensing area of the large pixel is greater than that of the small pixel. The red pixel (R), the green pixel (G), and the blue pixel (B) are arranged in a Bayer format. In this application, when color information is sufficient, light crosstalk caused by the small pixel to the large pixel can be reduced, and therefore a signal-to-noise ratio of the large pixel can be improved.

Dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining a focused and, optionally optically stabilized color image of an object or scene. A dual-aperture camera includes a first sub-camera having a first optics bloc and a color image sensor for providing a color image, a second sub-camera having a second optics bloc and a clear image sensor for providing a luminance image, the first and second sub-cameras having substantially the same field of view, an AF mechanism coupled mechanically at least to the first optics bloc, and a camera controller coupled to the AF mechanism and to the two image sensors and configured to control the AF mechanism, to calculate a scaling difference and a sharpness difference between the color and luminance images, the scaling and sharpness differences being due to the AF mechanism, and to process the color and luminance images into a fused color image using the calculated differences.

Dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining a focused and, optionally optically stabilized color image of an object or scene. A dual-aperture camera includes a first sub-camera having a first optics bloc and a color image sensor for providing a color image, a second sub-camera having a second optics bloc and a clear image sensor for providing a luminance image, the first and second sub-cameras having substantially the same field of view, an AF mechanism coupled mechanically at least to the first optics bloc, and a camera controller coupled to the AF mechanism and to the two image sensors and configured to control the AF mechanism, to calculate a scaling difference and a sharpness difference between the color and luminance images, the scaling and sharpness differences being due to the AF mechanism, and to process the color and luminance images into a fused color image using the calculated differences.

An image sensor including a semiconductor substrate, a plurality of color filters, a plurality of first lenses and a second lens is provided. The semiconductor substrate includes a plurality of sensing pixels arranged in array, and each of the plurality of sensing pixels respectively includes a plurality of image sensing units and a plurality of phase detection units. The color filters at least cover the plurality of image sensing units. The first lenses are disposed on the plurality of color filters. Each of the plurality of first lenses respectively covers one of the plurality of image sensing units. The second lens is disposed on the plurality of color filters and the second lens covers the plurality of phase detection units.

An image sensor including a semiconductor substrate, a plurality of color filters, a plurality of first lenses and a second lens is provided. The semiconductor substrate includes a plurality of sensing pixels arranged in array, and each of the plurality of sensing pixels respectively includes a plurality of image sensing units and a plurality of phase detection units. The color filters at least cover the plurality of image sensing units. The first lenses are disposed on the plurality of color filters. Each of the plurality of first lenses respectively covers one of the plurality of image sensing units. The second lens is disposed on the plurality of color filters and the second lens covers the plurality of phase detection units.

Disclosed in the present application are an image acquisition method, an imaging apparatus, an electronic device, and a non-transitory computer-readable storage medium. The image acquisition method includes: controlling exposure of a pixel array; and performing an interpolation process on a first colored original image and a second colored original image according to a first panchromatic original image, and fusing an interpolated image and the first panchromatic original image to obtain a target image with same resolution as resolution of the pixel array.

A system includes an image sensor having a plurality of pixels that form a plurality of regions of interest (ROIs), image processing resources, and a scheduler configured to perform operations including determining a priority level for a particular ROI of the plurality of ROIs based on a feature detected by one or more image processing resources of the image processing resources within initial image data associated with the particular ROI. The operations also include selecting, based on the feature detected within the initial image data, a particular image processing resource of the image processing resources by which subsequent image data generated by the particular ROI is to be processed. The operations further include inserting, based on the priority level, the subsequent image data into a processing queue of the particular image processing resource to schedule the subsequent image data for processing by the particular image processing resource.

An image sensor includes a two-dimensional pixel array and a lens array. The two-dimensional pixel array comprises a plurality of pixels. Some of the pixels includes two sub-pixels. A rectangular coordinate is established by taking the pixel as an origin, a length direction of the two-dimensional pixel array as an x-axis, and a width direction of the two-dimensional pixel array as a y-axis. The two sub-pixels lie in both a positive half axis and a negative half axis of the x-axis and lies in both a positive half axis and a negative half axis of the y-axis. The lens array comprises a plurality of lenses, each covering one of the pixels.

Techniques are described for efficient high-resolution output of an image captured using a high-pixel-count image sensor based on pixel binning followed by luminance-guided umsampling. For example, an image sensor array is configured according to a red-green-blue-luminance (RGBL) CFA pattern, such that at least 50-percent of the imaging pixels of the array are luminance (L) pixels. Pixel binning is used during readout of the array to concurrently generate a downsampled RGB capture frame and a downsampled L capture frame. Following the readout, the L capture frame is upsampled (e.g., by upscaling and interpolation) to generate an L guide frame with 100-percent luminance density. An upsampled RGB frame can then be generated by interpolating the RGB capture frame based both on known neighboring RGB information (e.g., from the RGB capture frame and previously interpolated information), as adjusted based on local luminance information from the L guide frame.