Picture taking device comprising a plurality of camera modules
09819861 · 2017-11-14
Assignee
Inventors
- Bruno Liege (Boulogne Billancourt, FR)
- Frédéric Guichard (Paris, FR)
- Hoang-Phi Nguyen (Paris, FR)
- Imène Tarchouna (Gentilly, FR)
- Stéphane Laveau (Paris, FR)
- Wolf Hauser (Meudon, FR)
Cpc classification
H04N23/54
ELECTRICITY
H04N23/45
ELECTRICITY
H04N23/57
ELECTRICITY
H04N23/741
ELECTRICITY
H04M1/0254
ELECTRICITY
H04N25/60
ELECTRICITY
H04N23/90
ELECTRICITY
International classification
Abstract
A picture taking device includes at least three camera modules, each having a sensor of resolution equal to or higher than thirteen megapixels. A diagonal of the photosensitive surface of the sensor of between 5 mm and 7 mm. An objective lens opening at minimum to f/2.0 for at least one focal length value. The device has a power supply and, a rigid connector to connect it to a mobile phone or tablet comprising a screen, and communicates images and/or commands with the mobile phone or tablet. The device also includes a digital processor to reduce noise while preserving the textures in at least one image captured by one of the sensors.
Claims
1. A picture taking device comprising: at least three camera modules, each comprising a sensor of resolution equal to or higher than thirteen megapixels; a photosensitive surface of each sensor has a diagonal dimension between 5 mm and 7 mm; an objective lens opening at minimum to f/2.0 for at least one focal length value; a power supply; a rigid connector to connect the picture taking device to a mobile phone or tablet type device comprising a screen; a digital processor to reduce noise in at least one image captured by one of the sensors; a communication connector to communicate at least one of images and commands with the mobile phone or tablet type device; and wherein the picture taking device has dimensions meeting the following criteria: maximum and minimum of a height, a width and a depth of a smallest rectangular parallelepiped inside which the picture taking device can be inscribed are less than 65 mm and less than 25 mm, respectively, and a volume of the picture taking device is less than 65 000 mm.sup.3.
2. The picture taking device as claimed in claim 1, wherein the digital processor comprises a calculation unit to produce an image of resolution identical to that of the sensors by a spatial and temporal merger of P*N images captured using the sensors, where P and N are non-zero natural integers and where N denotes the number of camera modules and is greater than or equal to three.
3. The picture taking device as claimed in claim 1, wherein the digital processor autonomously or in combination with the mobile phone or tablet type device is configured to produce a visible image of at least thirteen megapixels, having an exposure configured to have elements of which a reflectance is 18% in a scene to be captured which reaches a middle of a dynamic range in the visible image with a signal to noise ratio midway through the dynamic range equal to or greater than 35.5 dB, spatial frequency response edge and spatial frequency response texture values which differ by less than 10% and which, at one quarter of the Nyquist frequency, are less than or equal to 120% and which, at half the Nyquist frequency, are greater than or equal to 50%, from a capture of images for exposure times of 1/30 s or less of a scene illuminated with light at a lighting level less than or equal to 10 lux.
4. The picture taking device as claimed in claim 2, wherein the digital processor performs the spatial and temporal merger first in a spatial plane and then in a temporal plane.
5. The picture taking device as claimed in claim 2, wherein said camera modules are arranged in a line and wherein N is equal to three.
6. The picture taking device as claimed in claim 2, wherein said camera modules are arranged in a cross and wherein N is equal to five.
7. The picture taking device as claimed in claim 1, wherein some of said camera modules comprises a color sensor and each remaining camera modules comprises a monochrome sensor.
8. The picture taking device as claimed in claim 1 comprises no screen to allow previewing or post-viewing of an image.
9. The picture taking device as claimed in claim 1, wherein said communication connector is configured to allow an image taken by the picture taking device to be previewed on the screen of the mobile phone or tablet type device.
10. The picture taking device as claimed in claim 1, wherein said communication connector is configured to allow the picture taking device to be controlled using the screen of the mobile phone or tablet type device.
11. The picture taking device as claimed in claim 1, wherein said communication connector is configured to allow parameters of the picture taking device to be set using the screen of the mobile phone or tablet type device.
12. The picture taking device as claimed in claim 2, further comprising a noise reduction element which takes the spatial and temporal merger into consideration.
13. The picture taking device as claimed in claim 2, wherein the calculation unit is hosted remotely on the mobile phone or tablet type device.
14. The picture taking device as claimed in claim 1, further comprising a recorder to record raw images in addition to or in place of a recording of visible images after digital processing operations have been performed.
15. The picture taking device as claimed claim 1, wherein the rigid connector is positioned in a hinge allowing its orientation relative to the picture taking device to change.
16. The picture taking device as claimed in claim 1, further comprising an image processor to provide a digital image stabilization.
17. The picture taking device as claimed in claim 1, further comprising an autofocus element to maximize a sharpness of a subject being photographed or filmed.
18. The picture taking device as claimed in claim 17, wherein the autofocus element operates continuously to keep the subject permanently in focus.
19. The picture taking device as claimed in claim 2, wherein the digital processor is configured to modify parameters of the spatial merger of the images derived from said camera modules to reduce a depth of field in the image and to adjust a focus in an initial depth of field range after capture.
20. The picture taking device as claimed in claim 1, wherein some of said camera modules are exposed differently to capture images with different exposures.
21. The picture taking device as claimed in claim 1, further comprising a button to start a recording.
22. The picture taking device as claimed in claim 21, wherein the button has two modes of operation: partially depressed and fully depressed.
23. The picture taking device as claimed in claim 1, further comprising a programmable processor.
24. The picture taking device as claimed in claim 1, further comprising a transmitter to transmit at least one raw image to the mobile phone or tablet type device in at least one mode of operation.
25. A picture taking method, comprising the steps of: capturing, at 1/30 s or lower, a scene comprising lighting of 10 lux or below using a picture taking device comprising: at least three camera modules, each comprising a sensor of resolution equal to or higher than thirteen megapixels; a photosensitive surface of each sensor has a diagonal dimension between 5 mm and 7 mm; an objective lens opening at minimum to f/2.0 for at least one focal length value; a power supply; a rigid connector to connect the picture taking device to a mobile phone or tablet type device comprising a screen; a digital processor to reduce noise in at least one image captured by one of the sensors; a communication connector to communicate at least one of images and commands with the mobile phone or tablet type device; and wherein the picture taking device has dimensions meeting the following criteria: maximum and minimum of a height, a width and a depth of a smallest rectangular parallelepiped inside which the picture taking device can be inscribed are less than 65 mm and less than 25 mm, respectively, and a volume of the picture taking device is less than 65 000 mm.sup.3; and producing a visible image of a quality higher than thirteen megapixels, the image having an exposure configured to have elements of which a reflectance is 18% in the scene to be captured which reaches a middle of a dynamic range, with a signal to noise ratio midway through the dynamic range of 35.5 dB or higher, spatial frequency response edge and spatial frequency response texture values which differ by less than 10% and which, at a quarter of the Nyquist frequency, are less than or equal to 120% and which, at half the Nyquist frequency, are greater than or equal to 50%.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The invention will be better understood with the aid of the description, given hereinafter purely by way of explanation, of one embodiment of the invention, with reference to the figures in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
DETAILED DESCRIPTION OF THE EMBODIMENTS OF THE INVENTION
(22) The present invention relates to a picture taking device 10 comprising a plurality of camera modules 21, 22, 23, 24, 25 each comprising a sensor 30 with resolution equal to or better than thirteen megapixels, a diagonal of the photosensitive surface of the sensor measuring between 5 mm and 7 mm, an objective lens 40 open to the minimum to f/2.0 for at least one focal length value. The picture taking device 10 is able to be connected by a rigid connector 15 to a device 50 of the mobile phone or tablet type comprising a screen. The picture taking device according to the present invention furthermore has its own power supply means 12 and comprises means for communicating images and/or commands with said device of mobile phone or tablet type. It furthermore has digital processing means 14 for reducing noise while at the same time preserving the textures in at least one image captured by one of said sensors.
(23) The picture taking device 10 according to the present invention comprises digital processing means for reducing the noise while preserving the textures.
(24) These digital processing means 14 for reducing the noise while preserving the textures may be of the non-local mean calculation type as described in A. Buades, B. Coll and J. Morel (2005b), ‘A review of image denoising algorithms, with a new one’, Multiscale Model. Simul. 4, 490-530 or in A. Buades, B. Coll and J. Morel (2008b), ‘Nonlocal image and movie denoising’, Internat. J. Computer Vision 76, 123-139 or of the “block-matching 3D” calculation type as described in K. Dabov, A. Foi, V. Katkovnik and K. Egiazarian (2007), ‘Image denoising by sparse 3D transform-domain collaborative filtering’, IEEE Trans. Image Processing 16, 2080-2095 or in K. Dabov, A. Foi, V. Katkovnik and K. Egiazarian (2009), BM3D image denoising with shape-adaptive principal component analysis. In Proc. Workshop on Signal Processing With Adaptive Sparse Structured Representations: SPARS 09, volume 49.
(25) Said digital processing means comprise calculation means able to produce an image of resolution identical to that of said sensors using a spatial and temporal merger of P*N images captured using the sensors, where P and N are non-zero natural integers and where N denotes the number of camera modules and is greater than or equal to three.
(26) Said device 10 preferably comprises noise reduction means that take said merger into consideration.
(27) In one embodiment, said merger is performed first of all in the spatial plane and then in the temporal plane.
(28) The spatial merger of the N images captured simultaneously by all of the camera modules of the device may be as described in Li Zhang, Sundeep Vaddadi, Hailin Jin, and Shree Nayar, Multiple View Image Denoising, In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 2009.
(29) The temporal merger of P images obtained consecutively as output from the spatial merger may be as described in A. Buades, Y. Lou, J. M Morel, Z. Tang, A note on multi-image denoising, Local and Non-Local Approximation in Image Processing, LNLA 2009, pp: 1-15, 2009.
(30) The merger of M=P*N images allows a gain √{square root over (M)} in stops. 3 dB is gained in SNR for each stop gained. Thus, according to an embodiment using five sensors with a sensitive surface diagonal measurement of 6 mm in camera modules each having a volume of 1 cm.sup.3, a spatial merger of N=5 images and a temporal merger of P=4 images provides a gain of 7.5 dB, making it possible to reduce the size of the device according to the invention. Indeed, the sensitivity obtained is then the equivalent of that of a single sensor with a diagonal measurement of around 32 mm (namely a sensor and an objective lens which are 5 times larger in the x and y dimensions than a camera module of the invention) which would need an objective lens with a focal length 4 times longer in order to obtain the same field (namely 4 times greater in the z direction): in order to obtain the same performance under low light, the optical module (sensor+objective lens) would be bulkier by a factor of around 13 (approximately 64 cm.sup.3 rather than 5 cm.sup.3) for the same sensitivity, and would not allow the device to fit in a pocket.
(31) Advantageously, the temporal merger uses what is known as an “antighost” mechanism that makes it possible to discriminate between the images elements which are different and thus avoid merging them. The temporal merger may be performed on the images before demosaicing or after demosaicing.
(32) Advantageously, the separation between the center of one camera module and that of its nearest neighbor is less than 11 mm. When the objective lenses of the camera modules have a 35 mm equivalent focal length of 28 mm, that means that for objects situated more than 15 cm away from the device the disparity between the images captured by each of the camera modules can be limited to values of less than 10% of the width of the image captured by each sensor. As a result, that allows a better spatial merger of these images.
(33)
(34)
(35) According to one embodiment, said digital processing means for reducing the noise while preserving the textures are hosted remotely at least in part on the device of mobile phone or tablet type. In this embodiment, the preview digital processing (display of video prior to the picture taking for view finding) and the digital processing of the video for the video recording is performed in the device. In this embodiment, the still image processing is performed as follows. For preference, one or more successive raw images are transferred to the mobile phone or tablet which converts the raw image into a visible image involving noise reduction processing, for example spatial and/or temporal merger of several images and/or spatial noise reduction with the preservation of texture.
(36) As an alternative, a preprocessing operation is performed in the device, for example a spatial merger of the raw images captured by the various sensors, a conversion of raw image to visible image of at least two images, and a post-processing operation of reducing the noise is performed in the phone or the tablet, for example a temporal merger of several images and/or a spatial denoising with the preservation of texture.
(37) As an alternative, one or more successive raw or visible images are transferred to a personal computer or server which carries out a noise reduction processing operation and the conversion of the raw image to the visible image where appropriate.
(38) The noise reduction processing may be carried out automatically with parameters that are predetermined as a function of the sensor gain, or that take account of user settings (denoising level, white balance, contrast, etc).
(39) The processing in the phone or in the tablet may be carried out by software on the main processor and/or by software on the graphic processor and/or by using a component comprising wired or programmable calculation means suited to image processing.
(40) In an alternative form, said device allows the raw images to be recorded in addition to or in place of the recording of the visible images that have undergone digital processing. The user of the device will then be able to apply the digital processing of his choice to the recorded raw images. He will for example be able to apply a spatial merger and a temporal merger involving more or fewer images than those applied in the device.
(41)
(42) Advantageously, some of said camera modules use color sensors while others use monochrome sensors. The monochrome sensors are at least three times as sensitive as the color sensors because each of their pixels collects the photons over the entire spectral band of the visible (390-700 nm) whereas, in the case of color sensors, each pixel collects photons only in the spectral band corresponding to the color that it records. This is illustrated in
(43) The figures also illustrate the fact that, in one embodiment, the picture taking device 10 according to the present invention comprises a button 17 to start the recording.
(44) The picture taking device 10 according to the present invention has dimensions meeting the following criteria: the maximum of the height, of the width and of the depth of the smallest rectangular parallelepiped inside which said device 10 can be inscribed must be less than 65 mm, the minimum of these same height, width and depth must be less than 25 mm, the volume of the device is less than 65 000 mm.sup.3. Thus, it easily fits into the pocket of a bag or of a garment. This allows the user always to have about his person a picture taking device of digital reflex camera quality allowing pictures to be taken under very low lighting conditions, which can be used in particular for indoor photographs or moving scenes, notably of children. It is possible within this volume and with these dimensions, for example as depicted in
(45)
(46)
(47) The rigid connection may adopt a number of forms: a fixed connector fixed to the device according to the invention and that plugs into the corresponding connector belonging to the phone or tablet, and/or a fixed connector fixed to the device according to the invention and able to rotate so that the camera can be aimed in an adjustable direction by the user and that plugs into the corresponding connector belonging to the phone or to the tablet, and/or a mechanical attachment for example using clips it being possible for the connector to be a USB, micro USB, lightning or some other form of connector the connector allowing images to pass to the phone or the tablet during the previewing phase (display of video before the taking of pictures allowing view finding), and/or during the video recording and/or after still images have been captured, and/or allowing commands to pass from the phone or from the tablet to the device according to the invention.
(48) The rigid connection 15 allows the picture taking device 10/device 50 of the mobile phone or tablet type assembly to be held in one hand, holding the device 50 of the mobile phone or tablet type. The rigid connection allows the picture taking device 10 and device 50 of the mobile phone or tablet type to be held in two hands: one hand to hold the device 50 of mobile phone or tablet type and one hand to press the picture taking button 17 of the picture taking device 10. Without this rigid connection, it would be very difficult to view find and take pictures using the camera in one hand and the phone or tablet in the other.
(49)
(50)
(51) The rigid connection allows the device according to the invention and the phone or tablet to be secured together mechanically and also allows the passage of the electrical signals required for: transmitting images from the device according to the invention to the phone or tablet for previewing the images on the screen of the phone or of the tablet, it being possible for these images to be compressed and decompressed on the fly so as to reduce the bit rate to a format compatible with the phone or with the tablet, for example H264 or H265/CHVC or the like, and/or transmitting commands and/or controls from the phone or the tablet to the device according to the invention, notably: command to take a picture: taking a still image, starting/stopping a video recording, choice of resolution, choice of exposure: aperture, exposure time, sensitivity of the sensor, mode (priority on aperature, priority on exposure time, priority on sensitivity, manual, automatic, etc.) setting of the white balance, autofocus settings (deactivation, choice of area of interest, etc.), image stabilization settings, choice of the type of scene: automatic, landscape, portrait, etc., other camera settings, and/or transmitting commands and/or controls from the device according to the invention to the phone or the tablet, notably: command to take a picture or other commands situated on the device according to the invention and able to influence the application of to the mobile phone or the tablet data regarding the scene and calculated by the device according to the invention and/or by the mobile phone or by the tablet from statistics about the image which are supplied by the device according to the invention to the mobile phone or to the tablet, for example: illuminant determined by the white balance, exposure (exposure time, sensitivity, gain), underexposure alert, movement alert, presence and position of faces, type of scene, etc.
(52) According to one embodiment, the means 13 for communicating images and/or commands to said device 50 of the mobile phone or tablet type allow an image taken by said picture taking device 10 to be previewed on the screen 51 of said device 50 of mobile phone or tablet type. Thus, the user can enjoy the benefit of a large screen, even though the device according to the invention is small in size without a large screen and can fit into a pocket.
(53)
(54) In one embodiment, these means 13 allow said picture taking device 10 to be controlled via the screen 51 of said device 50 of the mobile phone or tablet type. Thus, the user may enjoy the benefit of numerous commands and settings, even though the device according to the invention is small in size with a small number of buttons and can fit into a pocket.
(55) In one embodiment, these means 13 allow parameters of said picture taking device 10 to be set using the screen 51 of said device 50 of the mobile phone or tablet type. Thus, the user can enjoy the benefit of multiple commands and settings, even though the device according to the invention is small in size with a small number of buttons and can fit into a pocket.
(56) In one embodiment, the device 50 of the mobile phone or tablet type has one of the following three operating systems: Android, iOS or Windows Phone (registered trademarks). The means 13 of said picture taking device 10 according to the present invention for using the screen 51 of said device 50 of mobile phone or tablet type have the ability to operate with the three abovementioned mobile phone or tablet operating systems.
(57) In one embodiment, said device 10 comprises a programmable processor 60.
(58)
(59) The picture taking device 10 according to the present invention has a high image quality under low lighting conditions, and notably a reduced noise level when measured on a visible image exposed in such a way as to have elements of which the reflectance is 18% in the scene that is to be captured that reach the midway point of the dynamic range: for a 100 lux scene, the signal to noise ratio (SNR) midway through the dynamic range is of the order of 45.5 dB for the picture taking device 10 according to the present invention, and is of the order of 29 dB for present-day phones or tablets; for a 25 lux scene, the signal to noise ratio is of the order of 39.5 dB for the picture taking device 10 according to the present invention, and is of the order of 23 dB for present-day phones or tablets; and for a 10 lux scene, the signal to noise ratio is of the order of 35.5 dB for the picture taking device 10 according to the present invention, and is of the order of 19 dB for present-day phones or tablets.
(60) The gain of 16.5 dB between the device and a present-day phone or tablet can be broken down as follows: the sensor is more sensitive: present-day phones or tablets use RGB sensors of which the diagonal of the photosensitive surface measures less than 7 mm; the picture taking device 10 uses both RGB sensors and monochrome sensors that are more sensitive by a factor of three. For the same number of pixels across the sensors, that represents a gain of the order of 3 dB. spatial and temporal merger of 20 images: the gain is 4.5 stops, namely 13.5 dB.
(61)
(62)
(63)
(64)
(65)
(66)
(67)
(68)
(69)
(70)
(71) In one embodiment, said picture taking device according to the present invention comprises a button for starting the recording 16.
(72) This button for starting the recording 16 is depicted in
(73) The button is used to start the taking of a photograph or to initiate the start of the video recording.
(74) In one embodiment, said button for starting the recording has two modes of operation: partially depressed and fully depressed.
(75) The partially depressed mode makes it possible for example to lock the exposure and/or white balance and/or focusing parameters onto the current values. It may also allow toggling from a low-consumption preview mode in which just one camera module captures undersampled images to a full-resolution image acquisition mode using all the camera modules to allow noise reduction digital processing to be carried out while at the same time preserving the textures using a spatial and/or temporal merger of P*N images, N being a natural integer greater than or equal to 3 and P being a natural integer greater than or equal to 1.
(76)
(77) In one embodiment, the device 10 according to the present invention comprises means for producing a visible image of at least thirteen megapixels exposed in such a way as to have elements of which the reflectance is 18% in the scene to be captured which reach the middle of the dynamic range in the visible image with an SNR in the middle of the dynamic range of 35.5 dB or higher, SFR edge and SFR texture values which differ by less than 10% and which, at a quarter of the Nyquist frequency, are less than or equal to 120% and which, at half the Nyquist frequency, are greater than or equal to 50%, from the capturing of images at 1/30 s or less of a scene illuminated at less than 10 lux. In this embodiment, said device 10 comprises five camera modules each comprising an objective lens open to f/2.0 having an MTF at half the Nyquist frequency of more than 50%, a sensor the diagonal of the photosensitive surface of which measures 6 mm, for example the Sony IMX135 sensor. Said device has no flash, it has a battery to power it, it being possible for example for the battery to be recharged depending on the embodiment using an external connector and/or by induction and/or by being removed from the device and/or via the phone or via the tablet. The digital processing means that reduce the noise while preserving the textures are made up of a denoising algorithm as described in K. Dabov, A. Foi, V. Katkovnik and K. Egiazarian (2009), “BM3D image denoising with shape-adaptive principal component analysis”. In Proc. Workshop on Signal Processing With Adaptive Sparse Structured Representations: SPARS 09, volume 49, of a spatial merger as described in Li Zhang, Sundeep Vaddadi, Hailin Jin, and Shree Nayar, Multiple View Image Denoising, In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 2009 and of a temporal merger as described in A. Buades, Y. Lou, J. M Morel, Z. Tang, A note on multi-image denoising, Local and Non-Local Approximation in Image Processing, LNLA 2009, pp: 1-15, 2009 and performed on four images recorded consecutively by the sensor. Thus, the device according to the invention allows pictures to be taken in low lighting conditions while at the same time being small in size and fitting into a pocket.
(78) Advantageously, in this embodiment, the device 10 uses these means to record a high-resolution (HD 1080p video format or better) video with a refresh rate greater than or equal to 30 images per second for a scene illuminated with 10 lux or less, each frame of which video is exposed in such a way as to have elements of which the reflectance is 18% in the scene that is to be recorded that reach the midway point of the dynamic range in the video recording, with an SNR in the middle of the dynamic range that is equal to or better than 35.5 dB, SFR edge and SFR texture values which differ by less than 10% and which, at a quarter of the Nyquist frequency, are less than or equal to 120% and which, at half the Nyquist frequency, are greater than or equal to 50%.
(79) In one embodiment, said picture taking device 10 has no screen for previewing or post-viewing an image. That makes it possible to reduce the size of the device.
(80) In one embodiment, said picture taking device 10 comprises image processing means that allow digital image stabilization. This makes it possible to reduce the size of the device by dispensing with the need for a bulky optical stabilization device while at the same time improving the picture taking performance under low lighting conditions and allowing a better temporal merger and thus noise reduction with better texture preservation performance.
(81) The image processing means that allow digital image stabilization may be as described in Jeong-A Im, Dae-Woong Kim*, and Ki-Sang Hong, Digital video stabilization algorithm for CMOS image sensor in Image Processing, 2006 IEEE International Conference on.
(82) Greenleaf, Allen R., Photographic Optics, The MacMillan Company, New York, 1950, pp. 25-27 provides formulae for calculating the distance Dp to the first plane of sharpness and the distance Dd to the last plane of sharpness for a given optical system and the optimal focusing distance:
(83)
(84) The depth of field Pc is the distance between the first plane of sharpness and the last plane of sharpness:
(85)
In the context of the invention, for each camera module, the focal length will be greater than 3.65 mm, the aperture f/2.0 or more, c less than or equal to 2.2 μm. For an s value of 1 m, Dp equals 0.75 m, Dd equals 1.49 m and Pc equals 0.74 m. If all the camera modules are focused at the same distance and this focus does not change for all the images used during the merger, the image resulting from the merger will by default have the depth of field of the individual camera modules.
(86) Systems using a larger single sensor and/or a higher aperture objective lens to capture as much light as the invention will have a shallower depth of field. The invention therefore allows easier focusing because of its greater depth of field.
(87) According to one embodiment, said device makes it possible to reduce the depth of field in the image and adjust the focus within the initial depth of field range after capture by modifying the parameters of the spatial merger of the images derived from the camera modules as described in Levoy, M. (2006). Light fields and computational imaging. Computer, 39(8), 46-55.
(88) According to one embodiment, said device exposes some of the camera modules differently in order to capture images with different exposures. The spatial merger is therefore set up to maintain, on the one hand, the high-light data from the images captured by the underexposed camera modules and, on the other hand, the low-light data from the images captured by the overexposed camera modules. This data is then merged to create a high dynamic range (HDR) image.
(89) The invention is described in the foregoing by way of example. It must be understood that a person skilled in the art is capable of embodying the invention in various different ways without thereby departing from the scope of the patent.