OPTICAL PROPERTY MEASUREMENT USING A SENSOR BEHIND A DISPLAY SCREEN

Abstract

Optical property measurement using a sensor behind a display screen Examples of this application disclose a method for measuring optical properties of a target. The method comprises illuminating the target with an illumination area with a display screen in contact with the target, and analysing signals reflected from the target and transmitted back through the display screen to a sensor positioned behind the display screen, to determine the optical properties of the target.

Claims

1. A method for measuring optical properties of a target comprising: providing a display screen; illuminating the target with an illumination area on the display screen, wherein the target is in contact with the display screen; providing a sensor positioned behind the display screen to receive light reflected from the target and transmitted back through the display screen; and analysing signals from the sensor during illumination to determine the optical properties of the target.

2. A method according to claim 1, wherein the illumination area is centred on the sensor axis.

3. A method according to claim 1, and further comprising varying the size of the illumination area and performing analysis based on the measurements at each size.

4. A method according to claim 1, wherein the signal is corrected for with a calibration function comprising: the sensitivity of the sensor; and a transmission function of the display screen, wherein the transmission function is non-zero in at least a part of in the visible spectrum.

5. A method according to claim 1, wherein the illumination area comprises a white pattern and the rest of the display screen is black.

6. A method according to claim 1, wherein the illumination area comprises a colored pattern and the rest of the display screen is black.

7. A method according to claim 6, wherein the illumination area comprises emission from each pixel color in the display sequentially.

8. A method according to claim 1, wherein the shape of the illumination area on the display screen is substantially a circle.

9. A method according to claim 1, wherein the sensor comprises one of: a three channel color sensor; a multi-spectral sensor.

10. A method according to claim 9, wherein the multi-spectral sensor comprises eight channels.

11. A method according to claim 1, wherein the optical property comprises a color measurement.

12. A method according to claim 11, wherein the color measurement is converted into a color space.

13. A method according to claim 12, wherein the color space is one of: RGB; and XYZ.

14. A method according to claim 1, wherein the optical property comprises a reconstructed re-emission spectrum.

15. A method according to claim 1, wherein the optical property comprises a grade of translucency.

16. A method according to claim 1, wherein the display screen comprises an organic light-emitting diode, OLED, display screen.

17. A method according to claim 1, wherein an additional optical device is placed in between the display screen and the sensor, wherein the additional optical device comprises one or both of a diffuser and a filter.

18. The method according to claim 17, wherein the filter is blocking in the near-infrared, NIR, range.

19. A method according to claim 1, wherein the target comprises skin.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Some examples of the disclosure will now be described by way of example only and with reference to the accompanying drawings, in which:

[0017] FIGS. 1A and 1B show a simplified schematic of the measurement set-ups compatible with determining color measurement of a translucent material.

[0018] FIG. 2 shows a simplified schematic of the device for carrying out the method of measuring the optical properties of a target material, in accordance with the present disclosure.

[0019] FIGS. 3A and 3B show the correction to the system sensitivity based on the transmission function of a OLED display screen, in accordance with the present disclosure.

[0020] FIGS. 4A and 4B show an exemplary emission and transmission function respectively for an OLED display screen, in accordance with the present disclosure.

DETAILED DESCRIPTION

[0021] In order to provide improved colour measurement of target materials, in particular translucent materials, a procedure is proposed below in which the target material is illuminated with a display screen in contact with the target, and the reflected signals are detected by a sensor located behind the display screen, and analysed.

[0022] FIGS. 1A and 1B show the constraints on the illumination required to measure transparent materials. There, are, broadly, two possible approaches. The first approach, shown in FIG. 1A, is a broad illumination spot 111 on the target 101, with the measurement 112 taking place only at the centre of the spot (i.e. where the illumination is brightest). This is inefficient, as most of the reflected light is not measured, but it allows all parts of the reflection to be picked up (e.g. the sensor will receive the direct reflection for the central rays of the illumination, and the indirect reflection for the outer rays). The second approach, shown in FIG. 1B, is to use a narrow illumination spot 121, with the measurement 122 surrounding the illumination spot to capture all the reflected light. This is more energy efficient, since all the light is captured, but it requires a large sensor.

[0023] FIG. 2 is a schematic illustration of a device according to the present disclosure. The device comprises a display screen 201, having a backing 202 and an optional diffuser or filter 203 located behind the backing. Behind the display screen, backing and diffuser or filter is located a sensor assembly 204, comprising a housing 205 having an aperture 206 (e.g. of 1 mm diameter), and a light sensor 207. To perform a measurement of a target material, the display screen 201 is placed in contact with the material 210, and provides illumination 211 to the material. The light 212 reflected from the material passes through the display screen and the aperture, and is detected by the light sensor 207. The signals received by the sensor during illumination can then be used to determine the optical properties of the target.

[0024] The illumination provided by the display screen is a coloured region (e.g. a primary colour, a secondary colour, or white). The reflected light can be used to determine how the target material scatters light, and therefore determine how transparent the material is.

[0025] The size, shape, and position of the illumination are provided by the display screen may be varied, and analysis carried out with each successive illumination pattern, and by comparing the results between illumination patterns. This can be useful, for example, to detect defects in the target material and determine their location (as these will reflect differently, but only when illuminated by the display screen). In general, the illumination area will be centred on an axis of the sensor, but this is not required.

[0026] As is usual for optical sensors, the sensor output will need to be calibrated based on the sensor sensitivity. A graph of sensitivity for an example multi-spectral sensor is shown in FIG. 3A. As can be seen in the figure, the sensor has several transmission peaks 311, 312, 313, 314, 315, 316, 317 and 318, each of which corresponds to one of the sensor channels. Calibration will also be based on the light output—i.e. the emission function of the display screen (shown for an OLED in FIG. 4A), and the pattern displayed.

[0027] In the device described above, the calibration may be improved by also taking into account the transmission function of the display screen (and any other components in front of the sensor) which is shown in FIG. 4B for an OLED. FIG. 3B shows the adjusted sensitivity of the same sensor as in FIG. 3A, when placed behind a display screen with the transmission function shown in FIG. 4B. Each of the peaks 321, 322, 323, 324, 325, 326, 327, 328 corresponds to one of the peaks in FIG. 3A, but their height and shape has changed significantly (note the different scale on the two graphs) to account for the reduced transmission of light by the display screen.

[0028] To aid in calibration, the transmission function may be measured relative to a material of known reflectance—e.g. taking a material with known optical properties, measuring the material using the method described above, and then adjusting the calibration so that the output matches the known optical properties of the material. This calibration, or any other suitable recalibration, may be done periodically to account for changes in the transmission of the display screen or sensitivity of the sensor over time, or may be performed prior to each measurement of a target material with unknown properties.

[0029] Other techniques as known in the art, such as taking multiple measurements and averaging them, may be used to improve the accuracy of the measured results.

[0030] Obtaining a broad spectrum measurement of the optical properties of the material may be done with white light, or alternatively it may be done by sequentially illuminating the target material with different colours of light (e.g. from each pixel colour in the display) and concatenating all of the measured reflection functions (or, during calibration, all of the measured transmission functions of the display screen).

[0031] Whether the illumination comprises a coloured pattern or a white pattern, the remainder of the display screen will generally be black—though this is not strictly required.

[0032] The shape of the illumination on the display screen may be a circle, or another pattern with circular symmetry such as a ring, or a series of concentric rings of varying thickness and/or colour. In general, though, the pattern may be any image which is capable of being formed by the display screen, and the sensor can be calibrated accordingly.

[0033] Where the target material has some kind of pre-existing feature or division (e.g. a target consisting of two materials attached together at a join, or a target having a flaw in its material), the shape of the illumination may be varied to account for that feature or division (e.g. illuminating the material on each side of the join differently, or choosing a pattern in order to locate the flaw).

[0034] The sensor may be a three-channel sensor or a multi spectral sensor. Suitable multi spectral sensors include the AS7341 multi-spectral sensor (which has 8 channels), or other sensors having at least 4 channels.

[0035] The measured optical properties of the target may include a colour measurement, which may be converted into a colour space such as RGB or XYZ. The conversion into the colour space may be performed by a matrix operation, multiplying the output signal vector from the sensor by an [N×M] matrix, where N is the number of sensor channels, and M is the number of dimensions in the colour space. For example, conversion between a 3-channel sensor and the RGB colour space would require a 3×3 matrix, and conversion between an 8-channel sensor and the XYZ colour space would require an 8×3 matrix. The matrix may be determined by calibration of the sensor as described above.

[0036] The measured optical properties may also include a reconstructed emission spectrum, which may be similarly calculated using an [N×M] matrix, where M is the number of “bins” in the emission spectrum model.

[0037] The measured optical properties may include a grade of translucency, which may be determined by varying the size and/or shape of the illumination area to determine the change in scattered light. For example, the illumination shape may be a circle centred on the sensor, and the size may be varied. For small illumination sizes, all the scattered light is captured. For larger illumination sizes, less scattered light is captured—but the spectrum and proportion of the scattered light captured will depend on the translucency properties of the material. By analysing each measured signal for each different illumination size, and comparing them, and grade of translucency may be assigned to the target material. For example, this may be based on an increased contribution of a particular frequency region within the scattered light spectrum at certain sizes.

[0038] Other standard algorithms as known to those skilled in the art may be used to convert the measured reflections in each band of the sensor to colours, emission spectra, translucency measurements, or other optical properties.

[0039] The display screen may be an organic light emitting diode (OLED) screen, or any other suitable illumination source capable of emitting light and having a non-zero transmission function over at least part of the visible spectrum. Preferably, this would have a non-zero transmission function over the entire visible spectrum, but this is not required.

[0040] As previously mentioned, an additional optical device such as a filter or diffuser may be placed between the display screen and the sensor, either behind or in front of the aperture. A diffuser may be used to reduce the effect of scattering inhomogeneity in the target material, allowing determination of average optical properties. A filter may be used to block near-infra red, ultra violet, or other unwanted light.

[0041] The sensor behind the display screen may also be used as an ambient light sensor when a target material is not in place (and this would not require illumination).

[0042] As an example use case, the target material may be skin, and the method may be used by placing the display on a person's skin to obtain colour, translucency, and other optical information. This data may then be used, for example, for skin-tone matching in the cosmetic industry.

[0043] Examples of the present disclosure can be employed in many different applications, including color measurement in the textile and paint industry, skin-color matching in the cosmetic industry, defect detection measurement in mechanical industries and is particularly well-suited for optical property measurement in translucent materials as well as in other industries.

[0044] The invention is defined by the appended claims, and in particular is not limited by the examples disclosed above. “Comprising” should be taken to mean that the relevant object includes the listed features, but may also contain other features. Any references to the singular include the plural, where appropriate—and where actions are performed by a processor or other computing device, the functions of several processors may be combined into one processor, or vice versa. Features disclosed in separate examples, or in separate dependent claims, may be combined as appropriate, and any reference numerals appearing in the claims should not be taken as limiting their scope.

LIST OF REFERENCE NUMERALS

[0045] 101 Target material for measurement

[0046] 111 Illumination spot on the target

[0047] 112 Measurement area

[0048] 121 Illumination spot on the target

[0049] 122 Measurement area

[0050] 201 Display screen

[0051] 202 Backing of display screen

[0052] 203 Diffuser or filter (optional)

[0053] 204 Sensor assembly

[0054] 205 Housing

[0055] 206 Aperture

[0056] 207 Light sensor

[0057] 210 Target material

[0058] 211 Illumination

[0059] 212 Reflected light

[0060] 311 to 318 Sensitivity of channels in a multi-spectral sensor

[0061] 321 to 328 Sensitivity of channels in a multi-spectral sensor corrected with the transmission function of the display screen