METHOD OF MAPPING SOURCE COLORS OF A SOURCE CONTENT
20170116955 ยท 2017-04-27
Assignee
Inventors
- Jurgen Stauder (Montreuil/Ille, FR)
- Jonathan Kervec (Paimpont, FR)
- Luis Eduardo GARCIA CAPEL (LA ALBATALIA (Murcia), ES)
Cpc classification
International classification
Abstract
Method of mapping source colors of a source content represented by source coordinates comprising: applying a reference display forward color transform characterizing a reference display device, applying a virtual display inverse color transform configured to model a virtual display device having approximately the same color primaries as a mastering display device used to master said source content.
Claims
1-14. (canceled)
15. A method of mapping source colors of a source content, wherein said source colors are represented by device-dependent source coordinates R,G,B in the reference device-dependent color space of a reference display device characterized by a reference display forward color transform comprising: applying said reference display forward color transform to device-dependent source coordinates (R,G,B) representing said source colors, resulting in device-independent source coordinates (X,Y,Z) representing the same source colors in a device-independent linear color space, applying a virtual display inverse color transform (IT.sub.VD) to said resulting device-independent source coordinates X, Y, Z representing said source colors, resulting in device-dependent mapped coordinates R, G, B representing mapped colors in said reference device-dependent color space, wherein said virtual display inverse color transform (IT.sub.VD) models a virtual display device characterized by the same primaries as the primaries of a mastering display device used to master said source content or by primaries extracted from a description of the color gamut of said source content.
16. The method according to claim 15 wherein said virtual display device is further characterized by an EOTF corresponding to that of a mastering display device used to master said source content.
17. The method according to claim 15 wherein said virtual display device is further characterized by an EOTF corresponding to that of said reference display device.
18. The method according to claim 17 wherein said virtual display device is further characterized by a white point corresponding to that of said reference display device.
19. A method of mapping source colors of a source content, wherein said source colors are represented by first device-independent source coordinates X, Y, Z in a device-independent color space comprising: applying a virtual display inverse color transform (IT.sub.VD) to said device-independent source coordinates X,Y,Z representing said source colors, resulting in device-dependent source coordinates R,G,B representing mapped colors in the reference device-dependent color space of a reference display device, applying a reference display forward color transform characterizing said reference display device to said device-dependent source coordinates R,G,B representing said mapped colors, resulting in second device-independent source coordinates X,Y,Z representing the same mapped colors in the device-independent linear color space, wherein said virtual display inverse color transform (IT.sub.VD) models a virtual display device characterized: by the same primaries as the primaries of a mastering display device used to master said source content or by primaries extracted from a description of the color gamut of said source content, by an EOTF corresponding to that of a mastering display device used to master said source content or to that of said reference display device.
20. The method according to claim 19 wherein said virtual display device is further characterized by an EOTF corresponding to that of a mastering display device used to master said source content.
21. The method according to claim 19 wherein said virtual display device is further characterized by an EOTF corresponding to that of said reference display device.
22. The method according to claim 21 wherein said virtual display device is further characterized by a white point corresponding to that of said reference display device.
23. The method for reproducing a source content on a target display device characterized by a target display inverse color transform, comprising: receiving device-dependent source coordinates R, G, B representing source colors of said source content in the reference device-dependent color space of a reference display device characterized by a reference display forward color transform, receiving metadata representing color primaries of a mastering display device used to master said source content or extracting color primaries from a description of the color gamut of said source content, using a virtual display inverse color transform (IT.sub.VD) modelling a virtual display device characterized by said color primaries, mapping said source colors into mapped colors according to the method of claim 15, resulting in device-dependent mapped coordinates R, G, B representing said mapped colors, applying said reference display forward color transform to said device-dependent mapped coordinates R, G, B, resulting into device-independent mapped coordinates X, Y, Z representing said mapped colors in device-independent color space, gamut mapping said device-independent mapped coordinates X, Y, Z from said reference color gamut towards said target color gamut and applying said target display inverse color transform to said gamut-mapped device-independent mapped coordinates X, Y, Z, resulting into device-dependent target coordinates R, G, B representing said mapped colors in the target device-dependent color space of said target display device, controlling said target display device by inputting said device-dependent target coordinates R, G, B, resulting in the reproduction of said source content.
24. The method for reproducing a source content on a target display device characterized by a target display inverse color transform, comprising: receiving first device-independent source coordinates X, Y, Z representing source colors of said source content, receiving metadata representing color primaries of a mastering display device used to master said source content or extracting color primaries from a description of the color gamut of said source content, using a virtual display inverse color transform (IT.sub.VD) modelling a virtual display device characterized by said color primaries, mapping said source colors into mapped colors according to the method of claim 19, resulting in device-independent mapped coordinates X, Y, Z representing said mapped colors, applying said target display inverse color transform to said device-independent mapped coordinates X, Y, Z, resulting into device-dependent mapped coordinates R, G, B, controlling said target display device by inputting said device-dependent mapped coordinates R, G, B, resulting in the reproduction of said source content.
25. A color processing device for mapping source colors of a source content, wherein said source colors are represented by device-dependent source coordinates R, G, B in the reference device-dependent color space of a reference display device characterized by a reference display forward color transform, comprising: a reference display forward color transform module configured for applying said reference display forward color transform to device-dependent source coordinates (R, G, B) representing said source colors, resulting in device-independent source coordinates (X, Y, Z) representing the same source colors in a device-independent linear color space, a virtual display inverse color transform module configured for applying a virtual display inverse color transform (IT.sub.VD) to the device-independent source coordinates X, Y, Z provided by said reference display forward color transform module, resulting in device-dependent mapped coordinates R,G,B representing mapped colors in said reference device-dependent color space, wherein said virtual display inverse color transform (IT.sub.VD) models a virtual display device characterized by the same primaries as the primaries of a mastering display device used to master said source content or by primaries extracted from a description of the color gamut of said source content.
26. The color processing device according to claim 25 wherein said virtual display device is further characterized by an EOTF corresponding to that of a mastering display device used to master said source content.
27. The color processing device according to claim 25 wherein said virtual display device is further characterized by an EOTF corresponding to that of said reference display device.
28. The color processing device according to claim 27 wherein said virtual display device is further characterized by a white point corresponding to that of said reference display device.
29. A color processing device for mapping source colors of a source content, wherein said source colors are represented by first device-independent source coordinates X, Y, Z in a device-independent color space, comprising: a virtual display inverse color transform module configured for applying a virtual display inverse color transform (IT.sub.VD) to said device-independent source coordinates X, Y, Z representing said source colors, resulting in device-dependent mapped coordinates R, G, B representing mapped colors in the reference device-dependent color space of a reference display device characterized by a reference display forward color transform, a reference display forward color transform module configured for applying said reference display forward color transform to device-dependent mapped coordinates R, G, B provided by said virtual display inverse color transform module, resulting in device-independent mapped coordinates X, Y, Z representing the same mapped colors in the device-independent linear color space, wherein said virtual display inverse color transform (IT.sub.VD) models a virtual display device characterized by the same primaries as the primaries of a mastering display device used to master said source content or by primaries extracted from a description of the color gamut of said source content.
30. The color processing device according to claim 29 wherein said virtual display device is further characterized by an EOTF corresponding to that of a mastering display device used to master said source content.
31. The color processing device according to claim 29 wherein said virtual display device is further characterized by an EOTF corresponding to that of said reference display device.
32. The color processing device according to claim 31 wherein said virtual display device is further characterized by a white point corresponding to that of said reference display device.
33. A target display device characterized by a target display inverse color transform configured for reproducing a source content, comprising: a reception module configured for receiving device-dependent source coordinates R, G, B representing source colors of said source content in the reference device-dependent color space of a reference display device characterized by a reference display forward color transform, a color primaries module configured to provide color primaries received as metadata representing color primaries of a mastering display device used to master said source content or extracted from a description of the color gamut of said source content, a color processing device according to claim 25, configured to map device-dependent source coordinates R, G, B provided by said reception module, using a virtual display inverse color transform (IT.sub.VD) modelling a virtual display device characterized by color primaries provided by said color primaries module, resulting in device-dependent mapped coordinates R, G, B representing said mapped colors, a final color transform module configured to apply said reference display forward color transform and said target display inverse color transform to device-dependent mapped coordinates R, G, B provided by said color mapping device, resulting into device-independent mapped coordinates X, Y, Z representing said mapped colors in device-independent color space, configured to gamut map said device-independent mapped coordinates X, Y, Z from said reference color gamut towards said target color gamut and to apply said target display inverse color transform to said gamut-mapped device-independent mapped coordinates X, Y, Z, resulting into device-dependent target coordinates R, G, B representing said mapped colors in the target device-dependent color space of said target display device, a target display control module configured to control said target display device by inputting device-dependent mapped coordinates R, G, B provided by said final color transform module, resulting in the reproduction of said source content.
34. A target display device characterized by a target display inverse color transform, configured for reproducing a source content, comprising: a reception module configured for receiving device-independent source coordinates X, Y, Z representing source colors of said source content, a color primaries module configured to provide color primaries received as metadata representing color primaries of a mastering display device used to master said source content or extracted from a description of the color gamut of said source content, a color processing device according to claim 29, configured to map device-independent source coordinates X, Y, Z provided by said reception module, using a virtual display inverse color transform (IT.sub.VD) modelling a virtual display device characterized by color primaries provided by said color primaries module, resulting in device-independent mapped coordinates X, Y, Z representing said mapped colors, a final color transform module configured to apply said target display inverse color transform to device-independent mapped coordinates X, Y, Z provided by said color mapping device, resulting into device-dependent mapped coordinates R, G, B, a target display control module configured to control said target display device by inputting device-dependent mapped coordinates R, G, B provided by said final color transform module, resulting in the reproduction of said source content.
35. A computer readable storage medium comprising stored instructions that when executed by at least one processor performs the method of claim 15.
36. A computer readable storage medium comprising stored instructions that when executed by at least one processor performs the method of claim 19.
37. A computer readable storage medium comprising stored instructions that when executed by at least one processor performs the method of claim 23.
38. A computable readable storage medium comprising stored instructions that when executed by at least one processor performs the method of claim 24.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0088] The invention will be more clearly understood on reading the description which follows, given by way of non-limiting example and with reference to the appended figures in which:
[0089]
[0090]
[0091]
[0092]
[0093]
[0094]
[0095]
[0096]
[0097]
[0098]
[0099]
[0100]
[0101]
[0102]
[0103]
DESCRIPTION OF EMBODIMENTS
[0104] It will be appreciated by those skilled in the art that block diagrams and the like presented herein represent conceptual views of illustrative circuitry embodying the invention. They may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
[0105] The functions of the various elements shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software.
[0106] A source content is provided but is formatted to be reproduced by a reference display device, for instance as standardized according to ITU-R BT.2020, i.e. based on a wide color gamut. This source content has been mastered on a given mastering display device, notably characterized by given color primaries.
[0107] We will now describe how such source colors could be advantageously mapped into mapped colors adapted to be reproduced by a target display device: in a first situation, the mapping of source colors is performed in the reference device-dependent color space of the reference display devices; in a second situation, the mapping of source colors is performed in device-independent color space.
[0108] The general embodiment of a mapping in the first situation is illustrated in
[0109] In this general embodiment of a mapping in the first situation illustrated on
[0110] In a second step of this method, the method applies the inverse transform IT.sub.VD of a virtual display device to the X,Y,Z color coordinates obtained from the first step above. Through this inverse transform, R,G,B device dependent color coordinates are obtained that represent mapped source colors, still in the color space of the reference display device. This virtual display device is characterized through a RP177 model (see above) by an EOTF, namely EOTF.sub.VD, and a matrix M.sub.VD. According to the invention, EOTF.sub.VD is defined as the EOTF of the reference display device and the matrix M.sub.VD is defined in reference notably to the primaries of the mastering display device according to the following equations:
where X.sub.MD-RY.sub.MD-RZ.sub.MD-R, X.sub.MD-GY.sub.MD-GZ.sub.MD-G and X.sub.MD-BY.sub.MD-BZ.sub.MD-B are the X,Y,Z color coordinates of, respectively, the Red, Green and Blue primaries of the mastering display device and x.sub.VD-W, y.sub.VD-W, z.sub.VD-W are the chromaticity coordinates of the white point of the reference display device in the XYZ color space.
[0111] We have then IT.sub.VD(XYZ)=EOTF.sup.1.sub.VD (M.sup.1.sub.VD[XYZ]). This inverse transform IT.sub.VD of the virtual display device is capable to transform XYZ coordinates of any color located within the color gamut of this virtual display devicei.e. of the mastering display deviceinto RGB color coordinates representing the same color in the color space of this virtual display device. The color gamut of this virtual display device consists of all colors defined by color coordinates X,Y,Z where these color coordinates X,Y,Z can be transformed by IT.sub.VD into valid R,G,B color coordinates. When X,Y,Z color coordinates are valid in the range [0,1], usually valid RGB color coordinates are in the range [0,1], too.
[0112] The data defining the Red, Green and Blue primary colors of the mastering display device could be sent as metadata together with the content to be reproduced, for instance by the content creator. Such metadata can be advantageously compliant with a standard, as for instance the MPEG proposal entitled Indication of SMPTE 2084 and 2085 and carriage of 2086 metadata in HEVC from January 2014, which proposes color primaries as SEI metadata, defined as follows: This SEI message provides metadata for specifying the color volume (the color primaries, white point, and luminance range) of the display that was used in mastering video content.
[0113] If no data are available concerning the mastering display device, Red, Green and Blue primaries of the mastering display device are replaced by Red, Green and Blue primaries extracted from a gamut boundary description describing the color gamut of the source content to calculate the matrix IM.sub.VD above.
[0114] As the second step above applies the inverse of the EOTF of the reference display device, this step is equivalent to a gamut mapping from the color gamut of the mastering display device to the color gamut of the reference display device.
[0115] As already explained above, source colors of the content to be reproduced by the target display device is generally within the color gamut of the mastering display device because this content is precisely generated by this mastering display device. Therefore, colors represented by X,Y,Z color coordinates obtained through the first step above are within the color gamut of the virtual display device, because this virtual display device is characterized by the same primary colors as those of the mastering display device. If these Primary colors are represented in the CIE xy chromaticity space by coordinates xr,yr for the red primary, xg,yg for the green primary, and xb,yb for the blue primary, these three primaries xr,yr and xg,yg and xb,yb form a chromaticity gamut triangle within the CIE xy chromaticity space. This gamut triangle corresponds to the color gamut of the mastering display device. As shown on
[0116] An important element of the method of color mapping of this general embodiment based on the first situation in which source colors are represented by R,G,B color coordinates is that the output RGB of the virtual display inverse transform are reference display dependent color coordinates, i.e. is that the obtained mapped colors are represented in the color space of the reference display device.
[0117] We will now describe in reference to
[0118] The mapping method comprises the following steps: [0119] 1. Obtainingin a manner known per seof primary colors from said gamut boundary description describing the source content color gamut. [0120] 2. From the obtained X.sub.S-RY.sub.S-RZ.sub.S-R, X.sub.S-GY.sub.S-GZ.sub.S-G and X.sub.S-BY.sub.S-BZ.sub.S-B coordinates of, respectively, the Red, Green and Blue primaries of the those primary colors in the CIE XYZ color space and from the chromaticities of the white point of the virtual display device x.sub.VD-W=x.sub.RD-W, y.sub.VD-W=y.sub.RD-W, that are set to the chromaticities x.sub.RD-W, y.sub.RD-W, of the white point of the reference display device, a source matrix M.sub.S is computed according to:
[0124] As a whole, the combination of the application of the source matrix M.sub.S and of the application of the inverse of the EOTF.sub.RD of the reference display device is equivalent to the application of the inverse model IT.sub.VD of a virtual display device such that IT.sub.VD (XYZ)=EOTF.sup.1.sub.RD (M.sup.1.sub.S[XYZ]).
[0125] An implementation of the above example on a whole image workflow is shown in
[0126] In order to ensure valid device-dependent RGB color coordinates, the coordinates are clipped after application of inverse EOTF, such as shown in
[0127] mastering of the source content resulting in RGB color coordinates representing source colors in the color space of the mastering display,
[0128] application of a forward model of the mastering display then of an inverse model of the BT.2020 reference display, resulting in RGB color coordinates representing source colors in the color space of the ITU-R BT.2020 reference display,
[0129] application of the mapping method as described in the example above, resulting in RGB color coordinates representing mapped source colors in the color space of the BT.2020 reference display,
[0130] application of the forward model of the BT.2020 reference display then of an inverse model of the consumer displayi.e. target display device, resulting in R,G,B color coordinates representing mapped source colors in the color space of this consumer display, that are adapted to control this consumer display for the rendering of the source content.
[0131] A general embodiment of a mapping in the second situation in which source colors are represented in a device-independent color space by trichromatic color coordinates X,Y,Z will be now described in reference to
[0132] We will now describe a first example of implementation of this general embodiment in reference to
[0133] The method comprises the following steps: [0134] 1. Extraction of primary colors from the gamut boundary description describing the source content color gamut. [0135] 2. From the extracted X.sub.S-RY.sub.S-RZ.sub.S-R, X.sub.S-GY.sub.S-GZ.sub.S-G and X.sub.S-BY.sub.S-BZ.sub.S-B coordinates of, respectively, the Red, Green and Blue primaries of those primary colors in the CIE XYZ color space and from the chromaticities of the white point of the virtual display device x.sub.VD-W=x.sub.RD-W, y.sub.VD-W=y.sub.RD-W that are set to the chromaticities x.sub.RD-W, y.sub.RD-W of the white point of the reference display device, a source matrix M.sub.S is calculated as follows:
[0139] As a whole, the combination of the application of the source matrix M.sub.S and of the application of the inverse of the EOTF.sub.RD of the reference display device is equivalent to the application of the inverse model IT.sub.VD of a virtual display device such that IT.sub.VD (XYZ)=EOTF.sup.1.sub.RD (M.sup.1.sub.S[XYZ]).
[0140] We will now describe a second example of implementation of the general embodiment above in reference to
[0141] This second example can be further simplified into a third example if the reference display device and the virtual display device are characterized by the same triple of EOTFs. In this case, neither an EOTF nor an inverse EOTF needs to be applied to color coordinates. This third example is shown on
[0142] An implementation of the general embodiment above applied on a whole image workflow is shown on
[0143] This implementation is then based on the following steps: [0144] Using a mastering display, artistic creation of an image the colors of which are represented by RGB color coordinates. [0145] Transforming the created mastering display device-dependent color coordinates R,G,B into X,Y,Z device-independent color coordinates using a forward model of the mastering display. [0146] Describing the source color gamut of the mastering display using X,Y,Z color coordinates of at least the red, green and blue as primary colors. These colors are measured using a colorimeter as output of the display controlled by at least three input signals. In case of a mastering display having 8 bit encoded R,G,B inputs, the input signals are (255,0,0), (0,255,0), (0,0,255), (255,0,255), respectively. [0147] Using SMPTE RP177 modeling of a display device, calculating from these primary colors and from the white point of the reference display a linear matrix M.sub.MD transforming device independent color coordinates into linear, pseudo device-dependent color coordinates:
[0153] It is to be understood that the mapping method according to the invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or combinations thereof. The invention may be notably implemented as a combination of hardware and software. Moreover, the software may be implemented as an application program tangibly embodied on a program storage unit. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. Preferably, the machine is implemented on a computer platform having hardware such as one or more central processing units (CPU), a random access memory (RAM), and input/output (I/O) interfaces. The computer platform may also include an operating system and microinstruction code. The various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU. In addition, various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit.
[0154] Therefore, further subjects of the invention are summarized below.
[0155] A subject of the invention is notably a color mapping device for mapping source colors of a source content, wherein said source colors are represented by device-dependent source coordinates R,G,B in the reference device-dependent color space of a reference display device characterized by a reference display forward color transform comprising:
[0156] a reference display forward color transform module configured for applying said reference display forward color transform to device-dependent source coordinates (R,G,B) representing said source colors, resulting in device-independent source coordinates (X,Y,Z) representing the same source colors in a device-independent linear color space,
[0157] a virtual display inverse color transform module configured for applying a virtual display inverse color transform (IT.sub.VD) to the device-independent source coordinates X,Y,Z provided by said reference display forward color transform module, resulting in device-dependent mapped coordinates R,G,B representing mapped colors in said reference device-dependent color space, wherein said virtual display inverse color transform (IT.sub.VD) models a virtual display device characterized by the same primaries as the primaries of a mastering display device used to master said source content or by primaries extracted from a description of the color gamut of said source content.
[0158] A subject of the invention is also a color mapping device for mapping source colors of a source content, wherein said source colors are represented by first device-independent source coordinates X,Y,Z in a device-independent color space comprising:
[0159] a virtual display inverse color transform module configured for applying a virtual display inverse color transform (IT.sub.VD) to said device-independent source coordinates X,Y,Z representing said source colors, resulting in device-dependent mapped coordinates R,G,B representing mapped colors in the reference device-dependent color space of a reference display device characterized by a reference display forward color transform,
[0160] a reference display forward color transform module configured for applying said reference display forward color transform to device-dependent mapped coordinates R,G,B provided by said virtual display inverse color transform module, resulting in device-independent mapped coordinates X,Y,Z representing the same mapped colors in the device-independent linear color space,
wherein said virtual display inverse color transform (IT.sub.VD) models a virtual display device characterized by the same primaries as the primaries of a mastering display device used to master said source content or by primaries extracted from a description of the color gamut of said source content.
[0161] A subject of the invention is also a target display device characterized by a target display inverse color transform characterized by a target display inverse color transform, configured for reproducing a source content, comprising
[0162] a reception module configured for receiving device-dependent source coordinates R,G,B representing source colors of said source content in the reference device-dependent color space of a reference display device characterized by a reference display forward color transform,
[0163] a color primaries module configured to provide color primaries received as metadata representing color primaries of a mastering display device used to master said source content or extracted from a description of the color gamut of said source content,
[0164] a color mapping device as summarized above that is configured to map device-dependent source coordinates R,G,B provided by said reception module, using a virtual display inverse color transform (IT.sub.VD) modelling a virtual display device characterized by color primaries provided by said color primaries module, resulting in device-dependent mapped coordinates R,G,B representing said mapped colors,
[0165] a final color transform module configured to apply said reference display forward color transform and said target display inverse color transform to device-dependent mapped coordinates R,G,B provided by said color mapping device, resulting into device-independent mapped coordinates X,Y,Z representing said mapped colors in device-independent color space, configured to gamut map said device-independent mapped coordinates X,Y,Z from said reference color gamut towards said target color gamut and to apply said target display inverse color transform to said gamut-mapped device-independent mapped coordinates X,Y,Z, resulting into device-dependent target coordinates R,G,B representing said mapped colors in the target device-dependent color space of said target display device,
[0166] a target display control module configured to control said target display device by inputting device-dependent mapped coordinates R,G,B provided by said final color transform module, resulting in the reproduction of said source content.
[0167] A subject of the invention is also a target display device characterized by a target display inverse color transform characterized by a target display inverse color transform, configured for reproducing a source content, comprising:
[0168] a reception module configured for receiving device-independent source coordinates X,Y,Z representing source colors of said source content,
[0169] a color primaries module configured to provide color primaries received as metadata representing color primaries of a mastering display device used to master said source content or extracted from a description of the color gamut of said source content,
[0170] a color mapping device as summarized above that is configured to map device-independent source coordinates X,Y,Z provided by said reception module, using a virtual display inverse color transform (IT.sub.VD) modelling a virtual display device characterized by color primaries provided by said color primaries module, resulting in device-independent mapped coordinates X,Y,Z representing said mapped colors,
[0171] a final color transform module configured to apply said target display inverse color transform to device-independent mapped coordinates X,Y,Z provided by said color mapping device, resulting into device-dependent mapped coordinates R,G,B,
[0172] a target display control module configured to control said target display device by inputting device-dependent mapped coordinates R,G,B provided by said final color transform module, resulting in the reproduction of said source content.
[0173] Although the illustrative embodiments of the invention have been described herein with reference to the accompanying drawings, it is to be understood that the present invention is not limited to those precise embodiments, and that various changes and modifications may be effected therein by one of ordinary skill in the pertinent art without departing from the invention. All such changes and modifications are intended to be included within the scope of the present invention as set forth in the appended claims.