DISPLAY SYSTEM AND DISPLAY SYSTEM CONTROL METHOD
20210144288 · 2021-05-13
Inventors
Cpc classification
G09G2360/142
PHYSICS
H04N7/18
ELECTRICITY
H04N23/74
ELECTRICITY
H04N17/00
ELECTRICITY
G09G2300/0452
PHYSICS
International classification
Abstract
According to an aspect of the present invention, there is provided a display system including a camera and a display device configured to reproduce a display video and having an infrared light source, the display system including an infrared luminance control unit configured to control luminance of the infrared light source in accordance with a state of a video captured by the camera.
Claims
1. A display system comprising: a camera; a display device having an infrared light source; and an infrared luminance control unit configured to control luminance of the infrared light source in accordance with a state of a video captured by the camera.
2. The display system according to claim 1, wherein the infrared luminance control unit controls the luminance of the infrared light source by collectively controlling electric currents which flow into infrared light sources using one constant current circuit configured to control an electric current which flows into each of the infrared light sources of a plurality of light emitting diode (LED) elements disposed in a line, each of the plurality of LED elements being configured to include the infrared light source.
3. The display system according to claim 1, wherein the infrared luminance control unit controls the luminance of the infrared light source by individually controlling electric currents which flow into infrared light sources using drive circuits configured to individually control electric currents which flow into a red LED, a green LED, and a blue LED constituting a plurality of LED elements disposed in a line, each of the plurality of LED elements being configured to include the infrared light source.
4. The display system according to claim 1, further comprising: a line-of-sight detection unit configured to detect lines of sight of photography targets who view the display video reproduced by the display system on the basis of the video captured by the camera; and a line-of-sight count analysis unit configured to analyze the number of lines of sight that have been detected with respect to each of a plurality of scenes constituting the display video.
5. The display system according to claim 1, further comprising: a plurality of light emitting diode (LED) elements, wherein the plurality of light emitting diode (LED) elements include light emitting diodes (LED) for emitting visible lights and the infrared light sources.
6. The display system according to claim 1, further comprising: a video contents reproducing device.
7. The display system according to claim 6, further comprising: a line-of-sight detection unit configured to detect a line of sight of a video, which is output of the video contents reproducing device, on the basis of the video captured by the camera.
8. The display system according to claim 1, wherein the camera comprises an infrared camera.
9. A method of controlling a display system: wherein the display system includes a camera and a display device having an infrared light source, wherein the display device includes an infrared luminance control unit, and wherein the infrared luminance control unit controls luminance of the infrared light source in accordance with a state of a video captured by the camera.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
DESCRIPTION OF EMBODIMENTS
[0028]
[0029] An LED element 1 shown in
[0030] The LED display 3 shown in
[0031] The printed circuit board 201 has, for example, wiring for driving the LED element R LED, the LED element G LED, the LED element B LED, and the LED element IR LED. Alternatively, the printed circuit board 201 may include drive circuits shown in
[0032]
[0033] The camera control system 100 includes an infrared camera 11, an infrared camera compatible display (a display device: the above-described LED display 3), and a personal computer (PC) 23 for content reproduction and infrared light emission amount adjustment.
[0034] The infrared camera 11 photographs a photography target. A video captured by the infrared camera 11 is sent to the PC 23 for content reproduction and infrared light emission amount adjustment.
[0035] The PC 23 for content reproduction and infrared light emission amount adjustment outputs a video signal representing a display video to the LED display 3 and also outputs a light emission amount adjustment instruction for adjusting an amount of light which is emitted from the infrared LED (the LED element IR LED). That is, the LED display 3 reproduces the display video output from the PC 23 for content reproduction and infrared light emission amount adjustment and emits light of the infrared LED on the basis of control by the PC 23 for content reproduction and infrared light emission amount adjustment.
[0036] According to the configurations shown in
[0037] As described above, the printed circuit board 201 is required to include an LED drive circuit for driving the LED element R LED, the LED element G LED, the LED element B LED, and the infrared LED element IR LED so that a clear video is captured by the infrared camera 11. LED drive circuits 41 to 43 will be described with reference to
(Regarding Operation of LED Drive Circuit 41)
[0038] A circuit for causing a uniform electric current to flow through the infrared LED element so that the drive circuit is simplified is provided as a method in which the LED drive circuit 41 (configuration example 1) drives the infrared LED element IR LED. Although the electric current is made uniform by limiting the electric current which flows into the infrared LED element IR LED with a resistor R in the present example, a constant current circuit may be used instead of the resistor R.
[0039]
[0040] As shown in
[0041] The LED drive circuit 41 generates a drive signal (a signal for driving a cathode electrode of each LED) assigned to each pixel on the basis of the number of pixel components of the LED display 3 in a matrix of m horizontal components×n vertical components. Here, m and n are the number of LED elements 1 in the horizontal direction (the number of columns) and the number of LED elements 1 in the vertical direction (the number of rows) in the LED display 3, i (=1 to m) represents a column number, and j (=1 to n) represents a row number.
[0042] In
[0043] Also, the MOSFET-P has a drain terminal connected to the one line, a gate terminal connected to an output terminal of the scan control circuit SCAN CTL, and a source terminal connected to a power supply voltage VCS.
[0044] Also, in the LED drive circuit 41 shown in
[0045] Output terminals of the scan control circuit SCAN CTL are connected to input terminals CTL of the drive circuits (the R LED driver, the G LED driver, and the B LED driver), respectively. Also, the scan control circuit SCAN CTL receives a scan control signal output by an infrared LED luminance control unit (to be described below with reference to
[0046] Also, in the LED drive circuit 41 shown in
[0047] On the other hand, in the LED drive circuit 41 shown in
(Regarding Operation of LED Drive Circuit 42)
[0048] As a method in which an LED drive circuit 42 (configuration example 2) drives infrared LED elements IR LED, electric currents of a plurality of infrared LED elements IR LED can be collectively controlled and brightness (luminance) of the plurality of infrared LED elements IR LED can be adjusted. In this example, a constant current circuit is configured to control the electric currents which flow into the infrared LED elements IR LED. The constant current circuit used here is set so that a constant current value can be controlled from outside of the circuit and is controlled by a CPU or the like. The brightness may be adjusted in conjunction with the infrared camera so that an intensity of illumination can be adjusted appropriately so that the infrared camera can capture a clear video. Also, when there are other infrared sensors or the like nearby, an amount of infrared light which is emitted can be adjusted appropriately to prevent the infrared sensor from malfunctioning.
[0049]
[0050] As shown in
[0051] Also, hereinafter, parts which are the same as those in
[0052] In the LED drive circuit 42 shown in
[0053] That is, in the LED drive circuit 42 shown in
[0054] More specifically, the brightness adjustment system 20 (a display control system) to be described below performs adjustment so that an optimum video can be received by analyzing a video received from the infrared camera 11, controlling an electric current which flows into the infrared LED element IR LED in accordance with an exposure state of the video, and increasing or decreasing an amount of infrared light which is emitted from the infrared LED element IR LED. For example, the brightness adjustment system 20 performs adjustment so that an optimum video can be received by analyzing whether an exposure state of the video received from the infrared camera 11 is an overexposure state (a state in which the photography target is photographed to be bright) or an underexposure state (a state in which the photography target is photographed to be dark), expanding an imaging range shown between the overexposure state and the underexposure state, and increasing or decreasing an amount of infrared light which is emitted in the expanded imaging range (details will be described below with reference to
[0055] That is, the constant current control circuit CORRENT CTL is controlled by the infrared LED luminance control unit 32, so that the luminance of the infrared LED elements IR LED is controlled by collectively controlling electric currents which flow into the infrared LED elements IR LED constituting the plurality of LED elements disposed in a line, wherein each of the LED elements is configured to include the infrared LED element.
(Regarding Operation of LED Drive Circuit 43)
[0056] As a method in which the LED drive circuit 43 (configuration example 3) drives an infrared LED element IR LED, the infrared LED element IR LED is connected to a drive circuit (an LED driver) in a configuration similar to that of the circuit for driving the red, green, and blue LEDs of the LED display 3. According to this configuration, the brightness of the infrared LED element IR LED can be adjusted individually and the brightness of the infrared LED element IR LED can be adaptively adjusted in accordance with a photography target of the infrared camera. The brightness is adaptively adjusted to an appropriate intensity of illumination so that a clear video can be captured by the infrared camera in conjunction with the infrared camera. Also, when there are other infrared sensors or the like nearby, the amount of infrared light which is emitted can be adaptively and appropriately adjusted to prevent the infrared sensor from malfunctioning.
[0057]
[0058] As shown in
[0059] Hereinafter, parts that are the same as those in
[0060] In the LED drive circuit 43 shown in
[0061] That is, in the LED drive circuit 43 shown in
[0062] More specifically, the brightness adjustment system 20 (a display control system) to be described below performs adjustment so that an optimum video can be received by analyzing a video received from the infrared camera 11, controlling an electric current which flows into the infrared LED element IR LED in accordance with an exposure state of the video, and increasing or decreasing an amount of infrared light which is emitted from the infrared LED element IR LED. For example, the brightness adjustment system 20 performs adjustment so that an optimum video can be received by analyzing whether an exposure state of the video received from the infrared camera 11 is an overexposure state (a state in which the photography target is photographed to be bright) or an underexposure state (a state in which the photography target is photographed to be dark) and increasing or decreasing an amount of infrared light which is emitted in an imaging range shown in the overexposure state and the underexposure state (details will be described below with reference to
[0063] That is, the drive circuit (the IR LED driver) is controlled by the infrared LED luminance control unit 32, so that the luminance of the infrared LED element IR LED is controlled by individually controlling electric currents that flow into the infrared LED elements constituting the plurality of LED elements disposed in a line, wherein each of the LED elements is configured to include the infrared LED element. Also, the description of “the plurality of LED elements disposed in the line” represents a plurality of LED elements 1 disposed in a horizontal direction (j represents a certain direction shown in
[0064]
[0065]
[0066] The camera control system 100 is configured to include an infrared camera system 10 (a photography system), a brightness adjustment system 20 (a display control system), and an infrared camera compatible LED display system 30 (a display system).
[0067] The infrared camera system 10 is configured to include an infrared camera unit 11 (the infrared camera 11 shown in
[0068] The infrared camera 11 photographs a subject (a photography target shown in
[0069] The exposure detection unit 12 detects an exposure state of an image from a state of a video captured by the infrared camera 11.
[0070] The CPU 13 analyzes the exposure state detected by the exposure detection unit 12 and appropriately adjusts the aperture and the shutter speed using the aperture/shutter speed control unit 14 so that the exposure of the captured video is optimized.
[0071] The brightness adjustment system 20 is included in the PC 23 for content reproduction and infrared light emission amount adjustment described above. The CPU 21 in the brightness adjustment system 20 performs adjustment so that an optimum video can be received by analyzing a video received from the infrared camera system 10, controlling the infrared camera compatible LED display system 30 in accordance with an exposure state of the video, and increasing or decreasing an amount of infrared light which is emitted from the infrared camera compatible LED display system 30.
[0072] The infrared camera compatible LED display system 30 is configured to include a CPU 31, an infrared LED luminance control unit 32, a scan control unit 33, and an infrared LED unit 34 and constitutes features of the present invention. Here, the CPU 31 and the infrared LED luminance control unit 32 are included in the above-described PC 23 for content reproduction and infrared light emission amount adjustment. Also, the scan control unit 33 is the scan control circuit SCAN CTL in the LED drive circuits 41 to 43 shown in
[0073] The CPU 31 is connected to the CPU 21 of the brightness adjustment system 20 and receives control information. The CPU 31 increases or decreases the luminance of the infrared element IR LED using the infrared LED luminance control unit 32 on the basis of the received information.
[0074] In the case of the LED drive circuit 43 (configuration example 3), the infrared LED luminance control unit 32 is connected to each infrared LED unit via the scan control unit 33 to individually control the luminance of each infrared element IR LED. The term “via the scan control unit 33” represents that the infrared LED luminance control unit 32 individually controls the luminance of the infrared element IR LED by controlling the scan control circuit SCAN CTL and the drive circuit (the IR LED driver) in
[0075] Also, in the case of the LED drive circuit 42 (configuration example 2), there is no drive circuit (IR LED Driver) and the infrared LED luminance control unit 32 directly controls the luminance of the infrared element IR LED by performing control using the constant current circuit CONSTANT CURRENT CIRCUIT.
[0076]
[0077] In
[0078] As indicated by the broken line 51 in
[0079] On the other hand, as indicated by a solid line S2 in
[0080] That is, as in the camera control system 100 including the LED drive circuit 42 (configuration example 2) or the LED drive circuit 43 (configuration example 3), it is possible to adjust the infrared light emitted from a screen of the infrared camera compatible LED display system by controlling the luminance of the infrared LED and expand the photography range in addition to the available photography range according to the aperture and the shutter speed provided in the original infrared camera system.
[0081] That is, according to the camera control system 100 of the present embodiment, it is not necessary to provide an infrared illumination device in the infrared camera 11 and the infrared camera 11 can perform clear photography because an object (a photography target) can be illuminated by a large screen included in the LED display 3 (the LED display).
[0082] As described above, according to the camera control system 100 of the present embodiment, it is not necessary to provide an infrared illumination device in the infrared camera 11 and the infrared camera 11 can be miniaturized. Thus, the infrared camera 11 can be integrated with the LED display 3 (the LED display) or the infrared camera 11 can be installed in an inconspicuous place, so that it becomes unlikely for the photography target to notice the presence of the infrared camera 11 (the camera) and natural monitoring and investigations of the photography target are possible. Of course, even if the LED display 3 (the LED display) is not in operation, only the infrared illumination function can be operated and the infrared camera 11 can photograph the photography target.
[0083] Also, adaptive correction by the camera control system 100 of the present embodiment will be described.
[0084]
[0085] When the luminance of each infrared LED can be individually controlled as in the camera control system 100 including the LED drive circuit 43 (configuration example 3), the brightness adjustment system 20 can clearly capture a photography target without blown highlights or crushed shadows by adaptively setting the luminance of an individual infrared LED according to a result of analyzing a captured video captured by the infrared camera system 10.
[0086] For example, as in the “infrared-camera captured video” shown in
[0087] In this case, in the light emission state of the infrared LED of the infrared camera compatible LED display system 30, an amount of light which is emitted from the infrared LED close to the blown highlight side is decreased (in a light emission state 91) and an amount of light which is emitted from the infrared LED close to the crushed shadow side is increased (in a light emission state 92) as in the “light emission state of the infrared element of the LED display (when adaptive correction is adjustable)” shown in
[0088] Thereby, it is possible to improve the sharpness of the video captured by the infrared camera 11 as in the photography target 81 and the photography target 82 in the “infrared-camera captured video (when adaptive correction is adjustable)” shown in FIG. 8C.
[0089] That is, it is possible to clearly photograph each of a plurality of photography targets even if distances between a plurality of photography targets and the LED display 3 (the infrared camera compatible LED display) constituting the infrared camera compatible LED display system are different by causing the above-described adaptive correction of the video captured by the infrared camera to be adjustable as a control means of the camera control system 100 of the present embodiment.
[0090] When a video is clear, it is easy to identify a line of sight of a photography target. A clear video can be utilized for various purposes of monitoring, crime prevention, investigation, and purchasing behavior, and the like.
[0091] For example, a signage display can be assumed for the purpose of utilizing a control means of the camera control system 100 of the present embodiment.
[0092]
[0093]
[0094] The camera control system 100a shown in
[0095] That is, the camera control system 100a does not include the infrared camera system 10 (the photography system), the brightness adjustment system 20 (the display control system), and the infrared camera compatible LED display system 30 (the display system) shown in
[0096] Thus, in the camera control system 100a, the LED display 3a reproduces a video signal representing a display video output from the content reproduction PC 23a. However, the camera control system 100a cannot measure the number of lines of sight of advertisement targets (equivalent to the photography targets of the infrared camera 11 shown in
[0097] On the other hand, the camera control system 100b shown in
[0098] Here, the PC 23b for content reproduction and infrared light emission amount adjustment further includes a line-of-sight detection function and a line-of-sight analysis function synchronized with the content reproduction with respect to the PC 23 for content reproduction and infrared light emission amount adjustment shown in
[0099] That is, the camera control system 100b is configured to include the infrared camera system 10 (the photography system), the brightness adjustment system 20 (the display control system), and the infrared camera compatible LED display system 30 (the display system) shown in
[0100] Here, the line-of-sight detection unit detects a line of sight of an advertisement target (equivalent to a photography target of the infrared camera 11 shown in
[0101] Also, the line-of-sight analysis unit can analyze the detected number of lines of sight with respect to each of a plurality of scenes constituting the display video.
[0102] Thereby, the camera control system 100b can measure the number of lines of sight of advertisement targets who view the reproduced displayed video (an advertising effect).
[0103] That is, the camera control system 100b can measure an effective scene by analyzing how many people have viewed a video displayed on the LED display 3 (the signage display) for how long in conjunction with display content of content so that the effect of advertisement displayed on the signage can be measured. Thereby, it is possible to make the operational effects of a signage appeal to advertisers or to set a fee or the like according to the effects.
[0104] Also, because the camera control system 100 and the camera control system 100b described above are premised on utilizing the infrared camera 11, monitoring and investigations in dark places can also be performed.
[0105] Next, a minimum configuration of the above-described embodiment will be described with reference to
[0106] The infrared camera compatible LED display system 30 (the display system) has the LED display 3 (the display device) that reproduces a display video and irradiates a photography target with infrared light. Also, the CPU 21 of the brightness adjustment system 20 (the display control system) analyzes the video captured by the infrared camera 11 and transmits control information representing that an amount of infrared light which is emitted in infrared light irradiation is to be adjusted in accordance with an exposure state of the video to the infrared camera compatible LED display system 30 (the display system). Here, the infrared camera compatible LED display system 30 (the display system) is configured to include the infrared LED luminance control unit 32 that controls the luminance of the infrared LED unit 34 (the infrared LED) that performs infrared light irradiation on the basis of the control information.
[0107] As described above, according to the embodiment and the minimum configuration example of the present invention, it is possible to provide a camera control system and a camera control method for enabling the infrared camera 11 to capture a clear video.
[0108] Also, according to the configuration of the display system, there is provided a display system including the infrared camera 11 (the camera) and the LED display 3 (the display device) configured to reproduce a display video and including the infrared LED unit 34 (the infrared light source). The display system includes the infrared LED luminance control unit 32 (the infrared luminance control unit) configured to control luminance of the infrared LED unit 34 in accordance with an exposure state of a video (a state of a video) captured by the infrared camera 11, so that it is possible to provide a display system and a display system control method for enabling the infrared camera 11 to capture a clear video.
[0109] Although embodiments of the present invention have been described above in detail with reference to the drawings, specific configurations are not limited to the embodiments and other designs and the like may be made without departing from the scope of the present invention. Also, some or all of programs to be executed by a computer of one or more CPUs or the like of the above-described embodiment can be distributed via a communication circuit or a computer-readable recording medium.
REFERENCE SIGNS LIST
[0110] 1, 1a LED element [0111] 2 LED cabinet [0112] 3, 3a LED display [0113] 10 Infrared camera system (photography system) [0114] 11 Infrared camera [0115] 12 Exposure detection unit [0116] 13, 21, 31 CPU [0117] 14 Aperture/shutter speed control unit [0118] 20 Brightness adjustment system (display control system) [0119] 23, 23a, 23b PC [0120] 30 Infrared camera compatible LED display system (display system) [0121] 32 Infrared LED luminance control unit [0122] 33 Scan control unit [0123] 34 Infrared LED unit (infrared LED) [0124] 41, 42, 43 LED drive circuit [0125] 101 Package [0126] 201 Printed circuit board