PROJECTOR SYSTEM AND IMAGING DEVICE
20180088447 ยท 2018-03-29
Assignee
Inventors
Cpc classification
G06F3/0425
PHYSICS
H04N9/3105
ELECTRICITY
G03B21/005
PHYSICS
G03B11/00
PHYSICS
G03B21/26
PHYSICS
International classification
G03B21/00
PHYSICS
H04N9/31
ELECTRICITY
Abstract
In an imaging section (imaging device), optical filters constituting an optical filter device are inserted and extracted, and an aperture varies an f-number in accordance with the insertion and the extraction of the optical filters. Thus, during the writing operation to the surface of the projection screen, namely during the interactive projector operation, entering of the light in the wavelength band other than that of the detected light DL is suppressed while capturing the detected light DL with the necessary light intensity, and during an alignment (a calibration), the axial chromatic aberration caused by the difference in wavelength band between the pattern image light GL as the image light and the detected light DL is suppressed to achieve an improvement in accuracy.
Claims
1. A projector system comprising: a projection main unit adapted to project image light obtained by modulating light from a light source; and an imaging section having an optical filter, which can be inserted and extracted, adapted to reduce the image light from the projection main unit and transmit detected light in a wavelength band other than a wavelength band of the image light, and an aperture adapted to vary an f-number in accordance with the insertion and the extraction of the optical filter.
2. The projector system according to claim 1, further comprising: a projector control section adapted to identify an image projection position based on information of image light obtained by the imaging section, and a light emitting position of the detected light detected by the imaging section, and perform control of image projection based on a positional relationship identified.
3. The projector system according to claim 1, wherein the projection main unit performs image projection reflecting information of the light emitting position of the detected light detected by the imaging section.
4. The projector system according to claim 1, wherein the projection main unit projects the image light adapted to project a pattern image, and performs a calibration adapted to associate pixels of light modulation of modulating the light from the light source and pixels of a light receiving element of the imaging section with each other based on information of the imaging section receiving the image light of the pattern image.
5. The projector system according to claim 4, wherein the aperture increases the f-number at the time of imaging the image light of the pattern image in the calibration to be larger than the f-number at the time of detecting the detected light in the image projection.
6. The projector system according to claim 1, wherein the aperture is a variable aperture adapted to vary an aperture value between the image light and the detected light.
7. The projector system according to claim 1, wherein the aperture is a fixed aperture adapted to shield light in the wavelength band of the image light and transmit light in the wavelength band of the detected light.
8. The projector system according to claim 1, wherein the imaging section detects light in an infrared wavelength band as the detected light in the wavelength band other than the wavelength band of the image light.
9. The projector system according to claim 8, wherein the optical filter is a visible light cut filter inserted in the image projection, and adapted to shield the image light and transmit the detected light.
10. An imaging device adapted to take an image of image light adapted to project a pattern image, and an image of detected light in a wavelength band other than a wavelength band of the image light, the imaging device comprising: an optical filter, which can be inserted and extracted, adapted to reduce the image light and transmit the detected light; and an aperture adapted to vary an f-number in accordance with the insertion and extraction of the optical filter.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The invention will be described with reference to the accompanying drawings, wherein like numbers reference like elements.
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
DESCRIPTION OF EXEMPLARY EMBODIMENTS
First Embodiment
[0028] An imaging device and a projector system incorporating the imaging device according to a first embodiment of the invention will hereinafter be described with reference to the accompanying drawings.
[0029] The projector system 500 shown in
[0030] As shown in
[0031] Although the detailed illustration is omitted, the projection main unit 100p is provided with a light source, a light modulation device, a projection optical system, and so on, and performs the image projection on the screen SC. Therefore, as shown in, for example,
[0032] The imaging section 50 takes the projection image projected by the projection main unit 100p to obtain the image information. Thus, the projection main unit 100p makes it possible to perform a calibration for associating the positional relationship between pixels of an image forming section (a pixel matrix in light modulation) constituting the projectionr main unit 100p and pixels of an imaging element 40, based on the image information obtained by the imaging section 50. Further, in the present embodiment, the imaging section 50 is arranged to be capable of capturing the light (the infrared light) in the wavelength band other than the image light of the visible light from the projection main unit 100p as the detected light in the actual use taking place after the calibration as already described above. As described above, the imaging section 50 is arranged to detect light in the wavelength band different between the calibration and the actual use taking place after the calibration. It should be noted that it is assumed here that the imaging section 50 is provided with an optical design so as to be suitable for the detection of the infrared light in the actual use focusing on the actual use. Specifically, it is assumed that it is designed that there is a state in which the focus is achieved in the range of the image taken by the imaging section 50 throughout the entire area of the irradiation target area PLa when detecting the wavelength band component of the infrared light.
[0033] Due to the configuration described above, the projector system 500 (or the projector 100) uses the calibration of associating the positional relationship between the pixels of the image forming section constituting the projection main unit 100p and the pixels of the imaging element 40 to thereby make the so-called interactive image projection possible.
[0034] Hereinafter, a configuration of the imaging section 50 (or the imaging device 50) will be described with reference to
[0035] The imaging lens system 30 is for forming an image, which is located on an object, on the imaging element 40, and is configured by housing a plurality of lenses, an aperture, and so on in a lens tube section. It should be noted that an example of the constituents such as lenses as an essential parts of the imaging lens system 30 will be described later with reference to
[0036] The imaging element 40 is formed using a solid-state imaging element such as a CCD image sensor or a CMOS image sensor. The imaging element 40 is a light receiving element capable of receiving and detecting the infrared light (IR light) in addition to the visible light.
[0037] The control device 80 controls overall the imaging section 50, and at the same time performs the communication and so on with the projector 100 equipped with the imaging section 50. Therefore, the control device 80 is provided with a drive control section 81 for performing drive control of the imaging element 40 and the imaging lens system. 30 constituting the imaging section 50, and a communication section 82 for performing the information communication process with the projector 100 (a projector control section CT). In this case, the imaging element 40 and the imaging lens system 30 are made to perform an imaging operation in accordance with the drive signal from the drive control section 81 of the control device 80, and are made possible to act in tandem with a variety of operations in the projector 100 equipped with the imaging section 50 via the communication section 82. Therefore, it is also possible to act in accordance with a command from a main device such as the projector.
[0038] It should be noted that the imaging section 50 can be what is incorporated as a part constituting the projector 100, but can also be what exists as the imaging device 50 as a separate body from the projector 100. It should be noted that it is conceivable that in order to play a role of the constituent for figuring out the projection image position of the projector 100, the imaging device 50 needs to be arranged that a lens system of a camera faces to a direction with an angle or the like corresponding a projection angle, a projection distance, and so on in the image projection by the projection main unit 100p, for example.
[0039] Here, if it is attempted to associate the image position of the pattern image PT shown by the pattern image light GL from the projection main unit 100p projected with, for example, visible light and the light emitting position of the infrared light IL from the pointing device such as the pen 70 (see
[0040] Hereinafter, a configuration of the imaging section (the imaging device) 50, in particular the optical system, will be described with reference to
[0041] The plurality of lenses L11 through L18 constitutes a fish-eye type lens, and has the half angle of view of, for example, no smaller than 70, and are made sufficient for imaging the whole of the screen SC.
[0042] The aperture ST is typically disposed at the position where the light beam is most densely collected out of the spaces between the lenses L11 through L18, and controls the intensity of the light finally reaching an image surface IM (an image surface of the imaging element 40) passing through the lenses L11 through L18. In other words, the aperture ST varies the f-number (an aperture value). In particular, in the present embodiment, the imaging section 50 is provided with the optical design optimized for the infrared light as already described, and is, therefore, made difficult to achieve the focus in the calibration of capturing the pattern image light GL as the visible light, in other words, the light different in wavelength band from the infrared light, compared to the actual use of capturing the infrared light. In order to cope with the above, as shown in
[0043] The optical filter device 60 has a first optical filter F11 and a second optical filter F12, and makes each of the optical filters F11, F12 capable of being inserted and extracted between the lenses L11 through L18 and the image surface IM (the image surface of the imaging element 40) using a stepping motor, a pinion, and so on not shown.
[0044] Among the constituents of the optical filter device 60, the first optical filter F11 is a visible light cut filter for cutting the light in the visible wavelength band, and at the same time transmitting the light in the infrared wavelength band. In other words, the first optical filter F11 is a filter for reducing the image light in the visible wavelength band, and at the same time, transmitting the detected light in the wavelength band other than the wavelength band of the image light. The first optical filter F11 is retracted outside the light path in the calibration as shown in
[0045] The second optical filter F12 is a filter for transmitting only the light in the wavelength band of the pattern image light GL for forming the pattern image, and cutting the light in other wavelength bands. The second optical filter F12 is disposed in the light path in the calibration as shown in
[0046] The aperture ST varies the f-number in accordance with the insertion and the extraction of such a first optical filter F11 and a second optical filter F12 as described above as a result.
[0047] It should be noted that regarding the optical filters F11, F12, a variety of forms is conceivable, and it is typically conceivable to configure the optical filters F11, F12 by forming the films having such characteristics as described above on, for example, a glass substrate having a light transmissive property, respectively. Regarding the glass substrate, by adopting those having the thickness of, for example, one through several millimeters, it is possible to provide the strength durable for the insetion and extraction actions. Further, the first optical filter F11 and the second optical filter F12 are formed to have respective thicknesses equivalent to each other. In other words, the glass substrates described above are configured so as to have respective thicknesses equivalent to each other. It should be noted that regarding the optical filters F11, F12, it is not limited to one made of glass, but can also be one made of synthetic resin.
[0048] Further, since the insertion and the extraction of the optical filters F11, F12 in such an optical filter device 60 are performed by the exchange between the optical filters F11, F12 having such a configuration as described above, it becomes possible to reduce the difference in refractive state of the light reaching the imaging element 40 between the calibration and the actual use. In other words, it becomes possible for the imaging section 50 to take the image while suppressing the defocus on the optical axis in both of the calibration and the actual use.
[0049] The calibration operation for associating the pixels (the pixels on the light modulation side) on the projection main unit 100p side with the pixels (the pixels on the imaging element 40 side) on the imaging section (the imaging device) side in the projector system 500 will hereinafter be described in detail with reference to
[0050] Firstly, in the projection main unit 100p, the image projection section 90 projects the pattern image light GL for projecting the pattern image PT for the calibration on the screen SC in accordance with the control by the projector control section CT. Here, it is assumed that the association with the pixel matrix (the pixels of the light modulation) in the light modulation of the projection main unit 100p is achieved with respect to the pattern image PT projected so as to have a rectangular shape. Further, as already described, the pattern image light GL is the light in the green wavelength band, and the imaging section (the imaging device) 50 takes the pattern image PT projected on the screen SC (obtains the information of the pattern image light GL). Further, the imaging section 50 has the configuration described with reference to
[0051] As described hereinabove, the projection main unit 100p associates the image part PI representing the image projection positions out of the pixel image PX2 as the information of the pattern image PT obtained by the imaging section 50 and the pixel image PX1 representing the positions of the pixels of the light modulation with each other to thereby achieve the calibration. Thus, it becomes possible to identify the pointing position based on the detected light DL detected by the imaging section 50, and thus, the interactive image projection becomes possible.
[0052] Hereinafter, the operation in the image projection (in the actual use) of the projector system 500 will be described in detail with reference to
[0053] Firstly, as shown in
[0054] Further, as shown in
[0055] The situation of the light reception in the imaging section 50 in the calibration and the image projection (the actual use) in the interactive situation will hereinafter be described with reference to
[0056] Firstly, as shown in
[0057] In contrast, in the actual use, the component in the infrared wavelength band I1 from the pen 70 is used (emitted) as the infrared light IL (the detected light DL). On this occasion, the aperture ST is opened (S2). In other words, the f-number is small, and the light intensity of the light which can pass through the aperture ST is high. Therefore, even the faint infrared light IL can reliably be detected as the detected light DL.
[0058] Here, as shown in
[0059] Compared to the case described hereinabove, as in the comparative example shown as the light beam chart B in
[0060] It should be noted that in the case of the configuration of the present embodiment, it results that the taken image of the imaging section 50 in the calibration of projecting the pattern image light GL becomes dark. However, in the calibration, there is no need to follow the content of the projection image varying one after another as in the case of the image projection in the interactive situation, and it is conceivable that it is possible to ensure the sufficient exposure time and so on even in the imaging in the state with the large f-number (the dark state), and it is hard to cause a problem.
[0061] As described hereinabove, in the imaging device (the imaging section) 50 according to the present embodiment and the projector system 500 incorporating the imaging device (the imaging section) 50, since the optical filters F11, F12 constituting the optical filter device 60 are inserted and extracted in the imaging section 50, it is possible to prevent entering of the light in the wavelength band other than that of the detected light DL while capturing the detected light DL with the necessary light intensity, for example, and ensure the writing operation on the projection screen, namely the operation of the interactive projector. On this occasion, by the aperture ST varying the f-number in accordance with the insertion and the extraction of the optical filters F11, F12, it is possible to suppress the axial chromatic aberration caused by the difference in wavelength band between the pattern image light GL as the image light and the detected light DL to achieve an improvement in accuracy of the alignment (the calibration).
Second Embodiment
[0062] An imaging device and a projector system incorporating the imaging device according to a second embodiment of the invention will hereinafter be described with reference to
[0063]
Other Issues
[0064] The invention is not limited to the embodiments described above, but can be put into practice in various forms within the scope or the spirit of the invention.
[0065] For example, it is also possible to separately dispose a device (a device for scanning the surface with the infrared light so as to irradiate the surface in a curtain manner) for irradiating the surface of the screen and the periphery of the screen with the infrared beam so as to cover the surface of the screen and the periphery of the screen as shown in JP-A-2015-159524, and use a method of capturing the reflected light as the infrared light reflected by an object appearing in the periphery of the screen together with the method of the invention. It is conceivable to detect the tip or the like by analyzing the image area of the imaging device corresponding to the position captured by detecting the reflected light (the infrared light), for example.
[0066] Further, it is also possible to assume that the projector system is constituted by two (or more) imaging sections 50a, 50b as in a modified example of a schematic configuration of the projector system shown in
[0067] Further, although in the above description, it is assumed that a variety of types of processes are performed by the projector control section CT or the PC connectable to the projector 100, regarding the processes to be assumed, a variety of configurations are possible, and it is conceivable to, for example, make the PC side perform the process of identifying the image projection position based on the information of the projection light PL obtained by the imaging section 50, and the position based on the detected light DL detected by the imaging section 50. In other words, it is also possible to assume that the image projection position and the light emitting position in the projector control section CT are identified, and a part or the whole of the control of the image projection based on the positional relationship thus identified is performed by externally connected equipment such as the PC (the PC or the like constitutes the projector control section). Further, in contrast, it is also possible to adopt a configuration (a PC-less configuration) of making the projector control section CT assume all of the processes without connecting the PC and so on.
[0068] Further, although in the above description, it is assumed that the pattern image PT is projected with the pattern image light GL formed of the light in the green wavelength band, the light used for the projection of the pattern image PT is not limited to the light in the green wavelength band, but it is also possible to use the light in other wavelength bands. In this case, it is conceivable to variously change the characteristic of the second optical filter F12 in the optical filter device 60 accordingly.
[0069] Further, in the optical filter device 60, regarding the second optical filter F12, it is possible to use the glass substrate alone without providing the film having the transmissive property, and can also be substituted by a member for transmitting light throughout at least the entire visible wavelength band. Further, in the case in which the defocusing on the optical axis of the imaging element 40 can sufficiently be reduced despite the difference between presence and absence of the glass substrate, for example, it is conceivable to adopt a configuration in which the first optical filter F11, which can be inserted and extracted, is provided alone without providing the second optical filter F12, and nothing is disposed at the installation position of the filter in the period (the calibration period) in which the image projection is not performed.
[0070] Further, although in the above description, the adjustment of the intensity of the light to be transmitted is achieved by adopting the variable aperture as the aperture ST in, for example, the first embodiment, it is also conceivable to adopt a configuration in which, for example, the aperture ST can be replaced.
[0071] Further, it is also possible to constitute the imaging element 40 as the light receiving element by an element capable of receiving only the light in the green wavelength band corresponding to, for example, the pattern image light GL, and an element capable of receiving only the light in the infrared wavelength band corresponding only to the infrared light IL (the detected light DL).
[0072] Further, although in the above description, the illustration and the detailed description of the light source, the light modulation device, the projection optical system and so on constituting the projection main unit 100p are omitted, a variety of configurations can be applied. For example, regarding the light source and the light modulation device, an LED light source and a laser source can be used as the light source besides a high-pressure mercury lamp or the like, further an organic EL (O-LED) can also be applied, and in particular, in the case of applying the organic EL element as the light source, it is possible to configure the device as a video device also having the role of the light modulation. Further, regarding the light modulation device, there are conceivable a variety of configurations such as the configuration of the light modulation device formed of a reflective liquid crystal panel, a digital micromirror device, or the like besides the transmissive liquid crystal panel.
[0073] The entire disclosure of Japanese Patent Application No. 2016-190770, filed Sep. 29, 2016 is expressly incorporated by reference herein.