APPARATUS AND METHOD FOR CONTACTLESS INPUT

20180011605 · 2018-01-11

Assignee

Inventors

Cpc classification

International classification

Abstract

By using a display 11 having a number of light-emitting blocks 29 in each of which one of light sensors 34 are incorporated and an optical image formation means 13 having first minute reflective surfaces 20 and second minute reflective surfaces 21 crossed in planar view, the first minute reflective surfaces 20 arranged standing on a same plane, the second minute reflective surfaces 21 arranged standing on a same plane, a first real image 12 is formed on the other side of the optical image formation means 13 from an image 11a on the display 11, a second real image 45a is formed on one side of the optical imaging means 13 from an image of an indicating means 45 having come into contact with the first real image 12, and a position of the second real image 45a is detected by the light sensors 34 of the display 11.

Claims

1-10. (canceled)

11. An apparatus for contactless input, comprising: a display having a number of light-emitting blocks, part or all of the light-emitting blocks each having one of light sensors incorporated; and an optical image formation means having a number of first minute reflective surfaces and a number of second minute reflective surfaces arranged crossed in planar view, the first minute reflective surfaces arranged standing on a same plane, the second minute reflective surfaces arranged standing on a same plane, first reflected light from each of the first minute reflective surfaces being reflected on the corresponding second minute reflective surfaces to form second reflected light, wherein a first real image is formed from an image on the display by means of the optical image formation means, the display being arranged on one side of the optical image formation means, the first real image being formed on the other side of the optical image formation means; a second real image is formed on the display on one side of the optical image formation means, from an image of an indicating means having come into contact with the first real image; and a position of the second real image is detected by the light sensors of the display.

12. The apparatus for contactless input according to claim 11, wherein the light sensors are infrared sensors, and each of the light-emitting blocks has one of infrared-light emitting portions and one of the infrared sensors aside from one of visible-light emitting portions.

13. The apparatus for contactless input according to claim 11, wherein the light sensors are infrared sensors, each of the light-emitting blocks has one of the infrared sensors besides the visible-light emitting portions, an infrared-light emitting means irradiating the indicating means having come into contact with the first real image from the side of the optical image formation means is provided separately from the display, and the position of the second real image is detected by the infrared sensors.

14. The apparatus for contactless input according to claim 12, wherein each of the visible-light emitting portions has an R light-emitting means, a G light-emitting means and a B light-emitting means.

15. The apparatus for contactless input according to claim 13, wherein each of the visible-light emitting portions has an R light-emitting means, a G light-emitting means and a B light-emitting means.

16. The apparatus for contactless input according to claim 11, wherein the display is a liquid-crystal type.

17. The apparatus for contactless input according to claim 12, wherein the display is a liquid-crystal type.

18. The apparatus for contactless input according to claim 11, wherein the display is a light-emitting diode type.

19. A method for contactless input, using a display having a number of light-emitting blocks, part or all of the light-emitting blocks each having one of light sensors incorporated, and an optical image formation means having first minute reflective surfaces and second minute reflective surfaces arranged crossed in planar view, the first minute reflective surfaces arranged in a state of standing numerously on a same plane, the second minute reflective surfaces arranged in a state of standing numerously on a same plane, first reflected light from each of the first minute reflective surfaces being reflected on each of the corresponding second minute reflective surfaces to form second reflected light, the method for contactless input, comprising steps of: forming a first real image from an image on the display arranged on one side of the optical image formation means by means of the optical image formation means, the first real image being formed on the other side of the optical image formation means; forming a second real image from an image of an indicating means having come into contact with the first real image, the second real image being formed on the display on one side of the optical image formation means; and detecting a position of the second real image formed on the display on one side of the optical image formation means by means of the light sensors of the display.

20. The method for contactless input according to claim 19, wherein the light sensors are infrared sensors, and each of the light-emitting blocks is provided with one of the infrared sensors aside from one of visible-light emitting portions each having an R light-emitting means, a G light-emitting means and a B light-emitting means.

21. The method for contactless input according to claim 20, wherein each of the light-emitting blocks is provided with one of infrared-light emitting portions.

22. The method for contactless input according to claim 19, wherein an infrared-light emitting means irradiating infrared light toward the indicating means is provided.

23. The method for contactless input according to claim 20, wherein the infrared-light emitting means irradiating infrared light toward the indicating means is provided.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0031] FIG. 1 is an explanatory diagram of an apparatus for contactless input according to a first embodiment of the present invention.

[0032] FIG. 2 is an explanatory diagram of an optical image formation means for use in the same apparatus for contactless input.

[0033] FIGS. 3(A) and 3(B) each are an explanatory diagram of a display for use in the same apparatus for contactless input.

[0034] FIG. 4 is an explanatory diagram of a display according to a variation for use in the same apparatus for contactless input.

[0035] FIGS. 5(A) and 5(B) each are an explanatory diagram of a display for use in an apparatus for contactless input according to a second embodiment of the present invention.

[0036] FIG. 6 is an explanatory diagram of an apparatus for contactless input according to a third embodiment of the present invention.

[0037] FIG. 7 is an explanatory diagram of a display for use in the same apparatus for contactless input.

DESCRIPTION OF EMBODIMENTS

[0038] Next, with reference to the accompanying drawings, descriptions will be given on embodiments of the present invention.

[0039] As illustrated in FIGS. 1 and 2, an apparatus for contactless input 10 according to a first embodiment of the present invention is provided with an optical image formation means 13 that is formed at an angle α of 30 to 60 degrees to and at a distance from a planar display 11 and that forms a real image 12 of an image on the display 11 at a symmetrical position to the image on the display 11 by receiving the light of the image on the display 11. Here, as a display, aside from a tabular one like an ordinary liquid-crystal display, a tridimensional one having a light source on the inside or one having concavities and convexities formed only on one side like a keyboard can also be used (the same applies to other embodiments as well). Also, when a transparent material such as transparent plastic, glass and the like is used as a main material of the optical image formation means 13, upon entrance of light from the air into the transparent material and exit of the light from the transparent material into the air, refraction due to the quality of the transparent material occurs. Thus, a position of the display 11 is determined in view of a refraction angle (the same applies to the following embodiments as well). The position of the display 11 with respect to the optical image formation means 13 can be determined freely to a certain extent, and focusing in the case of using a lens system is not necessary.

[0040] The optical image formation means 13 has, as illustrated in detail in FIG. 2, a tabular first light control panel 14 having a thickness t1 (e.g., 0.1 to 5 mm) and a tabular second light control panel 15 having a thickness t2 (e.g., 0.1 to 5 mm) arranged in a way that brings one side of both the first and second light control panels 14 and 15 in direct contact with or proximity to each other. A number of belt-like planar light-reflective portions 18 and a number of belt-like planar light-reflective portions 19 are formed respectively side by side inside the first light control panel 14 at a constant pitch (p1) and perpendicularly to a surface on one side of the first light control panel 14 and side by side inside the second light control panel 15 at a constant pitch (p2) and perpendicularly to a surface on one side of the second light control panel 15. Here, the planar light-reflective portions 18 of the first light control panel 14 and the planar light-reflective portions 19 of the second light control panel 15 are arranged crossed (in this embodiment, in an orthogonal state) in planar view.

[0041] Parts of the first and second light control panels 14 and 15 where the planar light-reflective portions 18 and 19 do not exist are formed of a transparent material such as glass and transparent plastic. It is preferable for these planar light-reflective portions 18 and 19 each to be formed of a metal sheet having high reflection efficiency, a vapor-deposited metal, a metal sheet having a layer for an adhesive agent at an intermediate portion, or a mirror sheet, and it is preferable for both front and back sides of these planar light-reflective portions 18 and 19 each to be a reflective surface. However, the present invention also applies to a case where only one side is a reflective surface. A method for producing the optical image formation means 13 is described in, for example, WO 2009/131128 A1, etc. Among metals having high reflection efficiency are aluminum, silver, titanium, nickel, chromium and the like.

[0042] Normally, in view of production efficiency, it is preferable for each pitch p1 between the planar light-reflective portions 18 and each pitch p2 between the planar light-reflective portions 19 to be the same, and it is preferable for the thickness t1 of the first light control panel 14 and the thickness t2 of the second like control panel 15 to be the same. Thus, the pitches between both of the planar light-reflective portions 18 and 19 will hereinafter be represented by p, and the thickness of both the first and second light control panels 14 and 15 will hereinafter be represented by t. When planarly viewing such the optical image formation means 13, as illustrated in a partially enlarged view in FIG. 1, the planar light-reflective portions 18 and the planar light-reflective portions 19 are crossed to form a number of square frames. An aspect ratio γ (height/width) of a single frame (i.e., a frame of one layer) in this case is thickness (t)/pitch (p). The aspect ratio γ is approximately 1 to 4.5, however, in order to obtain an even brighter real image 12 by making light reflect off one of the planar light-reflective portions 18 and one of the planar light reflective portions 19 a plurality of times, it is desirable for the aspect ratio γ to be 2.5 to 4.5 (in more detail, aspect ratio γ that exceeds 3 and is 4.5 or less).

[0043] Every single frame part of the first and second light control panels 14 and 15 forms each of first minute reflective surfaces 20 and second minute reflective surfaces 21 crossed in planar view. These first minute reflective surfaces 20 are arranged in a state of standing numerously on a same plane, and these second minute reflective surfaces 21 are arranged in a state of standing numerously on a same plane. Therefore, light from the display 11 arranged on one side of the optical image formation means 13 reflects off each of the first minute reflective surfaces 20 of the first light control panel 14 (first reflected light) on the front side (the side of the display 11), subsequently reflects off each of the corresponding second minute reflective surfaces 21 (second reflected light), and forms a real image 12 on the other side of the optical image formation means 13. This real image 12 becomes formed in space, and becomes the same in size as an image 11a formed on the display 11. Aside from cases where light reflects only on the inside of one frame, cases where light jumps over one frame and reflects are also included as incident light and reflected light.

[0044] Next, with reference to FIGS. 3(A), 3(B) and 4, descriptions will be given on the display 11 having been used for the apparatus for contactless input 10. This display 11 is basically a liquid-crystal type, and is provided with a backlight 24, a liquid-crystal portion 25, and a display portion 30 in which a number of cells (light-emitting blocks) 29 each having an R light-emitting means 26, a G light-emitting means 27 and a B light-emitting means 28 (hereinafter also simply referred to as the RGB light-emitting means 26 to 28), which are an example of visible-light emitting portions, are arranged in a lattice pattern. Here, the R light-emitting means 26, the G light-emitting means 27, and the B light-emitting means 28 do not emit light by themselves, refer to a portion that emits R (red) light, a portion that emits G (green) light, and a portion that emits B (blue) light, respectively, when light from the backlight 24 passes through the liquid-crystal portion 25, and can be replaced by simple color filters.

[0045] The liquid-crystal portion 25 has a well-known structure, which receives electric power by means of belt-like transparent electrodes 31 and belt-like transparent electrodes 32 arranged one above the other along X and Y directions respectively in a lattice pattern, and can be controlled between a light-shielding state and a light-transmitting state in increments of a cell (i.e., in increments of each RGB light-emitting means 26 to 28). Each of the cells 29 arranged in the display portion 30 has one of infrared-light emitting portions 33 and one of infrared sensors 34 that are examples of light sensors, aside from one of the RGB light-emitting means 26 to 28. Belt-like transparent electrodes 36 and belt-like transparent electrodes 37, both of which obtaining light signals from (in some cases, feeding power to) the infrared sensors 34, are respectively arranged above the infrared sensors 34 and below the infrared sensors 34 one above the other in a lattice pattern. In FIGS. 3(A) and 3(B), numerals 39 to 41 and 41a each represent a transparent protection plate material, a numeral 42 represents a deflection filter, and a numeral 43 represents barriers of each of the cells 29. As a light source for the backlight 24, a light source including red, blue and green visible lights and also including infrared light is used. The liquid-crystal portion 25 is controlled using the transparent electrodes 31 and 32, and the infrared sensors 34 are controlled using the transparent electrodes 36 and 37. Here, a numeral 25a represents a body of the liquid-crystal portion. The directions of the transparent electrodes 31 and 32, and 36 and 37 illustrated in FIG. 4 are illustrated differently from the directions of those illustrated in FIG. 3. Therefore, the display 11 illustrated in FIG. 4 is a variation of the display 11 illustrated in FIG. 3. Light sensors can be provided to all light-emitting blocks or can be provided to selected light-emitting blocks.

[0046] Descriptions will be given on behaviors of this display 11. When the liquid-crystal portion 25 corresponding to (i.e., to be immediately beneath) the RBG light-emitting means 26 to 28 and the infrared-light emitting portions 33 in each of the cells 29 is turned on and off through the transparent electrodes 31 and 32 with the backlight 24 in the state of being lit, visible light and infrared light become generated from one of the cells 29. This enables the formation of an image 11a on the display 11, and at the same time, infrared light of even illuminance becomes generated from the display 11.

[0047] Light rays (r1 to r4) from the image 11a displayed on the display 11, as illustrated in FIG. 1, go into the optical image formation means 13, and a real image 12 (the first real image, the same applies hereinafter) becomes formed on the other side of the optical image formation means 13. The display 11 and the real image 12 become formed bilaterally or vertically symmetrical to each other centering on the optical image formation means 13. In this case, infrared light emitted from the infrared-light emitting portions 33 of the display 11 goes into a state of a sheet, and becomes formed superimposed on the position of the real image 12. However, the formed infrared light cannot be visually confirmed.

[0048] Here, as illustrated in FIG. 1, when a finger (substitutable with a touch pen, a pointer, etc.), an example of an indicating means 45, is inserted in a predetermined position on the real image 12, reflected light of infrared light becomes produced from the indicating means 45, and from an image of the reflected infrared light, a second real image 45a becomes formed on the side of the display 11 (i.e., on the display 11) through the optical image formation means 13. As illustrated in FIG. 1, the reflected light rays of the infrared light from the indicating means 45 enter into the optical image formation means 13 through return circuits of r1′ and r3′, become refracted by and reflect off the optical image formation means 13, pass through return circuits of r2′ and r4′ and form the second real image 45a. Since the second real image 45a is an image formation by means of infrared light rays, the second real image 45a cannot be visually confirmed. In FIG. 1 (the same applies to FIG. 6), θ indicates that the first real image 12 (70) and the second real image 45a become formed symmetrical to each other with respect to the optical image formation means 13. r1 to r4 and r1′ to r4′ represent infrared light rays outside a beam of infrared light rays contributing to the image formation.

[0049] Here, an infrared image of the indicating means 45 is detected by the infrared sensors 34 arranged in the display 11, thereby detecting a part on the real image 12 pressed by the indicating means 45. When the real image 12 is, for example, a keyboard and the like, a pressed position on the keyboard can be detected. Therefore, in the case of this apparatus for contactless input 10, external infrared-light emitting portions, an external infrared camera and the like are not necessary.

[0050] Next, descriptions will be given on an apparatus for contactless input 50 according to a second embodiment of the present invention. When components are the same as those of the apparatus for contactless input 10 according to the first embodiment, the same numerals will be assigned to these components, and detailed description on them will be omitted (the same applies to the following embodiments as well).

[0051] As illustrated in FIGS. 1 and 2, this apparatus for contactless input 50 is provided with an optical image formation means 13 that is formed at an angle α of 30 to 60 degrees to and at a distance from a planar display 51 and that forms a real image 12 at a position symmetric to an image 11a displayed on the display 51 by making light from the image 11a enter into the optical image formation means 13.

[0052] A partially enlarged view of the display 51 is illustrated in FIG. 5(A), and an enlarged cross-section of the display 51 is illustrated in FIG. 5(B). The display 51 of this apparatus for contactless input 50 is a light-emitting diode type, not a liquid-crystal type. Therefore, the display 51 is provided with a number of cells (light-emitting blocks) 58 each having one of infrared-light emitting portions 55 formed of light-emitting diodes and one of infrared sensors (an example of light sensors) 56 formed of photo diodes and the like, aside from one of R light-emitting means 52, one of G light-emitting means 53, and one of B light-emitting means 54 (visible-light emitting portions) each formed of a light-emitting diode. A numeral 57 represents barriers separating each of the cells 58, and numerals 60 and 61 represent belt-like transparent electrodes feeding power to each of the light-emitting diodes of the R light-emitting means 52, the G light-emitting means 53, and the B light-emitting means 54 and receiving signals from the infrared sensors 56. The transparent electrodes 61 can be non-transparent. A numeral 63 represents a transparent protection plate material, a numeral 64 represents a protection plate material, and a numeral 65 represents a deflection filter.

[0053] An image of visible light rays containing red, green, and blue light, and infrared light can thereby be emitted from the display 51, and a real image 12 is formed from an image 11a displayed on the display 51 in space at a symmetrical position to the image 11a through the optical image formation means 13.

[0054] When touching the real image 12 with an indicating means 45, an infrared image (a second real image 45a) is formed on the surface of the display 51 by infrared light reflected through the optical image formation means 13, and a position on the real image 12 where the indicating means 45 has touched can be detected by the infrared sensors 56.

[0055] An apparatus for contactless input 67 according to a third embodiment of the present invention illustrated in FIG. 6 is provided with an optical image formation means 13 that is formed at an angle α of 30 to 60 degrees to and at a distance from a planar display 68, and that makes light from an image (an image of a keyboard, an image of a touch panel, etc.) 69 displayed on the display 68 enter and forms a real image (a first real image) 70 of the image 69 at a symmetrical position to the image 69. Here, an infrared-light emitting means 71 that irradiates the whole of the real image 70 with infrared light is provided on the other side of the optical image formation means 13. This infrared-light emitting means 71 is formed of, for example, an infrared-light emitting diode, an infrared lamp and the like, and is structured to infallibly irradiate an indicating means 45 having come into contact with the real image 70 from the side of the optical image formation means 13, and to emit reflected light toward the optical image formation means 13. The infrared-light emitting means 71 does not irradiate light (infrared light) toward the optical image formation means 13 in principle.

[0056] The display 68 has, as illustrated in FIG. 7, a number of light-emitting blocks (cells) 73, and each of the light-emitting blocks 73 is provided with one of visible-light emitting portions each having one of R light-emitting means 74, one of G light-emitting means 75 and one of B light-emitting means 76, and also provided with one of infrared sensors 77 which are an example of light sensors. When the display 68 is a liquid-crystal type, a liquid-crystal portion is provided on the bottom of the RGB light-emitting means 74 to 76, and when the display 68 is a light-emitting diode type, the RGB light-emitting means 74 to 76 each are formed of a light-emitting diode.

[0057] Therefore, in the case of the apparatus for contactless input 67 according to the third embodiment, by means of the infrared-light emitting means 71, the indicating means (a finger, a touch pen, etc.) 45 is irradiated with infrared light, and as illustrated in FIG. 6, reflected infrared light within the range of between h1 and h3 passes through the optical image formation means 13 and a second real image 45a becomes formed on the display 68. h2 and h4 represent infrared light rays passing the outside after passing through the optical image formation means 13. A position of the second real image 45a is detected by the infrared sensors 77. When an area of the second real image 45a is large, the position of the second real image 45a becomes detected by a number of the infrared sensors 77. Thus, it is preferred that image processing be performed to, for example, find a position of the center of gravity of the second real image 45a to make it an output of the display 68.

[0058] In the case of the apparatuses for contactless input 10, 50 and 67 according to the above first to third embodiments, in order to separate infrared signals via the infrared-light emitting portions 33 and 55 and via the infrared-light emitting means 71 from infrared light outside, it is preferred that the infrared signals be made to be on-off signals or waveform signals by means of modulation. In the case of the apparatus for contactless input 10, the modulation is performed by controlling the liquid crystals, in the case of the apparatus for contactless input 50, the modulation is performed by modulating the power to be fed to the infrared-light emitting portions (light-emitting diodes) 55, and in the case of the apparatus for contactless input 67, by modulating the power to be fed to the infrared-light emitting means 71.

[0059] The infrared sensors 34, 56 and 77 each select necessary signals through a filter after once changing received infrared light to electrical signals.

[0060] In the above embodiments, infrared light was used aside from visible light. However, it is also possible to structure an apparatus for contactless input without using infrared light and by using only visible light. In this case, the infrared-light emitting portions do not exist inside the cells, and the apparatus for contactless input is provided with visible light sensors instead of infrared sensors. Therefore, a light-sensitive touch panel for use in an ordinary personal computer can also be diverted to the apparatus for contactless input that uses only visible light. In this case, it is preferred that visible light be modulated, and the light sensors may be made to detect only part of light among the visible light. Infrared light also includes light rays having longer wavelengths than those of visible light rays, for example, far infrared rays and the like.

[0061] The present invention is not limited to the above embodiments, and applies to, for example, cases where the contactless input is performed by replacing parts of the structures of the apparatuses for contactless input according to the first to third embodiments with one another.

[0062] In the first to third embodiments, forms and structures of the light-emitting blocks (cells) were specifically described. However, improvement and changes of forms within the scope that does not alter the gist of the present invention are possible. Also, in the above embodiments, RGB light-emitting means are used. However, the order of the colors may be changed, and moreover, colors other than R, G, and B may be combined, and furthermore, the colors may be monochrome.

INDUSTRIAL APPLICABILITY

[0063] The apparatuses and methods for contactless input (apparatuses and methods for contactlessly detecting an indicated position on a reproduced image) according to the present invention form in the air a reproduced image of a control panel having operation buttons (e.g., a keyboard and a touch panel) when used for control panels of various types of machinery, and are capable of obtaining input signals when the operation buttons on the reproduced image are pressed. Therefore, the apparatuses and methods for contactless input according to the present invention can be used not only for control panels of factory machines, but also optimally for touch panels of mobile phones, personal computers, automobiles, vessels and the like.

REFERENCE SIGNS LIST

[0064] 10: apparatus for contactless input, 11: display, 11a: image, 12: real image (first real image), 13: optical image formation means, 14: first light control panel, 15: second light control panel, 18, 19: planar light-reflective portion, 20: first minute reflective surface, 21: second minute reflective surface, 24: backlight, 25: liquid-crystal portion, 25a: body of a liquid-crystal portion, 26: R light-emitting means, 27: G light-emitting means, 28: B light-emitting means, 29: cell, 30: display portion, 31, 32: transparent electrode, 33: infrared-light emitting portion, 34: infrared sensor, 36, 37: transparent electrode, 39, 40, 41, 41a: protection plate material, 42: deflection filter, 43: barrier, 45: indicating means, 45a: second real image, 50: apparatus for contactless input, 51: display, 52: R light-emitting means, 53: G light-emitting means, 54: B light-emitting means, 55: infrared-light emitting portion, 56: infrared sensor, 57: barrier, 58: cell, 60, 61: transparent electrode, 63: transparent protection plate material, 64: protection plate material, 65: deflection filter, 67: apparatus for contactless input, 68: display, 69: image, 70: real image (first real image), 71: infrared-light emitting means, 73: light-emitting block, 74: R light-emitting means, 75: G light-emitting means, 76: B light-emitting means, 77: infrared sensor