INPUT DISPLAY DEVICE

Abstract

An input display device includes an image display device having a function of displaying an image in the air, and a capacitive touch panel disposed on the image display device. A knob is provided as at least one transparent three-dimensional operation unit on a surface of the touch panel, and an aerial image is displayed at a position not beyond a top surface that is a touch surface of the knob.

Claims

1. An input display device comprising: an image display device configured to display an image in the air; and a capacitive touch panel disposed on the image display device, wherein the touch panel includes at least one transparent three-dimensional operation unit on a surface thereof, and the image is displayed inside the operation unit.

2. The input display device according to claim 1, wherein the operation unit includes a top surface that is a touch surface, and the image is formed at a position not beyond the top surface.

3. The input display device according to claim 1, further comprising a detector configured to detect a touch operation including proximity to the touch panel.

4. The input display device according to claim 1, wherein the operation unit is molded integrally with a cover glass of the touch panel.

5. The input display device according to claim 1, wherein the operation unit is coupled to a cover glass of the touch panel via an optical adhesive.

6. The input display device according to claim 1, wherein the image display device displays the image in the air using a retroreflective member.

7. The input display device according to claim 1, wherein the operation unit is a cylindrical or rectangular knob or button.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0014] FIG. 1A illustrates an example in which a flat touch panel is operated, FIG. 1B illustrates an example in which a touch panel of a three-dimensional UI is operated, and FIG. 1C is a schematic cross-sectional view of the three-dimensional UI;

[0015] FIGS. 2A-B are diagrams for explaining a problem of a three-dimensional operation unit (knob) of a conventional input display device;

[0016] FIG. 3 is a block diagram illustrating a configuration of an input display device according to an embodiment of the present disclosure;

[0017] FIGS. 4A-C are diagrams illustrating an example of a configuration for displaying an aerial image in an image display device according to an embodiment of the present disclosure;

[0018] FIGS. 5A-B are cross-sectional views schematically illustrating an example of a configuration of a three-dimensional knob according to an embodiment of the present disclosure;

[0019] FIGS. 6A-B are diagrams illustrating an example in which an aerial image is displayed by the input display device according to an embodiment of the present disclosure; and

[0020] FIGS. 7A-C are diagrams illustrating an example in which a position at which an aerial image is formed is adjusted according to an embodiment of the present disclosure.

DETAILED DESCRIPTION

[0021] Next, embodiments of the present disclosure will be described. An input display device according to the present disclosure provides an interface between a person and a machine. The input display device according to the present disclosure is not particularly limited, but is applied to, for example, an electronic device equipped with a touch panel display. The electronic device equipped with the touch panel display is, for example, an in-vehicle device having a navigation function, an audio visual function, a television function, and/or the like.

[0022] As the input display device according to the present disclosure, a display device (aerial display) using an aerial image forming technology is adopted to show an image as if the image exists in a hollow or interior of an uneven portion (a three-dimensional UI unit) of a touch panel. At this time, the image formation position is set to be located in the uneven portion. As a result, the uneven portion is recognized as a part of the image display device, thereby improving quality and design.

[0023] Next, embodiments of the present disclosure will be described in detail with reference to the drawings. FIG. 3 is a block diagram illustrating a configuration of an input display device according to an embodiment of the present disclosure. An input display device 100 according to the present embodiment includes an image display device 110 having a function of displaying an image in the air, a capacitive touch panel 120 mounted on the image display device 110, one or more transparent three-dimensional UI units (or operation units) 130 having three-dimensional shapes and attached to a surface of the touch panel 120, and a controller 140 controlling image display of the image display device 110, touch detection of the touch panel 120, and/or the like.

[0024] The image display device 110 has at least a function of displaying an image in the air as one of the functions, and for example, has a function of displaying an aerial image P at a position of a height D from a surface of a display, as illustrated in FIG. 4A. The image display device 110 can also have a function of displaying an image on a screen such as a flat liquid crystal display in addition to the function of displaying an aerial image.

[0025] A technique for displaying an image in the air is not particularly limited, but for example, a technique using a retroreflective member is known. The applicant of the present application discloses such a technique in, for example, JP 2022-180814 A, JP 2022-179868 A, JP 2022-177400 A, JP 2022-150245 A, and JP 2022-150214 A, all of which are herein incorporated by reference.

[0026] FIG. 4B is a schematic cross-sectional view illustrating an example of a configuration for displaying an image in the air. The image display device 110 includes a light source 200, a beam splitter 210, and a retroreflective member 220, and attached positions and angles of these members are appropriately adjusted in a housing or a casing to form an aerial image P at the position of the height D.

[0027] The light source 200 includes, for example, a liquid crystal display, an organic EL display, or the like, and outputs an image to a two-dimensional display area. The image generated by the light source 200 is an original image of the aerial image P, and the image is, for example, an operation icon or the like.

[0028] The beam splitter 210 is an optical member that splits incident light into reflected light and transmitted light, and includes, for example, a half mirror. The beam splitter 210 is disposed to be inclined with respect to a light emission direction of the light source 200, and the beam splitter 210 transmits some of light from the light source 200, and reflects the remaining light toward the retroreflective member 220.

[0029] The retroreflective member 220 is an optical member that emits light in a direction toward the side from which the light is incident, and includes a prismatic retroreflective element, such as a triangular pyramid retroreflective element or a full cube corner retroreflective element, or a bead retroreflective element. The retroreflective member 220 reflects light incident from the beam splitter 210 in a direction toward the side from which the light is incident, and causes the reflected light to move back to the beam splitter 210. The light transmitted through the beam splitter 210 is diffused after convergence to form an aerial image P. The aerial image P is formed at a position symmetrical to the light source 200 with respect to the surface of the beam splitter 210.

[0030] FIG. 4C is a schematic cross-sectional view illustrating another example of a configuration for displaying an image in the air. The image display device 110 includes a retroreflective member 240, a light guide plate 250 disposed above the retroreflective member 240, a half mirror 260 disposed above the light guide plate 250, and a light source 270, such as an LED.

[0031] Light L emitted from the light source 270 is incident from a side portion of the light guide plate 250, and uniformly irradiates the inside of the light guide plate 250. A light diffusion unit 252 for diffusing the incident light L in a vertical direction is formed at the bottom of the light guide plate 250. The light diffusion unit 252 configures an original image for generating an aerial image P.

[0032] Some of the light diffused or scattered in the vertical direction by the light diffusion unit 252 of the light guide plate 250 is transmitted through the half mirror 260, and the remaining light is reflected by the half mirror 260. The reflected light is incident on the retroreflective member 240. The light incident on the retroreflective member 240 is reflected in a direction toward the side from which the light is incident, and the light is transmitted through the half mirror 260 to form an aerial image P. The aerial image P is formed at a position symmetrical to the light diffusion unit 252 with respect to the surface of the half mirror 260.

[0033] The touch panel 120 includes, for example, a plurality of detection units (sensors) formed at positions where a plurality of X-side and Y-side electrode lines intersect. The detection unit detects a capacitance when a finger, a hand, or the like of a user approaches or contacts the touch panel 120. The touch panel 120 is mounted on the image display device 110 to provide an input interface for the user to make an input to an icon or the like displayed on the image display device 110.

[0034] The touch panel 120 further includes one or more three-dimensional operation units 130 (hereinafter, three-dimensional UI units) on the transparent panel. The three-dimensional UI unit 130 is constituted by a transparent member having an uneven shape, and the shape, size, height, and the like thereof are not particularly limited. However, the three-dimensional UI unit 130 is configured in such a manner that, when the user's hand or finger approaches or contacts a top surface or a touch surface of the three-dimensional UI unit 130, the capacitance at that position changes. The top surface of the three-dimensional UI unit 130 is not necessarily required to be flat, and may be uneven or inclined. Furthermore, the three-dimensional UI unit 130 may be entirely made of a transparent material, or may be partially hollow inside.

[0035] FIG. 3 illustrates an example in which four three-dimensional UI units 130 having a cylindrical shape and a rectangular shape are attached to a lower portion of the touch panel 120. The three-dimensional UI unit 130 has, for example, a three-dimensional shape such as a button or a knob, and the three-dimensional UI unit 130 is constituted by, for example, a clear part such as glass or plastic. For example, the three-dimensional UI unit 130 is integrally molded with a cover glass 124 on the touch sensor 122, as illustrated in FIG. 5A, or is pasted on a flat cover glass 124 with an optical adhesive (OCA/OCR or the like) 126, as illustrated in FIG. 5B.

[0036] Information on coordinates of a position at which the three-dimensional UI unit 130 is attached, height of the three-dimensional UI unit 130, and the like is registered in advance in a memory of the controller 140. For example, if the three-dimensional UI unit 130 has a cylindrical shape, coordinates of the center of the bottom surface of the three-dimensional UI unit 130 are registered as the attachment position, or if the three-dimensional UI unit 130 has a rectangular parallelepiped shape, coordinates of a position at which the diagonal lines of the rectangular bottom surface of the three-dimensional UI unit 130 intersect each other are registered as the attachment position.

[0037] Next, the controller 140 will be described in detail. The controller 140 is electrically connected to the image display device 110 and the touch panel 120 to perform display control of the image display device 110 and touch control of the touch panel 120. The controller 140 is executed by hardware and/or software, and is configured using, for example, an arithmetic processing unit, a microcontroller including a ROM/RAM, a CPU, a GPU, and/or the like.

[0038] As illustrated in FIG. 3, the controller 140 includes a drive/measurement unit 142, a touch detection unit 144, and a display control unit 146. The drive/measurement unit 142 drives a plurality of electrode lines on the X side and/or the Y side of the touch panel 120, and measures a capacitance of a detection unit (sensor) of each of the driven electrode lines. The measurement cycle is, for example, 60 frames/second.

[0039] The touch detection unit 144 detects a touch position on the touch panel 120 based on the capacitance measured by the drive/measurement unit 142. Here, the touch position includes not only a position when the user's finger contacts the touch panel 120 but also a position when the user's finger approaches the touch panel 120 at a certain distance. For example, when the user's finger contacts or approaches the flat surface of the touch panel 120, the touch detection unit 144 detects coordinates of a touch position based on a change in capacitance of a corresponding detection unit. Similarly, when the user's finger contacts or approaches the three-dimensional UI unit 130, a capacitance of a detection unit corresponding to the three-dimensional UI unit 130 changes, and the touch detection unit 144 detects a touch on the three-dimensional UI unit 130 according to the change in capacitance. When the touch position is detected by the touch detection unit 144, the controller 140 determines that there is a user input and executes processing such as image control according to the input.

[0040] The display control unit 146 controls image display of the image display device 110. For example, the display control unit 146 displays an icon representing a user's input operation as an aerial image at a position overlapping the three-dimensional UI unit 130. Furthermore, the display control unit 146 can also display an icon for user operation on a flat display screen other than the three-dimensional UI unit 130. The user visually recognizes the operation icon and performs an input by touching the three-dimensional UI unit 130 or the flat touch panel. When the user's touch operation is input, the display control unit 146 switches image display and the like.

[0041] FIG. 6 is an example in which the input display device 100 according to the present embodiment displays an aerial image. An aerial image P (an operation icon that is a musical note in the example of FIG. 6) displayed by the image display device 110 is displayed inside a cylindrical knob 130, that is, in a range not beyond a top surface 132. Preferably, the aerial image P is displayed in the vicinity of the top surface 132. As a result, a distance between the top surface 132, which is a touch surface, and the position at which the aerial image P is displayed is small, and it is possible to suppress a sensory deviation or discrepancy when the user touches the knob 130. In addition, since the aerial image P is displayed in the vicinity of the top surface 132 of the knob 130, the knob 130 is easily recognized as a part of the image display device, and the design is improved.

[0042] Here, as illustrated in FIG. 7A, if the position at which the aerial image P is formed by the image display device 110 is beyond the height H of the top surface 132 (or the thickness) of the knob 130, a sense of unity between the knob 130 and the image display device 110 cannot be sufficiently obtained.

[0043] Therefore, as illustrated in FIG. 7B, the position at which the aerial image P is formed is set in such a manner that the aerial image P is not beyond the height H of the knob 130, that is, the aerial image P is displayed in the vicinity of the top surface 132 of the knob 130. The image formation position is set by adjusting positions and angles at which optical members such as a retroreflective member and a beam splitter (half mirror) of the image display device 110 are attached. Note that an adjustment mechanism for adjusting positions and angles of these optical members can be provided in the image display device 110, and the adjustment mechanism may be driven manually or by a power source, such as a motor.

[0044] Furthermore, in another aspect, as illustrated in FIG. 7C, a knob 130A having a large height H1 may be attached so that the position at which the aerial image P is formed is not beyond the top surface 132 of the knob 130 (H1>H).

[0045] As described above, according to the present embodiment, the input display device including the three-dimensional UI is capable of reducing the foreign substance feeling of the uneven portion and improving the visibility, the quality, and the design.

[0046] Although the preferred embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the specific embodiments, and various modifications and alterations can be made within the scope of the gist of the invention set forth in the claims.