NOSE PAD EYE/GAZE TRACKING MODULE APPLICABLE TO SMART GLASSES OR HEAD WEARABLE DEVICE
20240377648 ยท 2024-11-14
Assignee
Inventors
- Johannes VOIGT (Feldkirch, AT)
- Primoz FLANDER (Wien, AT)
- Frank LINSENMAIER (Weinstadt, DE)
- Nils BERGER (Schaan, LI)
Cpc classification
G02B2027/0187
PHYSICS
G02B27/0179
PHYSICS
International classification
Abstract
The present invention relates to a nose pad eye/gaze tracking module applicable to known augmented/virtual reality glasses, to visual remote guide devices in general, constituting the nose pads part of said devices, without using any kind of connector. The invention further relates to a method for fastening the nose pad eye/gaze tracking module to said kind of device.
Claims
1-15. (canceled)
16. A nose pad eye tracking module configured to be at least one of fastened to and unfastened from a head wearable device, thus creating a gaze tracking device, the eye tracking module comprising: a first part having a first part frame having a U-shaped portion including two arms and being adaptable and compatible with a nose of a user when in use, said first part frame housing at least one left eye sensor and one right eye sensor, said eye sensors being arranged on the arms to detect a plurality of pupil position images of the user when in use; a second part having a second part frame and including a mechanical interface configured to connect the module to the head wearable device; electronic components including at least a data processing unit, a memory, and a data interface, said electronic components being configured to connect the module to a computer device and to send to said computer device eye movement information of the user wearing the smart glasses to which is fastened the nose pad eye tracking module when in use, wherein the module is a finished product being ready to be used once mechanically and electrically fastened to the head wearable device; wherein the first part comprises two arms designed as nose pads configured to be customizable on different nose shapes when the module is fastened to the head wearable device; wherein the mechanical interface is arranged on a top of the second part frame and comprises electrical and electronic interfaces connectable to corresponding downward mechanical, electrical, and electronic interfaces arrangeable on one of: a central portion of the head wearable device; and a further extension of the central portion of the head wearable device; and wherein the module is configured to be bottom-up connectable to the head wearable device.
17. The module according to claim 16, wherein the second part frame comprises an upward section shape connectable to a corresponding downward section shape of one of the central portion and the further extension of the central portion of the head wearable device.
18. The module according to claim 16, wherein the mechanical interface comprises an ending portion of a PCB.
19. The module according to claim 18, wherein the ending portion comprises two parallel elements made by insulating material forming part of the PCB and being spaced apart from one another thus forming a seat, the seat being adapted to house a corresponding ending portion of a further PCB included in the head wearable device, said two parallel elements supporting a number of conduction traces facing the seat.
20. The module according to claim 19, wherein the two parallel elements comprise a longitudinal aperture providing separation of at least two couples of conduction traces and further providing insertion of a guide arranged in a corresponding and congruent position on the corresponding ending portion of the head wearable device.
21. The module according to claim 19, wherein a longitudinal cross-section of the seat provides a snap-fit connection between the ending portion and the corresponding ending portion, said seat having a first maximum longitudinal cross-section width corresponding to a first minimum longitudinal cross-section of the ending portion and having a second minimum longitudinal cross-section width corresponding to a second maximum longitudinal cross-section width of the ending portion, when the ending portion and the corresponding ending portion are connected together.
22. The module according to claim 19, wherein the seat is bounded laterally by two other sides, each comprising a slot suitable to engage a correspondent retaining lip arrangeable on a compatible and congruent position on the opposite sides of the ending portion of the head wearable device.
23. The module according to claim 19, wherein the seat is bounded laterally by two other sides, each comprising a slot suitable to engage a corresponding retaining lip provided on a compatible and congruent position on opposite sides of the corresponding ending portion of the head wearable device, said two other sides being part of the second part frame surrounding the ending portion and bounding the two parallel elements.
24. The module according to claim 19, wherein the conduction traces are arranged on a top side of the ending portion and match correspondent conduction traces on a further top side of the ending portion of the PCB included in the head wearable device.
25. The module according to claim 24, further comprising a magnet bounding the ending portion, the magnet configured to attract a corresponding magnet arrangeable on the ending portion when in use.
26. The module according to claim 24, wherein the ending portion comprises lateral engaging notches, the ending portion being configured to engage suitable retaining lips of two lateral protruding arms of the ending portion when in use.
27. The module according to claim 16, wherein the mechanical interface comprises one of: a guide; at least two retaining lips; a longitudinal aperture dividing two conduction traces; a plurality of longitudinal apertures dividing each conduction trace from one another; two lateral protruding arms having retaining lips configured to firmly engage corresponding lateral engaging notches designed on a corresponding counterpart ending portion; and a protrusion on the second part frame configured to match a corresponding boundary seat on the corresponding counterpart ending portion.
28. The module according to claim 16, wherein the module comprises at least one field of view camera.
29. A method for fastening a nose pad gaze tracking module to a head wearable device, wherein: the nose pad gaze tracking module is configured to be fastened to and unfastened from head wearable device not provided with any nose pads, thus creating an gaze tracking device; the nose pad gaze tracking comprises a first part having a first part frame having a U-shaped portion including two arms and being adaptable and compatible with a nose bone of a user when in use, said first part frame housing at least one left eye sensor and one right eye sensor, said eye sensors being arranged on the arms to detect a plurality of pupil position images of the user when in use; said module further comprises a second part having a second part frame and including a mechanical interface configured to connect the module to the head wearable device; said module further comprising electronic components including at least a data processing unit, a memory, and a data interface, the electronic components being configured to connect the module to a computer device, and the electronic components being configured to send to said computer device eye movement information of the user wearing the head wearable device to which is fastened the nose pad gaze tracking module; the module is configured to be used when mechanically fastened to the head wearable device, and the first part comprises two arms designed as nose pads configured to be customizable on different nose shapes when the module is fastened to the head wearable device; and the mechanical interface is arranged on a top of second part frame and comprises specific electrical and electronic interfaces connectable to corresponding downward mechanical, electrical, and electronic interfaces arrangeable on one of a central portion of the head wearable device and a further extension of the central portion of the head wearable device, thus making the module configured to be bottom-up connectable to the head wearable device; the method comprising: providing said nose pad gaze tracking module; providing the head wearable device; and bottom-up fastening and connecting the nose pad gaze tracking module to the head wearable device at the central portion of the head wearable device to form a single unitary structure.
30. A gaze tracking device comprising: a head wearable device; and a nose pad gaze tracking module; wherein the nose pad gaze tracking module is configured to be fastened to and unfastened from the head wearable device not having any nose pads, thus creating a gaze tracking device; wherein said eye tracking module comprises a first part having a first part frame having a U-shaped portion including two arms, being adaptable and compatible with a nose bone of a user when in use, said first part frame housing at least one left eye sensor and one right eye sensor, said eye sensors being arranged on the arms to detect a plurality of pupil position images of the user when in use; wherein said module further comprises a second part having a second part frame and including a mechanical interface configured to connect the module to the head wearable device, said gaze tracking module further comprising electronic components including at least a data processing unit, a memory, and a data interface, said electronic components configured to connect the module to a computer device, and to send to said computer device eye movement information of the user wearing the head wearable device to which is fastened the nose pad gaze tracking module; wherein the module is configured to be used when mechanically fastened to the head wearable device, and the first part comprises two arms designed as nose pads configured to be customizable on different nose shapes when the module is fastened to the head wearable device; and wherein the mechanical interface is arranged on a top of the second part frame and comprises electrical and electronic interfaces connectable to corresponding downward mechanical, electrical, and electronic interfaces arrangeable on one of a central portion of the head wearable device and a further extension of the central portion, thus making the module configured to be bottom-up connectable to the head wearable device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0024] The structural and functional features of the present invention and its advantages with respect to the known prior art, will become even clearer from the underlying claims, and in particular from an examination of the following description, made with reference to the attached figures which show a preferred but not limited schematic embodiment of the invented method, system, device, in which:
[0025]
[0026]
[0027]
DETAILED DESCRIPTION
[0028] In general, this disclosure describes a nose pad eye/gaze tracking module 1, a method for fastening/unfastening the module to/from different kinds of smart eyeglasses/head wearable device 8, and an eye/gaze tracking device comprising smart eyeglasses/head wearable device 8 provided with the nose pad eye tracking module 1.
[0029] The specifications right or left or high or low or front or back relate to the intended manner of wearing eyeglasses and the eye tracking module by a human being.
[0030] Regarding smart eyeglasses/head wearable device 8 in general, it shall be highlighted that they have at least an upper part of their frame having the purpose to hold the temples and if necessary retaining the lenses, which could be sun lenses or specific filtering/protective lenses or lenses in general. Furthermore, they may have at least a portion, so-called nose bridge, acting as a spacer between the two lenses, able to create space for the user's nose.
[0031] The nose bridge is a portion necessary in all eyeglasses, but in some cases, this portion is not clearly detectable, for example in head wearable device or head-mounted headset. In some cases, like smart glasses provided with extended technology (see
[0032] The nose pad eye tracking module 1, according to the present invention, comprises a first part 10, comprising a first part frame 11, having, in turn, a U-shaped portion 110. In said U-shaped portion 110 are preferably located a right eye acquisition sensor 4 and a left eye acquisition sensor 3, which have the purpose of taking images of each user's eye, in order for the position of the pupil in the space to be detected (see
[0033] The left and right eye sensors 3, and 4 may be preferably eye cameras but may be different kinds of technologies like lasers able to scan the user's eyes to detect the position of pupils or microelectromechanical systems like for instance MEMS-based scanning elements.
[0034] The module furthermore comprises a second part 12, having a second part frame 13, housingin a preferred embodimenta mechanical interface 7 (see
[0035] Said mechanical interface 7 in all the embodiments described in the present specification is provided also with an electrical/electronic interface, in order to electrically/electronically connect the nose pad eye/gaze tracking module 1 with the smart eyeglasses/head wearable device 8.
[0036] In a preferred embodiment the mechanical interface 7 on top of the second part frame 13 exploits the action of the laminated insulating material forming part of a PCB (see
[0037] It's important to highlight that the bottom-up connection between the module 1 and the smart eyeglasses/head wearable device 8 at the central portion 88, implies a very reduced space occupied by the module 1, because the available space is very small between the smart eyeglasses/head wearable device 8 and head of the human being, when between the smart eyeglasses/head wearable device 8 and the nose pad eye/gaze tracking module 1 are connected together and in use.
[0038] The U-shaped portion 110 comprises two arms 100, and is particularly designed for being used as nose pads, thus being configured to make the smart eyeglasses/head wearable device 8 easily customizable on different nose shapes when the module is fastened to said smart eyeglasses/head wearable device. The nose pad eye/gaze tracking module 1 of the present invention is used, replacing, the nose pads of the smart eyeglasses/head wearable device 8, without interfering with the user's nose.
[0039] The U-shaped part 110 may be made of soft materials, and in particular, the arms 100 may be made with flexible material, in order to further better adapt the arm 100 shapes to the nose of the user and to cooperate fastening the module on the smart eyeglasses/head wearable device 8 as described hereinafter.
[0040] As mentioned before, in a preferred solution, the right eye acquisition sensor 4 is arranged in the right arm 100, and the left eye acquisition sensor 3 is arranged in the left arm 100 of the U-shaped portion 110. When the two eye acquisition sensors 3, and 4 are designed as digital cameras they may have an objective lens. The two eye acquisition cameras 3, and 4 are each configured to prepare an eye video including individual eye images or individual images of the eyes of the human wearing the eye tracking module. Said eye acquisition cameras 3, 4 must be directed towards the position of the eyeball of the wearer.
[0041] In a possible configuration (see
[0042] At least one field of view camera (not present in the drawings) is arranged on and/or in the module 1, in each embodiment disclosed in the present specification. The field of view camera records a field of view video, including individual and successive field of view images. In that case, the recordings of the two eye acquisition sensors 3, 4 and the at least one field of view camera can thus be entered in correlation in the field of view video of the respective gaze point of the user (when the module is fastened to the smart eyeglasses/head wearable device.
[0043] More than one field of view cameras may also be arranged in and/or the nose pad eye tracking module 1, in each embodiment disclosed in the present specification.
[0044] Furthermore, the module has electronic components like a data processing unit (like a microprocessor), a connected storage medium, and a data interface, the data processing unit being connected to the right eye acquisition sensor 4 and the left eye acquisition sensor 3. The module furthermore may have an energy accumulator for the energy supply of the eye sensors 3, 4, and also the data processing unit, memory, and the data interface. The module furthermore may have an external power supply via cable, or an internal battery and a correspondent power interface, not shown in the schematic drawings.
[0045] In each embodiment disclosed in the present specification the electroniccomponents, including a data processing unit (like a microprocessor) and a connected storage medium, and at least a data processing unit, a memory, a data interface, a power unit/interface, may be arranged in the first part 10, or in the second part 12 or some of them in the first part 10 and other ones in the second part 12.
[0046] Furthermore because of these electronic components are enclosed inside the relevant module frames and the module frame shapes are sealed and have no sharp edges, the module disclosed in the present invention is also easy to be cleaned. Furthermore, the frame of each part where these electronic parts are arranged, encloses them, conferring them protection against accidental hits, dust, or in general external agents which might compromise said part operations (the drawings provided are schematic and do not have limiting purposes).
[0047] In each embodiment disclosed in the present specification a data processing unit may be preferably designed as a combination of a microcontroller or processor together with memory. The data processing unit is connected in a signal-conduction manner to a data interface. The data interface and the data processing unit may be formed jointly in hardware, for example, by an ASIC or an FPGA. The interface is preferably designed as a wireless interface, for example, according to the Bluetooth standard or IEEE 802.x, or as a wired interface. Additional sensors might be inserted in the eye tracking module and connected to the data processing unit.
[0048] In each embodiment disclosed in the present specification the data processing unit, the memory and the data interface may be connected at least indirectly to an energy accumulator by circuitry, and are connected in a signal-conduction manner to the field of view camera (when present), the right eye acquisition sensor 4, and the left eye acquisition sensor 3.
[0049] It shall be highlighted that in each embodiment disclosed in the present specification, the entire recording, initial analysis, and storage of the recorded videos may thus be performed in or by the eye tracking module itself or by a computer device connected (wireless or via cable) to the module.
[0050] Regarding the U-shaped portion 110 where are arranged at least one left eye sensor 3 and one right eye sensor 4, in each embodiment disclosed in the present specification also a left Infrared LED illuminator 30 and a right Infrared LED illuminator 40 may be arranged in said U-shaped portion 110. Said illuminators 30, 40 help to better detect pupil positions of the wearer's eyes, when in use.
[0051] In order to connect the module the nose pad eye/gaze tracking module 1 to the smart eyeglasses/head wearable device 8, is already mentioned above that the mechanical interface 7 on top of the second part frame 13, comprises the action of the laminated insulating structure forming part of a PCB (see
[0052] In a preferred embodiment an ending portion 70 of the PCB included in the nose pad eye/gaze tracking module 1 is shaped like a female connection (see
[0053] The ending portion 70 may have a rectangular cross-section, comprising two parallel elements 700, spaced apart from one another. The space between the two parallel elements forms a suitable seat 704 for a correspondent ending portion 880 (in this case a male part) of a PCB included in the smart eyeglasses/head wearable device 8. The seat 704 comprises a suitable number of conduction traces 770, corresponding to the number of conduction traces 882 of the ending portion 880. When the ending portion 880 of the smart eyeglasses/head wearable device 8 is connected stably with the ending portion 70 of the nose pad eye/gaze tracking module 1, then both devices have established electrical and electronic connections, being able to communicate with each other. The ending portion 880 may further be shaped with two parallel elements spaced apart from one another and defining a space 884, allowing the two parallel elements to get close to each other when both are inserted in the seat 704 of the ending portion 70. In this case, the two parallel elements 700 are less forced to bend outwardly when the two devices are connected because that movement is compensated by the opposite movement of the two parallel elements of the ending portion 880 (see
[0054] In all the embodiments described in the present invention, the ending portion 70 of the PCB of the nose pad eye/gaze tracking module 1 is designed to firmly and stably hold in place the correspondent ending portion 80, maintaining the continuity of the signal between the two devices and preventing any loss of communication between them. It shall be highlighted furthermore that, being established a bottom-up connection between the two devices and acting the nose pad eye/gaze tracking module 1 as the nose pad of the smart eyeglasses/head wearable device 8 when both are connected together. The connection between the two devices is forced to be maintained stable due to the weight of the smart eyeglasses/head wearable device 8 itself. This particular aspect is peculiar to all the embodiments of the present invention.
[0055] In a further preferred embodiment the ending portion 70 of the PCB included in the nose pad eye/gaze tracking module 1 is shaped in the same way as the already mentioned embodiment like a female connection (see
[0056] A further embodiment not described in the figures may have a plurality of longitudinal apertures aiming to physically separate each conductive trace between one another either on the ending portion 70 and on the ending portion 80, in order to allow a certain flexibility in tolerances during the connection between the two devices.
[0057] In a further preferred embodiment (see
[0058] This embodiment may also be configured with the second part frame 13 acting as the counterpart of the snap-fit profile, instead of the PCB (see
[0059] The embodiment of
[0060] In a further preferred embodiment (see
[0061] In this case, the mechanical retaining force needed when the two devices are connected together is provided by a magnet 5, designed to bounder the ending portion 70, being able to attract a correspondent magnet 890 arranged on the ending portion 80, in order to hold in position the nose pad eye/gaze tracking module 1 on the smart eyeglasses/head wearable device 8 when in use. The use of a magnet 5 surrounding the ending portion 70 to improve the stability of the connection of the two devices, may be arranged in all the embodiments described in the present specification.
[0062] The last embodiment described may be further improved, arranging the second part frame 13 further totally bounding the magnet 5 and further creating a boundary seat 705 around the very ending portion 70, said boundary seat 705 configured to match a congruent protrusion 885 of the ending portion 80, thus offering a guide for an easy connection of the two devices together (see
[0063] An improvement of the embodiment shown in
[0064] Another improvement of the embodiment shown in
[0065] It must be highlighted that in all the embodiments described so far, the ending portion 70 of the PCB of the nose pad eye/gaze tracking module 1 is designed as the female part of the connection between the two devices and the ending portion 880 of the PCB of the smart eyeglasses/head wearable device 8 as the male part, but the two ending parts 70, 880 may be exchanged in the opposite way in order to better meet specific technical requirements of the smart eyeglasses/head wearable device 8 manufacturers. Therefore the ending portion 70 may be designed as a male part of the connection as already described in each embodiment and the ending portion 880 as the correspondent female part.
[0066] In the embodiment shown in
[0067] Finally, it may be provided an embodiment where the ending portion 70 has physically separated support of conductive traces, with they arranged on a lateral side of their respective support. In this case, expecting the same configuration on the correspondent counterpart ending portion is obtained an embodiment able to provide a rotating mounting connection between the two devices.
[0068] As already described, when the module comprises a field of view camera, it is able to detect a plurality of images, such as video images, of the field of view of the wearer the nose pad eye tracking module, once fastened when in use. Said field of view camera may be arranged in a part of the frame of the module 1 facing outwardly the smart eyeglasses/head wearable device 8 when in use, or may be arranged in a portion of the frame, which may be configured to be higher than the upper portion of the frame of the smart eyeglasses/head wearable device 8, when the eye tracking module is fastened to the smart eyeglasses/head wearable device 8.
[0069] It shall be highlighted that in each embodiment disclosed in the present invention the two arms 100 are designed in such a way to be used as nose pads configured to make the smart eyeglasses/head wearable device 8 customizable on different nose shapes when the module is fastened to said smart eyeglasses/head wearable device 8.
[0070] The nose pad eye/gaze tracking module 1 disclosed in the present invention, due to its dimension reduced size and its described configuration, results in a very light weighted module, not affecting the user's comfort, when he is wearing his/her smart eyeglasses/head wearable device 8 to which is fastened the module.
[0071] The present invention further relates to a method for fastening the nose pad eye tracking module 1 to a smart eyeglasses/head wearable device 8, wherein the eyeglasses 8 and module 1 have structures already described in this specification, according to all the embodiments described. The method comprises the following steps: [0072] bottom-up connecting the nosepad eye/gaze tracking module 1 to the smart eyeglasses/head wearable device 8 at the central portion 88 of the smart eyeglasses/head wearable device 8.
[0073] The present invention further relates to an eye/gaze tracking device comprising a pair of smart eyeglasses/head wearable device 8 and the nose pad eye tracking module 1, wherein the smart eyeglasses/head wearable device 8 and the nose pad eye/gaze tracking module 1 have structures already described in this specification, according to all the embodiments described.