HELMET

Abstract

The invention relates to a head mounted image capture device (1) for capturing facial motion of a user. The device (1) includes a helmet (2) with side portions (5), each for resting on the sides of a user's head. Each side portion (5) includes an arm (6) to which a respective camera (7) is mounted. Each camera (7) is positioned laterally of a user's face for capturing image data relating to a respective side of the user's face.

Claims

1. A head mounted image capture device for capturing facial motion of a user, the device comprising a helmet and a pair of opposed cameras, characterised in that each camera is positioned laterally of a user's face for capturing image data relating to a respective side of the user's face.

2. The device of claim 1 comprising a central plane segmenting the lateral sides of the device, wherein each camera is oriented such that the angle between its image plane and the central plane is less than 45 degrees.

3. The device of claim 2, wherein each camera is oriented such that the angle between its image plane and the central plane is less than 30 degrees.

4. The device of claim 3, wherein each camera is oriented such that the angle between its image plane and the central plane is less than 20 degrees.

5. The device of claim 1, wherein the or each camera is configured to be substantially aligned with the user's cheeks and/or nose.

6. The device of claim 1, comprising a memory and a processor operatively connected to the memory, wherein the processor is configured to reconstruct, in use, at least a portion of the user's face based on data acquired from both cameras using a neural network.

7. The device of claim 1, wherein the helmet comprises: a front portion for resting on the user's forehead; a back portion for resting on the back of the user's head; and at least two side portions, each for resting on the sides of a user's head.

8. The device of claim 6, wherein the helmet comprises: a front portion for resting on the user's forehead; a back portion for resting on the back of the user's head; and at least two side portions, each for resting on the sides of a user's head.

9. The device of claim 7, wherein the back portion comprises a strap or cord connected to each side portion and having an adjustable length.

10. The device of claim 7, comprising a top portion for resting on top of the user's head, wherein the top portion comprises a strap or cord connected to each side portion and having an adjustable length, each end of the strap or cord of the top portion being releasably secured to one of the side portions to enable adjustment of its length.

11. The device of claim 9, comprising a top portion for resting on top of the user's head, wherein the top portion comprises a strap or cord connected to each side portion and having an adjustable length, each end of the strap or cord of the top portion being releasably secured to one of the side portions to enable adjustment of its length.

12. The device of claim 7, wherein the front portion comprises a strap or cord connected to each side portion and having an adjustable length; each end of the strap or cord of the top portion being releasably secured to one of the side portions to enable adjustment of its length.

13. The device of claim 9, wherein the front portion comprises a strap or cord connected to each side portion and having an adjustable length; each end of the strap or cord of the top portion being releasably secured to one of the side portions to enable adjustment of its length.

14. The device of claim 11, wherein the front portion comprises a strap or cord connected to each side portion and having an adjustable length; each end of the strap or cord of the top portion being releasably secured to one of the side portions to enable adjustment of its length.

15. The device of claim 7, wherein each side portion comprises an arm to which one of the cameras is mounted.

16. The device of claim 14, wherein each side portion comprises an arm to which one of the cameras is mounted.

17. The device of claim 15, wherein each arm is rotatable relative to the side portion, each side portion and/or arm including at least one visual indicator for determining the orientation of the arm.

18. The device of claim 7, comprising an articulated structure connecting the front portion to the back portion for approximating the profile of the head of the user.

19. A computer-implemented method of reconstructing at least a portion of a user's face based on data acquired from at least one camera positioned laterally of the user's face, the method comprising reconstructing at least a front portion of the user's face using a neural network.

20. A method of assembling image data acquired from at least one camera positioned laterally of the user's face, the method comprising reconstructing at least a front portion of the user's face using a neural network.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Embodiments of the invention will now be described by way of example only with reference to the accompanying drawings in which:

[0049] FIG. 1 is a schematic view of a head mounted image capture device according to a first example;

[0050] FIG. 2 is a side view of a head mounted image capture device according to a second example;

[0051] FIG. 3 is a top view of the device of FIG. 2;

[0052] FIG. 4 is a rear view of the device of FIGS. 2 and 3;

[0053] FIG. 5 is an upper rear view of the device of FIGS. 2 to 4;

[0054] FIG. 6 is a side view similar to that of FIG. 2 with the device mounted on the head of a user.

DETAILED DESCRIPTION OF THE INVENTION

[0055] Referring now to FIG. 1, there is shown a head mounted image capture device 1 according to a first example for capturing facial motion of a user. The device 1 in this example includes a controller 10 and a helmet 2. The helmet 2 includes a front portion 3 for resting on the user's forehead, a back portion 4 for resting on the back of the user's head and a pair of side portions 5, each for resting on the sides of a user's head. Each side portion 5 includes an arm 6 to which a camera 7 is mounted.

[0056] The device 1 also includes a top portion 8 for resting on top of the user's head and neck portion 9 for resting on the back of the user's neck. Each of the front portion 3, top portion 8 and neck portion 9 are provided by straps 30, 80, 90 in this example, which are releasably connected to a respective side portion 5 at each of their ends to enable adjustment of their length in a conventional manner. Similarly, the back portion 4 in this example includes a semi-rigid plastic strap 40 with a rack and pinion mechanism 41 for adjusting its length.

[0057] Each side portion 5 includes a cushion 50, which is filled with foam in this example. Each arm 6 is pivotally adjustable relative to a respective one of the side portions 5, using an adjustment knob 60. Each arm also includes a rod 61 to which a respective camera 7 is adjustably mounted. In this example, the orientation of the camera 7 relative to the rod 61 is fixed, but it is able to slide along the length of the rod 61. However, it is envisaged that the orientation of the camera 7 may also be adjustable in other examples.

[0058] The rod 61 is releasably secured within a clamp 62, which is pivotally mounted to a respective side portion 5 by a pivotal connection 51. The clamp 62 includes a screw 63 used to releasably secure the rod 61 in any one of a plurality of positions along its length. The pivotal connection 51 allows adjustment of the orientation of the clamp 61 relative to the side portion 5, thereby enabling the cameras 7 to be moved toward or away from the user's face. However, the pivotal connection 51 has a predetermined tension to inhibit inadvertent adjustment of the orientation of the clamp 61.

[0059] As shown in FIG. 1, the cameras 7 oppose and face one another directly at a location intended to be substantially aligned with the cheeks and/or nose of a user (not shown) wearing the device 1. As such, these cameras 7 are positioned laterally of the user's face for capturing image data relating to a respective side of the user's face.

[0060] In this example, the cameras 7 are aimed directly at one another. In other words, each camera 7 is oriented such that its image plane is parallel to a central plane C segmenting the lateral sides of the device 1. However, it is envisaged that the cameras 7 may be oriented at an angle with respect to the central plane.

[0061] The controller 10 includes a memory 11 and a processor 12 operatively connected to the memory 11. Each camera 7 is connected to the controller 10 via a respective cable 70. The controller 10 is configured to receive image data from the camera 7 and to store it on the memory 11. The processor 12 is configured to reconstruct at least a portion of the user's face based on data acquired from the two cameras 7. More specifically, the processor 12 is configured to assemble or stitch together image data acquired from the two cameras 7, thereby to create a digital representation of the user's face.

[0062] Known head mounted image capture devices for capturing facial motion of a user normally use at least 3 cameras, and generally obstruct the view of the user. This invention mitigates this issue by using a pair of cameras 7 positioned laterally of the user's face, and reconstructing the user's face to generate a digital representation from only those two lateral cameras 7. The reconstruction is preferably performed using a neural network.

[0063] FIGS. 2 to 6 show a head mounted image capture device 101 according to a second example. The device 101 in this example includes a helmet 102 with a front portion 103 for resting on the user's forehead, a back portion 104 for resting on the back of the user's head and a pair of side portions 105, each for resting on the sides of a user's head. Each side portion 105 includes an arm 106 to which a camera 107 is mounted. The device 101 also includes a top portion 108 for resting on top of the user's head H and an articulated structure 109 connecting the front portion 103 to the back portion 104 for approximating the profile of the head of the user.

[0064] The front portion 103 in this example includes a semi-rigid plastic strap 130. Each end of the strap 130 is releasably secured to a respective one of the side portions 105 by a clamp 131 to enable adjustment of its length.

[0065] The back portion 104 includes a cushion support plate 140 and an adjustment mechanism 141 secured to the rear side of the cushion support plate 140. The adjustment mechanism 141 includes a locking member 142 that is step-wise adjustable toward and away from the articulated structure 109. The back portion 104 also includes an elasticated cord 143 attached at each end to a respective one of the side portions 105. The elasticated cord 143 also extends through a pair of holes in the locking member 142 to form a loop. The locking member 142 includes a pair of locking slots 144 having a necked portion for releasably retaining respective portions of the elasticated cord 143 to enable adjustment of its effective length.

[0066] Each side portion 105 includes a series of visual indicators 150, in the form of numbers in this example. Each arm 106 includes a hub 160 with a visual indicator 161, in the form of a line, that cooperates with the visual indicators 150 of the side portion 105 to which it is mounted, to provide an indication of the orientation of the arm 106. This facilitates the configuration of the helmet 102, and also enables the orientation of the arms 106 to be synchronised in a simple manner. Each side portion 105 also includes a cushion 151, which is filled with foam in this example.

[0067] Each arm 106 also includes a pair of legs 162 that diverge from one another at an oblique angle. The legs 162 have respective feet 163 that are coaxial with, but extend away from, one another. Each foot 163 includes a hole 164 extending along its length through which a rod 165 of the arm 106 extends. Each leg 162 is formed in two parts, which can be clamped or loosened by bolts 166 and together form a clamp to releasably secure the rod 165 in position.

[0068] One of the cameras 107 is mounted to the end of each rod 165 and faces inwardly, toward the other camera 107 but at an angle relative thereto. More particularly, each camera 107 is oriented such that its image plane is at an angle ß with respect to a central plane C segmenting the lateral sides of the device 101. In this example, the angle ß is approximately 15 degrees, but it is envisaged that the angle may be greater or less than this angle. For example, the angle may be 20 degrees, 30 degrees or even 45 degrees. Similarly, the angle may be 10 degrees, 5 degrees or zero degrees.

[0069] The top portion 108 includes a semi-rigid plastic strap 180 with a pair of slots 181, each of which extends from adjacent one of its ends and terminates at a central portion 182 of the strap 180. Each side of the strap 180 is releasably secured to a respective one of the side portions 105 by a threaded fastener 183 that extends through one of the slots 181 and releasably clamps the strap 180 into position to enable adjustment of its length. The top portion 108 also includes a locating slot 184 that receives and locates the articulated structure 109 relative to the top portion 108.

[0070] The articulated structure 109 includes a plurality of elements 190 pivotally connected together in series by fasteners 191, which enable the angular position of the elements 190 to be adjusted relative to one another. In this manner, the articulated structure 109 forms a kind of spine that extends along the central plane C of the helmet 102.

[0071] Each element 190 includes a short bar 192 with rounded ends, through which the fasteners 191 go, and a cushion support plate 193. A cushion 194 is provided, which extends along the articulated structure 109 from the front portion 103 to the back portion 104, for supporting the helmet 102 on the user's head. The cushion 194 is mounted at a first of its ends to the front portion 103 and at a second of its ends to the cushion support plate 140 of the back portion 104. The cushion 194 is also mounted to the cushion support plate 193 of each element 190 along its length. The cushion 194 is filled with foam in this example.

[0072] It will be appreciated by those skilled in the art that several variations to the aforementioned embodiments are envisaged without departing from the scope of the invention.