CAPTURING AND USING FACIAL METRICS FOR MASK CUSTOMIZATION

Abstract

An apparatus for use with an electronic device in capturing facial metrics of a user of the electronic device, wherein the electronic device has a front facing camera facing the user and a rear facing camera facing away from the user. The apparatus includes a frame structured to be coupled to the electronic device and a number of reflective surfaces mounted to the frame. The number of reflective surfaces are positioned and structured such that the front facing camera may capture a first image of the user and the rear facing camera may capture a second image of the user simultaneously with the first image.

Claims

1. An apparatus for use with an electronic device in capturing facial metrics of a user of the electronic device, the electronic device having a front facing camera facing the user and a rear facing camera facing away from the user, the apparatus comprising: a frame structured to be coupled to the electronic device; and a number of reflective surfaces mounted to the frame, wherein the number of reflective surfaces are positioned and structured such that the front facing camera may capture a first image of the user and the rear facing camera may capture a second image of the user simultaneously with the first image.

2. The apparatus of claim 1, wherein the number of reflective surfaces comprises a number of mirrors mounted to the frame.

3. The apparatus of claim 1, wherein the frame comprises a securement mechanism structured to selectively couple the frame to the electronic device.

4. The apparatus of claim 1, wherein the frame is structured to generally encompass a majority of the electronic device.

5. The apparatus of claim 1, wherein the number of reflective surfaces comprises: a first reflective surface mounted to the frame such that the first reflective surface is structured to be disposed at a first angle () with regard to the rear facing camera when the apparatus is positioned on the electronic device; and a second reflective surface mounted to the frame at a second angle perpendicular to the first angle.

6. The apparatus of claim 5, wherein the first reflective surface is a portion of a first mirror mounted to the frame and wherein the second reflective surface is a portion of a second mirror mounted to the frame.

7. A system for capturing facial metrics of a user, the system comprising: an electronic device having a front facing camera facing the user and a rear facing camera facing away from the user; an apparatus comprising: a frame coupled to the electronic device; and a number of reflective surfaces mounted to the frame, wherein the number of reflective surfaces are positioned and structured such that the front facing camera may capture a first image of the user and the rear facing camera may capture a second image of the user simultaneously with the first image.

8. The system of claim 7, wherein the electronic device comprises a smartphone or tablet.

9. The system of claim 7, wherein the number of reflective surfaces comprises a number of mirrors mounted to the frame.

10. The system of claim 7, wherein the frame comprises a securement mechanism and wherein the frame is selectively coupled to the electronic device by the securement mechanism.

11. The system of claim 7, wherein the frame generally encompasses a majority of the electronic device.

12. The system of claim 7, wherein the number of reflective surfaces comprises: a first reflective surface mounted to the frame such that the first reflective surface is structured to be disposed at a first angle () with regard to the rear facing camera when the apparatus is positioned on the electronic device; and a second reflective surface mounted to the frame at a second angle perpendicular to the first angle.

13. The system of claim 12, wherein the first reflective surface is a portion of a first mirror mounted to the frame and wherein the second reflective surface is a portion of a second mirror mounted to the frame.

14. A method of determining facial metrics of a user of an electronic device having a front facing camera facing the user and a rear facing camera facing away from the user, the method comprising: enabling both of the front facing camera and the rear facing camera to capture images at or near the same time; capturing a first image of the user using one of the front facing camera or the rear facing camera; capturing a second image of the user using the other of the front facing camera or the rear facing camera without moving the electronic device with respect to the user; and determining facial metrics of the user by analyzing the first image and the second image.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0024] FIGS. 1A and 1B, respectively, are isometric front and rear views of an electronic device in the form of a smartphone in accordance with one example embodiment of the present invention;

[0025] FIGS. 2A and 2B, respectively, are isometric front and rear views of a system for use in determining facial metrics of a user which includes the electronic device of FIGS. 1A and 1B shown with an apparatus for use in determining facial metrics of a user of the electronic device in accordance with one example embodiment of the present invention coupled to the electronic device;

[0026] FIG. 3 is a sectional view of the apparatus of FIGS. 2A and 2B taken along line 3-3 of FIGS. 2A and 2B; and

[0027] FIGS. 4A and 4B, respectively, are isometric front and rear views of a another system for use in determining facial metrics of a user which includes the electronic device of FIGS. 1A and 1B shown with an apparatus for use in determining facial metrics of a user of the electronic device in accordance with another example embodiment of the present invention disposed about and generally encompassing a majority of the electronic device.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

[0028] As required, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention, which may be embodied in various forms. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present invention in virtually any appropriately detailed structure.

[0029] As used herein, the singular form of a, an, and the include plural references unless the context clearly dictates otherwise. As used herein, the statement that two or more parts or components are coupled shall mean that the parts are joined or operate together either directly or indirectly, i.e., through one or more intermediate parts or components, so long as a link occurs. As used herein, directly coupled means that two elements are directly in contact with each other. As used herein, fixedly coupled or fixed means that two components are coupled so as to move as one while maintaining a constant orientation relative to each other.

[0030] As used herein, the word unitary means a component is created as a single piece or unit. That is, a component that includes pieces that are created separately and then coupled together as a unit is not a unitary component or body. As used herein, the statement that two or more parts or components engage one another shall mean that the parts exert a force against one another either directly or through one or more intermediate parts or components. As used herein, the term number shall mean one or an integer greater than one (i.e., a plurality).

[0031] Directional phrases used herein, such as, for example and without limitation, top, bottom, left, right, upper, lower, front, back, and derivatives thereof, relate to the orientation of the elements shown in the drawings and are not limiting upon the claims unless expressly recited therein.

[0032] As used herein, the term image shall refer to a representation of the form of a person and may be in the form of electronic information describing the form.

[0033] Embodiments of the present invention utilize cameras on readily available electronic devices which have both front and rear-facing cameras, such as, for example, without limitation, most cellular smartphones and electronic tablets, to capture multiple images of a person/patient that are captured generally at the same time. Such images are then employed, using known techniques, to determine facial metrics of the patient which are then employed in determining, and further identifying, a custom mask for use by the patient in receiving a pressure support therapy.

[0034] FIGS. 1A and 1B, respectively, show front and rear views of an example electronic device 10 in the form of a smartphone which may be employed with, or as an element of, example embodiments in accordance with the present invention. Electronic device 10 includes a housing 12 having various electronic components, including a suitable processing device 14 (shown schematically in hidden line in FIG. 1B) disposed therein. Electronic device 10 further includes an/input output device positioned on a front face 16 of housing 12 in the form of a touchscreen 18 for providing data to, or receiving output from, processing device 14. Further input devices, e.g., side buttons 18A and 18B, may also be provided in electrical communication with processing device 14 for providing indications to processing device for carrying out predetermined functions thereof. Electronic device 10 further includes a first image capturing device in the form of a front facing camera 20 positioned on front face 16 facing away from housing 12 in a first direction D1, and a second image capturing device in the form of a rear-facing camera 22 positioned on a rear face 24 of housing 12, opposite front face 16, facing away from housing 12 in a second direction D2 opposite first direction D1. Front and rear facing cameras 20 and 22 are electrically connected to processing device 14 such that cameras 20 and 22 are both controlled by, and communicate captured image data to, processing device 14. As will be described further below, processing device 14 is structured to selectively actuate either one, or both of cameras 20 and 22 either simultaneously or generally simultaneously (i.e., close enough in sequence so as to capture the subsequent image subject without movement by the subject between images).

[0035] Processing device 14 includes a processing portion which may be, for example, a microprocessor, a microcontroller or some other suitable processing device, and a memory portion that may be internal to the processing portion or operatively coupled to the processing portion and that provides a storage medium for data and software executable by the processing portion for controlling the operation of electronic device 10. The memory portion can be any of one or more of a variety of types of internal and/or external storage media such as, without limitation, RAM, ROM, EPROM(s), EEPROM(s), FLASH, and the like that provide a storage register, i.e., a machine readable medium, for data storage such as in the fashion of an internal storage area of a computer, and can be volatile memory or nonvolatile memory.

[0036] FIGS. 2A and 2B, respectively, are front and rear isometric views of the electronic device 10 of FIGS. 1A and 1B, shown with an apparatus 30 thus forming a system 100 for use in capturing facial metrics of a user of electronic device 10 according to one, exemplary embodiment of the present invention. Apparatus 30 includes a frame 32 structured to be coupled to electronic device 10 via any suitable coupling means (e.g., without limitation, a frictional fit, an adhesive, a spring-loaded clamping mechanism ,or any other suitable securement mechanism). As shown in the sectional view of FIG. 3, apparatus 30 includes a number (two are utilized in the example embodiment) of reflective surfaces 34A, 34B mounted to frame 32 which are positioned and structured such that rear-facing camera 22 is effectively aimed, such as shown by arrow D2 in the same direction, i.e., first direction D1, as front facing camera 20. Accordingly, apparatus 30 thus provides for front facing camera 20 to capture a first image of a user of electronic device 10 equipped with apparatus 30 while also allowing rear facing camera 22 to capture a second image of the user at or about the same time as the first image without moving the phone whatsoever. Although two reflective surfaces 34A and 34B are employed in the example embodiment illustrated, it is to be appreciated that any number of surfaces may employed without varying from the scope of the present invention.

[0037] In the example embodiment illustrated in FIG. 3, reflective surfaces 34A and 34B were portions of mirrors mounted to frame 32. In such example, reflective surface 34A was mounted to frame 32 such that reflective surface 34A is disposed at a first angle with regard to rear facing camera 22 when apparatus 30 is positioned on electronic device 10. In such example embodiment second reflective surface 34B is mounted to frame 32 at a second angle (not labeled) perpendicular to the first angle.

[0038] FIGS. 4A and 4B, respectively, are front and rear isometric views of the electronic device 10 of FIGS. 1A and 1B, shown with an apparatus 130 thus forming a system 100 for use in capturing facial metrics of a user of electronic device 10 according to one, exemplary embodiment of the present invention. Apparatus 130 includes is of similar layout as apparatus 30 previously discussed in conjunction with FIGS. 2A, 2B and 3 except apparatus 130 is secured to electronic device 10 via a coupling portion 150 which is formed similar to a protective smartphone case which generally encompass a majority of electronic device 10.

[0039] Having thus described example embodiments of apparatuses 30 and 130, and systems 100 and 100 including such apparatuses and an associated electronic device 10, use of as such systems in determining facial metrics of a user with such systems will be briefly described. As an initial step, a user of electronic device 10 would select a program which would enable both front facing camera 20 and rear facing camera 22 to capture images at or near the same time. Next, a first image of the user is captured using one of front facing camera 20 or rear facing camera 22 subsequently, or simultaneously, a second image of the user is captured using the other of front facing camera 20 or rear facing camera 22 without moving the electronic device with respect to the user. Finally, facial metrics of the user are determined by analyzing the first image and the second image. During such analysis, the first and second images may be stitched together and triangulated to construct a 3D geometry from which a custom CPAP mask for the user may be made or otherwise identified to the user. Alternatively, the 2D images could be used to create a 3-D spatial model using any number of other techniques known to one skilled in the art such as through the use of disparity maps in the epipolar plane, volumetric deep neural networks (DNN), or generative adversarial network correlations.

[0040] From the foregoing, it is to be appreciated that embodiments of the present invention provide for facial metrics of a user to be obtained through the use of a readily available electronic device such as a smartphone, tablet, or similar device without the need for an expensive 3D imaging device.

[0041] Although the invention has been described in detail for the purpose of illustration based on what is currently considered to be the most practical and preferred embodiments, it is to be understood that such detail is solely for that purpose and that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover modifications and equivalent arrangements that are within the spirit and scope of the appended claims. For example, it is to be understood that the present invention contemplates that, to the extent possible, one or more features of any embodiment can be combined with one or more features of any other embodiment. It is also to be appreciated that the overall and/or cross sectional shapes of structures described herein are provided for exemplary purposes only and that such shapes may be varied without varying from the scope of the present invention.

[0042] In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word comprising or including does not exclude the presence of elements or steps other than those listed in a claim. In a device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The word a or an preceding an element does not exclude the presence of a plurality of such elements. In any device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain elements are recited in mutually different dependent claims does not indicate that these elements cannot be used in combination.