SAGGING EVALUATION METHOD, DEVICE, PROGRAM, AND SYSTEM
20230172530 · 2023-06-08
Inventors
Cpc classification
A61B5/107
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
A61B5/442
HUMAN NECESSITIES
G06V40/171
PHYSICS
International classification
A61B5/00
HUMAN NECESSITIES
Abstract
Factors that cause a sagging appearance are found, and sagging is evaluated based on the found factors. A method according to one embodiment of the present disclosure includes a step of acquiring a gravity-induced prominence amount and a gravity-induced hollowness amount that are acquired from a change between a three-dimensional shape of a three-dimensional face image of a subject in a horizontal position and a three-dimensional shape of a three-dimensional face image of the subject in a vertical position; a step of calculating an intrafacial movement induced sag amount and an anteroposterior buccal sag amount from the gravity-induced prominence amount and the gravity-induced hollowness amount; and a step of evaluating a type of sagging and a degree thereof based on the intrafacial movement induced sag amount and the anteroposterior buccal sag amount as indices.
Claims
1. A sagging evaluation method comprising: acquiring a gravity-induced prominence amount and a gravity-induced hollowness amount that are acquired from a change between a three-dimensional shape of a three-dimensional face image of a subject in a horizontal position and a three-dimensional shape of a three-dimensional face image of the subject in a vertical position; calculating at least one of an intrafacial movement induced sag amount or an anteroposterior buccal sag amount from the gravity-induced prominence amount and the gravity-induced hollowness amount; and evaluating a type of sagging and a degree thereof based on the at least one of the intrafacial movement induced sag amount or the anteroposterior buccal sag amount as indices.
2. The sagging evaluation method according to claim 1, wherein letting VC.sub.swelling be the gravity-induced prominence amount, VC.sub.shrinking be the gravity-induced hollowness amount, S.sub.f be the intrafacial movement induced sag amount, and S.sub.c be the anteroposterior buccal sag amount, the intrafacial movement induced sag amount and the anteroposterior buccal sag amount are obtained as follows:
3. The sagging evaluation method according to claim 2, further comprising acquiring a visual score from a facial image of the subject in the vertical position and calculating a sagging skin coefficient from the visual score by
4. The sagging evaluation method according to claim 2, further comprising acquiring a sagging skin coefficient based on skin viscoelasticity of the subject acquired by a viscoelasticity acquisition device and calculating a visual score from the sagging skin coefficient by
5. The sagging evaluation method according to claim 1, further comprising iteratively acquiring the three-dimensional face images of the subject in the horizontal position and the three-dimensional face images of the subject in the vertical position, wherein at least one of the gravity-induced prominence amount, the gravity-induced hollowness amount, the intrafacial movement induced sag amount, or the anteroposterior buccal sag amount is a representative value of values calculated by using the iteratively acquired three-dimensional face images.
6. The sagging evaluation method according to claim 1, further comprising iteratively acquiring the three-dimensional face images of the subject in the horizontal position and the three-dimensional face images of the subject in the vertical position, wherein the gravity-induced prominence amount and the gravity-induced hollowness amount are acquired from the change between the three-dimensional shapes of the three-dimensional face images of each of the iteratively acquired three-dimensional face images, and wherein the calculating the intrafacial movement induced sag amount includes calculating, as the intrafacial movement induced sag amount, a representative value of the intrafacial movement induced sag amounts, which are calculated from the intrafacial movement induced sag amounts and the gravity-induced prominence amounts of the iteratively acquired three-dimensional face images.
7. The sagging evaluation method according to claim 5, further comprising selecting a substance or a cosmetic treatment that increases or reduces the representative value of the values calculated by using the iteratively acquired three-dimensional face images.
8. (canceled)
9. The sagging evaluation method according to claim 5, further comprising presenting a cosmetic method that increases the representative value of the values calculated by using the iteratively acquired three-dimensional face images, the cosmetic method being presented based on the representative value of the values calculated by using the iteratively acquired three-dimensional face images.
10. A device for evaluating a type of sagging and a degree thereof, comprising: an acquisition unit configured to acquire a gravity-induced prominence amount and a gravity-induced hollowness amount that are acquired from a change between a three-dimensional shape of a three-dimensional face image of a subject in a horizontal position and a three-dimensional shape of a three-dimensional face image of the subject in a vertical position; a calculation unit configured to calculate an intrafacial movement induced sag amount and an anteroposterior buccal sag amount from the gravity-induced prominence amount and the gravity-induced hollowness amount; and an output unit configured to output the intrafacial movement induced sag amount and the anteroposterior buccal sag amount.
11. (canceled)
12. A non-transitory computer-readable storage medium storing a program configured to cause a device for evaluating a type of sagging and a degree thereof to execute processing to acquire a gravity-induced prominence amount and a gravity-induced hollowness amount that are acquired from a change between a three-dimensional shape of a three-dimensional face image of a subject in a horizontal position and a three-dimensional shape of a three-dimensional face image of the subject in a vertical position; calculate an intrafacial movement induced sag amount and an anteroposterior buccal sag amount from the gravity-induced prominence amount and the gravity-induced hollowness amount; and output the intrafacial movement induced sag amount and the anteroposterior buccal sag amount.
13. A system for evaluating a type of sagging and a degree thereof, the system comprising an image capturing terminal, an analysis terminal, and a server, wherein the image capturing terminal is configured to generate data of a three-dimensional face image of a subject in a horizontal position and a three-dimensional shape of a three-dimensional face image of the subject in a vertical position, wherein the analysis terminal is configured to calculate, from the data, a gravity-induced prominence amount and a gravity-induced hollowness amount that are acquired from a change between a three-dimensional shape of a three-dimensional face image of a subject in a horizontal position and a three-dimensional shape of a three-dimensional face image of the subject in a vertical position, and wherein the server includes an acquisition unit configured to acquire the gravity-induced prominence amount and the gravity-induced hollowness amount, a calculation unit configured to calculate an intrafacial movement induced sag amount and an anteroposterior buccal sag amount from the gravity-induced prominence amount and the gravity-induced hollowness amount, and an output unit configured to output the intrafacial movement induced sag amount and the anteroposterior buccal sag amount.
14. (canceled)
15. (canceled)
16. (canceled)
17. A method of evaluating a type of sagging and a degree thereof, comprising: acquiring a gravity-induced prominence amount that is acquired from a change between a three-dimensional shape of a three-dimensional face image of a subject in a horizontal position and a three-dimensional shape of a three-dimensional face image of the subject in a vertical position; acquiring a visual score from a facial image of the subject in the vertical position; calculating a sagging skin coefficient from the gravity-induced prominence amount and the visual score by
S.sub.ss=C.sub.s×VC.sub.swelling (2) where VC.sub.swelling is the gravity-induced prominence amount, S.sub.ss is the visual score, and C.sub.s is the sagging skin coefficient; and evaluating the type of sagging and the degree thereof based on the sagging skin coefficient as an index.
18. (canceled)
19. The sagging evaluation method according to claim 1, the method further comprising: evaluating three of a visual score on sagging of a face, the intrafacial movement induced sag amount of the face, the anteroposterior buccal sag amount of the face, or a sagging skin coefficient of the face; and evaluating, based on the three evaluations, one other of the three of the visual score on sagging of the face, the intrafacial movement induced sag amount of the face, the anteroposterior buccal sag amount of the face, or the sagging skin coefficient of the face.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0009]
[0010]
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
MODE FOR CARRYING OUT THE INVENTION
[0040] Embodiments of the present disclosure will be described hereinafter with reference to the drawings.
Description of Terms
[0041] “Three-dimensional face image” refers to an image expressing the three-dimensional shape of a face of a person who is the subject of sag evaluation.
[0042] “Horizontal position” refers to a state where the median plane of the face rests at right angles to the direction of gravity.
[0043] “Vertical position” refers a state where the median plane of the face rests parallel to the direction of gravity.
[0044] “Visual score (to be also referred to as visual evaluation or S.sub.ss)” is a quantified value representing a visual valuation of sagging. As reported in Non-Patent Document 1, a visual score is calculated based on determination by an evaluator as to which of reference photographs 1 through 5 the face of a person subject to sag evaluation is closest. For example, the visual score is calculated from an oblique side face image (an image obtained by capturing the face at an angle of 45° to the left and right from the front of the face) when the face of the person subject to the sag evaluation is in a vertical position (that is, in a state where the median plane of the face rests parallel to the direction of gravity). Note that the visual score of the face of the person subject to sag evaluation may be calculated by a trained model generated from machine learning by using the oblique side face images for which visual scores have been determined as the training data. The visual score is determined for each of the upper cheek area, the lower cheek area, and the lateral cheek area, but the visual score may also be newly generated by averaging the scores for one of these areas. S.sub.ss is acquired by averaging, in particular, the visual scores of the upper cheek area and the lower cheek area, and indicates a sagging appearance in the upper and lower cheek areas.
[0045] Factors that affect a sagging appearance (that is, the visual score) will be described hereinafter with reference to
[0046] First, the areas of the face where the volume changes when the face of the person is in the horizontal position (that is, in a state where the median plane of the face is stationary at right angles to the direction of gravity) and when the face of the person is in the vertical position (that is, a state where the median plane of the face rests parallel to the direction of gravity) will be described with reference to
[0047] <Gravity-Induced Prominence>
[0048]
[0049] <Gravity-Induced Hollowness>
[0050]
[0051]
where VC.sub.shrinking is the gravity-induced hollowness amount, VC.sub.swelling is the gravity-induced prominence amount, S.sub.f is the intrafacial movement induced sag amount, S.sub.c is the anteroposterior buccal sag amount, and θ is π/4.
[0052] The intrafacial movement induced sag and the anteroposterior buccal sag will be described in detail hereinafter with reference to
[0053]
[0054]
[0055]
[0056] <Site of Occurrence>
[0057] The intrafacial movement induced sag occurs on the entire area of the cheek. In contrast, the anteroposterior buccal sag occurs locally (around the mouth).
[0058] <Rate of Contribution to Visual Score>
[0059] Based on a correlation R between the visual score and the intrafacial movement induced sag to be described with reference to
[0060] <Correlation with Age>
[0061] Based on the relationship between age and the intrafacial movement induced sag to be described with reference to
[0062] <Change in Volume Per Visual Evaluation of 0.5 and its Meaning>
[0063] Based on the relationship between age, the visual score, and the intrafacial movement induced sag to be described with reference to
[0064] <Quality of Sagging>
[0065] The intrafacial movement induced sag is sagging that gradually advances over a long period on the entire face due to gravity. In contrast, the anteroposterior buccal sag is sagging that occurs locally (around the mouth area) regardless of age due to gravity.
[0066] Two factors (that is, the two types of sagging referred to as an “intrafacial movement induced sag” and an “anteroposterior buccal sag”) that cause a sagging appearance were found in this manner. Further, the two factors (that is, the two types of sagging referred to as the “intrafacial movement induced sag” and the “anteroposterior buccal sag”) that cause a sagging appearance can be evaluated in accordance with the change in the volume of the face of a person between when the face of the person is in the horizontal position and when the face of the person is in the vertical position.
[0067] Furthermore, a sagging skin coefficient, which is a third factor that differs from the “intrafacial movement induced sag” and the “anteroposterior buccal sag” but also contributes to a sagging appearance, will be described with reference to
[0068]
S.sub.ss=C.sub.s×VC.sub.swelling (2)
[0069] Also, from the relationship between the gravity-induced prominence amount VC.sub.swelling, the intrafacial movement induced sag amount S.sub.f, and the anteroposterior buccal sag amount S, equation (3) was found as follows.
[0070] Based on equations (2) and (3) described above, the relationship between a sagging appearance (that is, the visual score S.sub.ss), the sagging skin coefficient C.sub.s, the intrafacial movement induced sag amount S.sub.f, and the anteroposterior buccal sag amount S.sub.c can be expressed by equation (4) as follows.
[0071]
[0072] Note that
[0073]
C.sub.s=a.sub.iE.sub.i+b.sub.i(i=R0˜R9,Ue,Uv,Ur) (5)
[0074] where E is a skin viscoelasticity parameter, and a and b are fitting coefficients.
[0075] In
[0076]
C.sub.s=Σ.sub.i(a.sub.iE.sub.i)+b(i=R0˜R9,Ue,Uv,Ur) (6)
where E is a skin viscoelasticity parameter, and a and b are fitting coefficients.
[0077] In
[0078] In this manner, a sagging appearance (that is, the visual score S.sub.ss) is composed of three factors, that is, the “sagging skin coefficient C.sub.s”, the “intrafacial movement induced sag amount S.sub.f”, and the “anteroposterior buccal sag amount S.sub.c”.
[0079] The “sagging skin coefficient C.sub.s”, the “intrafacial movement induced sag amount S.sub.f”, and the “anteroposterior buccal sag amount S.sub.c” will be compared and described below with reference to
[0080]
[0081] As indicated in a graph a1 illustrated on the left side of
[0082] As indicated in a graph b1 illustrated in the middle of
[0083] As indicated in a graph c1 illustrated on the right side of
[0084] Note that the sum of the rate of contribution of the sagging skin coefficient C.sub.s, the rate of contribution of the intrafacial movement induced sag amount S.sub.f, and the rate of contribution of the anteroposterior buccal sag amount S.sub.c is 114%. This is due to multicollinearity (a strong correlation between explanatory variables) between the sagging skin coefficient C.sub.s and the intrafacial movement induced sag amount S.sub.f that arises from the strong correlation that both the sagging skin coefficient C.sub.s and the intrafacial movement induced sag amount S.sub.f have with age as illustrated in
[0085]
[0086] As indicated in a graph a2 illustrated on the left side of
[0087] As indicated in a graph b2 illustrated in the middle of
[0088] As indicated in a graph c2 illustrated on the right side of
[0089] <Overall System Configuration>
[0090]
[0091] The image capturing terminal 20 is a terminal configured to generate data of an image (three-dimensional face image) expressing the three-dimensional shape of the face of a person subject to sagging evaluation. For example, the image capturing terminal 20 is a measurement device configured to capture a 3D (three-dimensional) image. More specifically, the image capturing terminal 20 generates the three-dimensional face image data of when the face of the person subject to sagging evaluation is in the horizontal position (specifically, when the median plane of the face rests at right angles to the direction of gravity) and the three-dimensional face image data of when the face of the person subject to sagging evaluation is in the vertical position (specifically, when the median plane of the face rests parallel to the direction of gravity). The image capturing terminal 20 will be described in detail later with reference to
[0092] The analysis terminal 30 is a computer (for example, a personal computer, a tablet, a smartphone, or the like) configured to calculate the information used for sagging evaluation based on the data generated by the image capturing terminal 20. More specifically, the analysis terminal 30 calculates the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking based on the change between the three-dimensional shape of the three-dimensional face image acquired when the face of the person subject to the sagging evaluation is in the horizontal position and the three-dimensional shape of the three-dimensional face image acquired when the face of the person subject to the sagging evaluation is in the vertical position. The analysis terminal 30 will be described in detail later with reference to
[0093] The evaluation device 10 is a computer (for example, a server) configured to evaluate sagging. The evaluation device 10 calculates, for example, the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c based on the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking. The evaluation device 10 will be described in detail later with reference to
[0094] Although the evaluation device 10 and the analysis terminal 30 are described as separate computers in
[0095]
[0096] The acquisition unit 101 acquires the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking calculated by the analysis terminal 30. The acquisition unit 101 also stores the acquired gravity-induced prominence amount VC.sub.swelling and the acquired gravity-induced hollowness amount VC.sub.shrinking in a memory so as to enable them to be referred to by the calculation unit 102.
[0097] The calculation unit 102 calculates the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking. The calculation unit 102 stores the calculated intrafacial movement induced sag amount S.sub.f and the calculated anteroposterior buccal sag amount S.sub.c in a memory to enable them to be referred to by the evaluation unit 103 and the output unit 104. A method of calculating the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c will be described in detail below.
[0098] <<Calculation of Intrafacial Movement Induced Sag Amount S.sub.f and Anteroposterior Buccal Sag Amount S.sub.c>>
[0099] The calculation unit 102 calculates the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c by letting the gravity-induced hollowness amount VC.sub.shrinking be the x-axis and the gravity-induced prominence amount VC.sub.swelling be the y-axis and converting the coordinates by 45° as illustrated in equation (1) as follows.
where θ=π/4.
[0100] The evaluation unit 103 evaluates the type of sagging and the degree thereof by using the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c as indices.
[0101] The output unit 104 outputs the value of the intrafacial movement induced sag amount S.sub.f, the value of the anteroposterior buccal sag amount S.sub.c, the type of sagging, and the degree thereof. For example, the output unit 104 can be configured to transmit the value of the intrafacial movement induced sag amount S.sub.f, the value of the anteroposterior buccal sag amount S.sub.c, the type of sagging, and the degree thereof to the analysis terminal 30 or be configured to display the value of the intrafacial movement induced sag amount S.sub.f, the value of the anteroposterior buccal sag amount S.sub.c, the type of sagging, and the degree thereof on a display unit of the evaluation device 10.
[0102]
[0103] The generation unit 201 generates the three-dimensional face image data when the face of the person subject to the sagging evaluation is in the horizontal position and the three-dimensional face image data when the face of the person subject to the sagging evaluation is in the vertical position. The generation unit 201 transmits the generated data to the analysis terminal 30.
[0104]
[0105] The calculation unit 301 acquires the data generated by the image capturing terminal 20. Further, the calculation unit 301 calculates the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking based on the change between the three-dimensional shape of the three-dimensional face image of when the face of the person subject to the sagging evaluation is in the horizontal position and the three-dimensional shape of the three-dimensional face image of when the face of the person subject to the sagging evaluation is in the vertical position that were generated by the image capturing terminal 20. Further, the calculation unit 301 can transmit the calculated gravity-induced prominence amount VC.sub.swelling and the calculated gravity-induced hollowness amount VC.sub.shrinking to the evaluation device 10. The method of calculating the gravity-induced prominence amount VC.sub.swelling and the method of calculating the gravity-induced hollowness amount VC.sub.shrinking will be described in detail below.
[0106] <<Calculation of Gravity-Induced Prominence Amount VC.sub.swelling>>
[0107] The calculation unit 301 compares the three-dimensional shape in the horizontal position with the three-dimensional shape in the vertical position. The calculation unit 301 determines that, with respect to the area (the area described in
[0108] <<Calculation of Gravity-Induced Hollowness Amount VC.sub.shrinking>>
[0109] The calculation unit 301 compares the three-dimensional shape in the horizontal position with the three-dimensional shape in the vertical position. The calculation unit 301 determines that, with respect to the area (the area described in
[0110] <Method>
[0111] An evaluation method for various types of sagging will be described hereinafter with reference to
[0112]
[0113] In step 1 (S1), the image capturing terminal 20 generates the three-dimensional face image data of when the face of the person subject to sagging evaluation is in the horizontal position (that is, when the median plane of the face rests at right angles to the direction of gravity) and the three-dimensional face image data of when the face of the person subject to sagging evaluation is in the vertical position (that is, when the median plane of the face rests parallel to the direction of gravity).
[0114] In step 2 (S2), the image capturing terminal 20 transmits the data generated in S1 to the analysis terminal 30.
[0115] In step 3 (S3), the analysis terminal 30 calculates the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking based on the change between the three-dimensional shape of the three-dimensional face image in the horizontal position and the three-dimensional shape of the three-dimensional face image in the vertical position acquired in S2.
[0116] <<Calculation of Gravity-Induced Prominence Amount VC.sub.swelling>>
[0117] More specifically, the analysis terminal 30 compares the three-dimensional shape in the horizontal position with the three-dimensional shape in the vertical position. The analysis terminal 30 determines that, with respect to an area (the area described in
[0118] <<Calculation of Gravity-Induced Hollowness Amount VC.sub.shrinking>>
[0119] More specifically, the analysis terminal 30 compares the three-dimensional shape in the horizontal position with the three-dimensional shape in the vertical position. The analysis terminal 30 determines that, with respect to the area (the area described in
[0120] In step 4 (S4), the analysis terminal 30 transmits the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking calculated in S3 to the evaluation device 10.
[0121] In step 5 (S5), the evaluation device 10 calculates the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking acquired in S4. More specifically, the evaluation device 10 calculates the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking based on the coordinate conversion by equation (1) described above.
[0122] Note that the evaluation device 10 can be configured to evaluate the type of sagging and the degree thereof by using the calculated intrafacial movement induced sag amount S.sub.f and the calculated anteroposterior buccal sag amount S.sub.c as indices. For example, the evaluation device 10 can evaluate the type of sagging as follows by setting the proportion of intrafacial movement induced sag amount S.sub.f as the proportion of sagging caused by aging and setting the proportion of anteroposterior buccal sag amount S.sub.c as the proportion of sagging caused by individual differences.
[0123] TYPE (intrafacial movement induced sag, anteroposterior buccal sag)
[0124] TYPE 1 (present, absent): aging-induced sagging type
[0125] TYPE 2 (absent, present): partial sagging type
[0126] TYPE 3 (present, present): sagging face type
[0127] TYPE 4 (absent, absent): zero presence of sagging type
[0128] The intrafacial movement induced sag may also be compared with the average for the age of the subject and the result may be indicated by a degree such as high, medium, and low as illustrated below.
[0129] TYPE 1 (medium): an age-appropriate sagging type
[0130] TYPE 2 (low): a youthful appearance sagging type
[0131] TYPE 3 (high): an aging appearance sagging type
[0132] In step 6 (S6), the evaluation device 10 transmits the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c that were calculated in S5 to the analysis terminal 30. Note that the evaluation device 10 can be configured to transmit the type of sagging and the degree thereof that were evaluated in S5 to the analysis terminal 30.
[0133]
[0134] In step 11 (S11), the acquisition unit 101 of the evaluation device 10 acquires the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking. For example, the acquisition unit 101 of the evaluation device 10 acquires the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking from the analysis terminal 30.
[0135] In step 12 (S12), the calculation unit 102 of the evaluation device 10 calculates the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking acquired in S11. More specifically, the calculation unit 102 of the evaluation device 10 calculates the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking based on the coordinate conversion by equation (1) described above.
[0136] Note that the evaluation unit 103 of the evaluation device 10 can also be configured to evaluate the type of sagging and the degree thereof by using, as indices, the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c calculated by the calculation unit 102. For example, the evaluation unit 103 of the evaluation device 10 can evaluate the degree of facial sagging by setting the proportion of the intrafacial movement induced sag amount S.sub.f as the proportion of sagging caused by aging, and setting the proportion of the anteroposterior buccal sag amount S.sub.c as the proportion of sagging caused by individual differences.
[0137] In step 13 (S13), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or displays on the display unit of the evaluation device 10) the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c that were calculated in S12. Note that the output unit 104 of the evaluation device 10 can also be configured to output (for example, transmit to the analysis terminal 30 or display on the display unit of the evaluation device 10) the type of sagging and the degree thereof evaluated in S12.
[0138]
[0139] In step 101 (S101), the acquisition unit 101 of the evaluation device 10 acquires the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking For example, the acquisition unit 101 of the evaluation device 10 acquires the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking from the analysis terminal 30.
[0140] In step 102 (S102), the calculation unit 102 of the evaluation device 10 calculates the intrafacial movement induced sag amount S.sub.f from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking acquired in S101. More specifically, the calculation unit 102 of the evaluation device 10 calculates the intrafacial movement induced sag amount S.sub.f from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking based on the coordinate conversion by equation (1) described above.
[0141] In step 103 (S103), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or displays on the display unit of the evaluation device 10) the intrafacial movement induced sag amount S.sub.f calculated in S102.
[0142]
[0143] In step 111 (S111), the acquisition unit 101 of the evaluation device 10 acquires the visual score S.sub.ss, the anteroposterior buccal sag amount S.sub.c, and the sagging skin coefficient C.sub.s of the face of the person subject to the sagging evaluation.
[0144] For example, the acquisition unit 101 of the evaluation device 10 can acquire the visual score S.sub.ss calculated from a facial image acquired when the face of the person subject to sagging evaluation is in the vertical position (that is, in a state where the median plane of the face rests parallel to the direction of gravity). Note that the visual score S.sub.ss may be calculated by using a trained model generated by machine learning.
[0145] For example, the acquisition unit 101 of the evaluation device 10 can acquire the anteroposterior buccal sag amount S.sub.c calculated from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking.
[0146] For example, the acquisition unit 101 of the evaluation device 10 can acquire the sagging skin coefficient C.sub.s based on skin viscoelasticity that is acquired by a device (viscoelasticity acquisition device) for acquiring skin viscoelasticity.
[0147] In step 112 (S112), the calculation unit 102 of the evaluation device 10 calculates the intrafacial movement induced sag amount S.sub.f from the visual score S.sub.ss, the anteroposterior buccal sag amount S.sub.c, and the sagging skin coefficient C.sub.s acquired in S111. More specifically, the calculation unit 102 of the evaluation device 10 calculates the intrafacial movement induced sag amount S.sub.f from the visual score S.sub.ss, the anteroposterior buccal sag amount S.sub.c, and the sagging skin coefficient C.sub.s by equation (4) described above.
[0148] In step 113 (S113), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or displays on the display unit of the evaluation device 10) the intrafacial movement induced sag amount S.sub.f calculated in S112.
[0149]
[0150] In step 201 (S201), the acquisition unit 101 of the evaluation device 10 acquires the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking. For example, the acquisition unit 101 of the evaluation device 10 acquires the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking from the analysis terminal 30.
[0151] In step 202 (S202), the calculation unit 102 of the evaluation device 10 calculates the anteroposterior buccal sag amount S.sub.c from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking acquired in S201. More specifically, the calculation unit 102 of the evaluation device 10 calculates the anteroposterior buccal sag amount S.sub.c from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking based on the coordinate conversion by equation (1) described above.
[0152] Note that the evaluation unit 103 of the evaluation device 10 can be configured to evaluate the type of sagging and the degree thereof by using, as an index, the anteroposterior buccal sag amount S.sub.c calculated by the calculation unit 102. For example, the evaluation unit 103 of the evaluation device 10 can evaluate the degree of facial sagging based on an increase or decrease from the anteroposterior buccal sag amount S.sub.c acquired in the past.
[0153] In step 203 (S203), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or displays on the display unit of the evaluation device 10) the anteroposterior buccal sag amount S.sub.c calculated in S202. Note that the output unit 104 of the evaluation device 10 can also be configured to output (for example, transmit to the analysis terminal 30 or display on the display unit of the evaluation device 10) the type of sagging and the degree thereof evaluated in S202.
[0154]
[0155] In step 211 (S211), the acquisition unit 101 of the evaluation device 10 acquires the visual score S.sub.ss, the intrafacial movement induced sag amount S.sub.f, and the sagging skin coefficient C.sub.s of the face of the person subject to sagging evaluation.
[0156] For example, the acquisition unit 101 of the evaluation device 10 can acquire the visual score S.sub.ss calculated from a facial image acquired when the face of the person subject to sagging evaluation is in the vertical position (that is, in a state where the median plane of the face rests parallel to the direction of gravity). Note that the visual score S.sub.ss may be calculated by using a trained model generated by machine learning.
[0157] For example, the acquisition unit 101 of the evaluation device 10 can acquire the intrafacial movement induced sag amount S.sub.f calculated from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking.
[0158] For example, the acquisition unit 101 of the evaluation device 10 can acquire the sagging skin coefficient C.sub.s based on skin viscoelasticity that is acquired by a device (viscoelasticity acquisition device) for acquiring skin viscoelasticity.
[0159] In step 212 (S212), the calculation unit 102 of the evaluation device 10 calculates the anteroposterior buccal sag amount S.sub.c from the visual score S.sub.ss, the intrafacial movement induced sag amount S.sub.f, and the sagging skin coefficient C.sub.s acquired in S211. More specifically, the calculation unit 102 of the evaluation device 10 calculates the anteroposterior buccal sag amount S.sub.c from the visual score S.sub.ss, the intrafacial movement induced sag amount S.sub.f, and the sagging skin coefficient C.sub.s by equation (4) described above.
[0160] Note that the evaluation unit 103 of the evaluation device 10 can be configured to evaluate the type of sagging and the degree thereof by using, as an index, the anteroposterior buccal sag amount S.sub.c calculated by the calculation unit 102. For example, the evaluation unit 103 of the evaluation device 10 can evaluate the degree of facial sagging based on an increase or a decrease from the anteroposterior buccal sag amount S.sub.c acquired in the past.
[0161] In step 213 (S213), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or displays on the display unit of the evaluation device 10) the anteroposterior buccal sag amount S.sub.c calculated in S212. Note that the output unit 104 of the evaluation device 10 can also be configured to output (for example, transmit to the analysis terminal 30 or display on the display unit of the evaluation device 10) the type of sagging and it degree thereof evaluated in S212.
[0162]
[0163] In step 301 (S301), the acquisition unit 101 of the evaluation device 10 acquires the intrafacial movement induced sag amount S.sub.f. For example, the acquisition unit 101 of the evaluation device 10 can acquire the intrafacial movement induced sag amount S.sub.f calculated from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking.
[0164] In step 302 (S302), the acquisition unit 101 of the evaluation device 10 acquires the anteroposterior buccal sag amount S.sub.c. For example, the acquisition unit 101 of the evaluation device 10 can acquire the anteroposterior buccal sag amount S.sub.c calculated from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking.
[0165] In step 303 (S303), the acquisition unit 101 of the evaluation device 10 acquires the visual score S.sub.ss. For example, the acquisition unit 101 of the evaluation device 10 can acquire the visual score S.sub.ss calculated from a facial image acquired when the face of the person subject to sagging evaluation is in the vertical position (that is, in a state where the median plane of the face rests parallel to the direction of gravity). Note that the visual score S.sub.ss may be calculated by using a trained model generated by machine learning.
[0166] Note that S301 to S303 may be performed in any order and may be performed simultaneously.
[0167] In step 304 (S304), the calculation unit 102 of the evaluation device 10 calculates the sagging skin coefficient C.sub.s from the intrafacial movement induced sag amount S.sub.f, the anteroposterior buccal sag amount S.sub.c, and the visual score S.sub.ss acquired in S301 to S303. More specifically, the calculation unit 102 of the evaluation device 10 calculates the sagging skin coefficient C.sub.s from the intrafacial movement induced sag amount S.sub.f, the anteroposterior buccal sag amount S.sub.c, and the visual score S.sub.ss by equation (4) described above.
[0168] Note that the evaluation unit 103 of the evaluation device 10 can also be configured to evaluate the type of sagging and the degree thereof by using, as an index, the sagging skin coefficient C.sub.s calculated by the calculation unit 102. For example, the evaluation unit 103 of the evaluation device 10 can evaluate the degree of facial sagging based on an increase or a decrease from the sagging skin coefficient C.sub.s acquired in the past. The degree of facial sagging may also be evaluated by whether the subject's sagging skin coefficient is greater or less than the average of his or her real age.
[0169] In step 305 (S305), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or displays on the display unit of the evaluation device 10) the sagging skin coefficient C.sub.s calculated in S304. Note that the output unit 104 of the evaluation device 10 can also be configured to output (for example, transmit to the analysis terminal 30 or display on the display unit of the evaluation device 10) the type of sagging and the degree thereof evaluated in S304.
[0170]
[0171] In step 401 (S401), the acquisition unit 101 of the evaluation device 10 acquires the intrafacial movement induced sag amount S.sub.f. For example, the acquisition unit 101 of the evaluation device 10 can acquire the intrafacial movement induced sag amount S.sub.f calculated from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking.
[0172] In step 402 (S402), the acquisition unit 101 of the evaluation device 10 acquires the anteroposterior buccal sag amount S.sub.c. For example, the acquisition unit 101 of the evaluation device 10 can acquire the anteroposterior buccal sag amount S.sub.c calculated from the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking.
[0173] In step 403 (S403), the acquisition unit 101 of the evaluation device 10 acquires the sagging skin coefficient C.sub.s. For example, the acquisition unit 101 of the evaluation device 10 can acquire the sagging skin coefficient C.sub.s based on skin viscoelasticity that is acquired by a device (viscoelasticity acquisition device) for acquiring skin viscoelasticity.
[0174] Note that S401 to S403 may be performed in any order and may be performed simultaneously.
[0175] In step 404 (S404), the calculation unit 102 of the evaluation device 10 calculates the visual score S.sub.ss from the intrafacial movement induced sag amount S.sub.f, the anteroposterior buccal sag amount S.sub.c, and the sagging skin coefficient C.sub.s acquired in S401 to S403. More specifically, the calculation unit 102 of the evaluation device 10 calculates the visual score S.sub.ss from the intrafacial movement induced sag amount S.sub.f, the anteroposterior buccal sag amount S.sub.c, and the sagging skin coefficient C.sub.s by equation (4) described above.
[0176] In step 405 (S405), the output unit 104 of the evaluation device 10 outputs (for example, transmits to the analysis terminal 30 or displays on the display unit of the evaluation device 10) the visual score S.sub.ss calculated in S404.
[0177] <<Recommendation of Solution to Sagging>>
[0178] In the sagging evaluation method described above, it is also possible to output a solution to sagging along with the evaluation result (each of the values, the type of sagging, and the degree thereof). More specifically, the output unit 104 of the evaluation device 10 outputs a predetermined solution corresponding to the evaluation result (each of the values, the type of sagging, and the degree thereof). For example, in a case where there is a high proportion of the intrafacial movement induced sag amount S.sub.f, the output unit 104 of the evaluation device 10 recommends cosmetic treatments and training that include cosmetics, supplements, and massages for resolving the intrafacial movement induced sag. In a case where there is a high proportion of the anteroposterior buccal sag amount S.sub.c, the output unit 104 of the evaluation device 10 recommends cosmetic treatments and training that include cosmetics, supplements, and massages for resolving the anteroposterior buccal sag. For example, the output unit 104 of the evaluation device 10 recommends cosmetic treatments and training that include cosmetics, supplements, and massages corresponding to the intrafacial movement induced sag amount S.sub.f and the anteroposterior buccal sag amount S.sub.c.
[0179] <<Weighting>>
[0180] In the evaluation of the type of sagging and the degree thereof described above, the evaluation of factors may be weighted based on the rate of contribution of the sagging skin coefficient C.sub.s with respect to the visual score S.sub.ss, the rate of contribution of the intrafacial movement induced sag amount S.sub.f with respect to the visual score S.sub.ss, and the rate of contribution of the anteroposterior buccal sag amount S.sub.c with respect to the visual score S.sub.ss.
[0181] <<Iterative Acquisition of Three-Dimensional Face Image>>
[0182] In one embodiment of the present disclosure, three-dimensional face images of a subject in the horizontal position and the vertical position are acquired iteratively, and at least one of the gravity-induced prominence amount VC.sub.swelling, the gravity-induced hollowness amount VC.sub.shrinking, the intrafacial movement induced sag amount S.sub.f, or the anteroposterior buccal sag amount S.sub.c can be set as a representative value of values calculated by using the three-dimensional face images that are iteratively acquired. This will be described in detail below.
[0183]
[0184] That is, even when three-dimensional face images of the same person are acquired on the same date, in the same place, and in the same period of time, there is variation in the gravity-induced prominence amount VC.sub.swelling and the gravity-induced hollowness amount VC.sub.shrinking.
[0185]
[0186] Hence, in one embodiment of the present disclosure, three-dimensional face images of the subject in the horizontal position and the vertical position are acquired iteratively, and at least one of the gravity-induced prominence amount VC.sub.swelling, the gravity-induced hollowness amount VC.sub.shrinking, the intrafacial movement induced sag amount S.sub.f, or the anteroposterior buccal sag amount S.sub.c can be set as a representative value of values calculated by using the three-dimensional face images that are iteratively acquired.
[0187]
[0188]
[0189]
[0190]
[0191] Note that one embodiment of the present disclosure can further include selecting substances or cosmetic treatments that increase or decrease the representative value of the values calculated by using the iteratively acquired three-dimensional face images. In this manner, one embodiment of the present disclosure can select and acquire substances or cosmetic treatments that increase or decrease the representative value of the values calculated by using the iteratively acquired three-dimensional face images. For example, the substances are materials, such as plant extracts or compounds, intended to be mixed into cosmetics. Also, the substances are, for example, cosmetics, drugs, food, or the like. Furthermore, one embodiment of the present disclosure can further include presenting a cosmetic method for increasing the representative value of the values calculated by using the iteratively acquired three-dimensional face images, based on the representative value of the values calculated by using the iteratively acquired three-dimensional face images.
[0192] <Hardware Configuration>
[0193]
[0194] The evaluation device 10 and the analysis terminal 30 each can include an auxiliary storage device 1004, a display device 1005, an operation device 1006, an I/F (interface) device 1007, and a drive device 1008. Each piece of the hardware of the evaluation device 10 and the analysis terminal 30 is connected to each other via a bus B.
[0195] The CPU 1001 is an arithmetic device that executes various programs installed in the auxiliary storage device 1004.
[0196] The ROM 1002 is a non-volatile memory. The ROM 1002 functions as a main storage device that stores various programs and data necessary for executing various programs installed in the auxiliary storage device 1004 by the CPU 1001. Specifically, the ROM 1002 functions as a main storage device that stores boot programs such as a basic input/output system (BIOS) and an extensible firmware interface (EFI).
[0197] The RAM 1003 is a volatile memory such as a dynamic random access memory (DRAM) and a static random access memory (SRAM). The RAM 1003 functions as a main storage device that provides a workspace deployed when various programs installed in the auxiliary storage device 1004 are executed by the CPU 1001.
[0198] The auxiliary storage device 1004 is an auxiliary storage device that stores various programs or information to be used when the various programs are executed.
[0199] The display device 1005 is a display device that displays an internal state or the like of the evaluation device 10 and the analysis terminal 30.
[0200] The operation device 1006 is an input device in which an administrator of the evaluation device 10 and the analysis terminal 30 inputs various instructions to the evaluation device 10 and the analysis terminal 30.
[0201] The I/F device 1007 is a communication device for connecting to a network and communicating with other devices.
[0202] The drive device 1008 is a device for setting the storage medium 1009. The storage medium 1009 herein includes a medium for optically, electrically, or magnetically recording information, such as a CD-ROM, a flexible disk, or a magneto-optical disk. Further, the storage medium 1009 may include a semiconductor memory or the like that electrically records information, such as an erasable programmable read-only memory (EPROM), a flash memory, or the like.
[0203] Note that the various programs installed in the auxiliary storage device 1004 are installed when, for example, the distributed storage medium 1009 is set in the drive device 1008 and various programs recorded in the storage medium 1009 are read out by the drive device 1008. Alternatively, various programs installed in the auxiliary storage device 1004 may be installed by being downloaded from the network via the I/F device 1007.
[0204] Although embodiments have been described in detail above, the present disclosure is not limited to the specific embodiments described above, and various modifications and substitutions can be made without departing from the scope of the claims.
[0205] This international application claims priority based on Japanese Patent Application No. 2020-092470 filed on May 27, 2020 and on Japanese Patent Application No. 2020-209513 filed on Dec. 17, 2020. The entire contents of Japanese Patent Application No. 2020-092470 and Japanese Patent Application No. 2020-209513 are incorporated herein by reference.
REFERENCE SYMBOLS LIST
[0206] 1 evaluation system [0207] 10 evaluation device [0208] 20 image capturing terminal [0209] 30 analysis terminal [0210] 101 acquisition unit [0211] 102 calculation unit [0212] 103 evaluation unit [0213] 104 output unit [0214] 201 generation unit [0215] 301 calculation unit [0216] 1001 CPU [0217] 1002 ROM [0218] 1003 RAM [0219] 1004 auxiliary storage device [0220] 1005 display device [0221] 1006 operation device [0222] 1007 I/F device [0223] 1008 drive device [0224] 1009 storage medium