AUGMENTED REALITY IMAGE ANALYSIS METHODS FOR THE VIRTUAL FASHION ITEMS WORN

Abstract

An image analysis method for virtual wear fashion items worn on the head portion of a person such as hats, earrings, and glasses in augmented reality is provided. The image analysis method includes: Step A, receiving a user smart devices; Step B, a smart device that can shoot the head portion of the user obtain the video in real time; Step C, extracting feature information about the smart devices in the nose, mouth, forehead, ears, by the eye of the user's face from a real-time video; Step D, generating the characteristic point based on the feature information for tracking the feature points in accordance with the movement of the head part video; and Step E, synthesizing the virtual image of the product to fashion the head portions of the video of the variable so as to correspond to the movement of the feature point.

Claims

1. An image analysis method for virtual wear fashion items worn on the head portion of a person such as hats, earrings, and glasses in augmented reality, comprising steps of: Step A. receiving a virtual image of fashion products from fashion items to your smart device mall server; Step B, is a smart device that can shoot the head portion of the user obtain the video in real time; Step C, extracting feature information about the smart devices in the nose, mouth, forehead, ears, by the eye of the user's face from a real-time video; Step D, generating the characteristic point based on the feature information for tracking the feature points in accordance with the movement of the head part video; and Step E, synthesizing the virtual image of the product to fashion the head portions of the virtual image of the video is variable so as to correspond to the movement of the feature point.

2. The method according to claim 1, wherein the Step C further comprises the step of: Step C-1, capturing a face image in the user's head portion; Step C-2, extracting the feature information of the face from the captured facial image; and Step C-3, comparing to the feature information and the group classification type to extract the type information of the face, wherein for fashion items virtual wearing, characterized in that to combine the extracted facial feature information and type information to generate the polygons on the face containing the Step C-4 to produce a side and back images of the user's head from which augmented reality, image analysis methods.

3. The method according to claim 2, wherein the step C2 further comprises the step of: Step C-2-1, extracting from the mouth and eyes facial image; Step C-2-2, linking the extracted mouth and eyes inverted triangle shape to extract the nose area; Step C-2-3, analyzing the edge and the color change in the nose area extracting detailed information of the nose; Step C-2-4, analyzing the color change in the extracted eyebrow area on the extracted eyes; and Step C-2-5, extracting the facial feature points and a contour of the face, wherein enhancement for the wearing virtual fashion goods characterized in that it comprises step C-2-6 comprising the steps of combining the measured values and statistics for each facial area of the extracted extracts the user's facial face feature information required to generate a polygon reality image analysis methods.

4. An image analysis methods for virtual wear fashion items worn on the head portion of a person such as hats, earrings, and glasses in augmented reality, comprising steps of: Step A, receiving a virtual image of fashion products from fashion items to your smart device mall server; Step B, smart device that can shoot the head portion of the user obtain the video in real time; Step C, extracting feature information about the smart devices in the nose, mouth, forehead, ears, by the eye of the user's face from a real-time video; Step D, the image information of the user's head portion that is generated from the feature information extracted by re-calibrated to the preference of the user; and Step E, generating a feature point as a rough correction based on the feature information to the step of tracking feature points in accordance with the movement of the head part video; and Step F, by the step of the head portion of the video synthesizing a virtual image of said variable fashion items that the virtual image to correspond to the movement of the feature point.

5. The method according to claim 4, wherein Step D further comprises: Step D-1, to the face and eyes, mouth correction extracted from the face image; Step D2, checking the information on the connection mouth and nose to the corrected eye to the triangle shape that is re-extracted, and directly proceeds to step D-2, or the correction information according to the preferences of the user; Step 3, determining the information to be extracted eyebrow again analyzes the color change in the area above the corrected eye, and directly proceeds to Step D-3, or the correction information according to the preferences of the user; Step D-4, correcting the facial contours and feature points extracted from the face image, Step D-5, correcting the skin color to the face extracted from the face image, and; Step D-6, extracting a user's facial face feature information required for polygon generation analysis method.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0025] FIG. 1 is a block diagram showing the augmented reality image analysis method according to an embodiment of the present invention.

[0026] FIG. 2 is a block diagram showing the details of step C according to the embodiment of the present invention.

[0027] FIG. 3 is a block diagram showing the details of the step C-2 in accordance with an embodiment of the present invention.

[0028] FIG. 4 is a conceptual diagram showing the augmented reality analysis method according to an embodiment of the present invention.

[0029] FIG. 5 is a block diagram showing the augmented reality image analysis method according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0030] Advantages and features and methods of accomplishing the same of the present invention by reference to the embodiments which are described in detail in conjunction with the accompanying drawings will be apparent. However, the invention will be implemented in that as a variety of different that forms limited to the embodiments set forth below, only, and the present embodiments are to the disclosure of the invention complete, one of ordinary skill in the art. It is provided to alert the party to complete the scope of the invention. And the terms used herein are for purposes of describing the embodiments, and are not intended to limit the present invention. In this specification the singular also includes the plural unless specifically stated otherwise in the text.

[0031] Hereinafter, with reference to the accompanying drawings will be described in detail for a preferred embodiment of the present invention. On the other hand, the city and the detailed description of the configuration and the action and effect thereof can be easily understood from those of ordinary knowledge in the art will be described briefly and in detail, or the center portions with respect to the present invention omitted.

[0032] FIGS. 1 to 4 are diagrams for explaining the augmented reality image analysis method according to an embodiment of the present invention. Specifically, FIG. 1 is a block diagram showing the augmented reality image analysis method according to an embodiment of the present invention, FIG. 2 is a block diagram showing the details of step C according to the embodiment of the present invention, FIG. 3 is the is a block diagram showing the details of the step C-2 in accordance with an embodiment of the invention, FIG. 4 is a conceptual diagram showing the augmented reality analysis method according to an embodiment of the present invention.

[0033] As it is shown in FIG. 1, the augmented reality image analysis method for fashion items virtual wear according to the embodiment of the present invention, A method comprising: from a fashion item mole server user smart device receives a virtual image of a fashion product (S100) and smart devices to extract feature information about B comprising the steps taken for the head portion of the user obtain the video in real time (S200), and the nose by the eye of the user's face is a smart device from a real-time video, mouth, forehead, ears, create the feature points based on phase C (S300) and feature information by combining the virtual image of the fashion items in the head region of the D step of tracking feature points (S400), and the video according to the head area the movement of the videos E comprises a step (S500) for varying to a virtual image corresponding to a motion of the feature point.

[0034] Here, C step (S300) is a C-2 and extracting the feature information of the face from the illustrated described above, Step C-1 for capturing a facial image of the user's head area (S310), a captured facial image in FIG. 2 (S320) and, based on the characteristic information compared to the classified type by combining C-3 phase to extract the type information of the face (S330), and the extracted face characteristic information and type information to generate the polygons on the face, and this is from the C-4 can include step (S340) of generating an image side and back of the user's head.

[0035] Specifically referring to step C (S300), the user smart device to obtain a user's facial image face. This operates the camera in accordance with user input signals generated through the smart device input can be made by the user as the photographed face image of the face. Again, this can be achieved by loading the user's face as the face image stored in the storage unit is the smart devices, depending on the input signal.

[0036] Thus, when the user face image of the face is obtained, the smart device extracts the feature information of the face from the face image faces the acquired through a face recognition module of the control unit. The feature information of the face as referring to each part of the face from the user's facial image (eyes, nose, mouth, eyebrows, contour, forehead, chin etc.) specific characteristics, for example, the entire length and width, chin-length face and bottom of the face, middle of the face, including the information needed for the polygon generation for the height, nose length, mouth height, length, and the user's face, such as the height of the forehead, the eyes of the mouth of the nose.

[0037] In addition, C-2 step (S320) is connected to the nose region as snow-C and 2-1 reverse phase (S321) and, extracted eyes and mouth from the mouth triangle shape extracting facial face image shown in FIG. 3 C-2-2 extracting (S322) and, with the edge and 2-3 C-step analysis by the color change to extract the details of the nose (S323) in the nose area, the color of the extracted area in the snow C-2-4 comprising the steps of analyzing the variation extracted eyebrow (S324) and, C-2-5 extracting a feature point of the face and a contour face (S325), and the extracted measured values and statistics for each facial region It may combine the information contained in the C-2-6 step (S326) of extracting a user's facial face feature information required to generate the polygons.

[0038] Here, the eye is first extract the pupil can be made in the form of extracting the shape of the eye relative to the pupil, the extraction of these eyes and mouth can be accomplished using the general facial recognition technology.

[0039] As shown in FIG. 4 is now, smart devices according to the described process to date is informed of the information of the head portion, including the user's face through the video recording, user fashion a virtual image information of a variety of accessory items mole you want to buy and then transmitted from the server, and by collecting all information sent to the user and which protrudes to the image easy to confirm the image. Accordingly, it may represent a natural on their face images taken with the camera, as shown in the mirror the appearance of wearing a virtual fashion items there is an effect that can greatly improve the reliability and consumer satisfaction.

[0040] In addition to the case such as the above-described process, and according to another embodiment of the present invention, A step comprising: from a fashion item mole server user smart device receives a virtual image of a fashion product (S10) as shown in FIG. 5, the foregoing the device is to extract feature information about the B stage (S20) to shoot the head portion of the user obtain the video in real time, the nose by the eye of is the smart device the user's face from a real-time video, mouth, forehead, ears, and C phase (S30), and the D stage to re-extraction by correcting for your hair user preferences for video information of a portion (S40) which is generated from the feature information, generates a characteristic point a correction to the rough based on the feature information the variable is the E step (S50) to track the feature point according to the head area the movement of the moving image, and the virtual image by synthesizing the virtual image of the fashion product on a head portion of the video so as to correspond to the movement of the feature point which may be made, including the step F (S60).

[0041] The other embodiment example differs from the one embodiment described above of the invention after the extraction of the feature information for the user's face, without creating a feature point according to the right feature information, according to the user's characteristic information to match the preference of the user D is that the more capable step (S40) for correcting or editing the 3D face image. D stage through the fashion items without having to experience the bother of changing Visage, etc. according to the user's body weight, skin color, make-up and molding will be able to confirm whether or not you can go with your own. For example, in the case of women, it is to try synthesis of fashion products according to their skin color that can darken over tanning can learn in advance the fashion items for changes in the makeup, men's outdoor activities or tanning.

[0042] To this end, to determine the D-1 step (S41) are extracted from the facial image snow and correction mouth, information of the nose by connecting the corrected eye and mouth with a reverse triangle shape is extracted again, and the information as it proceeds, or D-2 step (S42) for correcting according to the preferences of the user, wherein in the compensation area of the snow by analyzing the color change to determine the eyebrow information to be extracted again, as it proceeds, or the user of the information step D-3 is corrected in accordance with the symbols (S43) and, with the face feature point and a contour D-4 step (S44) for correcting the extracted from the image, D-5 for correcting the skin color extracted from the facial face image step (S45) and; Characterized in that by combining the actually measured value and status information for each face region the corrected containing D-6 (S26) extracting a user's facial face feature information required to generate the polygons.

[0043] The features and technical advantages of the present invention to better understand the claims of the invention described below the foregoing was rather broadly described above. One of ordinary skill in the art will appreciate that the present invention without changing the departing from the scope and spirit may be embodied in other specific forms. Thus, embodiments described above are illustrative and in every way should be understood as non-limiting. The scope of the invention should be construed to be represented by the claims below rather than the foregoing description, and all such modifications that are derived from the form of the claims and their equivalents within the scope of the invention concept.