Method for designating and tagging album of stored photographs in touchscreen terminal, computer-readable recording medium, and terminal
11036792 · 2021-06-15
Assignee
Inventors
Cpc classification
G06F3/04847
PHYSICS
G06F3/017
PHYSICS
G06F16/5866
PHYSICS
International classification
G06F16/58
PHYSICS
Abstract
Provided is a method of classifying, into an album, one or more image files stored in a terminal with a screen to which a touch screen is applied. Album/folder information included in the terminal is confirmed. An image file stored in the terminal is displayed on the screen of the terminal. It is determined whether a predetermined specific gesture is input with respect to the image file. When the specific gesture is input, it is determined whether the album/folder information is stored. When it is determined that the album/folder information is not stored, album/folder information is recommended. Both or one of the recommended album/folder information and the stored album/folder information is displayed on the screen of the terminal. It is determined to which album/folder information a drag is made among the album/folder information displayed on the screen of the terminal. The image file is moved to an album/folder corresponding to the album/folder information to which the drag has been made.
Claims
1. A method of classifying, into an album, one or more image files stored in a terminal with a screen to which a touch screen is applied, the method comprising: (1) a step of checking album/folder information included in the terminal; (2) a step of displaying an image file stored in the terminal on the screen of the terminal; (3) a step of determining whether a predetermined specific gesture is input with respect to the image file; (4) a step of determining whether the album/folder information is stored when the specific gesture is input; (5) a step of recommending album/folder information when it is determined in the step (4) that the album/folder information is not stored; (6) a step of displaying both or one of the album/folder information recommended in the step (5) and the stored album/folder information on the screen of the terminal; (7) a step of determining to which album/folder information a drag is made among the album/folder information displayed on the screen of the terminal; and (8) a step of moving the image file to an album/folder corresponding to the album/folder information to which the drag has been made.
2. The method according to claim 1, wherein the step (1) includes identifying a folder including image files among folders included in a storage of the terminal as an album, and storing a name of the album as the album/folder information.
3. The method according to claim 1, wherein in the step (3), the specific gesture includes touching and holding the screen for a long time.
4. The method according to claim 1, wherein the step (8) includes tagging the image file with a phrase corresponding to the album/folder information, together with the movement of the image file.
5. The method according to claim 1, wherein the recommendation of the album/folder information in the step (5) includes recommending information received from an external server connected to the terminal via wire or wirelessly, and album/folder information related to the image file is recommended from the external server through machine learning.
6. The method according to claim 5, wherein the information received from the external server includes one of: information obtained by conducting image recognition on the image file; and information regarding a location identified by conducting GPS recognition on the image file.
7. The method according to claim 1, wherein the recommendation of the album/folder information in the step (5) includes recommending one of: information obtained by conducting image recognition on the image file in the terminal; and information regarding a location identified by conducting GPS recognition on the image file in a smart device.
8. The method according to claim 1, wherein the step (1) is performed between the steps (2) and (3) or between the steps (3) and (4).
9. The method according to claim 1, wherein when a plurality of pieces of album/folder information are displayed in the step (6), the plurality of pieces of album/folder information are arranged around the point on the screen where a user is touching.
10. The method according to claim 9, wherein when the plurality of pieces of album/folder information are n pieces of information, the n pieces of information are arranged radially around the point on the screen where the user is touching to be spaced from each other at an angle of 360/n degrees.
11. The method according to claim 9, wherein when the number of the plurality of pieces of album/folder information exceeds a certain number, the plurality of pieces of album/folder information are displayed in two or more virtual concentric circles.
12. The method according to claim 11, wherein previously stored album/folder information confirmed in the step (1) among the plurality of pieces of album/folder information is displayed in an inner first concentric circle, and the album/folder information recommended in the step (5) among the plurality of pieces of album/folder information is displayed in the inner first concentric circle when there is a free space in the first concentric circle, and is displayed in a concentric circle outside the first concentric circle when there is no free space in the first concentric circle.
13. The method according to claim 11, wherein previously stored album/folder information confirmed in the step (1) and the album/folder information recommended in the step (5) among the plurality of pieces of album/folder information is displayed in different forms to be visually distinguished from each other.
14. The method according to claim 11, wherein previously stored album/folder information confirmed in the step (1) and the album/folder information recommended in the step (5) among the plurality of pieces of album/folder information is displayed with a time difference.
15. A non-transitory computer-readable recording medium on which a program or an application for smart devices is recorded, the program or the application causing a terminal to execute the method according to claim 1.
16. A terminal in which a program or an application for smart devices is installed and includes a screen to which a touch screen is applied, the program or the application causing the terminal to execute the method according to claim 1.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
REFERENCE SIGN LIST
(8) 301: internal storage space
BEST MODE FOR CARRYING OUT THE INVENTION
(9) According to the present invention, there is provided a method of classifying, into an album, one or more image files stored in a terminal with a screen to which a touch screen is applied, the method including (1) a step of confirming album/folder information included in the terminal; (2) a step of displaying an image file stored in the terminal on the screen of the terminal; (3) a step of determining whether a predetermined specific gesture is input with respect to the image file; (4) when the specific gesture is input, a step of determining whether the album/folder information is stored; (5) when it is determined in step (4) that the album/folder information is not stored, a step of recommending album/folder information; (6) a step of displaying both or one of the album/folder information recommended in step (5) and the stored album/folder information on the screen of the terminal; (7) a step of determining to which album/folder information a drag is made among the album/folder information displayed on the screen of the terminal; and (8) a step of moving the image file to an album/folder corresponding to the album/folder information to which the drag has been made.
(10) Step (1) may include identifying a folder including image files among folders included in a storage of the terminal as an album, and storing a name of the album as the album/folder information.
(11) In step (3), the specific gesture may include touching and holding the screen for a long time.
(12) Step (8) may include tagging the image file with a phrase corresponding to the album/folder information, together with the movement of the image file.
(13) The recommendation of the album/folder information in step (5) may include recommending information received from an external server connected to the terminal via wire or wirelessly, and album/folder information related to the image file may be recommended from the external server through machine learning.
(14) The information received from the external server may include one of: information obtained by conducting image recognition on the image file; and information regarding a location identified by conducting GPS recognition on the image file.
(15) The recommendation of the album/folder information in step (5) may include recommending one of: information obtained by conducting image recognition on the image file in the terminal; and information regarding a location identified by conducting GPS recognition on the image file in the smart device.
(16) Step (1) may be performed between steps (2) and (3) or between steps (3) and (4).
(17) When a plurality of pieces of album/folder information are displayed in step (6), the plurality of pieces of album/folder information may be arranged around the point on the screen where the user is touching.
(18) When the plurality of pieces of album/folder information are n pieces of information, the n pieces of information may be arranged radially around the point on the screen where the user is touching to be spaced from each other at an angle of 360/n degrees.
(19) When the number of the plurality of pieces of album/folder information exceeds a certain number, the plurality of pieces of album/folder information may be displayed in two or more virtual concentric circles.
(20) Previously stored album/folder information confirmed in step (1) among the plurality of pieces of album/folder information may be displayed in an inner first concentric circle, and the album/folder information recommended in step (5) among the plurality of pieces of album/folder information may be displayed in the inner first concentric circle when there is a free space in the first concentric circle and may be displayed in a concentric circle outside the first concentric circle when there is no free space in the first concentric circle.
(21) Previously stored album/folder information confirmed in step (1) and the album/folder information recommended in step (5) among the plurality of pieces of album/folder information may be displayed in different forms to be visually distinguished from each other.
(22) Previously stored album/folder information confirmed in step (1) and the album/folder information recommended in step (5) among the plurality of pieces of album/folder information may be displayed with a time difference.
(23) According to the present invention, there is provided a computer-readable recording medium having recorded thereon either a program or an application for smart devices for executing the above-described method of classifying image files into albums in the terminal.
(24) According to the present invention, there is provided a terminal with a screen to which a touch screen is applied, the terminal configured to be used to implement the above-described method of classifying image files into albums.
EMBODIMENTS
(25) Hereinafter, a system and a method according to the present invention will be described with reference to the accompanying drawings.
(26)
(27) Smartphones, smart pads, and other smart devices today have a camera function, and photographs that are taken using the camera function of each device are stored in a specific folder of an internal storage of the device. For example, as illustrated in
(28) Although the terms “folder” and “album” have similar concepts, when image files are stored in a folder, the folder may be identified as an album. A folder name and an album name may be the same. In a special case, a name of an album corresponding to a folder may be set to be different from that of the folder, but generally, the terms “folder name” and “album name” are used interchangeably.
(29) Referring to
(30) After the two photographs in a folder are selected, a “MORE” button at the top of the drawing is pressed.
(31) Then, as illustrated in
(32) When a user selects “Move to album”, albums (i.e., folders having photographs stored therein) included in the device are displayed as illustrated in
(33) In the embodiment illustrated in
(34) In summary, the above-described method of the related art is a method of designating a photograph album in a smartphone by selecting photographs and pressing the “MORE” button at the top of the drawing to move or copy the photographs to an album, and using ‘Move after select’ as a basic User eXperience (UX) in the same manner as a GUI method using a mouse. That is, this method is a method of directly creating and selecting an album/folder. This method is considered inconvenient to be used in current touch-based smart devices and current smart devices with a large screen.
First Embodiment
(35)
(36)
(37) Among the presented photographs, a user designates (for example, touches) a photograph to be categorized. Then the designated photograph is displayed in a larger size as illustrated in
(38) Although various functions may be performed on the screen of
(39) A specific gesture is described to be performed when the photograph is displayed on the entire screen as illustrated in
(40) As a basic embodiment, a specific gesture is assumed to be performed on the screen of
(41) “Paris”, “Amsterdam”, “New York”, and “London” illustrated in an example of
(42) When a user's finger touching the point on the screen of
(43) To summarize briefly,
(44)
(45)
(46)
(47)
(48)
(49) Although the first embodiment of the present invention has been described with reference to
(50) In step 100, a device (e.g., a smart device with a touch screen, such as a smartphone or a smart pad) confirms album/folder information included in a storage thereof. The storage of the device may include a memory embedded in the device, a card type memory inserted into the device, and the like. In other words, in step 100, previously stored album information and folder information are identified.
(51) That is, matters, such as a folder in which photographs are stored, the name of the folder (album name), etc., are identified in advance.
(52) In step 101, ‘view photo’ is conducted. When ‘view photo’ is conducted, a photograph is selected from among photographs in a screen such as that of
(53) In step 102, predetermined specific UX such as a long touch (touching and holding; i.e., touching and holding the photograph for a long time) is input. The process proceeds to step 103 when such an input is received, and the screen showing the photograph in step 101 is retained when such an input is not received. In other words, step 102 may be considered as a step to determine whether the input gesture is a predetermined and appointed gesture when a specific gesture (e.g., touching and holding (long-pressing)) is input on the photograph.
(54) In step 103, whether the album/folder information is stored is determined. That is, whether the album/folder information confirmed in step 100 is smoothly stored is determined. When a photograph file is included in a folder, the folder may be handled as an album. In this case, the name of the album is generally the same as that of the folder but the name of the album corresponding to the folder may be set to be different from that of the folder, if necessary.
(55) When it is determined to be ‘Yes’ in step 103, the process proceeds to step 105 and the album/folder information is displayed. That is, when there are previously stored “Paris”, “London”, “New York”, and “Amsterdam” albums, the screen will be displayed as illustrated in
(56) However, in step 103, it may be determined to be ‘No’. That is, there may not be any other albums (i.e., folders including a photograph file) except for a folder (album) in which the selected photograph is currently present. In this case, the process proceeds to step 104 and album/folder names are recommended. The recommendation of the album/folder names in step 104 may be performed using another user's data analysis server. The recommendation of the album/folder names will be described below with reference to
(57)
(58) In step 105, the previously stored folder/album names or the recommended folder/album names according to step 103 or 104 are displayed on the screen. That is, as illustrated in
(59) In step 106, in order to put the photograph into the “New York” folder in a circumstance as illustrated in
(60) In step 107, the photograph is moved to the designated album/folder by the user's dragging UX input described above.
(61) In this case, it is possible to not only move the photograph but also tag the photograph together with the movement of the photograph. That is, a “New York” tag can be added to the photograph while the photograph is moved to the “New York” folder. An album/folder name and a tag do not necessarily match but may have a predetermined correlation. For example, the album/folder name may be “New York” and the tag may be “New York photo”.
(62) Although step 100 is illustrated before step 101 in
(63)
(64) The method relates to the folder names illustrated in
(65) In
(66) Thereafter, a recommendable machine-learning-based external server is connected to recommend appropriate information, and the appropriate information is stored in the internal storage space 301 (step 303). Thus, internally stored album information and recommended album information learned from the outside are transmitted to the smart device to be used in the smart device (step 304).
Second Embodiment
(67)
(68) The second embodiment is similar to the first embodiment of the present invention but is useful when there are many folder names (album names) to be displayed in the circumstance as illustrated in
(69) Only four album names are displayed in
(70) Therefore, according to the second embodiment of the present invention, when the number of folders (albums) is large, the names of the folders can be displayed in a circular shape based on the importance and a degree of recommendability thereof as illustrated in
(71) For example, folder names stored in the internal storage, which are imported without an additional task, can be immediately suggested in an inner circle of
(72) In the case of recommended folder names which require separate processing or networking, it may be difficult to display the folder names at an early stage within a short time period.
(73) In this case, recommended folder names may be displayed in the circular shape with a time difference. The folder names may be displayed in the inner circle, and may be displayed in the outer circle when the number of folder names displayed in the inner circle is equal to or greater than a certain number (seven in
(74) For example, the previously stored album/folder information confirmed in step 100 of
(75) Although the two circles are illustrated, three or more circles may be used when the size of a screen is sufficiently large. However, it is desirable to consider that a user may feel difficult to confirm when an extremely large number of circles (virtual multiple circles) are used. The number of circles may be determined by sensing the resolution of the smart device.
Third Embodiment
(76)
(77) In an example of a screen of a smartphone of
(78) In the above example, “Works” and “Paris” are the names of albums that exist in an internal storage of the smart device, and “Golden Gate Bridge” and “DoveLoop, San Francisco” are album names that do not exist in the internal storage and are recommended according to the present invention.
(79) “Golden Gate Bridge” is an album name recommended through image recognition, and “DoveLoop, San Francisco” is an album name recommended through GPS information. Recommended album names such as “Golden Gate Bridge” and “DoveLoop, San Francisco” may be obtained by performing step 303 of
(80) Image recognition may be conducted in a smart device. However, since the amount of base data is likely to be extremely small in a smart device, it is preferable that image recognition is conducted through machine learning by connecting to an external server in many cases.
(81) Similarly, GPS location recognition may be conducted in a smart device when location data by GPS is stored in the smart device. However, since the amount of location data is likely to be extremely small in a smart device, it is preferable that GPS location recognition is conducted through machine learning by connecting to an external server in many cases.
(82)
(83) In step 701, when ‘view photo’ is conducted, a photograph as illustrated in
(84) In step 702, whether a photograph includes GPS information (latitude and longitude information) is determined. The photograph presented as an example is confirmed to include information such as latitude of 37.818 and longitude of −122.28.
(85) When it is determined that GPS information is included, the process proceeds to step 703 from step 702. In step 703, the name of the place is identified based on the latitude and longitude information. The location of the place was identified as DoveLoop, San Francisco, Calif. 94129, USA. In step 704, an appropriate place name at the location is selected or chosen. In this example, DoveLoop, San Francisco is determined as an appropriate place name.
(86) On the other hand, when it is determined that GPS information is not included, the process proceeds to step 705 from step 702. In step 705, an album name is created through image recognition. As a result of image recognition, the photograph is identified as Golden Gate Bridge. The album name may be searched for by a technique, for example, machine learning or the like.
(87) In step 706, a unified album name is recommended. An album name ‘DoveLoop, San Francisco’ based on the name of the place was obtained from GPS information, and an album name ‘Golden Gate Bridge’ was obtained through image recognition. The above two album names are displayed as recommended album names as illustrated in
(88) On the other hand, in an example of
(89) Although the present invention has been described above with respect to an album name (folder name), a name that is the same as the album name (or a name that is slightly modified if necessary) may be added as a tag to the photo.
(90) While the present invention has been described above with respect to specific examples, the present invention is not limited to the embodiments set forth herein, and various modifications can be made by those skilled in the art within the basic scope of the present invention defined in the appended claims. It should be understood that other modifications not departing from the basic idea of the present invention also fall within the scope of the present invention.
INDUSTRIAL APPLICABILITY
(91) The present invention relates to a method of designating and tagging an album or a folder for photographs stored in a touch screen terminal such as a smartphone, and a computer-readable recording medium and a terminal therefor.
SEQUENCE LIST
(92) (None)