Proactive creation of photo products
10255707 ยท 2019-04-09
Assignee
Inventors
- Mohan A. Dasannacharya (San Ramon, CA, US)
- John M. Josling (San Francisco, CA, US)
- Greg C. Bosch (Redwood City, CA, US)
- Stephanie I. Tang (San Francisco, CA, US)
Cpc classification
H04N1/00132
ELECTRICITY
H04N1/00442
ELECTRICITY
H04N1/00461
ELECTRICITY
H04N1/00458
ELECTRICITY
International classification
H04N1/00
ELECTRICITY
Abstract
A method for proactively creating a photobook includes identifying a group of images by a computer system and automatically creating a design for a photobook by the computer system without receiving a user's request for designing a photobook if the number of images in the group is determined to be within a predetermined range. Pages of the photobook incorporate a plurality of images in the group. The method further includes presenting the design of the photobook to a user for preview and receiving an order from the user for a physical manifestation of the photobook based on the design.
Claims
1. A computer system for proactively creating a photo product, comprising: a computer processor configured to receive a group of images from one or more user devices and to automatically identify an event based on image capture times and image capture locations of the images, wherein the computer processor is configured to select images taken at the event to form a set of selected one or more images, wherein the computer processor is configured to automatically identify an organizer for the event, to automatically select a photo product type in part based on a partnership that has been set up with the organizer, wherein the computer processor is configured to automatically create a design of a photo product of the selected photo product type using the set of selected one or more images for the event.
2. The computer system of claim 1, wherein the computer processor is configured to automatically select a number of images taken at the event to form the set of selected one or more images, wherein the computer processor is configured to automatically select a photo product type in part based on the number of selected one or more images, wherein the computer processor is configured to automatically place the selected one or more images in a layout of a photo product of the selected photo product type to create the design of a photo product.
3. The computer system of claim 1, wherein the computer processor is configured to automatically select a photo product type in part based on the event, wherein the computer processor is configured to automatically place the selected one or more images in a layout of a photo product of the selected photo product type to create the design of a photo product.
4. The computer system of claim 1, wherein the design of a photo product is created without receiving a user's request.
5. The computer system of claim 1, wherein the set of selected one or more images from the event is automatically selected based on a quality threshold, wherein the quality threshold comprises one or more of color balance, light exposure, image tone, image sharpness including blurriness, image pixel values, image composition, faces in the images taken at the event.
6. The computer system of claim 1, wherein the computer processor is configured to automatically analyze the image capture times and the image capture locations of the images by the computer processor while the group of images are received from one or more user devices.
7. The computer system of claim 1, wherein the images are received from the one or more user devices over a computer network.
8. The computer system of claim 1, wherein the computer processor is further configured to automatically place the selected one or more images in a layout of a photo product of the selected photo product type to create the design of a photo product.
9. The computer system of claim 1, wherein the computer processor is further configured to automatically assign at least a portion of the selected one or more images into a first page group and a second page group each comprising one or more images, wherein the computer processor is configured to place the first page group of one or more images in the first page of the photo product, wherein the computer processor is configured to place the second page group of one or more images in the second page of the photo product.
10. The computer system of claim 1, wherein the computer processor is further configured to automatically select a first page layout from a library of page layouts, wherein the first page group of one or more images are placed in the first page according to the first page layout, wherein the computer processor is further configured to automatically select a second page layout from the library of page layouts, wherein the second page group of one or more images are placed in the second page according to the second page layout.
11. The computer system of claim 10, wherein at least two selected images are separated into the first page group and the second page group based on capture times of the two selected images.
12. The computer system of claim 10, wherein at least two selected images are separated into the first page group and the second page group based on color content of the two selected images.
13. The computer system of claim 1, wherein the computer processor is further configured to automatically share a design of the photo product with one or more user devices.
14. A computer system for proactively creating a photo product, comprising: a computer processor configured to receive a group of images from one or more user devices and to automatically identify an event based on image capture times and image capture locations of the images, wherein the computer processor is configured to select images taken at the event to form a set of selected one or more images, wherein the computer processor is configured to select a photo product type in part based on the number of selected one or more images taken at the event, wherein the computer processor is configured to automatically create a design of a photo product using the selected one or more images for the event, wherein the computer processor is configured to enable display of a design of the photo product with one or more user devices.
15. The computer system of claim 14, wherein the computer processor is configured to automatically analyze the image capture times and the image capture locations of the images by the computer processor while the group of images are received from one or more user devices.
16. The computer system of claim 14, wherein the computer processor is further configured to share a design of the photo product with one or more user devices.
17. A computer system for proactively creating a photo product, comprising: a computer processor configured to receive a group of images from one or more user devices and automatically identify an event based on image capture times and image capture locations of the images, wherein the computer processor is configured to select images taken at the event to form a set of selected one or more images, wherein the computer processor is configured to automatically select a photo product type as determined by nature of the event, wherein the computer processor is configured to automatically create a design of a photo product using the set of selected one or more images for the event, wherein the computer processor is configured to enable display of a design of the photo product with one or more user devices.
18. The computer system of claim 17, wherein the computer processor is configured to automatically analyze the image capture times and the image capture locations of the images are by the computer processor while the group of images are received from one or more user devices.
19. The computer system of claim 17, wherein the computer processor is further configured to share a design of the photo product with one or more user devices.
Description
BRIEF DESCRIPTIONS OF THE DRAWINGS
(1) The accompanying drawing, which are incorporated in and form a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
DETAILED DESCRIPTION OF THE INVENTION
(13) In the present invention, the term photo album refers to a book that includes one or two cover pages and one or more image pages. Each of the image pages can include one or more images. The image pages can also include text or image caption. The image layout can also include a background pattern. In the imaging industry, photo albums can include photo books, scrapbooks, snap books, and any books form including bound image pages.
(14) A computer 100 illustrated in
(15) It should be noted that the computer 100 can exist in other configurations from the example shown in
(16) Although large numbers of images are frequently captured by digital cameras, people often are not aware of the types of customized digital enabled imaging products that are available from image service providers such as Shutterfly, Inc. Customizable image products can include photobooks, photo calendars, photo greeting cards, photo stationeries, photo mugs, photo T-shirt, and so on, which can provide significant enhanced ways for preserving people's treasured memories in addition to viewing images on electronic displays.
(17) Additionally, significant obstacles exist even for people who are aware of the availability of customizable image products. The design of a photobook, for example, can take significant amount of time and effort. A user has to select photos for many pages including a cover page. The user needs to select a format, and a style for the photobook. The user needs to design or select layout for each page, sort images for different pages, and place images onto individual pages. The photobook design can take many iterative steps such as selecting suitable images, selecting layout, selecting images for each page, add text, which can often take hours to complete.
(18) Once the user approves a design, the photobook can be made according to the design locally by a printer 130 connected to the computer 100, or remotely by the imaging service provider at a printing facility 170.
(19) Referring to
(20) The computer system then determines if the number of images is within a predetermined range (step 220). For example, the threshold for the number of images in the group can be 20 (i.e. the predetermined range is 20 or higher). If the images in the group are within the predetermined range, the computer system automatically selects a style and a format for a photobook (step 230). The styles of photobooks can include, for example, romance, seasonal, every day, vacation, travel, wedding, baby, kids, birthday, school memories, sports, Mother's day, holiday, etc., each of which can include more detailed styles. A style of a photobook can specify a theme for the photobook such as colors, background themes, patterns, picture frames, text fonts, positions of the text, and images on the inner pages as well as covers of the photobook. The format of a photobook can include the size e.g. 57, 88, 1212 etc.), the paper stock materials for the pages and the cover, the type of binding, and the finish of the photobook.
(21) In some embodiments, the predetermined range can depend on how the group of images is selected, whether they are selected for printing, or for electronic share, or placed in a single electronic folder or album, or received in an image upload, or tagged by a same label. For example, the threshold number can be 15 for the images that are selected for printing, and 20 for the images that are selected for electronic sharing. The different threshold image numbers for different image aggregation sources is based on the observation that users conducting different image operations often have different degrees of interests in seeing the design and making a physical image-based product such as a photobook. The above described flexibility in image threshold numbers can provide service best suitable to different segments of users.
(22) The style and the format of the photobook can have default selections such as everyday for the photobook style and 8 by 8 hardcover for the photobook format. In some embodiments, the style and the format of the photobook can be selected based on knowledge of the images in the group. Specifically, an image property can be extracted from the group of identified images. For example, if the images are identified by a common tag label Hawaii Vacation, a photobook style for vacation, or specifically for Hawaiian vacation, may be automatically selected. In another example, if the images identified are in an electronic album called Molly's Birthday Party, a birthday photobook style can be automatically selected. In another example, the album name 315 (
(23) The computer system automatically produces a design incorporating the identified images using the automatically selected photobook style and format (step 240). It should be noted that the photobook design using the group of identified images, and the associated selections of photobook style and formats, are proactively and automatically implemented by the computer system without receiving a request from a user. The approach described in the present systems and methods is different from conventional photobook creation processes wherein users initiate projects to design photobooks. As described above, conventional photobook-making methods require awareness and familiarity of the photobooks by the users. The projects of creating photobooks can be very time consuming.
(24) The proactively and automatically created design of the photobook can be presented by the computer system to a user for preview (step 250). As shown in
(25) The user can click arrow buttons 550, 560 to view different pages of the photobook. The cover and different pages of the photobook design 500 can also be played automatically like a slide show once the user clicks the button 400 (
(26) Optionally, the user is allowed to edit the photobook design 500 (step 260). The user can change, switch, or remove the images 518, 531, 541, and 542 on the book cover 510 and pages 530, 540. The user can also change text information such as the book cover 515 and the text 543. It should be noted that the photobook design 500 represents a complete design of a photobook that is ready to be ordered. The editing is an optional step depending on the user's time availability.
(27) It should be understood that the proactively created photobook designs can be presented in many forms. As describe above, images identified to create a photobook design typically belong to a group, such as a group of shared images, posted images, uploaded images, or images selected for printing, etc. The proactively created photobook design is presented to the user at relevant places on the web pages, such as on a web page for confirming the share of the group of images, at a share web when the group of shared images are viewed, or at a page after a group of images have been ordered for printing. The image service provider can also proactively send an email to inform someone about the creation of the photobook design. For example, a user that just uploaded a group of images to the server managed by the image service provider may receive an email message from the service provider about the creation of the photobook design.
(28) After the user has reviewed and optionally edited the photobook design 500, the user can save the photobook design 500 and order a physical manifestation of the photobook based on the to edit the photobook design 500 from the image service provider (step 270).
(29) The image service provider can receive the order via the server 160 has a physical manifestation manufactured at the printing facility 170 according to the photobook design 500 (step 280).
(30) Details about the proactive design of a photobook (in steps 230-240,
(31) The sorted images may be first placed into a group including a large number of images that do not fit on a page. For example, ten images in Group B (
(32) In some embodiments, the images can be sorted or grouped based on geographic locations. For example, assuming Group C (
(33) A page layout is automatically selected from the library of page layouts in accordance with the properties of the images on the page as well as the text information associated with the image receiving areas in the page layout (step 630). The format of the image receiving field in the page layout matches the format of the selected image. For example, images in Group A (
(34) The page layout also includes an image caption area positioned adjacent to the image receiving area for receiving the associated text information. For example, one portrait image and one landscape image may be selected for the next page. The portrait image has associated text information entered by the user and stored in conjunction with the portrait image. The landscape is not associated with any text information. In selecting a page layout, the disclosed system first select page layouts containing two image receiving areas, and then further selects page layouts that have include one portrait and one landscape image receiving areas. Additionally, the disclosed system further selects page layouts that include an image caption area in association with the portrait image receiving area. After the page layout is selected, the selected image(s) and associated text are automatically placed in the selected page layout (step 640). The placement of the selected image(s) and associated text can be done in a single step because they are pre-stored in an integrated data structure as described previously. The same steps can be repeated for fill the image fields and text fields in each page of a photo book. The user can select an image from the plurality of images to be used as part of the book cover. Details about arranging images in page layouts are disclosed in the above referenced commonly assigned U.S. patent application Ser. No. 12/406,873, titled Smart photobook creation, the content of which is incorporated herein by reference.
(35) In some embodiments, the design of the photobook can be dynamically changed as the identified images change in the group. For example, the photobook design 500 can dynamically change as a user adds or removes images in and out of an image album (310,
(36) The second design of the photobook is subsequently presented for user's preview (step 1080). The change in the group of identified images can include addition, removal, a change in the sequence, addition of remarks and keywords, addition in change in tagging in a group of images. The uploading of images into an image folder/album can take more than one uploading events. The design of the photobook can be continually updated as new images are received by the image folder/album.
(37) In some embodiments, referring to
(38) Optionally, an organizer (such as MLB) for the event is automatically identified (step 1140). Optionally, it determined whether a partnership has already been established between the network-based image service provider and the event organizer (step 1150). If not, a partnership can be established in response to the images identified taken at the event. The partnership can define the type of corporations between the network-based image service provider and the event organizer, which among other things, include the type of photo products that the network-based image service provider can help create and fulfill for the event organizer.
(39) The images taken at the event are then selected based on certain predetermined criteria (such as color balance, light exposure, image tone, image sharpness including blurriness, image pixel values, image composition, faces in the images, etc.). Those images taken at the event that are above a quality threshold are selected to form a set of selected images (step 1160).
(40) A photo product type is then automatically selected based on a number of possible factors (step 1170). First, the photo product type can be dependent on the number of images that are above a quality threshold (that is, selected images). For example, a photo book or photo calendar usually need more than 10 images while photo greeting cards and photo mugs can be formed using fewer images. Secondly, the photo product type can be determined by the nature of the event. For example, a photo T-shirt and photo water bottle may be especially suitable for a sports event. In the case of the location being identified as a party provider (jump house location) or a theme park, product designs suitable to these venues can be chosen. Furthermore, the photo product type can be defined by the agreement of the partnership between the network-based image service provider and the event organizer (step 1170). In the case of partnerships, certain pre-stored images could be added: for example, images of Mickey and Donald for a partnership with Disney; or the player images and team statistics in the case of partnership with a sports team.
(41) The selected images are automatically placed in a layout of a photo product of the selected photo product type (step 1180), without receiving a user's request. Details of grouping, page layout selection, and placing images onto a photo product such as a photobook are disclosed above in relation to
(42) A design of the photo product can then be shared with one or more user devices (step 1190) over the computer network. A user can view or order a copy of the photo product. The network-based image service provider can then make the photo product and ship to the user. After the transaction, the network-based image service provider may share a portion of the proceeds with the partner that organized the event.
(43) It should be understood that the library of page layout contains layouts with different numbers of images other than one, two, and three. For a given number of images on a page and for the given formats of the images, the page layout is not limited to the designs shown in this application. There can be a large variation of layout designs for the same number of images with the same formats on each page. Moreover, the sorting and grouping of images can be implemented by other approaches or using other metrics. The illustration of page grouping and page breaks for the images can also vary within the scope of the present disclosure. Moreover, the presently disclosed systems and methods are compatible with a software application installed locally on a computer device, client software in communication with a remote server, or a software application installed on a central server.