Interactive guest image capture using video wall/floor/ceiling displays for selections of background scenes, and selection/distribution of customized souvenir portfolios including merged images/sound

Abstract

Systems and methods for creating and distributing professional quality pictorial souvenirs giving the illusion that guests of a facility were imaged at other locations, including making initial arrangements with guests, showing selections of background scene images at video displays and flashing chrome key images interspersed with frames of the scene images, taking key guest images in synch with the flashed key images, extracting guest image content from the key guest images and merging into selecting scene images, showing preview merges images for guest selection and providing souvenir portfolios that include merged images to guests or designees after making financial arrangements, including for payment to third parties for copyright content included in the souvenirs and with advertisers for promotional material included in the souvenirs.

Claims

1. A method comprising: flashing at different times chroma key images and background scene images at a video display surface where one or more guests pose for imaging; using one or more cameras to take key guest images of said one or more guests when said video display surface shows said chroma key images; computer-processing the key guest images with a computer system; computer-merging the processed key guest images into the background scene images with a computer system to form merged images; and assembling customized souvenir portfolios that include at least some of the merged images.

2. The method of claim 1 in which said taking of said key guest images comprises taking plural key guest images of the same one or more guests, each of said plural key guest images of the same one or more guests being taken while the video display surface is showing respective different chroma key images.

3. The method of claim 2 in which said image processing comprises comparing said plural key guest images with each other or with the respective different chroma key images and selecting for merging a key guest image that meets selected image quality criteria.

4. The method of claim 3 in which said image quality criteria include differences in color content between said plural key guest images and said respective different chroma key images.

5. The method of claim 1 in which said taking of said key guest images comprises concurrently taking each of at least some of said key guest images with the one or more cameras having respective different perspectives.

6. The method of claim 1 in which said computer-merging comprises merging said key guest images into the background scene images that comprise video clips.

7. The method of claim 6 in which said video clips include video that zooms in and/or out relative to the key guest images.

8. The method of claim 1 in which said computer-processing comprises using pattern recognition to generate a metric related to a number of people in respective images of said key guest images, and charging for the customized souvenir portfolios by adjusting charges in relation to said metric.

9. The method of claim 1 comprising including at least a part of the video display surface in a floor supporting said one or more guests.

10. The method of claim 1 comprising including in the video display surface at least two walls surrounding said one or more guests.

11. The method of claim 1 in which said flashing comprises projecting at least some of said background scene images on said video display surface.

12. The method of claim 1 in which said flashing comprises showing at least some of said background scene images on one or more electronic screens comprising said video display surface.

13. The method of claim 1 including interacting with at least some of said one or more guests via smartphones to obtain guest information and supplying the obtained information to said computer system to associate with respective souvenir portfolios.

14. The method of claim 1, in which said flashing of said chroma key images and said background scene images comprises flashing said chroma key images and said background scene images on a projection video screen.

15. The method of claim 1, in which said flashing of said chroma key images and said background scene images comprises flashing said chroma key images and said background scene images on a front projection video screen.

16. The method of claim 1, in which said flashing of said chroma key images and said background scene images comprises flashing said chroma key images and said background scene images on a back projection video screen.

17. The method of claim 1, in which said flashing of said chroma key images and said background scene images comprises flashing said chroma key images and said background scene images on a liquid crystal display (LCD) video screen.

18. The method of claim 1, in which said flashing of said chroma key images comprises flashing green images on some occasions but blue images on different occasions.

19. The method of claim 1, in which said assembling of said customized souvenir portfolios further comprises including in said customized souvenir portfolios other material selected from a group of promotional material, advertisements, and sound.

20. The method of claim 1, in which said computer-merging comprises forming the merged images in a form of multi-frame video clips.

21. An automated system comprising: a guest facility that comprises a video display surface serving as background for taking images of guests and an automated camera system configured to take the images; a source of background scene images and of chroma key images; a system control computer configured to direct said source to supply the chroma key images and background scene images to the video display surface and to direct the video display surface to display the supplied chroma key images and background scene images at respective different times; the system control computer being further configured to direct the camera system to take one or more images of said guests while the video display surface is displaying one or more of said supplied chroma key images, thereby producing one or more key guest images; and an image processing computer configured to receive and process said one or more key guest images, and to merge the resulting processed key guest images with selected images of said supplied background scene images, thereby forming merged images of guests inserted into selected background scene images.

22. The system of claim of claim 21 further including a payment and delivery computer system configured to respond to guest orders for said merged images and charges for delivering the ordered merged images to said guests.

23. The system of claim of claim 21 in which the video display surface includes a video floor configured to support said guests and display said supplied chroma key images and background scene images.

24. The system of claim 21 in which said video display surface comprises plural walls surrounding a location at which said key guest images are taken and configured to display said supplied chroma key images and background scene images.

25. The system of claim 21 in which the system control computer is configured to direct the video display surface to display at different times chroma key images that differ in color from each other while the camera system is taking said one or more key guest images.

26. The system of claim 25 in which the image processing computer is further configured to compare qualities of said one or more key guest images taken in association with the chroma key images that differ in color and to select for merging key guest images meeting selected quality criteria.

27. The system of claim 21 in which said image processing computer is configured to merge said one or more key guest images into said supplied background scene images that comprise video clips.

28. The system of claim 21 in which said image processing computer is configured to merge said one or more key guest images into said supplied background scene images that are video cups zooming in and/or out relative to said one or more key guest images, thereby forming merged video cups giving an illusion of background scenes that zoom in and/or out relative to the guests.

29. The system of claim 21, in which said video display surface comprises a projection video screen.

30. The system of claim 21, in which said video display surface comprises a back projection video screen.

31. The system of claim 21, in which said video display surface comprises a front projection video screen.

32. The system of claim 21, in which said video display surface comprises a liquid crystal display (LCD) video screen.

33. The system of claim 21, in which said source of chroma key images provides green and blue chroma key images of which only one of said green and blue chroma key images is displayed at said video display surface at one time.

34. The system of claim 21, in which said image processing computer is further configured to associate said merged guest images with other material selected from a group of promotional material, advertisements, and sound.

35. The system of claim 21, in which said merged guest images comprise multi-frame video clips.

Description

BRIEF DESCRIPTION OF THE DRAWING

(1) FIG. 1 is a flow chart illustrating main steps of a method that is an example of an embodiment described below.

(2) FIG. 2 is a block diagram of a system related to the method illustrated in FIG. 1.

(3) FIG. 3 illustrates a key guest image and a merged image into which an extracted guest image has been inserted.

(4) FIG. 4 illustrates several frames of a video clip showing zooming in from a satellite image to an image of a couple that has been extracted from a guest key image of the couple and merged into a frame showing a crowd into which the video clip is zooming.

(5) FIG. 5 schematically illustrates an environment in which guest images can be taken against a video display surface that can include walls, a floor, and a ceiling.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

(6) FIG. 1 illustrates main steps in a preferred embodiment. As one of many possible examples, consider a facility in a tourist attraction such as the top of the Sears Tower in Chicago or the Empire State building in New York City. The guests are tourists or other visitors. Some may be receptive to creating and purchasing a professional quality pictorial souvenir of their visit. Of course, there are other examples such as visitors to any venue where it can be expected that some may be interested in a pictorial souvenir of their experience that could include images the visitors cannot take or at least cannot conveniently take themselves.

(7) Some or all the steps illustrated in FIG. 1 can be included in a process that can involve significant participation by facility personnel, or in a process that primarily involves the use of automated equipment. In the case of the former, step 100 includes interaction between guests and facility personnel: for example, guests are welcomed by facility personnel upon arrival at the facility or a reception venue, and are directed to an imaging studio. Any guests who decline are politely thanked and told to enjoy their visit. In step 102, a guest who has not declined is ushered into an imaging location to be appropriately positioned with respect to a video display surface and camera and lighting systems, and to receive suggestions on posing. In step 104, the guest at the imaging location can be shown scenes on the video surface so that one or more can be chosen for merging with guest images. In step 106 one or more background key image frames such as chroma key frames are flashed on the video surface, and guest key images are taken in sync with the chroma key images. In step 108 a computer processes the guest key images to extract the images of the guest, and in step 110 selects the best extractions, possibly including from several otherwise identical guest key images taken with different chrome key backgrounds or by combining guest image content from images taken with different chroma key images. In step 112, an image processing computer merges the extracted guest images into one or more of the selected scene background images, and in step 114 at least some of the resulting merged images are displayed for the guest to make a selection and to order any for inclusion in a guest souvenir portfolio. Step 116 involves generating the ordered souvenir portfolios, in electronic form and/or as a hard copy, and step 118 involves calculating charges and charging guests and any third parties and providing compensation to any third parties, and step 120 includes actually delivering the portfolios and any upsell items to guests and/or their designees.

(8) A variation can comprise greeting and directing guests as described above and having a photographer taking an image of a guest against a key image that may or may not be on video surface. Several guest key images can be taken in rapid succession, for example from different angles so that merged images can include the guest looking up or down or straight ahead, or so that different chroma key images can be used depending on items the guest is wearing or holding. After confirming the quality of the guest key image, the photographer can thank and give the guest a themed card with a code such as a 4-digit number or a barcode and explain where the guest can select and pick up merged images, and possibly select background scene images. Facilities personnel greet guests who might order portfolios, and scan or otherwise enter the code in a computer system that automatically merges a guest image extracted from the guest key images with one or more of popular background scene image appropriate for the venue, and the system displays the results to the guest. The guest is prompted to make a selection or to view guest images merged into different backgrounds, and to make purchase decisions for merged images and any delivery options of upsell items or services. Traffic flow and transaction speed can be enhanced by controlling factors such as the number of options for background scene images and/or merged images presented to a guest, the duration of display of merged or other images for selection, the number of purchase option offered to a guest, etc. The guest is given choices of ways to pay for ordered souvenirs, and after payment the guest receives the pictorial souvenir, for example as a copy that is printed and possibly bound on the spot and/or as an electronic version.

(9) In an example of an implementation using greater degree of automation, step 100 involves interaction by electronic communications that can be wireless or wired. For example, a guest can be prompted by a sign or in some other way to communicate by a smartphone or another wireless or wired electronic device with a system website or a system computer, to thereby initiate a transaction and record guest identification and payment information such as a credit card number. A guest may have previously interacted with the same or related system, in which case the interaction can use pre-existing information. In step 102, the guest is directed by signs or messages to a personal device to pose at a video display surface, and in step 104 the system shows the guest one or more background scenes, on the video surface or on the guest's electronic device or on another display, determines by an electronic communication which background scene or scenes the guest has selected, and continues showing selected scenes or other material on the video surface. In step 106, the video surface can show a selected background scene to the guest but intersperse flashes of key image frames or fields, such as blue or green, and the camera system can take key guest images at times in synch with the key images, possibly with multiple fixed cameral from different angles and possibly while flashing a succession of different chroma key images and using different lighting choices. In step 108, a computer included in the system processes the guest key images to extract the guest image content. For example, if the key image is a narrow range of blue of set intensity, this process extracts pixels that are outside that range of blue at that intensity. In step 110, the system computer selects the best extraction based on factors such as smoothness of the extracted image and shading. For example, if guest key images were taken with each of red, blue, and green key images, the system computer may select the guest image extracted from the blue background because it has the best appearance, e.g., because the guest's clothing did not include any blue close to the background key image. This process can compare several guest images extracted from key guest images using different chrome keys and select the best guest image, or the best combination of guest images when merged into a single guest image, based on comparison results and factors such as smoothness of the guest images, color consistency, overall quality, etc. In step 112, the system computer merges guest images into background scene images that the guest has selected and/or that the computer system has selected for offering to the guest, and in step 114 offers some or all of the merged images as preview images to the guest. The scene images can be still or video images, and can be from stock or from live cameras viewing venues such as streets or events. Similarly, the guest key images can be stills of video clips generated by repeatedly flashing chroma key frames or fields in synch with taking key guest image frames or fields, A scene image can involve zooming in and/or out, for example zooming into the location at which the customer is imaged from a satellite or an aircraft. This showing of background scenes can be done on the same or a different video surface or display and/or on the guest's personal device such as a smartphone. If preview images are shown on a device that the system does not control, they can be modified in some way so that the guest would not be tempted to keep them in place of paid images. For example, the preview images can be coded to disappear from the guest device in a few seconds, or to change in appearance, or to have lower resolution, or to include content that makes them less desirable than paid images. Still in step 114, the customer communicates orders to purchase a souvenir portfolio of some or all of the images seen in preview. In step 116, the system computer and other equipment generate a souvenir portfolio containing the ordered images and possibly other material such as images of the venue or other sites or of people or events, promotional material, advertisements, gift items, sound, etc. Sound can come from any of a number or sources; for example, from a guest's smartphone or microphones near the guest, or from stock sound tracks, of live from microphones at other locations. The portfolio thus can comprise still images, video images, or both, with or without sound. In step 118 the system computer calculates charges for the guest and possibly charges to or from third parties. For example, if a merged image includes a scene in which a third party has rights such as copyright, a payment may be due to the third party. If material in the portfolio includes promotional material from a third party, a payment may be due to the system from a third party. Also in step 118, the system computer can finalize the charges through an automated charging system. In step 120, the souvenir portfolio is delivered to the guest and/or designees of the guest. For example, the portfolio can be sent electronically to the guest's smartphone of tablet, to an address the guest has specified, to a printer system in the facility that can print and bind a hard copy, and/or an order can be sent to an off-site printing facility to print and package the portfolio and deliver it to the guest or a designee.

(10) FIG. 2 illustrates in block diagram form facilities that can be used to carry out processes described above. Guests can proceed through an initial guest interaction facility 200 where they can provide identification and charging information or where initial guest key images can be taken. Guests then proceed to a video surface display facility 202 where images of a guest can be taken against a chroma key image and where the guest can perceive being in different scenes by showing such scenes on the video surface. Video surface 202 can be a single wall of display screen such as a projection screen or screens such as LCDs that typically is higher and wider than a guest even when the guest is a group of people. In addition, video wall 202 can include similar screen or screens or one or more other walls, on a ceiling, and/or on the floor, so that the guest can be imaged against key images on multiple surfaces from multiple angles. Key image storage 204 provides a chroma key image to facility 200, which can be a single key or multiple keys having different color and intensity characteristics. Background scene image storage 206 provides one or more scenes for display on the video wall in facility 202 or on other displays. A camera system 208 takes images of the guest in facility 202, and a lighting system 210 provides appropriate lighting. Storage 204, storage 208, camera system 208, and lighting system 210 operate under the control of a computer controller 212 to flash chroma key images on video surface 202 as needed when camera system 208 is taking guest key images, to provide appropriate lighting from lighting system 210, and to show on video surface 202 at other times scenes from storage 206, which scenes can be backgrounds for merged images or promotional or other material. The guest key images and the background scene images that have been selected for merging are processed in image processing facility 214 into merged images, for example using technology similar to that used for merging images in Adobe Photoshop. The merged images are presented for guest review and selection at preview facility 216 that can use video surface 202 to display preview merged images, but preferably uses other displays such as a display on a guest smartphone and/or on a video display different from video surface 202. In response to orders for merged images from guest order facility 218, which can use a guest smartphone or some other fixed or portable electronic device, preview facility 216 supplies the ordered merged images to charging facility 220, which calculates and makes charges to the guest and to any sources of promotional material for items included in the guest's souvenir portfolio, and also any charges to be paid to third parties such as copyright owners for protected content includes in a guest portfolio. A souvenir portfolio assembly facility prepares the ordered souvenir for delivery. If only an electronic copy is to be delivered, facility 222 sends it to delivery facility 224 as an electronic document for sending to the guest's smartphone, to an address or a social network that the guest designates, and/or to some other destination that the guest specified. If a hard copy is involved, assembly facility 222 can be provided with printing and binding/packaging equipment to prepare it, and possibly to include add-ons such as gift items or special effects such as special frames, LED lights, sound sources, and controllers for such lights and sound sources. Assembly facility 224 can be at the same or close physical location as video surface 202, or it can be at a remote location, or parts can be at different locations. For example, a part involved with souvenir portfolios in electronic form can be at or close to video surface 202 and a part involved in hard copy souvenir portfolios can be at a different location.

(11) In another example, an initial image can be taken of a guest and subjected to computer analysis for color content to select a chroma key image in a color that differs from guest body or attire colors.

(12) In another example, pattern recognition can be used to generate a metric related to the number of people in the extracted guest image, and the charging of gusts for the pictorial souvenirs comprises adjusting charges in relation to the metric.

(13) FIG. 3 illustrates a simple example of a key guest image of a woman taken against a chroma key background that can be red, green, blue, or some other color that differs from her skin tone and dress colors, and a merged image in which the extracted image of the woman has been merged into a background scene of buildings.

(14) FIG. 4 illustrates an example of creating a merged image involving zooming in to create an illusion that a satellite image is zooming in on an event at a venue with a crowd. The images above the waving couple can be from a service such as Google Earth or from a camera on an aircraft or similar images can come from a camera mounted on a high support. The image of the couple can be a still or video image extracted from a guest key image that is merged into a stock or live image of a crowd as described above, and also merged into the zooming sequence video clip.

(15) FIG. 5 schematically illustrates an environment in which images of guests 500 can be taken against a video surface display that can include side walls 202a and 202b, a floor 202c, and a ceiling 202d, with a camera system 208 with three cameras pointing to a guest 201 on floor 202c at different angles, and a lightning system 210. As described above any one or more of the illustrated portions of video surface display 202 can show background scene images, key images, or other material.

(16) For conciseness, the system operation described above omits conventional steps that a skilled computer software designer or programmer would know how to implement, and gives an example of a sequence of steps that need not be performed in the illustrated order, and do not require the full set of illustrated steps to be performed in every use of the system or method. As a non-limiting example, step 104 can be omitted for some implementations, and step 116 can start before step 114. Hardware/software system designers and programmers can implement specific examples of the disclosed systems and method without undue experimentation according to the description in this patent specification and can select specific design goals and tradeoffs in cost, performance, and other factors.

(17) In the foregoing description, certain terms have been used for brevity, clarity, and understanding, but no unnecessary limitations are to be implied therefrom beyond the requirements of the prior art, because such words are used for description purposes herein and are intended to be broadly construed.

(18) At least some of the process steps described above can be formatted as algorithmic steps represented by a computer program that, when loaded into a suitable computer system, causes the system to carry out those steps. In such a case, computer-readable media in which such a program is stored in non-transitory form, can be considered to be a computer program product.

(19) The embodiments of the systems illustrated and described herein are by way of example, and the scope of the invention is not limited to the exact details of construction and use. Components and features described in one embodiment can be used instead of or in addition to components and features described in the context of other embodiments.