SYSTEM FOR PROVIDING MIXED REALITY INTERACTION WITH A COMMERCIAL OFFERING
20180025384 ยท 2018-01-25
Inventors
Cpc classification
G06Q30/0252
PHYSICS
International classification
Abstract
A response to an advertisement driven stimulus is effected by locating a portable Mixed Reality (MR) device at a terrestrial position at a point in time; identifying a fixed point advertisement in proximity to the portable MR device based upon the device's terrestrial position; and providing a response specific to the fixed point advertisement. The point in time is determined by a signal from the portable MR device with respect to an advertisement, whereafter the MR device is located by receiving a navigational signal. Communication is automatically established with a central data server where the fixed point advertisement is identified by comparing the terrestrial position of the portable MR device with a plurality of tabulated positions of fixed point advertisements. A unique identifier associated with the portable MR device and position of the device are utilized by the data server to tailor a specific response to the advertisement based stimulus.
Claims
1. A method for providing access to a commercial offering, said method comprising the steps of: locating a portable mixed reality device at a terrestrial position at a point in time; identifying a commercial offering in proximity to said portable mixed reality device at said point in time based upon said terrestrial position; and providing a response specific to said commercial offering.
2. The method as recited in claim 1, wherein said locating step comprises receiving a navigational signal at said portable mixed reality device.
3. The method as recited in claim 2, wherein said providing a response step comprises the step of paying for goods or services, said goods or services being determined by the identification of said commercial offering.
4. The method as recited in claim 2, wherein said providing a response step comprises paying an admission fee.
5. The method as recited in claim 4, wherein said providing a response step further comprises generation within said portable mixed reality device of an access code.
6. The method as recited in claim 5, wherein said portable mixed reality device is adapted to communicate said access code to a receiver associated with said commercial offering.
7. A method for utilizing a transportation service, said method comprising the steps of: locating a portable mixed reality device at a terrestrial position; determining the availability of a transportation service based upon said terrestrial position; and communicating with said transportation service.
8. The method as recited in claim 7, wherein said locating step comprises receiving a navigational signal.
9. The method as recited in claim 8, said method further comprising the step of paying a service charge.
10. The method as recited in claim 9, wherein said service charge comprises a ride fare.
11. A method for providing access to a commercial offering, said method comprising the steps of: locating a portable mixed reality device at a terrestrial position at a point in time; identifying a commercial offering in proximity to said portable mixed reality device at said point in time based upon said terrestrial position; signaling a receiver associated with said commercial offering, and providing a response specific to said commercial offering.
12. The method as recited in claim 11 wherein said signaling a receiver step comprises activating a brain actuated controlled signaling device.
13. The method as recited in claim 11, wherein said signaling a receiver step comprises activating an electrical switch or button.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0009] Although the scope of the present invention is much broader than any particular embodiment, a detailed description of the preferred embodiment follows together with illustrative figures, wherein like reference numerals refer to like components, and wherein:
[0010]
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
[0025] Although those of ordinary skill in the art will readily recognize many alternative embodiments, especially in light of the illustrations provided herein, this detailed description is exemplary of the preferred embodiment of the present invention, the scope of which is limited only by the claims appended hereto.
[0026] Referring now to the Figures, a system for providing mixed reality interaction with a commercial offering 20 is shown to generally comprise a user side 40 for collection of a user's commercial intentions and a processing side 21 for acting upon those intentions. The user side 40 is preferably linked to the processing side 21 through a publicly accessible data network 36. As will be better understood further herein, the user's location is captured by providing a signal from a brain-actuated control device 48a or a switch/button 48b on a location capture unit 41 when the user desires more information about a product advertised on a closely located fixed position advertisement 54. This location information is then transmitted through the public data network 36 to the processing side 21 where an information center 22 may interpret and act upon the user's desire. As also will be better understood further herein, the user may be connected by wireless telephone 42 to a business telephone call center 32; order a product from a manufacturer's distribution center 33; or participate in an interactive, prompt-based cellular telephone call with the information center 22. Additionally, the user may interact with the information center 22 via a blended computer-generated virtual image or images associated with the commercial offering, for example, a 3D holographic animated character could appear in the user's visual field to complete the transaction, all of which could take place while the user is engaged in an unrelated primary task.
[0027] As shown particularly in
[0028] As shown in
[0029] In the configuration of
[0030] As particularly shown in
[0031] Turning now to
[0032] Although those of ordinary skill in the art will recognize many substantially equivalent alternatives, the preferred method for resolution of the target location is detailed in
[0033] If the resolution of the target is at this point successful, i.e., there is only one likely candidate remaining, then the type of service requested is identified at the data server 23. This identification may then be used to determine whether it is appropriate to terminate communication 77 between the information center 22 and the location capture unit 41, thereby minimizing data charges. If, on the other hand, the target resolution is not yet successful, i.e., there remains more than one candidate target, other collected information may then be used to further attempt resolution 73. For example if merely comparing the distances 70 to the candidate targets proves insufficient to identify the intended fixed position advertisement 54, the directional field of view 72, as obtained through the directional indicator 52, or the direction of travel, as determined by the GPS receiver 49, may be utilized to determine which fixed position advertisement 54 the user was likely to have been looking at when the signal 48a or 48b was generated. Again, if the resolution is at this point successful, the type of service may be identified 71.
[0034] If at this point the target has not yet been successfully resolved, however, user input may be applied 74, if desired. By way of example, such user input may be gathered by utilizing speech synthesis/recognition implemented through the public data network 36 to the user's wireless telephone 42 with a request for more information. In this manner, the user may be prompted to respond, for example, by speaking to indicate which commercial offering the user is considering. The user's response may then be transmitted back through the user's wireless telephone 42 to the information center 22 where the instruction may then be carried out. If no user input is available, however, such as would be the case if communication was interrupted communication prior to successful target resolution, the system must at this point must fail 75. Upon failure, however, a communication may nonetheless still be transmitted through electronic mail or other equivalent means notifying the user that the request cannot yet be fulfilled. This transmission may also include instructions or choices for response whereby the request may ultimately be fulfilled. For example, the electronic mail may allow the user to reply to a selection of reply addresses in order to effect the user's intention. On the other hand, the information requested by the user may be pre-positioned upon the web server 27 in which case the user would be provided with a URL address for each likely candidate. Finally, in the event of a resolution failure, all open communications between the location capture unit 41 and the information center 22 are terminated 76 in order to prevent further data charges.
[0035] Turning now to
[0036] In many cases, it is envisioned that the user will simply desire information to be transmitted via electronic mail or otherwise to a business or residence 60. In this case, an information request 83 is fulfilled by simply transmitting 84 the desired information from the electronic mail server 28 through the Internet 62, allowing receipt by the user of the information at his or her residence 60 through his or her own Internet connection 61 without the necessity for actually talking with a sales person. In the case, for example, of a house for sale, this electronic mail may include multi-media components. In the exemplary case, a virtual tour of the home for sale may be generated on the multi-media server 29 and attached to the E-mail to be transmitted.
[0037] In another aspect of the information request 83, it may be that the user wishes to be contacted by the ultimate service provider or product manufacturer. In this case, the user's identity may be transmitted through the Internet 62 to the manufacturer 33 or service provider over their own Internet connection 34. The manufacturer 33 or service provider may then initiate contact with the user in any manner appropriate to the offered good or service and authorized by the user. For example, the user utilizing the present invention to contact a hotel or restaurant reservations clerk may wish that the hotel or restaurant contact the user by cellular telephone. In this manner, the user is spared cellular airtime charges until such time as a reservations clerk is available to actually speak with the user.
[0038] In yet another aspect of the present invention, it may be that the user desires to actually consummate a purchase 85 as a result of generating a signal via brain-actuated control device 48a or switch/button 48b. Such a purchase request 85 may be fulfilled either by passing the order information to the manufacturer or by drop shipping. In the former case, the user's pertinent profile information, such as address and credit card number, are simply E-mailed to the manufacturer along with details of the product order. The manufacturer may then utilize any commercial delivery service 35 for fulfillment of the user's request. In the latter case, the user's credit card information may be processed 86 at the information center 22 whereafter the order can be shipped 87 without delay.
[0039] Finally, an interactive session may be established 89 with the user as a result of a generated signal from brain-actuated control device 48a or switch/button 48b. In this case, the information center 22 provides the user with a series of synthesized voice prompts 90 and collects 91 responses entered into the user's telephone keypad or other available data input system, such as a virtual input device. As with the call pass through function 79, the user interactive session 89 requires that the communication with the user be maintained until all responses are collected. At this time, however, the communication may then be terminated 92. In an alternate embodiment of the interactive session 89, the user may interface with the information center 22 through his or her web browser capable wireless telephone 43 or through his or her handheld computing device 46 and wireless MODEM 44 or through any other substantially equivalent mode of communication. This embodiment of the interactive session 89 can include a mixed reality simulation of, for example, a customer service representative who can subsequently interact with the user in a natural manner utilizing, for example, speech recognition.
[0040] In an extension of the interactive session function 89 and the purchase request function 85, the present invention may be utilized to interactively consummate a purchase. For example, in one implementation of this feature, the principles of the present invention may be advantageously employed to enable a user to select and purchase a number of movie, or other, admission tickets, thereby bypassing long ticket booth lines. This is particularly advantageous when considering that delays incurred in line, which in fact may cause one to actually miss a show time, are likely caused by the volume of persons present who seek tickets to entirely different showings.
[0041] In operation, the user seeking tickets to a particular event simply moves to within the proximity of the ticket outlet and, thereafter, generates a signal on his or her location capture unit 41. The target event is then resolved, as previously described, and an interactive session 89 is established between the user and the information center 22. A virtual customer service representative, for example, could then materialize within the user's visual field and interact with the user in a natural way. The user may thereby then select the particular event, the show time, the number of tickets required and the like and/or may provide information regarding special requirements such as for seniors' or children's tickets or disabled access or seating. As previously described, the user's interaction with the information center 22 may be through cellular or other wireless telephone 42, web browser capable wireless telephone 43, handheld computing device 46 and wireless MODEM 44 or any substantially equivalent mode of communication. In the case wherein the user decides that he or she does in fact wish to make a ticket or other purchase, pertinent profile information may be utilized to process the user's request as previously discussed.
[0042] It is noted that many readily available handheld computing devices 46 comprise an infrared or wireless communications link for short range transmission of data to and from the handheld computing device. As a result, although any of the previously mentioned devices may be utilized for the interactive session 89 between the user and the information center 22, short range communication capable handheld computing devices 46 may be utilized to additional advantage for this particular aspect of the present invention. In particular, an authorization code may, during the interactive session 89, be downloaded from the information center 22 to the user's handheld computing device 46. The handheld computing device 46 may then be taken with the user to the event venue and there utilized as an electronic ticket, thereby allowing the user to gain immediate access without stopping at a will call window or the like for identification and ticketing. Although the processing of the electronic ticket may be monitored, those of ordinary skill in the art will recognize many possibilities for implementation of this function though a completely automated and unattended system. In this manner, this aspect of the present invention is particularly adapted to ensure the fastest possible access to even the most crowded events, including not only movie theaters but also theme parks, concert events, sporting events and the like. Additionally, those of ordinary skill in the art will recognize that this aspect of the present invention may also be advantageously implemented in other applications such as, for example, streamlined passage through an automated car wash.
[0043] Turning now to
[0044] As shown in
[0045] While the foregoing description is exemplary of the preferred embodiment of the present invention, those of ordinary skill in the relevant arts will recognize the many variations, alterations, modifications, substitutions and the like as are readily possible, especially in light of this description, the accompanying drawings and claims drawn thereto. For example, as shown in
[0046] In the case of radio advertisement, a specially modified radio, e.g. a radio equipped with RDS, may be provided in order that the data capture unit 120 may have available information as to what radio station the user is listening. Upon hearing an announcement to click now, the user may respond as previously described. In either the television or radio example, it is to be understood that the user side 40 may comprise any previously discussed combination of elements such that any previously discussed service may be provided. For example, the data capture unit 120 may be utilized as an automated telephone dialer for connection of the user with a call center 32, restaurant or hotel reservations line or the like. Finally, aspects of the present invention may be extended to a set of applications based upon a user-fee based business model. In particular, it is envisioned that the position location and communication aspects of the previously described embodiments may be implemented within a non-advertisement-based context, such as may exist in the provision of public goods. As one example of such an application, it is noted that the position location and communication aspects of the invention may be utilized to provide a 3D virtual tour guide for sight-seeing in the public parks, historic places or other recreation areas. The virtual tour guide would appear in the user's real-space via headset 50 and accompany the user throughout the tour providing interesting or even vital information. In this case, the user may be directly charged (according to billing information in the user's profile) or the service may be provided as part of the admission fee to the park or like venue.
[0047] In a further extension of this model, it is also noted that the foregoing features of the invention may be implemented in order to provide landmark identification for the visually impaired or cognitively disabled persons. In particular, such a person may traverse a historical location and automatically (or upon signaling) receive audio information regarding the historical significance of his or her exact position within the location. With the use of a location capture unit 41 having directional capability (such as provided with a flux gate compass or the like), the user may receive additional or tailored information based upon the direction in which he or she is facing.
[0048] In yet a further extension of the present invention, provision may be made for a taxi cab, Uber car or shuttle application, as shown in
[0049] At this point, the processing side 21 determines whether such service is available based upon the user's resolved location. As will be understood by those of ordinary skill in the art, this determination may involve communication between the processing side 21 and the taxi, Uber or shuttle service in any of the manners previously described or the substantial equivalent thereof. Additionally, this determination may also be at least in part based upon system knowledge of the exact location and status (through the provision of GPS receivers within cabs or shuttles) of affiliated vehicles Should it be determined that the desired service is available, pickup details are transmitted 132 to both the user and the taxi or shuttle service. As will be understood by those of ordinary skill in the art, transmission to the transportation service may be through the service dispatcher or may be through direct communication with the driver via an MR display worn by the driver of the vehicle. It is envisioned that one possibility includes rendering a 3D virtual representation of the driver and passenger to enable them to virtually meet. In any case, in the preferred embodiment of the present invention details regarding the identity of the user are transmitted to the driver and details regarding the service and driver are transmitted to the user. In this manner, the present invention betters upon the prior art inasmuch as the present invention provides heightened security for both the user in need of a ride and the driver called upon to provide the ride.
[0050] Additionally, the implementation of the present invention carries with it the additional benefit of enabling the user to automatically pay any required fare or fee utilizing credit card or other financial information maintained upon the data server 23. In fact, it is envisioned that taxi, Uber or shuttle services taking advantage of the present invention may be able to entirely dispense with the necessity for carrying cash. To this end, the user is preferably given an option at the end of the ride to pay the fare utilizing the location unit 41. To pay the fare 133, the user need only generate a signal on the location capture unit 41, whereafter authorization for the charge may be processed through the processing side 21. As will be understood by those of ordinary skill in the art, indication of the user's desire to pay the fair may be through direct communication between the location capture unit 41 and the processing side 21 or may be through a transmission between an appropriately configured location capture unit 41 and dashboard or otherwise mounted receiving equipment provided within the taxi or shuttle vehicle. Of course, tips may be added to the fare at this time at the user's discretion. Likewise, it is noted that should an appropriate service not be available, other option 134 such as voice connection 79 to a standard taxi service or Uber car may be provided as previously described.
[0051] Finally, it will be apparent to those of ordinary skill in the art that this feature of the present invention can still be further extended to take advantage of the extraordinary communications connectivity provided through the network of the present invention For example, while the user is awaiting his or her taxi he or she may interact with a virtual taxi dispatcher or proximate Uber driver to upload destination information to the processing side 21 through a handheld computing device 46, smart phone or the like. The information center 22 may then generate and transmit to the driver detailed directions for ensuring that the user is expeditiously delivered to his or her desired destination. In any case, because the scope of the present invention is much broader than any particular embodiment, the foregoing detailed description should not be construed as a limitation of the scope of the present invention, which is limited only by the claims appended hereto.