INTERFACE METHOD AND SYSTEM FOR ENABLING AN ADVERTISEMENT SPONSOR TO INPUT DATA CONCERNING LEADS GENERATED IN RESPONSE TO ADVERTISEMENTS

Abstract

A method and system for controlling a display enables the sponsor of an advertisement to score displayed leads by either swiping left of right in the area of a touchscreen where the lead is displayed, to move a slider to indicate a value of the lead, or to otherwise input a score or rating. The method and system also allows a user to verify the accuracy of a displayed lead type identification, and to submit a corrected lead type identification to the provider if the initial identification is incorrect, for use as input to a neural network that performs the lead type identification.

Claims

1. A method of enabling the sponsor of an advertisement to score advertising leads provided by an advertisement management and/or analysis service, comprising the steps of: displaying a list of the leads; associating a numerical value, a rating, or a score with one of the leads based on interaction by the sponsor with the display of leads.

2. A method as claimed in claim 1, wherein the numerical value is at least one of: (a) a minimum or maximum input by a directional swipe movement relative to the display; (b) a value assigned by the sponsor and indicated by a direct numerical input or movement of an indicator included in the display; and (c) a score assigned by the sponsor and indicated by the position of one of a selected plurality of selectable shapes or icons.

3. A method as claimed in claim 2, wherein the numerical value is said minimum or maximum value, and the gesture is a sliding movement of a user's hand or at least one finger across a touchscreen of a mobile device on which the list of leads is displayed, the direction of the sliding movement indicating whether the input score is said minimum value or said maximum value.

4. A method as claimed in claim 3, further comprising steps of tabulating the values input by said sliding movements to obtain a total score for a plurality of leads.

5. A method as claimed in claim 4, wherein the step of tabulating the scores further including a step of normalizing the scores according to the equation: $\mathrm{Score}.Math.=\frac{v-a}{b-a}.Math.\left(d-c\right)$ where v is the final score or running total, a is the maximum possible score, b is the minimum possible score, c is the minimum score in the range of scores is to be mapped, and d is the maximum score to which the range of scores is to be mapped.

6. A method as claimed in claim 4, further comprising the step of inputting the lead scores to an advertising platform API (application programming interface) that scores the corresponding advertisement that generated the lead.

7. A method as claimed in claim 2, wherein the numerical value is said value assigned by the sponsor.

8. A method as claimed in claim 7, wherein the said indicator is a slider whose position is set by touching an area of the touchscreen on which the slider is displayed and executing a sliding movement of the user's hand or at least one finger across the touchscreen, accompanied by a varying display of the numerical value to be input.

9. A method as claimed in claim 8, wherein the numerical value is a monetary value.

10. A method as claimed in claim 8, further comprising steps of tabulating the numerical values input by said sliding movements to obtain a total score for a category of leads.

11. A method as claimed in claim 1, wherein the step of displaying the leads comprises the step of displaying the leads on a touchscreen of a mobile device.

12. A method as claimed in claim 1, further comprising the steps of displaying a lead type identifier and selectable icons respectively indicative of whether the lead type identifier is accurate or inaccurate, and of uploading a selection of one of the icons to an artificial intelligence program that utilizes the uploaded selection as a teaching input to refine identification of lead types.

13. A method as claimed in claim 12, further comprising the step of, upon selection of an icon that indicates that the identifier is inaccurate, displaying a list of potential identifiers, and uploading a potential identifier selected by a user.

14. A method of training a provider of a list of leads generated based on responses to an advertisement to more accurately identify the leads, comprising the steps of: displaying a lead type identifier and selectable icons respectively indicative of whether the lead type identifier is accurate or inaccurate; upon selection of an icon that indicates that the identifier is accurate, notifying the provider that the list type identifier is accurate; upon selection of an icon that indicates that the identifier is inaccurate, displaying a list of potential identifiers, and upon selection of one of the potential identifiers, uploading the selected potential identifier to the provider for use as a teaching input to refine identification of lead types.

15. A system for enabling the sponsor of an advertisement to score advertising leads provided by an advertisement management and/or analysis service, comprising a memory, a processor, and a set of display control instructions stored in the memory and executable by the processor, the set of display control instructions including instructions for: displaying a list of the leads; associating a numerical value, a rating, or a score with one of the leads based on interaction by the sponsor with the display of leads.

16. A system as claimed in claim 13, wherein the numerical value is at least one of: (a) a minimum or maximum input by a directional swipe movement relative to the display; (b) a value assigned by the sponsor and indicated by a direct numerical input or movement of an indicator included in the display; and (c) a score assigned by the sponsor and indicated by the position of one of a selected plurality of selectable shapes or icons.

17. A system as claimed in claim 16, wherein the numerical value is said minimum or maximum, and the gesture is a sliding movement of a user's hand or at least one finger across a touchscreen of a mobile device on which the list of leads is displayed, the direction of the sliding movement indicating whether the input score is said minimum value or said maximum value.

18. A system as claimed in claim 17, further comprising instructions for tabulating the values input by said sliding movements to obtain a total score for a category of leads.

19. A system as claimed in claim 18, further including an instruction for normalizing the scores according to the equation: $\mathrm{Score}.Math.=\frac{v-a}{b-a}.Math.\left(d-c\right)$ where v is the final score or running total, a is the maximum possible score, b is the minimum possible score, c is the minimum score in the range of scores is to be mapped, and d is the maximum score to which the range of scores is to be mapped.

20. A method as claimed in claim 19, further comprising the step of inputting the lead scores to an advertising platform API (application programming interface) that scores the corresponding advertisement that generated the lead.

21. A system as claimed in claim 16, wherein the numerical value is said value assigned by the sponsor.

22. A system as claimed in claim 21, wherein the indicator is a slider whose position is set by touching an area of the touchscreen on which the slider is displayed and executing a sliding movement of the user's hand or at least one finger across the touchscreen, accompanied by a varying display of the value to be input.

23. A method as claimed in claim 22, wherein the numerical value is a monetary value.

24. A system as claimed in claim 22, further comprising instructions for tabulating the values input by said sliding movements to obtain a total score for a category of leads.

25. A system as claimed in claim 17, wherein the instructions for displaying the leads comprises instructions for displaying the leads on a touchscreen of a mobile device.

26. A system as claimed in claim 17, further comprising instructions for displaying a lead type identifier and selectable icons respectively indicative of whether the lead type identifier is accurate or inaccurate, and for uploading a selection of one of the icons to an artificial intelligence program that utilizes the uploaded selection as a teaching input to refine identification of lead types.

27. A system as claimed in claim 26, further comprising instructions for, upon selection of an icon that indicates that the identifier is inaccurate, displaying a list of potential identifiers, and uploading a potential identifier selected by a user.

28. A system for training a provider of a list of leads generated based on responses to an advertisement to more accurately identify the leads, comprising a memory, a processor, and a set of display control instructions stored in the memory and executable by the processor, the set of display control instructions including instructions for: displaying a lead type identifier and selectable icons respectively indicative of whether the lead type identifier is accurate or inaccurate; upon selection of an icon that indicates that the identifier is accurate, notifying the provider that the list type identifier is accurate; upon selection of an icon that indicates that the identifier is inaccurate, displaying a list of potential identifiers, and upon selection of one of the potential identifiers, uploading the selected potential identifier to the provider for use as a teaching input to refine identification of lead types.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0021] FIG. 1 is a schematic illustration of a mobile device display and method of lead scoring data input according to a first exemplary embodiment of the invention.

[0022] FIG. 1A includes screen shots of the mobile device display of FIG. 1.

[0023] FIG. 2 is a schematic illustration of a mobile device display and method of lead scoring data input according to a variation of the first exemplary embodiment of the invention.

[0024] FIG. 2A is a screenshot of the mobile device display of FIG. 2.

[0025] FIG. 3 is a schematic illustration of a mobile device display and method of lead scoring data input according to a second variation of the first exemplary embodiment of the invention.

[0026] FIG. 3A is a screenshot of the mobile device display of FIG. 3.

[0027] FIG. 4 is a schematic illustration of a mobile device display that permits input of training data for an advertising analysis program that utilizes artificial intelligence.

[0028] FIG. 4A is a schematic illustration of the mobile device display of FIG. 4, after a mobile device user has selected the no option.

[0029] FIGS. 4B and 4C are screen shots of the mobile device displays of FIGS. 4 and 4A.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0030] The method and system of the invention provides a way to score leads transmitted to the user in response to an advertising service that displays the advertisements to potential clients or customers and collects information that can be used to contact the potential clients or customers. For example, in response to the advertisement, the potential client or customer may input data through a web browser concerning the nature of the client's or customer's problem for which the client is seeking assistance, or a product or service sought by the client or customer, together with information that may be used to contact the client or customer. Alternatively, the potential client or customer may provide the information by calling a dedicated response number operated by the advertisement service, such as a toll-free number, with the information being transcribed and packaged as leads and transmitted to a mobile device app or browser software for display and rating in the manner illustrated in FIGS. 1, 1A, 2, 2A, 3, and 3A. The mobile device user may then provide feedback on the interaction in the form of a score, which is then sent to data analysis software of the advertisement management service. The feedback may be provided immediately based on information displayed in the leads, or after interaction with a potential client or customer listed in the lead.

[0031] An example of an existing service that can disseminate advertisements, collect leads, and provide them to the provider of products or services on whose behalf the advertisements were placed is the Google Adwords API/Advertising Platform, which provides a website or cloud-based interface for apps that assist users in developing advertisements and collecting leads. However, it will be appreciated that the invention is not limited to scoring of leads based on ads placed through Google Adwords, and that other ad placement and lead developing services may be utilized. In addition, while a mobile device is illustrated, the interface is not limited to mobile devices, as explained above.

[0032] FIG. 1 illustrates a preferred embodiment of the invention that enables the mobile device user to quickly and intuitively score the leads by inputting advertisement response data by using one of two movements or gestures to interact with a graphic display on a touchscreen of the mobile device to score leads that have been provided to the user. The advertisement response can have one of two states, and data entry is accomplished by performing a different gesture or motion relative to the display to indicate which of the states has been selected.

[0033] In the illustrated example, the states may indicate a positive or negative reaction to the information presented in the lead (such as the content of a chat), and/or may take into account follow-up interactions with the potential clients or customers identified in the lead.

[0034] The motion or gesture may be in the form of a swipe, meaning a sliding movement of the user's hand or finger(s) across the touchscreen display of the mobile device. The direction of the movement, for example in a rightward or leftward direction, is correlated to a positive or negative response. Appropriate software and display controller routines for detecting and distinguishing right and left swipe motions or gestures is well-known to mobile app developers.

[0035] The numerical values or scores correlated with the respective swipe motions may be tabulated, as explained below, by maintaining a running total of the numerical values and processing the total for upload to the central advertisement management and analysis software that provides the leads. The uploaded scores may be just one of many inputs processed by the analysis software, the inputs including data concerning the advertisement, historical data, and so forth, which are then processed to obtain a display of data and conclusions concerning the effectiveness of the advertisement, which may then be transmitted back to the mobile device for display or stored in a database accessible to the user.

[0036] As shown in FIGS. 1 and 1A, a mobile device interface in the form of a touch screen 1 is controlled to display a plurality of advertising leads 2-7 received by the advertisement manager or provider. The user then makes a determination as to whether the lead has value and inputs the results of the determination by swiping right or left, as indicated by arrows 8 and 9. If the user swipes right, as indicated by arrow 8, the lead is scored as the maximum allowed value for purposes of the analysis algorithm, while a left swipe, indicated by arrow 9, results in a minimum allowed value. The minimum and maximum allowed values may optionally be adjusted for different leads according to criteria determined by the mobile app or software that controls the interface. In the screen shot of FIG. 1A, the list of leads is shown in the form of chat transcripts. In the left screen shot, the mobile user has swiped right to indicate a valuable lead, while the right screen shot shows the result of a leftward swipe to indicate an unproductive lead.

[0037] The scores are then processed to provide a running total or score that is adjusted up or down with each swipe, after which the running total may optionally be normalized according to the following formula:

[00001]$\mathrm{Score}.Math.=\frac{v-a}{b-a}.Math.\left(d-c\right)$

where v is the final score or running total, a is the maximum possible score, b is the minimum possible score, c is the minimum score in the range of scores is to be mapped, and d is the maximum score to which the range of scores is to be mapped. For example, if the scores for the mobile app are between 5 and 5, but the range of scores recognized by Adwords is between 0 and 10, a score of 2 would be mapped to 7. This score can then be provided to the ad service, for example Google Adwords, as data for evaluating the effectiveness of the ad. Those skilled in the art will appreciate that the scoring may be carried out by the application programming interface using a programming language such as Python.

[0038] In the variation of the exemplary embodiment shown in FIGS. 2 and 2A, which may replace the embodiment of FIG. 1 or be implemented as an optional alternative method selectable by the user, the lead may be scored on a sliding scale of values that can be input or selected by the user, for example by manipulating a movable object on the display such as a slider such as the one shown in the screen shot of FIG. 2A. For example, the slider can represent a range of dollar amounts that indicate the value of the service or product purchased by the client or customer. As illustrated in FIGS. 2 and 2A, the mobile app or software again displays a list of leads, which are scored by the user. In this embodiment, at least two additional elements are displayed after selecting a lead, for example by touching the portion of the screen where the lead is displayed to trigger display of the two additional elements, which are a slider 10 and a select button 11. Upon display of the slider, the user moves his finger across the display to establish a desired position of the slider, after which the user touches the button 11 to fix the position of the slider 10 and establish and store an input value. Selection may be facilitated by displaying a dollar amount that varies with the position of the slider, or by displaying a series of dollar amounts at fixed positions relative to the slider. FIG. 2A is a screen shot showing a slider that has been positioned to indicate a monetary value of $10,000, and a selected confirmation button (in the form of a check mark).

[0039] The dollar amounts may again be normalized or mapped to a predetermined minimum and maximum according to the algorithm described above in connection with FIG. 1 before transmission to the advertisement management and analysis service for analysis, the input score for each may be transmitted directly to the ad service upon input, or a total of input dollar amounts may be transmitted directly to the advertising management and analysis service that provides the leads.

[0040] As alternative to a slider, the score input for a lead may be replaced by a series or array of selectable shapes or icons, whose position is indicative of the score. By way of example and not limitation, as shown in FIG. 3 and in the screen shot of FIG. 3A, the shapes or icons may be in the form of an array of stars 12 that, for five stars, enables input of a rating of one to five. The number of shapes or icons, and the shapes themselves, may of course be varied by those skilled in the art without affecting the functionality of the display.

[0041] Once the leads are scored and the information provided to the advertisement management and analysis service, the scores may be used to set prices for the advertisements, assist in their design, timing, and media selection, select which advertisements to purchase and display, and/or for any other purpose for which the scores for respective leads provide useful information.

[0042] A second embodiment of the input method and system of the invention is illustrated in FIGS. 4 and 4A. This embodiment is utilized in a lead type identification function of the advertisement management and evaluation system, and in particular to provide feedback to a neural network that performs the lead type analysis. Instead of having the user select a score from options by swiping or manipulating a slider, this option presents a lead type prediction generated by the neural network or artificial intelligence-based program utilized by the ad management server. The lead types may include, by way of example and not limitation, leads identified by the nature of the problem for which the advertiser's service is requested, such as car accident, medical malpractice, taxes, or divorce.

[0043] The evaluation program may utilize an artificial intelligence engine such as Watson to develop a label identifying the type or category of the lead, which is displayed on the mobile device together with a confirmation button having a yes or no option that allows the user to either verify the label is accurate or to indicate that the label is inaccurate. If the user touches the area of the screen associated with the no button, shown in FIG. 4, the mobile app or user interface controlling software provides a list of alterative label options that can be selected by the user, as shown in FIG. 4A. Depending on the user's selection, a positive or negative score is uploaded to the advertising management server. Information on labels that do not match the initially-presented label are also set to the analysis software as feedback for the analysis performed by the artificial intelligence engine, which is used to refine the predictions made by the engine and enhance the listings of leads in the embodiments of FIGS. 1 to 3. FIGS. 4B and 4C are respective screen shots of for the arrangement of FIG. 4 and an example of an alternative label listing corresponding to the alternative label listing of FIG. 4A.