HYBRID DATA COLLECTION SYSTEM TO CREATE AN INTEGRATED DATABASE OF CONNECTED AND DETAILED CONSUMER VIDEO VIEWING DATA IN REAL-TIME

Abstract

The present invention relates generally to a very sophisticated system and software to collect a large range of hybrid user dam in relation to viewing of video content on any viewing platforms including television, online and other forms systems available on a real-time basis. Specifically, embodiments of the present invention provide systems and software for hybrid data collection and storage for large numbers of different data types and complex output analyses instantaneously. Further, because of the single source of the user data, system data outputs are already, and uniquely, in a verified (and validated) form and there are no requirements of additional verification or validations procedures such as identity (or device) graphing.

Claims

1. A computer system and software module to collect real-time user video viewing data leveraging links between related systems users (friends) to create new and different descriptive data types all in real-time, comprising: an application software module comprising computer executable code on the user mobile device, a direct interface between the module and user device's operating system, an internet protocol connection with cloud-based system servers, an internet protocol connection to other related users' (friends') devices, a computer readable database for user and system data recording, wherein the said software module, said internet protocol connections and databases are configured to: use system software to identify content being viewed in real-time. augment content title information with related metadata records in system database, share viewing information across related user groups (friends' groups) create comparative viewing indexes between related users (friends) to weight relevance of viewing. record all data and data types collected to large-scale computer readable databases, tagged by time, individual user, connected user groups, content title and other key elements for analysis and outputs.

2. The system and related software module in claim 1, wherein the said elements are further configured to: access key user data directly from the user and related users' (friends') devices, including device types, device identification, contacts information and other related data, collect other key user demographic information entered by the individual users in setting up their accounts including credit card verifications from system cloud servers, record all data and data types collected to large-scale computer readable databases, tagged by time, individual user, connected user groups, content title and other key elements for analysis and outputs.

3. The computer system and software module in claim 1, wherein the said elements are further configured to: use content information received from user devices and system servers to calculate start, finish and elapsed times of current viewing, record viewing information and share with related users (friends) on the system, leverage this information to encourage users' communications about content, and record hybrid data information tagged by content and user on the system database servers for system analysis.

4. A computer system and software to collect other hybrid data types by leveraging voice, text, video and other data communications between users, which comprises: a software module comprising computer executable code on the user mobile device, a direct interface with the user device operating system, an internet protocol network connection between user devices and system cloud servers, a software application to establish communications between user devices via text, voice or video, a data interface application to share user viewing and other information between related user devices on the system, an application to interface with the user device to integrate contacts information into the system, and a system to allow users to initiate communications with related user (friends) tied to current viewing and group membership, configured to: create voice, text and video communications between related users, initiate joint or individual communications linked to specific content being viewed by users, create pre-scheduled communications around organized (scheduled) group viewing, share viewing and other related information between related parties (friends) using the system, and record all types of communications information (data) to a backend database server for analysis flagged to individual users and user groups.

5. The software application and systems as in claim 1, wherein one or more of the said software applications and or server software systems are used to create ratings for specific content related to prior viewing and user bias configured to: send prompt to a user via the user device screen including any history of prior viewing, and duration of current viewing, request the user input a ratings number for the currently viewed content, forward the data inputs via an internet protocol connection to system servers and, share individual user ratings with related (friends) and record data on the system database servers flagged by user and content identification.

6. The software application and systems as in claim 1, wherein one or more of the said software applications and or server software systems are used to create ratings for specific content configured to: use the identity of content being viewed from the system to search and retrieve program viewing history from the system database servers, calculate levels of user interest in content based on current viewing, total time watched and overall frequency of viewing, create a system-generated content rating for this video content by alternate weightings of all the key viewing elements and, share individual user ratings which related (friends) and record data on the system database servers flagged by user and content.

7. A software and device implemented method for verifying collected user data as identified in claim 2, wherein the system collected data is simultaneously verified instantaneously by a number of means, comprising the following steps: user is verified in the system upon registering on the system through address and credit card verifications, a related user mobile device is authenticated as the source of the user data via universal device identity number (UDID) and telephone number confirmation, data collected and recorded by die system is tagged with related user identification cross-referenced with said verified name, address, phone and device numbers (UDID's, all collected user data is pre-verified by the system immediately on receipt.

8. A software implemented method for collecting and analyzing user communications as identified in claim 4, to determine user sentiment on a one-step real-time basis in relation to specific content viewed, comprising the steps: utilize keyword software to analyze the recorded communications data between users as recorded to determine whether the communication is related to any specific video content viewed by users, apply artificial intelligence software to determine user sentiment indicators for any specific identified content whether positive or negative and the level of intensity thereof and, record the sentiment analysis data elements on the system database servers tagged to users and individual program content.

9. A software implemented method of claim using the system identified in claim 4, for real-time analysis, wherein the various forms of hybrid data recorded in the said system databases can be leveraged to produce more advanced predictive reporting outputs, involving; operator inputs of requested forms and types of predictive data analysis required, system software runs data sorts to retrieve required verified data inputs for analysis, and artificial intelligence software analyzes selected data using iterative processing to create requested predictive reports based on both historical and real-time data, and create report outputs based on pre-verified data in near real-time.

10. A software implemented method of claim using the method identified in claim 9, and the said more advanced, data analysis utilizing prescriptive reporting methods involving; operator inputs requested forms and types of predictive data analysis required, system accesses verified data from system databases and live data feeds from user devices to create data pool for analysis, artificial intelligence software functionality to perform high velocity, real-time prescriptive reports to assess specific user viewing reactions and, the report output is created by the system rapidly based on pre-verified data.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0025] FIG. 1 is a summary process flow diagram showing an exemplary method in accordance with an embodiment of the present invention; and

[0026] FIG. 2 is a diagram of a typical set-up for the collection of viewing data and the key devices and systems involved in accordance with an embodiment of the present invention.

[0027] FIG. 3 is a process flow diagram showing an exemplary method in accordance with an embodiment of the present invention; and

[0028] FIG. 4 is a process flow diagram showing an exemplary method in accordance with an embodiment of the present invention; and

[0029] FIG. 5 is a process flow diagram showing an exemplary method in accordance with an embodiment of the present invention; and

[0030] FIG. 6 is a process flow diagram showing an exemplary method in accordance with an embodiment of the present invention

DETAILED DESCRIPTION OF THE INVENTION

[0031] A better understanding of the disclosed embodiments will be obtained from the following detailed descriptions and accompanying illustrations. All illustrations of the drawings are for the purpose of describing selected versions of the present invention and are not intended to limit the scope of the present invention.

[0032] Embodiments of the present invention are directed to providing systems and software, including applications installed on user smartphones, PC's, laptops, tablets and other similar devices, to collect, to combine and analyze large volumes of hybrid user data obtained from user's viewing of video content and advertising. Because of the social nature of the system's consumer applications and the requirement to monitor, manage and share consumer viewing information between users, the system collects large amounts of detailed information on individual video viewing across all content platforms (including broadcast, cable, satellite and on-line systems). The software on the consumer devices is linked via internet protocol networks to multiple cloud-based servers to transfer to and from these servers in real-time.

[0033] In embodiments of the current invention, social sharing of viewing information with friends encourages users to use the system regularly and invite more friends to install the software application on their device and join them on the network. In this way the numbers of users (panel sizes) will continue to grow organically to provide more and more viewing data information to the system data servers for analysis and outputs.

[0034] Turning now to FIG. 1, an exemplary embodiment of the key elements, devices and data systems, in accordance with an embodiment of the present invention, is shown. According to an embodiment of the invention, the system incorporates a consumer application, [101], downloaded and installed on the consumer device which can include smartphones, PC's, tablets, smart TV's and TV connected equipment. This is integrated with the device operating system, [102], and the device audio recorder (microphone), [103]. In this embodiment the device is connected to cloud servers via a communications manager system, [104], and to the main backend systems servers, [105], as well as data storage servers, [106]. There are also software systems to analyze and create data outputs in step [107] to produce data outputs for reports in step [108] and large scale raw data transfers in step [109].

[0035] According to an embodiment of the present invention, when a user signs up for the social viewing application, the System creates an initial data profile for the user including name, address, gender, content viewing platforms and credit card validation. It also creates tagged files to process and stores data derived from the user's viewing of video content material in computer readable memory in system databases. After users register and set up their personal options, they are prompted to also select friends from their current friends' lists and invite them to join their “viewing friend's group”. From this point on, all viewing information, ratings and recommendations are shared with all members of the connected friends' group via internet protocol network links to each users' devices

[0036] According to an embodiment of the present invention, once users have provided the required profile information and begin to watch any television or video content (including advertising), the system begins continuously monitoring user viewing using automatic video content recognition systems based on audio fingerprinting technology.

[0037] In a key embodiment of the present invention, the device application software monitors the consumer's viewing using the device microphone (or other audio track information) to create audio fingerprints (ie. short samples of the audio track data from the viewed program or advertising spot) which are transmitted to the system servers. The system software subsequently performs audio fingerprint comparisons against an extensive database of fingerprinted video content and current advertising video to determine a “match”. As part of the process, the system utilizes extensive program, network and or platform metadata qualified by known user information and location to determine a complete program profile of viewed content including program titles, episode and season information and viewing network and or platform.

[0038] In a preferred embodiment of the present invention, the program data collected and additional information derived by the system itself, are transmitted in real-time to the primary user's device and the devices of other linked users (friends) on the system. This user information is also collected and tagged to allow additional analysis of friends' interaction around viewing content as well as a comparative viewing index and recorded in large computer readable database servers on the system. In addition, information on advertising content viewed by a user, and identified by the system, is recorded in related database servers and similarly tagged to individual viewing users.

[0039] Separately, in an embodiment of the present invention, the application on the consumer device incorporates a number of forms of in-application communications including voice, video and text messaging which are enabled to allow users to interface with each other regarding viewed content, including their views, ratings and program recommendations. The system software monitors and records in-app communications in a computer readable database in real-time. Subsequently, system software uses key-word analysis to identify communications between users in relation to specific viewed video content. These communications are tagged to individual users and user(friends) groups. Utilizing artificial intelligence software and leveraging other system data including individual viewing histories, ratings and program recommendations, the system identifies user communications based on sentiment (positive or negative) and intensity. In doing this the software considers factors such as frequency and regularity of individuals viewing and viewing correlations between friends group members to also develop a separate profile of the user(friends) groups combined interest in a particular program or video content. The sentiment analysis data is recorded in a computer readable database and mapped in real-time to other program data on the database servers. This information can be outputted as reports for defined content or on an aggregate basis for specific video content or other programing.

[0040] In a common embodiment of the present invention, the system and device application also incorporate automatic and semi-automatic ratings options for each program being viewed by a user. In the first instance, the automatic ratings engine software uses the actual viewing times in minutes, percentage of total program run-time viewed as well as previous repetitive viewing to produce an estimated individual rating for a particular program. System ratings software then utilizes these inputs to create a combined estimated rating which is tagged to the user and recorded on the system database servers. In the second instance, system users are presented with a manual ratings option via an automatic on-screen prompt (pop-up) on their device once the user has viewed a significant proportion of the program. The user is prompted to manually input a program rating for that show from a ratings scale displayed on the user device. The user ratings response which is likewise recorded on system database servers. In both cases the ratings information is tagged to that particular user and shared with other related users (friends) via the internet protocol network.

[0041] According to an embodiment of the present invention, a particular function of the system allows for specific predictive and prescriptive analysis of consumer viewing (and related) data based on control panel inputs. This tool creates a way of estimating consumer reaction (by selected user type or other classification) to specific content or content types in real-time by performing iterative tests on live user data. Artificial intelligence software is further used in this process to create more advanced forecasts and predictive analyses for key use cases and cross reference results against other related user data in the databases.

[0042] According to an embodiment of the current invention, as an individual uses the system over time, the system software creates extensive histories of personal viewing habits, friends' viewing habits and viewing ratings and recommendations all recorded and flagged to individual user profiles in the system databases. This information is subsequently analyzed by system software applications to classify individual users into specific viewer categories. The relevant data includes not only show preferences and genres, but also other specific unique viewing classifications which identify particular users.

[0043] In a preferred embodiment of the present invention, system applications uniquely monitor and verify the real identity of any user(viewer) via confirmed personal information including location, email addresses, credit cards, mobile phone numbers and unique device identification (UDID) number. There is no requirement for separate identity (or device) graphing procedures to ensure that all data for an individual exactly matches a particular consumer's identity with a near 100% degree of accuracy.

[0044] According to the preferred embodiment of the current invention, the huge amounts of hybrid data (both structured and unstructured) collected from user devices as well as related data derived by the system are recorded into one or more database servers. These databases are managed by system management software as well as various analytics and reporting tools to provide both batch data and report outputs including in real-time with direct client online access.

[0045] In an embodiment of the system of the current invention, management and reporting software systems are used to provide analysis and reporting of viewing and associated data in real-time. Further, the systems are structured to provide live operator console access to the system to individual clients for viewing and outputting reports of pre-verified consumer and aggregate data. In this regard, a specific and unique use case is the creation of real-time predictive and or prescriptive analysis of current programming on any number of content platforms. Through the system reporting console (which can also be operated via the web by an external third-party), the operator can produce report outputs of current viewing data by user groups for a particular program or programs based on various input criteria. These include, but are not limited to, user demographics, viewing location, histories of prior viewing, individual content ratings for a show and derived sentiment levels of the user and or friends. In this way the system provides sophisticated analysis and reports which show users relative interest, propensity to watch and comparative viewing habits for specific programs. The software systems also provide similar types of analysis for advertising content and related video interstitials.

[0046] Turning now to FIG. 2, embodiments of the present invention are shown. These incorporate key elements of the system and backend servers including, but not limited to: smartphones, PC's and tablets, smart TV's or connected TV devices all linked to the internet via wired or wireless connections. These are all linked to backend cloud servers which incorporate multiple layers of device communications and application management software systems including: device application interface and control software , database servers and file management software, consumer text and voice communications databases, artificial intelligence and key word identifications software, data reporting and analytics software, and data lake storage servers. One of ordinary skill in the art would appreciate that the system could be comprised of fewer components or additional components than those displayed in FIG. 2 that is provided for exemplary purposes.

[0047] Turning then to FIG. 3 and FIG. 4, which show embodiments of the present invention. These diagrams represent the elements of the recording of the audio track from the content viewing device and the subsequent identification systems as well as the interfaces between the consumer device app and system backend servers and software. The first stage shown in FIG. 3 relates to the consumer device processes. The application software, [301], connects with the device operating system in step [302] to trigger (open) the device microphone, [304], to record the audio track from content being viewed contemporaneously. Fingerprinting software, [305], then analyzes the audio track and creates fingerprint data which is recorded and sent in step [306] via an internet protocol network to a communications manager system, [307], for forwarding to content identification systems in the backend. In the second stage in FIG. 4, the audio fingerprint data is received from the communications manager server in step [401] and sent to the fingerprint matching server, [402]. Software then matches the audio fingerprints with an extensive library of video content fingerprints on a video content fingerprint database in step [403] to identify a program or other video content or advertising. Based on the content identification output in step [404], if no match is found a null response is returned to the device application, [405]. If content is identified as video programing in step [404], the information, including program title and episode, is then forwarded to other system servers where software incorporates additional program descriptors and information in step [406] via interfaces with a comprehensive content metadata database, [408]. This database includes detailed information on program titles, schedules, networks, platforms, actors and cast as well as season and episode information. The full program data file is then returned in step [409] via an internet protocol network to the device application for output display on the consumer device screen, [410]. Simultaneously the information is forwarded and tagged to individual users in step [411] and recorded on the user viewing history data storage servers [412].

[0048] Content identified as advertising video in step [404] is forwarded directly in step [407] to be tagged by user in step [411] and recorded on the system data storage servers, [412].

[0049] FIG. 5 represents an embodiment of the invention reflecting the mechanisms for handling and creating sentiment analysis of users(viewers) in terms of positive or negative reactions to specific programs or other video content. The device application, [501], which is integrated with the device operating system, [502], manages text and voice communications between systems users on the system. The text and voice data (reflecting these communications) is stored in a computer readable database, [504], where the data is analyzed by key word software in step [505] to create basic user sentiment data outputs. Artificial intelligence software, [506], which also leverages inputs from user and friends viewing data in step [509], is then applied to the existing sentiment analysis data to derive more sophisticated sentiment analysis outputs and reports, [510].

[0050] FIG. 6 shows an embodiment of the present invention which represents the processes for handling user and system derived information and creating data outputs including raw, structured and unstructured data files and other secondary reports. In the first instance, inputs to the reporting console, [601], initiate analysis and reporting functionality in step [602] via interfaces with database management software, [603], and the data storage servers to produce reports and other requested forms of outputs, [604]. In the second instance, manual inputs to the data extraction console in step [605] initiate a data sorting and transfer process in step [606] via data management systems, [603], against the data storage servers. Raw data outputs are then formatted in step [607] and transferred to output servers in step [608] utilizing FTP or other transfer formats to transmit data to third party or other remote systems.

[0051] While certain novel features of this invention have been shown and described, it will be understood that various omissions, substitutions and changes in the forms and details of the device illustrated and its operation can be made by those skilled in the art without departing from the spirit of the invention.