US20150213469A1 - Methods and apparatus to determine audience engagement indices associated with media presentations - Google Patents
Methods and apparatus to determine audience engagement indices associated with media presentations Download PDFInfo
- Publication number
- US20150213469A1 US20150213469A1 US14/685,260 US201514685260A US2015213469A1 US 20150213469 A1 US20150213469 A1 US 20150213469A1 US 201514685260 A US201514685260 A US 201514685260A US 2015213469 A1 US2015213469 A1 US 2015213469A1
- Authority
- US
- United States
- Prior art keywords
- engagement index
- media
- engagement
- internet
- internet service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
- G06Q30/0203—Market surveys; Market polls
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/31—Indexing; Data structures therefor; Storage structures
- G06F16/313—Selection or weighting of terms for indexing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/3331—Query processing
-
- G06F17/30616—
-
- G06F17/30657—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/29—Arrangements for monitoring broadcast services or broadcast-related services
- H04H60/31—Arrangements for monitoring the use made of the broadcast services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/61—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
- H04H60/66—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 for using the result on distributors' side
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/29—Arrangements for monitoring broadcast services or broadcast-related services
- H04H60/33—Arrangements for monitoring the users' behaviour or opinions
Definitions
- the present disclosure relates generally to monitoring media and, more particularly, to methods and apparatus to determine audience engagement indices associated with media presentations.
- audience measurement entities determine audience size and demographic composition for media based on registered panel members. That is, an audience measurement entity enrolls people that consent to being monitored into a panel. The audience measurement entity then monitors the media habits of those panel members to identify media presentations (e.g., television programs, radio programs, Internet browsing, video on demand access, etc.) exposed to those panel members. The audience measurement entity can then determine the size and demographic composition of audience(s) for those media presentations based on the collected media measurement data.
- media presentations e.g., television programs, radio programs, Internet browsing, video on demand access, etc.
- FIG. 1 depicts an example system that may be used to determine audience engagement indices for media presentations based on exposure data measured from media panels and on Internet message postings.
- FIG. 2 depicts an example media programming database storing metadata about scheduled media presentations.
- FIG. 3 depicts an example Internet message database storing messages from users of an Internet service provider.
- FIG. 4 depicts an example apparatus that may be used to determine audience engagement indices for media presentations.
- FIG. 5 is a flow diagram representative of example machine readable instructions that may be executed to implement the apparatus of FIG. 4 to determine audience engagement indices of media presentations based on engagement levels measured from media panels and Internet message postings.
- FIG. 6 is an example processor system that can be used to execute example instructions of FIG. 5 to implement the example apparatus of FIG. 4 .
- Example methods, apparatus, systems, and articles of manufacture disclosed herein may be used to determine audience engagement indices associated with media presentations based on measured media panel exposure data and on audience engagement levels determined from Internet message postings.
- an engagement index (or indice) is a value selected to quantify the amount of interest in a media presentation.
- Some traditional techniques for determining engagement indices involve surveying audience members with questions to elicit responses indicative of an amount of interest by those audience members in select media presentations.
- Other traditional techniques for determining engagement indices involve registering audience members who consent to having their media habits monitored.
- a media audience measurement entity can then track the media habits of the audience panel (i.e., the registered audience members) and determine engagement indices based on the collected media exposure data.
- the media audience measurement entity may also conduct surveys of some or all of the panelists to correlate audience member responses with the collected media exposure data to determine one or more engagement indices for different target media presentations.
- Example methods, apparatus, and/or articles of manufacture determine one or more engagement indices for any type of media presentation (e.g., television programs, radio programs, Internet-based media, advertisements, video on demand, media content, etc.).
- examples disclosed herein may be adapted to determine engagement indices for any type of media presentation including programming content and/or advertisements.
- media presentation is generic to any form of media (e.g., content, advertisements, etc.).
- “media content” refers to programming (e.g., news, sit-coms, television series, feature films, etc.) as opposed to advertisements.
- example methods, apparatus, systems, and articles of manufacture disclosed herein advantageously leverage characteristics of Internet-based message postings evidencing users' consumption, involvement and/or engagement with those media presentations.
- Such consumption involvement and/or engagement is evidenced when, for example, users discuss media presentations (e.g., television or radio programs, advertisements, etc.) on message or discussion boards (e.g., social network sites, blogs, discussion boards, and/or any other Internet-based discussion mediums).
- Such discussions or postings are indicative of audience engagement levels in such media programs.
- Internet engagement indices Internet message-based engagement indices
- survey engagement indices traditional techniques
- composite engagement indices relatively more accurate engagement indices
- audience base e.g., panelist audience members and non-panelist audience members contributing to Internet-based message postings
- Some example methods to determine audience engagement indices associated with media presentations involve determining an Internet engagement index based on a quantity of matches between a keyword associated with a media presentation and messages posted on an Internet service. Some such example methods also involve determining a total engagement index (TEI) (or a composite engagement index) based on the Internet engagement index and a survey engagement index indicative of an engagement measure of panel members to the media presentation.
- TTI total engagement index
- the quantity of registered users of an Internet service may be significantly more than the quantity of audience members in a media panel managed by a media audience measurement entity.
- the Internet engagement index determined based on messages posted on the Internet service may be weighted using a first weighting value proportional to the quantity of registered users of the Internet service.
- the survey engagement index determined based on the media panel members may be weighted using a second weighting value proportional to the quantity of audience members of the media panel.
- the TEI may then be equated to the average of weighted values for the Internet engagement index and the survey engagement index.
- FIG. 1 illustrates an example system 100 to determine composite audience engagement indices and/or TEIs for media presentations based on engagement levels measured from media panels and Internet message postings.
- the example system 100 includes an example audience measurement entity 102 and an Internet database proprietor 104 that hosts an Internet message database 106 .
- the audience measurement entity 102 may work with any entity (e.g., an Internet service provider) having a database (e.g., the Internet message database 106 ) storing messages posted by individuals (e.g., registered users of the Internet service provider).
- database proprietors e.g., the Internet database proprietor 104 .
- Example database proprietors include entities such as Facebook, Myspace, Google, Yahoo!, MSN, Twitter, Apple iTunes, television network websites, radio network websites, etc. There are many database proprietors operating on the Internet. These database proprietors provide one or more services to large numbers of subscribers. That is, in exchange for the provision of the service, the subscribers register with the proprietor. As part of this registration, database proprietors may collect information from the subscribers including, for example, unique usernames, demographic information, etc. In the illustrated example of FIG. 1 , the Internet database proprietor stores user account information including demographics information in a user account (UA) database 107 .
- U user account
- the Internet message database 106 receives, stores, and hosts messages posted by users via, for example, computing devices 108 in communication with to the Internet database proprietor 104 through the Internet 110 .
- the messages may be posted by users on message boards, message walls, blogs, discussion boards, and/or any other messaging or discussion medium(s) that are intended to be accessible by other users and/or generally accessible by people browsing the Internet.
- Whether messages are accessible to the example system of FIG. 1 may be based on terms of service (TOS) agreements or privacy policies of the Internet database proprietor 104 .
- TOS terms of service
- For messages accessible to the example system of FIG. 1 such messages may be accessed using one or more application program interfaces (APIs) made available by the Internet database proprietor 104 for accessing and/or searching the Internet message database 106 .
- APIs application program interfaces
- the media audience measurement entity 102 includes an example query and reporting server 112 in communication with an example media presentation database 114 and an example media panel engagement index database 116 .
- the example query and reporting server 112 of FIG. 1 is configured to generate a total engagement index (TEI) 124 (i.e., a composite engagement index) as described below.
- TEI total engagement index
- the query and reporting server 112 is implemented using the example apparatus 400 of FIG. 4 .
- the media presentation database 114 stores metadata for media presentations including, for example, television programming, radio programming, Internet-based programming, advertisements, and/or any other type of media content.
- An example excerpt from the media presentation database 114 is shown in FIG. 2 . As shown in FIG.
- Metadata in the example media presentation database 114 includes program titles (e.g., “The Daily Show”, “Myth Busters”, “All My Children”, and “Today”).
- the metadata stored in the presentations of the media presentation database 114 may also include network names (as shown in FIG. 2 ), air dates (as shown in FIG. 2 ), air times, actor/actress names, program categories, etc.
- the media presentation database 114 may also include metadata for aired advertisements.
- advertisement metadata may include brand names, product/service categories, product/service types, trademarks, service marks, catch phrases, etc.
- the query and reporting server 112 uses the metadata stored in the media presentation database 114 to select keywords searchable in Internet message postings to determine when users responsible for such message postings are referring to particular media presentations in their messages. For example, for the television show “Myth Busters,” the example query and reporting server 112 may perform a keyword search exchange 118 with the Internet message database 106 based on a keyword search string “myth busters” selected from the title of the television show. For example, referring to FIG. 3 , the Internet message database 106 stores messages from registered users of the Internet database proprietor 104 . In the illustrated example of FIG. 3 , contents of messages 302 and 304 include the phrase “myth busters.” Thus, when the example query and reporting server 112 of FIG.
- the Internet message database 106 performs a search query in the Internet message database 106 based on the search string “myth busters,” the Internet message database 106 returns an indication of at least two matches corresponding to the messages 302 and 304 . If matches are found in other messages in the Internet message database 106 , the example Internet message database 106 of FIG. 1 will also report those matches to the query and reporting server 112 as part of the keyword search exchange 118 . In the illustrated examples, the query and reporting server 112 , uses the quantity (e.g., a number) of matches reported by the Internet message database 106 to determine an Internet engagement index for the corresponding media program for which the search was conducted in the Internet message database 106 .
- the Internet engagement indices determined by the query and reporting server 112 of FIG. 1 based on Internet message postings are also referred to herein as Internet message-based engagement indices.
- the example media panel engagement index database 116 stores survey engagement indices for one or more media presentations represented in the media presentation database 114 .
- the survey engagement indices in the media panel engagement index database 116 are also referred to herein as media panel engagement indices and are determined by a media panel monitoring system 120 .
- the media panel monitoring system 120 monitors audience members that have agreed to be part of a media panel (e.g., a television audience panel, a radio audience panel, an Internet audience panel, a TV/Internet audience panel, a radio/Internet audience panel, a TV/radio/Internet audience panel, etc.) and have, thus, consented to having their media habits monitored by the media audience measurement entity 102 .
- the media panel monitoring system 120 Based on the data collected using such monitoring, the media panel monitoring system 120 repeatedly determines survey engagement indices for different media presentations represented in the media presentation database 114 .
- the survey engagement indices are developed through surveys of panelists that are exposed to the media in question.
- the media audience measurement entity 102 and/or the media panel monitoring system 120 may use the panelist responses to assess levels of engagement by panelists with media in question and generate the survey engagement indices based on the assessed levels of engagement.
- the media panel monitoring system 120 stores the survey engagement indices in the media panel engagement index database 116 .
- panels may be organized based on audience member demographics.
- some survey engagement indices stored in the media panel engagement index database 116 may correspond to respective demographic groups.
- the media panel monitoring system 120 when individuals join a panel monitored by the media panel monitoring system 120 , they provide detailed information concerning their identity and demographics (e.g., gender, race, income, home location, occupation, etc) to the media audience measurement entity 102 tracking that panel.
- the media audience measurement entity 102 is provided with a demographics database 122 to store demographic information corresponding to panelists.
- the query and reporting server 112 generates the total engagement index (TEI) 124 based on survey engagement indices from the media panel engagement index database 116 and Internet engagement indices derived from messages in the Internet message database 106 .
- TEI total engagement index
- the example query and reporting server 112 of FIG. 1 employs example Equation 1 below to determine the TEI 124 .
- TEI (( WT P *EI P )+( WT I *EI I ))/( WT P +WT I ) Equation 1
- TEI is the TEI 124
- WT P is a panel weighting value
- EI P is a survey engagement index
- WT I is an Internet weighting value
- EI I is an Internet engagement index.
- the TEI 124 for a particular media presentation is an average of a weighted survey engagement index (WT P *EI P ) and a weighted Internet engagement index (WT I *EI I ).
- the TEI 124 is equal to the sum of the weighted survey engagement index (WT P *EI P ) and the weighted Internet engagement index (WT I *EI I ) divided by the sum of the panel weighting value (WT P ) and the Internet weighting value (WT I ).
- the query and reporting server 112 of the illustrated example retrieves the survey engagement index (EI P ) from the media panel engagement index database 116 .
- the query and reporting server 112 of the illustrated example determines the Internet panel engagement index (EI I ) by tallying the quantity of messages from unique users (e.g., keyword matches in multiple messages from the same registered user are counted as only one match or one exposure by that registered user to the target media presentation) in the Internet message database 106 that mention the keyword (e.g., the title) associated with a target media presentation and dividing that quantity by the total quantity of registered users of the Internet database proprietor 104 eligible for posting messages stored in the Internet message database 106 .
- EI I the Internet panel engagement index
- the panel weighting value (WT P ) is proportional to a quantity of audience members of a media panel used to determine the TEI 124 .
- the Internet weighting value (WT I ) is proportional to the quantity of registered users of an Internet service (e.g., the Internet database proprietor 106 ) storing the user messages that were used to develop the Internet engagement index (EI I ).
- the Internet weighting value (WT I ) may be set equal to the quantity of registered users of the Internet database proprietor 106
- the panel weight value (WT P ) may be set equal to the quantity of audience members of the panel used to determine the TEI 124 .
- the weight values (WT P ) and (WT I ) may be set equal to 1 in Equation 1 if the quantity of registered users of the Internet database proprietor 106 is equal or substantially equal to the quantity of audience members of the panel used to determine the TEI 124 .
- the resulting TEI 124 is a weighted average value.
- the query and reporting server 112 uses demographics-based engagement indices to determine the TEI 124 for one or more demographic segments of interest. That is, the example query and reporting server 112 uses engagement indices from the media panel engagement index database 116 that correspond to select demographic segments represented in the demographics database 122 . In addition, the example query and reporting server 112 may perform keyword searches only on messages in the Internet message database 106 that were posted by users associated with the same demographics of interest. The query and reporting server 112 may obtain or discern demographics of registered users of the Internet database proprietor 104 based on a co-operative audience measurement relationship between the Internet database proprietor 104 and the media audience measurement entity 102 .
- FIG. 4 illustrates an example implementation 400 of the query and reporting server 112 of FIG. 1 .
- the example apparatus 400 includes an example keyword selector 402 , an example demographics selector 404 , an example query interface 406 , an example survey engagement index interface 408 , an example Internet engagement index generator 410 , an example weighting generator 412 , and an example total engagement index generator 414 .
- the example apparatus 400 is provided with the keyword selector 402 to select keywords related to a target media presentation for searching in Internet message postings (e.g., Internet message postings stored in the Internet message database 110 of FIG. 1 ).
- the keyword selector 402 may search one or more records in the media presentation database 114 of a target media presentation for which to determine a TEI (e.g., the TEI 124 of FIG. 1 ). From the one or more records, the keyword selector 402 selects one or more keywords (e.g., a title) representative of the target media presentation.
- the keyword selector 402 may select the keywords “daily show” (e.g., a subset of the title) to search for in messages in the Internet message database 110 .
- the keyword selector 402 may select the keywords “myth busters” representing the entirety of the title of the television program.
- the example apparatus 400 is provided with the demographics selector 404 .
- the example demographics selector 404 of FIG. 4 identifies particular panels based on demographics information in the demographics database 122 .
- the information returned by the demographics selector 404 is used to retrieve corresponding survey engagement indices from the survey engagement index database 116 corresponding to the panelists of the selected demographics group.
- the example apparatus 400 of FIG. 4 is provided with the query interface 406 .
- the query interface 406 of the illustrated example receives keywords from the keyword selector 402 for a particular target media presentation and generates a query search string to perform the keyword search exchange 118 ( FIG. 1 ) with the Internet message database 106 via an application program interface (API).
- API application program interface
- the query interface 406 generates query search strings that request a username or unique user ID associated with each message containing the searched keywords.
- the query interface 406 can then tally the quantity of unique usernames or user IDs such that duplicate usernames or unique user IDs are not counted more than once.
- the database proprietor may implement functionality to ensure the returned quantity represents unique usernames.
- the query interface 406 may also structure query search strings to restrict analysis (e.g., the count of messages) to messages having posting dates/times within particular dates and/or timeframes (e.g., within 24 hours of broadcast, within one week of broadcast, etc.).
- the example apparatus 400 of FIG. 4 is provided with the survey engagement index interface 408 .
- the example survey engagement index interface 408 of FIG. 4 retrieves survey engagement indices (EIp) from the survey engagement index interface 408 corresponding to target media presentations.
- the survey engagement index interface 408 may limit retrieval of survey engagement indices to evaluate identified by the demographics selector 404 .
- the example apparatus 400 of FIG. 4 is provided with the Internet engagement index generator 410 .
- the example Internet engagement index generator 410 of FIG. 4 determines the Internet engagement index (EI I ) as discussed above in connection with Equation 1 by dividing the quantity of messages from unique users in the Internet message database 106 that mention the keyword(s) of a target media presentation by the total quantity of registered users of the Internet database proprietor 104 eligible for posting messages stored in the Internet message database 106 .
- the example apparatus 400 of FIG. 4 is provided with the weighting generator 412 .
- the example weighting generator 412 of FIG. 4 determines the weight values (WT P ) and (WT I ) as described above in connection with Equation 1 to account for different media panels having quantities of audience members different from the quantity of registered users of the Internet database proprietor 104 .
- the apparatus 400 is provided with the total engagement index generator 414 .
- the example total engagement index generator 414 of FIG. 4 determines the TEI 124 using Equation 1 as described above.
- the example apparatus 400 of FIG. 4 may be implemented by hardware, software, firmware and/or any combination of hardware, software and/or firmware.
- any of the keyword selector 402 , the demographics selector 404 , the query interface 406 , the survey engagement index interface 408 , the Internet engagement index generator 410 , the weighting generator 412 , and the total engagement index generator 414 and/or, more generally, the example apparatus 400 could be implemented by one or more circuit(s), programmable processor(s), application specific integrated circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)) and/or field programmable logic device(s) (FPLD(s)), etc.
- ASIC application specific integrated circuit
- PLD programmable logic device
- FPLD field programmable logic device
- At least one of the keyword selector 402 , the demographics selector 404 , the query interface 406 , the survey engagement index interface 408 , the Internet engagement index generator 410 , the weighting generator 412 , and/or the total engagement index generator 414 are hereby expressly defined to include a computer readable medium such as a memory, DVD, CD, etc. storing the software and/or firmware.
- the example apparatus 400 of FIG. 4 may include one or more elements, processes and/or devices in addition to, or instead of, those illustrated in FIG. 4 , and/or may include more than one of any or all of the illustrated elements, processes and devices.
- FIG. 5 is a flow diagram representative of example machine readable instructions that may be executed to determine TEIs (e.g., the TEI 124 of FIG. 1 ) of media presentations based on engagement levels measured from media panels and Internet message postings to implement the example query and reporting server 112 of FIG. 1 and/or the example apparatus 400 of FIG. 4 .
- the example process of FIG. 5 may be implemented using machine readable instructions that, when executed, cause a device (e.g., a programmable controller, processor, or other programmable machine or integrated circuit) to perform the operations shown in FIG. 5 .
- the example process of FIG. 5 may be performed using a processor, a controller, and/or any other suitable processing device.
- the example process of FIG. 5 may be implemented using coded instructions stored on a tangible machine readable medium such as a flash memory, a read-only memory (ROM), and/or a random-access memory (RAM).
- a tangible machine readable medium such as a flash memory, a read-only memory
- the term tangible computer readable medium is expressly defined to include any type of computer readable storage and to exclude propagating signals. Additionally or alternatively, the example process of FIG. 5 may be implemented using coded instructions (e.g., computer readable instructions) stored on a non-transitory computer readable medium such as a flash memory, a read-only memory (ROM), a random-access memory (RAM), a cache, or any other storage media in which information is stored for any duration (e.g., for extended time periods, permanently, brief instances, for temporarily buffering, and/or for caching of the information). As used herein, the term non-transitory computer readable medium is expressly defined to include any type of computer readable medium and to exclude propagating signals.
- coded instructions e.g., computer readable instructions
- a non-transitory computer readable medium such as a flash memory, a read-only memory (ROM), a random-access memory (RAM), a cache, or any other storage media in which information is stored for any duration (e.g.
- the example process of FIG. 5 may be implemented using any combination(s) of application specific integrated circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)), field programmable logic device(s) (FPLD(s)), discrete logic, hardware, firmware, etc. Also, the example process of FIG. 5 may be implemented as any combination(s) of any of the foregoing techniques, for example, any combination of firmware, software, discrete logic and/or hardware.
- ASIC application specific integrated circuit
- PLD programmable logic device
- FPLD field programmable logic device
- example process of FIG. 5 is described with reference to the flow diagram of FIG. 5 , other methods of implementing the process of FIG. 5 may be employed.
- order of execution of the blocks may be changed, and/or some of the blocks described may be changed, eliminated, sub-divided, or combined.
- one or both of the example process of FIG. 5 may be performed sequentially and/or in parallel by, for example, separate processing threads, processors, devices, discrete logic, circuits, etc.
- the example apparatus 400 selects a target media presentation (block 402 ).
- the apparatus 400 may receive a name or identifier of a target media presentation from a user interacting with the query and reporting server 112 ( FIG. 1 ) or may select a target media presentation in an automated manner from a pre-stored list of media presentation pre-selected for the query and reporting server 112 to generate TEIs (e.g., the TEI 124 of FIG. 1 ).
- TEIs e.g., the TEI 124 of FIG. 1 .
- the example keyword selector 402 selects one or more keywords associated with the target media presentation (block 504 ).
- the keyword selector 402 may analyze one or more entries in the media presentation database 114 corresponding to the target media presentation and select the one or more keywords (e.g., from a title or any other metadata) representative of the target media presentation.
- the query interface 406 ( FIG. 4 ) initiates a keyword search in the Internet message database 106 (block 506 ) to perform the keyword search exchange 118 of FIG. 1 .
- the query interface 406 receives search results (block 508 ) and determines whether there are sufficient search results (block 510 ) related to the target media presentation to determine a meaningful TEI (e.g., the TEI 124 of FIG. 1 ) based on Internet message postings in the Internet message database 106 . For example, if the quantity of search results is too low (or if no matches are found), any resulting Internet engagement index may not fairly or sufficiently contribute to an accurate or meaningful TEI. That is, the resulting Internet engagement index may be a statistical outlier or a meaningless anomaly relative to a survey engagement index in the media panel engagement index database 116 ( FIG. 1 ) for the same target media program.
- the apparatus 400 may receive demographics of a target audience group from a user interacting with the query and reporting server 112 ( FIG. 1 ) or may select target demographics in an automated manner from a pre-stored list of demographics-based groups pre-selected for the query and reporting server 112 to generate TEIs (e.g., the TEI 124 of FIG. 1 ). If the demographics interface 404 selects target demographics (block 512 ), the demographics selector 404 applies a demographics filter (block 514 ).
- the demographics selector 404 may identify survey engagement indices in the media panel engagement index database 116 that are associated with panelists having select target demographics of interest. Additionally, the demographics interface 404 may work with the query interface 406 to filter the search results from the Internet message database 106 based on the target demographics.
- the example query interface 406 submits the target demographics to the Internet database proprietor 104 with a listing of usernames or unique user IDs received in the keyword search results at block 508 and request the Internet database proprietor 104 to filter the usernames or unique user IDs based on the target demographics.
- the Internet database proprietor 104 may filter the usernames or unique user IDs based on corresponding demographics information stored in the UA database 107 and return the filtered results (i.e., filtered usernames or unique user IDs associated with matching demographics) to the query interface 406 .
- the Internet database proprietor 104 provides the media audience measurement entity 102 with access to the UA database 107 , and the demographics selector 404 applies the demographics filter to the keyword search results (e.g., the usernames or unique user IDs) at the operation of block 514 by directly accessing demographics information of registered users in the UA database 107 .
- the keyword search results e.g., the usernames or unique user IDs
- EI I Internet engagement index
- the survey engagement index interface 408 retrieves a survey engagement index (EI P ) (block 518 ) from the media panel engagement index database 116 corresponding to the target media program. In examples in which particular demographics were applied at block 514 , the survey engagement index interface 408 selects the survey engagement index (EI P ) based also on the target demographics.
- the example weighting generator 412 determines weight values (block 520 ). For example, the weighting generator 412 may determine the panel weighting value (WT P ) and the Internet weighting value (WT I ) as discussed above in connection with Equation 1.
- the total engagement index generator 414 determines the TEI 124 ( FIG. 1 ) (block 522 ) based on the Internet engagement index (EI I ), the survey engagement index (EI P ), the panel weighting value (WT P ), and the Internet weighting value (WT I ) as discussed above in connection with Equation 1.
- the example apparatus 400 determines whether there is another target demographic group for which to generate a TEI for the same target media presentation (block 524 ). If there is another demographic group, control returns to block 514 . Otherwise, the apparatus 400 determines whether there is another target media presentation to analyze (block 526 ). If there is another target media presentation to analyze (e.g., another target media presentation indicated by a user or located on a pre-defined target media presentation list), control returns to block 502 . Otherwise, the example process of FIG. 5 is ended.
- another target media presentation to analyze e.g., another target media presentation indicated by a user or located on a pre-defined target media presentation list
- the media audience measurement entity 102 may communicate with any number of Internet database proprietors and generate TEIs based on data received from any number of Internet database proprietors.
- FIG. 6 is a block diagram of an example processor system 610 that may be used to execute the example computer readable instructions of FIG. 5 to implement the example query and reporting server 112 of FIG. 1 and/or the example apparatus 400 of FIG. 4 .
- the processor system 610 includes a processor 612 that is coupled to an interconnection bus 614 .
- the processor 612 may be any suitable processor, processing unit, or microprocessor.
- the system 610 may be a multi-processor system and, thus, may include one or more additional processors that are identical or similar to the processor 612 and that are communicatively coupled to the interconnection bus 614 .
- the processor 612 of FIG. 6 is coupled to a chipset 618 , which includes a memory controller 620 and an input/output (I/O) controller 622 .
- a chipset provides I/O and memory management functions as well as a plurality of general purpose and/or special purpose registers, timers, etc. that are accessible or used by one or more processors coupled to the chipset 618 .
- the memory controller 620 performs functions that enable the processor 612 (or processors if there are multiple processors) to access a system memory 624 and a mass storage memory 625 .
- system memory 624 may include any desired type of volatile and/or non-volatile memory such as, for example, static random access memory (SRAM), dynamic random access memory (DRAM), flash memory, read-only memory (ROM), etc.
- SRAM static random access memory
- DRAM dynamic random access memory
- flash memory flash memory
- ROM read-only memory
- the mass storage memory 625 may include any desired type of mass storage device including hard disk drives, optical drives, tape storage devices, etc.
- the I/O controller 622 performs functions that enable the processor 612 to communicate with peripheral input/output (I/O) devices 626 and 628 and a network interface 630 via an I/O bus 632 .
- the I/O devices 626 and 628 may be any desired type of I/O device such as, for example, a keyboard, a video display or monitor, a mouse, etc.
- the network interface 630 may be, for example, an Ethernet device, an asynchronous transfer mode (ATM) device, an 802.11 device, a digital subscriber line (DSL) modem, a cable modem, a cellular modem, etc. that enables the processor system 610 to communicate with another processor system.
- ATM asynchronous transfer mode
- 802.11 802.11
- DSL digital subscriber line
- memory controller 620 and the I/O controller 622 are depicted in FIG. 6 as separate functional blocks within the chipset 618 , the functions performed by these blocks may be integrated within a single semiconductor circuit or may be implemented using two or more separate integrated circuits.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Theoretical Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Economics (AREA)
- Game Theory and Decision Science (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
- This patent arises from a continuation of U.S. patent application Ser. No. 12/965,505, filed on Dec. 10, 2010, which is hereby incorporated herein by reference in its entirety.
- The present disclosure relates generally to monitoring media and, more particularly, to methods and apparatus to determine audience engagement indices associated with media presentations.
- Traditionally, audience measurement entities determine audience size and demographic composition for media based on registered panel members. That is, an audience measurement entity enrolls people that consent to being monitored into a panel. The audience measurement entity then monitors the media habits of those panel members to identify media presentations (e.g., television programs, radio programs, Internet browsing, video on demand access, etc.) exposed to those panel members. The audience measurement entity can then determine the size and demographic composition of audience(s) for those media presentations based on the collected media measurement data.
-
FIG. 1 depicts an example system that may be used to determine audience engagement indices for media presentations based on exposure data measured from media panels and on Internet message postings. -
FIG. 2 depicts an example media programming database storing metadata about scheduled media presentations. -
FIG. 3 depicts an example Internet message database storing messages from users of an Internet service provider. -
FIG. 4 depicts an example apparatus that may be used to determine audience engagement indices for media presentations. -
FIG. 5 is a flow diagram representative of example machine readable instructions that may be executed to implement the apparatus ofFIG. 4 to determine audience engagement indices of media presentations based on engagement levels measured from media panels and Internet message postings. -
FIG. 6 is an example processor system that can be used to execute example instructions ofFIG. 5 to implement the example apparatus ofFIG. 4 . - Example methods, apparatus, systems, and articles of manufacture disclosed herein may be used to determine audience engagement indices associated with media presentations based on measured media panel exposure data and on audience engagement levels determined from Internet message postings. As used herein, an engagement index (or indice) is a value selected to quantify the amount of interest in a media presentation. Some traditional techniques for determining engagement indices involve surveying audience members with questions to elicit responses indicative of an amount of interest by those audience members in select media presentations. Other traditional techniques for determining engagement indices involve registering audience members who consent to having their media habits monitored. A media audience measurement entity can then track the media habits of the audience panel (i.e., the registered audience members) and determine engagement indices based on the collected media exposure data. In some examples, the media audience measurement entity may also conduct surveys of some or all of the panelists to correlate audience member responses with the collected media exposure data to determine one or more engagement indices for different target media presentations.
- Example methods, apparatus, and/or articles of manufacture determine one or more engagement indices for any type of media presentation (e.g., television programs, radio programs, Internet-based media, advertisements, video on demand, media content, etc.). Thus, examples disclosed herein may be adapted to determine engagement indices for any type of media presentation including programming content and/or advertisements. As used herein, media presentation is generic to any form of media (e.g., content, advertisements, etc.). Also, “media content” refers to programming (e.g., news, sit-coms, television series, feature films, etc.) as opposed to advertisements.
- Unlike traditional techniques that rely on collected media exposure data and/or audience survey responses collected from panelists, example methods, apparatus, systems, and articles of manufacture disclosed herein advantageously leverage characteristics of Internet-based message postings evidencing users' consumption, involvement and/or engagement with those media presentations. Such consumption involvement and/or engagement is evidenced when, for example, users discuss media presentations (e.g., television or radio programs, advertisements, etc.) on message or discussion boards (e.g., social network sites, blogs, discussion boards, and/or any other Internet-based discussion mediums). Such discussions or postings are indicative of audience engagement levels in such media programs. Examples disclosed herein use Internet message-based engagement indices (hereinafter “Internet engagement indices”) in connection with engagement indices determined using traditional techniques (hereinafter “survey engagement indices”) to generate relatively more accurate engagement indices (hereafter “composite engagement indices”) encompassing a larger audience base (e.g., panelist audience members and non-panelist audience members contributing to Internet-based message postings).
- Some example methods to determine audience engagement indices associated with media presentations involve determining an Internet engagement index based on a quantity of matches between a keyword associated with a media presentation and messages posted on an Internet service. Some such example methods also involve determining a total engagement index (TEI) (or a composite engagement index) based on the Internet engagement index and a survey engagement index indicative of an engagement measure of panel members to the media presentation. In some example implementations, the quantity of registered users of an Internet service may be significantly more than the quantity of audience members in a media panel managed by a media audience measurement entity. In such example implementations, the Internet engagement index determined based on messages posted on the Internet service may be weighted using a first weighting value proportional to the quantity of registered users of the Internet service. In addition, the survey engagement index determined based on the media panel members may be weighted using a second weighting value proportional to the quantity of audience members of the media panel. The TEI may then be equated to the average of weighted values for the Internet engagement index and the survey engagement index.
-
FIG. 1 illustrates anexample system 100 to determine composite audience engagement indices and/or TEIs for media presentations based on engagement levels measured from media panels and Internet message postings. In the illustrated example ofFIG. 1 , theexample system 100 includes an exampleaudience measurement entity 102 and anInternet database proprietor 104 that hosts anInternet message database 106. Theaudience measurement entity 102 may work with any entity (e.g., an Internet service provider) having a database (e.g., the Internet message database 106) storing messages posted by individuals (e.g., registered users of the Internet service provider). Such entities may be referred to as “database proprietors” (e.g., the Internet database proprietor 104). Example database proprietors include entities such as Facebook, Myspace, Google, Yahoo!, MSN, Twitter, Apple iTunes, television network websites, radio network websites, etc. There are many database proprietors operating on the Internet. These database proprietors provide one or more services to large numbers of subscribers. That is, in exchange for the provision of the service, the subscribers register with the proprietor. As part of this registration, database proprietors may collect information from the subscribers including, for example, unique usernames, demographic information, etc. In the illustrated example ofFIG. 1 , the Internet database proprietor stores user account information including demographics information in a user account (UA)database 107. - In the illustrated example of
FIG. 1 , theInternet message database 106 receives, stores, and hosts messages posted by users via, for example,computing devices 108 in communication with to theInternet database proprietor 104 through the Internet 110. In illustrated examples, the messages may be posted by users on message boards, message walls, blogs, discussion boards, and/or any other messaging or discussion medium(s) that are intended to be accessible by other users and/or generally accessible by people browsing the Internet. Whether messages are accessible to the example system ofFIG. 1 may be based on terms of service (TOS) agreements or privacy policies of theInternet database proprietor 104. For messages accessible to the example system ofFIG. 1 , such messages may be accessed using one or more application program interfaces (APIs) made available by theInternet database proprietor 104 for accessing and/or searching theInternet message database 106. - In the illustrated example of
FIG. 1 , the mediaaudience measurement entity 102 includes an example query and reportingserver 112 in communication with an examplemedia presentation database 114 and an example media panelengagement index database 116. The example query andreporting server 112 ofFIG. 1 is configured to generate a total engagement index (TEI) 124 (i.e., a composite engagement index) as described below. In some examples, the query andreporting server 112 is implemented using theexample apparatus 400 ofFIG. 4 . Themedia presentation database 114 stores metadata for media presentations including, for example, television programming, radio programming, Internet-based programming, advertisements, and/or any other type of media content. An example excerpt from themedia presentation database 114 is shown inFIG. 2 . As shown inFIG. 2 , metadata in the examplemedia presentation database 114 includes program titles (e.g., “The Daily Show”, “Myth Busters”, “All My Children”, and “Today”). In some examples, the metadata stored in the presentations of themedia presentation database 114 may also include network names (as shown inFIG. 2 ), air dates (as shown inFIG. 2 ), air times, actor/actress names, program categories, etc. Although not shown, themedia presentation database 114 may also include metadata for aired advertisements. Such advertisement metadata may include brand names, product/service categories, product/service types, trademarks, service marks, catch phrases, etc. Although the following examples discuss determining engagement indices for media programs or presentations, such examples are equally applicable to determining engagement indices for advertisements. - In the illustrated example of
FIG. 1 , the query andreporting server 112 uses the metadata stored in themedia presentation database 114 to select keywords searchable in Internet message postings to determine when users responsible for such message postings are referring to particular media presentations in their messages. For example, for the television show “Myth Busters,” the example query and reportingserver 112 may perform akeyword search exchange 118 with theInternet message database 106 based on a keyword search string “myth busters” selected from the title of the television show. For example, referring toFIG. 3 , theInternet message database 106 stores messages from registered users of theInternet database proprietor 104. In the illustrated example ofFIG. 3 , contents ofmessages server 112 ofFIG. 1 performs a search query in theInternet message database 106 based on the search string “myth busters,” theInternet message database 106 returns an indication of at least two matches corresponding to themessages Internet message database 106, the exampleInternet message database 106 ofFIG. 1 will also report those matches to the query and reportingserver 112 as part of thekeyword search exchange 118. In the illustrated examples, the query and reportingserver 112, uses the quantity (e.g., a number) of matches reported by theInternet message database 106 to determine an Internet engagement index for the corresponding media program for which the search was conducted in theInternet message database 106. The Internet engagement indices determined by the query and reportingserver 112 ofFIG. 1 based on Internet message postings are also referred to herein as Internet message-based engagement indices. - Returning to
FIG. 1 , the example media panelengagement index database 116 stores survey engagement indices for one or more media presentations represented in themedia presentation database 114. The survey engagement indices in the media panelengagement index database 116 are also referred to herein as media panel engagement indices and are determined by a mediapanel monitoring system 120. In the illustrated example ofFIG. 1 , the mediapanel monitoring system 120 monitors audience members that have agreed to be part of a media panel (e.g., a television audience panel, a radio audience panel, an Internet audience panel, a TV/Internet audience panel, a radio/Internet audience panel, a TV/radio/Internet audience panel, etc.) and have, thus, consented to having their media habits monitored by the mediaaudience measurement entity 102. Based on the data collected using such monitoring, the mediapanel monitoring system 120 repeatedly determines survey engagement indices for different media presentations represented in themedia presentation database 114. In some examples, the survey engagement indices are developed through surveys of panelists that are exposed to the media in question. For example, the mediaaudience measurement entity 102 and/or the mediapanel monitoring system 120 may use the panelist responses to assess levels of engagement by panelists with media in question and generate the survey engagement indices based on the assessed levels of engagement. The mediapanel monitoring system 120 stores the survey engagement indices in the media panelengagement index database 116. In some examples, panels may be organized based on audience member demographics. In such examples, some survey engagement indices stored in the media panelengagement index database 116 may correspond to respective demographic groups. - In the illustrated example of
FIG. 1 , when individuals join a panel monitored by the mediapanel monitoring system 120, they provide detailed information concerning their identity and demographics (e.g., gender, race, income, home location, occupation, etc) to the mediaaudience measurement entity 102 tracking that panel. The mediaaudience measurement entity 102 is provided with ademographics database 122 to store demographic information corresponding to panelists. - In the illustrated example of
FIG. 1 , the query and reportingserver 112 generates the total engagement index (TEI) 124 based on survey engagement indices from the media panelengagement index database 116 and Internet engagement indices derived from messages in theInternet message database 106. For example, the example query and reportingserver 112 ofFIG. 1 employs example Equation 1 below to determine theTEI 124. -
TEI=((WT P *EI P)+(WT I *EI I))/(WT P +WT I) Equation 1 - In Equation 1 above, TEI is the
TEI 124, WTP is a panel weighting value, EIP is a survey engagement index, WTI is an Internet weighting value, and EII is an Internet engagement index. In Equation 1 above, theTEI 124 for a particular media presentation is an average of a weighted survey engagement index (WTP*EIP) and a weighted Internet engagement index (WTI*EII). In particular, theTEI 124 is equal to the sum of the weighted survey engagement index (WTP*EIP) and the weighted Internet engagement index (WTI*EII) divided by the sum of the panel weighting value (WTP) and the Internet weighting value (WTI). The query and reportingserver 112 of the illustrated example retrieves the survey engagement index (EIP) from the media panelengagement index database 116. The query and reportingserver 112 of the illustrated example determines the Internet panel engagement index (EII) by tallying the quantity of messages from unique users (e.g., keyword matches in multiple messages from the same registered user are counted as only one match or one exposure by that registered user to the target media presentation) in theInternet message database 106 that mention the keyword (e.g., the title) associated with a target media presentation and dividing that quantity by the total quantity of registered users of theInternet database proprietor 104 eligible for posting messages stored in theInternet message database 106. - In the example of
FIG. 1 , the panel weighting value (WTP) is proportional to a quantity of audience members of a media panel used to determine theTEI 124. The Internet weighting value (WTI) is proportional to the quantity of registered users of an Internet service (e.g., the Internet database proprietor 106) storing the user messages that were used to develop the Internet engagement index (EII). In some examples, the Internet weighting value (WTI) may be set equal to the quantity of registered users of theInternet database proprietor 106, and the panel weight value (WTP) may be set equal to the quantity of audience members of the panel used to determine theTEI 124. In some examples, the weight values (WTP) and (WTI) may be set equal to 1 in Equation 1 if the quantity of registered users of theInternet database proprietor 106 is equal or substantially equal to the quantity of audience members of the panel used to determine theTEI 124. When values other than 1 are used for the weight values (WTP) and (WTI), the resultingTEI 124 is a weighted average value. - To further illustrate Equation 1, consider an example in which a television panel monitored by the media
panel monitoring system 120 contains 4,000 audience members (i.e., WTP=4,000) and results in an 80% survey engagement index (EIp) for a particular television show. In addition, a registered user base of 100,000 users (i.e., WTI=100,000) registered in theInternet database proprietor 104 results in a 30% Internet engagement index (EII) for the same television show. In such an example, the query and reportingserver 112 can use Equation 1 to determine that theTEI 124 is equal to 33.7 (i.e., TEI=33.7=((4,000*80)+(100,000*30))/(4,000+100,000)). - In some examples, the query and reporting
server 112 uses demographics-based engagement indices to determine theTEI 124 for one or more demographic segments of interest. That is, the example query and reportingserver 112 uses engagement indices from the media panelengagement index database 116 that correspond to select demographic segments represented in thedemographics database 122. In addition, the example query and reportingserver 112 may perform keyword searches only on messages in theInternet message database 106 that were posted by users associated with the same demographics of interest. The query and reportingserver 112 may obtain or discern demographics of registered users of theInternet database proprietor 104 based on a co-operative audience measurement relationship between theInternet database proprietor 104 and the mediaaudience measurement entity 102. -
FIG. 4 illustrates anexample implementation 400 of the query and reportingserver 112 ofFIG. 1 . In the illustrated example ofFIG. 4 , theexample apparatus 400 includes anexample keyword selector 402, anexample demographics selector 404, anexample query interface 406, an example surveyengagement index interface 408, an example Internetengagement index generator 410, anexample weighting generator 412, and an example totalengagement index generator 414. - Turning in detail to
FIG. 4 , theexample apparatus 400 is provided with thekeyword selector 402 to select keywords related to a target media presentation for searching in Internet message postings (e.g., Internet message postings stored in theInternet message database 110 ofFIG. 1 ). For example, thekeyword selector 402 may search one or more records in themedia presentation database 114 of a target media presentation for which to determine a TEI (e.g., theTEI 124 ofFIG. 1 ). From the one or more records, thekeyword selector 402 selects one or more keywords (e.g., a title) representative of the target media presentation. For example, if the target presentation is “The Daily Show,” thekeyword selector 402 may select the keywords “daily show” (e.g., a subset of the title) to search for in messages in theInternet message database 110. Alternatively, if the target media presentation is “Myth Busters,” thekeyword selector 402 may select the keywords “myth busters” representing the entirety of the title of the television program. - To select demographics information in the
demographics database 122 ofFIG. 1 and/or from theInternet database proprietor 104, theexample apparatus 400 is provided with thedemographics selector 404. Theexample demographics selector 404 ofFIG. 4 identifies particular panels based on demographics information in thedemographics database 122. The information returned by thedemographics selector 404 is used to retrieve corresponding survey engagement indices from the surveyengagement index database 116 corresponding to the panelists of the selected demographics group. - To perform keyword search queries in the
Internet message database 106, theexample apparatus 400 ofFIG. 4 is provided with thequery interface 406. Thequery interface 406 of the illustrated example receives keywords from thekeyword selector 402 for a particular target media presentation and generates a query search string to perform the keyword search exchange 118 (FIG. 1 ) with theInternet message database 106 via an application program interface (API). In some examples, thequery interface 406 generates query search strings that request a username or unique user ID associated with each message containing the searched keywords. Thequery interface 406 can then tally the quantity of unique usernames or user IDs such that duplicate usernames or unique user IDs are not counted more than once. Alternatively, the database proprietor may implement functionality to ensure the returned quantity represents unique usernames. In either of the example approaches, an impression or exposure is counted once per user even if that user mentioned the keywords in more than one message. In some example implementations, thequery interface 406 may also structure query search strings to restrict analysis (e.g., the count of messages) to messages having posting dates/times within particular dates and/or timeframes (e.g., within 24 hours of broadcast, within one week of broadcast, etc.). - To retrieve survey engagement indices (EIp) from the media panel engagement index database 116 (
FIG. 1 ), theexample apparatus 400 ofFIG. 4 is provided with the surveyengagement index interface 408. The example surveyengagement index interface 408 ofFIG. 4 retrieves survey engagement indices (EIp) from the surveyengagement index interface 408 corresponding to target media presentations. In some examples, the surveyengagement index interface 408 may limit retrieval of survey engagement indices to evaluate identified by thedemographics selector 404. - To generate internet message-based engagement indices (EII) based on searches performed in the
Internet message database 106, theexample apparatus 400 ofFIG. 4 is provided with the Internetengagement index generator 410. The example Internetengagement index generator 410 ofFIG. 4 determines the Internet engagement index (EII) as discussed above in connection with Equation 1 by dividing the quantity of messages from unique users in theInternet message database 106 that mention the keyword(s) of a target media presentation by the total quantity of registered users of theInternet database proprietor 104 eligible for posting messages stored in theInternet message database 106. - To generate weighting values for determining the TEI 124 (
FIG. 1 ), theexample apparatus 400 ofFIG. 4 is provided with theweighting generator 412. Theexample weighting generator 412 ofFIG. 4 determines the weight values (WTP) and (WTI) as described above in connection with Equation 1 to account for different media panels having quantities of audience members different from the quantity of registered users of theInternet database proprietor 104. - To determine the TEI 124 (
FIG. 1 ), theapparatus 400 is provided with the totalengagement index generator 414. The example totalengagement index generator 414 ofFIG. 4 determines theTEI 124 using Equation 1 as described above. - While an example manner of implementing the
apparatus 400 has been illustrated inFIG. 4 , one or more of the elements, processes and/or devices illustrated inFIG. 4 may be combined, divided, re-arranged, omitted, eliminated and/or implemented in any other way. Further, thekeyword selector 402, thedemographics selector 404, thequery interface 406, the surveyengagement index interface 408, the Internetengagement index generator 410, theweighting generator 412, and the totalengagement index generator 414 and/or, more generally, theexample apparatus 400 ofFIG. 4 may be implemented by hardware, software, firmware and/or any combination of hardware, software and/or firmware. Thus, for example, any of thekeyword selector 402, thedemographics selector 404, thequery interface 406, the surveyengagement index interface 408, the Internetengagement index generator 410, theweighting generator 412, and the totalengagement index generator 414 and/or, more generally, theexample apparatus 400 could be implemented by one or more circuit(s), programmable processor(s), application specific integrated circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)) and/or field programmable logic device(s) (FPLD(s)), etc. When any of the appended apparatus claims are read to cover a purely software and/or firmware implementation, at least one of thekeyword selector 402, thedemographics selector 404, thequery interface 406, the surveyengagement index interface 408, the Internetengagement index generator 410, theweighting generator 412, and/or the totalengagement index generator 414 are hereby expressly defined to include a computer readable medium such as a memory, DVD, CD, etc. storing the software and/or firmware. Further still, theexample apparatus 400 ofFIG. 4 may include one or more elements, processes and/or devices in addition to, or instead of, those illustrated inFIG. 4 , and/or may include more than one of any or all of the illustrated elements, processes and devices. -
FIG. 5 is a flow diagram representative of example machine readable instructions that may be executed to determine TEIs (e.g., theTEI 124 ofFIG. 1 ) of media presentations based on engagement levels measured from media panels and Internet message postings to implement the example query and reportingserver 112 ofFIG. 1 and/or theexample apparatus 400 ofFIG. 4 . The example process ofFIG. 5 may be implemented using machine readable instructions that, when executed, cause a device (e.g., a programmable controller, processor, or other programmable machine or integrated circuit) to perform the operations shown inFIG. 5 . For instance, the example process ofFIG. 5 may be performed using a processor, a controller, and/or any other suitable processing device. For example, the example process ofFIG. 5 may be implemented using coded instructions stored on a tangible machine readable medium such as a flash memory, a read-only memory (ROM), and/or a random-access memory (RAM). - As used herein, the term tangible computer readable medium is expressly defined to include any type of computer readable storage and to exclude propagating signals. Additionally or alternatively, the example process of
FIG. 5 may be implemented using coded instructions (e.g., computer readable instructions) stored on a non-transitory computer readable medium such as a flash memory, a read-only memory (ROM), a random-access memory (RAM), a cache, or any other storage media in which information is stored for any duration (e.g., for extended time periods, permanently, brief instances, for temporarily buffering, and/or for caching of the information). As used herein, the term non-transitory computer readable medium is expressly defined to include any type of computer readable medium and to exclude propagating signals. - Alternatively, the example process of
FIG. 5 may be implemented using any combination(s) of application specific integrated circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)), field programmable logic device(s) (FPLD(s)), discrete logic, hardware, firmware, etc. Also, the example process ofFIG. 5 may be implemented as any combination(s) of any of the foregoing techniques, for example, any combination of firmware, software, discrete logic and/or hardware. - Although the example process of
FIG. 5 is described with reference to the flow diagram ofFIG. 5 , other methods of implementing the process ofFIG. 5 may be employed. For example, the order of execution of the blocks may be changed, and/or some of the blocks described may be changed, eliminated, sub-divided, or combined. Additionally, one or both of the example process ofFIG. 5 may be performed sequentially and/or in parallel by, for example, separate processing threads, processors, devices, discrete logic, circuits, etc. - Turning in detail to
FIG. 5 , initially, theexample apparatus 400 selects a target media presentation (block 402). For example, theapparatus 400 may receive a name or identifier of a target media presentation from a user interacting with the query and reporting server 112 (FIG. 1 ) or may select a target media presentation in an automated manner from a pre-stored list of media presentation pre-selected for the query and reportingserver 112 to generate TEIs (e.g., theTEI 124 ofFIG. 1 ). - The example keyword selector 402 (
FIG. 4 ) then selects one or more keywords associated with the target media presentation (block 504). For example, thekeyword selector 402 may analyze one or more entries in themedia presentation database 114 corresponding to the target media presentation and select the one or more keywords (e.g., from a title or any other metadata) representative of the target media presentation. - The query interface 406 (
FIG. 4 ) initiates a keyword search in the Internet message database 106 (block 506) to perform thekeyword search exchange 118 ofFIG. 1 . Thequery interface 406 receives search results (block 508) and determines whether there are sufficient search results (block 510) related to the target media presentation to determine a meaningful TEI (e.g., theTEI 124 ofFIG. 1 ) based on Internet message postings in theInternet message database 106. For example, if the quantity of search results is too low (or if no matches are found), any resulting Internet engagement index may not fairly or sufficiently contribute to an accurate or meaningful TEI. That is, the resulting Internet engagement index may be a statistical outlier or a meaningless anomaly relative to a survey engagement index in the media panel engagement index database 116 (FIG. 1 ) for the same target media program. - If there are sufficient search results (block 510), control advances to block 512, at which the demographics interface 404 (
FIG. 4 ) determines whether to select particular demographics (block 512). For example, theapparatus 400 may receive demographics of a target audience group from a user interacting with the query and reporting server 112 (FIG. 1 ) or may select target demographics in an automated manner from a pre-stored list of demographics-based groups pre-selected for the query and reportingserver 112 to generate TEIs (e.g., theTEI 124 ofFIG. 1 ). If thedemographics interface 404 selects target demographics (block 512), thedemographics selector 404 applies a demographics filter (block 514). For example, thedemographics selector 404 may identify survey engagement indices in the media panelengagement index database 116 that are associated with panelists having select target demographics of interest. Additionally, the demographics interface 404 may work with thequery interface 406 to filter the search results from theInternet message database 106 based on the target demographics. - In some examples, the
example query interface 406 submits the target demographics to theInternet database proprietor 104 with a listing of usernames or unique user IDs received in the keyword search results atblock 508 and request theInternet database proprietor 104 to filter the usernames or unique user IDs based on the target demographics. TheInternet database proprietor 104 may filter the usernames or unique user IDs based on corresponding demographics information stored in theUA database 107 and return the filtered results (i.e., filtered usernames or unique user IDs associated with matching demographics) to thequery interface 406. - In some examples, the
Internet database proprietor 104 provides the mediaaudience measurement entity 102 with access to theUA database 107, and thedemographics selector 404 applies the demographics filter to the keyword search results (e.g., the usernames or unique user IDs) at the operation ofblock 514 by directly accessing demographics information of registered users in theUA database 107. - After applying the demographics filter (block 514) or if the
demographics interface 404 determines that it should not select particular demographic group(s) (block 512), control advances to block 516, at which the Internet engagement index generator 410 (FIG. 4 ) determines an Internet engagement index (EII) (block 516) as discussed above in connection with Equation 1 based on the keyword search results received atblock 508 and/or filtered atblock 514. - The survey engagement index interface 408 (
FIG. 4 ) retrieves a survey engagement index (EIP) (block 518) from the media panelengagement index database 116 corresponding to the target media program. In examples in which particular demographics were applied atblock 514, the surveyengagement index interface 408 selects the survey engagement index (EIP) based also on the target demographics. - The example weighting generator 412 (
FIG. 4 ) determines weight values (block 520). For example, theweighting generator 412 may determine the panel weighting value (WTP) and the Internet weighting value (WTI) as discussed above in connection with Equation 1. The total engagement index generator 414 (FIG. 4 ) determines the TEI 124 (FIG. 1 ) (block 522) based on the Internet engagement index (EII), the survey engagement index (EIP), the panel weighting value (WTP), and the Internet weighting value (WTI) as discussed above in connection with Equation 1. - The
example apparatus 400 determines whether there is another target demographic group for which to generate a TEI for the same target media presentation (block 524). If there is another demographic group, control returns to block 514. Otherwise, theapparatus 400 determines whether there is another target media presentation to analyze (block 526). If there is another target media presentation to analyze (e.g., another target media presentation indicated by a user or located on a pre-defined target media presentation list), control returns to block 502. Otherwise, the example process ofFIG. 5 is ended. - Although examples described above involve the media
audience measurement entity 102 as communicating with only one Internet database proprietor (i.e., the Internet database proprietor 104), in other examples, the mediaaudience measurement entity 102 may communicate with any number of Internet database proprietors and generate TEIs based on data received from any number of Internet database proprietors. -
FIG. 6 is a block diagram of anexample processor system 610 that may be used to execute the example computer readable instructions ofFIG. 5 to implement the example query and reportingserver 112 ofFIG. 1 and/or theexample apparatus 400 ofFIG. 4 . As shown inFIG. 6 , theprocessor system 610 includes aprocessor 612 that is coupled to aninterconnection bus 614. Theprocessor 612 may be any suitable processor, processing unit, or microprocessor. Although not shown inFIG. 6 , thesystem 610 may be a multi-processor system and, thus, may include one or more additional processors that are identical or similar to theprocessor 612 and that are communicatively coupled to theinterconnection bus 614. - The
processor 612 ofFIG. 6 is coupled to achipset 618, which includes amemory controller 620 and an input/output (I/O)controller 622. A chipset provides I/O and memory management functions as well as a plurality of general purpose and/or special purpose registers, timers, etc. that are accessible or used by one or more processors coupled to thechipset 618. Thememory controller 620 performs functions that enable the processor 612 (or processors if there are multiple processors) to access asystem memory 624 and amass storage memory 625. - In general, the
system memory 624 may include any desired type of volatile and/or non-volatile memory such as, for example, static random access memory (SRAM), dynamic random access memory (DRAM), flash memory, read-only memory (ROM), etc. Themass storage memory 625 may include any desired type of mass storage device including hard disk drives, optical drives, tape storage devices, etc. - The I/
O controller 622 performs functions that enable theprocessor 612 to communicate with peripheral input/output (I/O)devices network interface 630 via an I/O bus 632. The I/O devices network interface 630 may be, for example, an Ethernet device, an asynchronous transfer mode (ATM) device, an 802.11 device, a digital subscriber line (DSL) modem, a cable modem, a cellular modem, etc. that enables theprocessor system 610 to communicate with another processor system. - While the
memory controller 620 and the I/O controller 622 are depicted inFIG. 6 as separate functional blocks within thechipset 618, the functions performed by these blocks may be integrated within a single semiconductor circuit or may be implemented using two or more separate integrated circuits. - Although the following discloses example methods, apparatus, systems, and articles of manufacture including, among other components, firmware and/or software executed on hardware, it should be noted that such methods, apparatus, systems, and articles of manufacture are merely illustrative and should not be considered as limiting. For example, it is contemplated that any or all of these hardware, firmware, and/or software components could be embodied exclusively in hardware, exclusively in firmware, exclusively in software, or in any combination of hardware, firmware, and/or software. Accordingly, while the following describes example methods, apparatus, systems, and articles of manufacture, such provided examples are not the only ways to implement such methods, apparatus, systems, and articles of manufacture.
- Although certain example methods, apparatus, systems, and articles of manufacture have been described herein, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all methods, apparatus and articles of manufacture fairly falling within the scope of the claims of this patent.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/685,260 US20150213469A1 (en) | 2010-12-10 | 2015-04-13 | Methods and apparatus to determine audience engagement indices associated with media presentations |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/965,505 US9009298B2 (en) | 2010-12-10 | 2010-12-10 | Methods and apparatus to determine audience engagement indices associated with media presentations |
US14/685,260 US20150213469A1 (en) | 2010-12-10 | 2015-04-13 | Methods and apparatus to determine audience engagement indices associated with media presentations |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/965,505 Continuation US9009298B2 (en) | 2010-12-10 | 2010-12-10 | Methods and apparatus to determine audience engagement indices associated with media presentations |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150213469A1 true US20150213469A1 (en) | 2015-07-30 |
Family
ID=46200478
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/965,505 Active 2032-07-03 US9009298B2 (en) | 2010-12-10 | 2010-12-10 | Methods and apparatus to determine audience engagement indices associated with media presentations |
US14/685,260 Abandoned US20150213469A1 (en) | 2010-12-10 | 2015-04-13 | Methods and apparatus to determine audience engagement indices associated with media presentations |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/965,505 Active 2032-07-03 US9009298B2 (en) | 2010-12-10 | 2010-12-10 | Methods and apparatus to determine audience engagement indices associated with media presentations |
Country Status (1)
Country | Link |
---|---|
US (2) | US9009298B2 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8473975B1 (en) * | 2012-04-16 | 2013-06-25 | The Nielsen Company (Us), Llc | Methods and apparatus to detect user attentiveness to handheld computing devices |
US8874924B2 (en) | 2012-11-07 | 2014-10-28 | The Nielsen Company (Us), Llc | Methods and apparatus to identify media |
US9609386B2 (en) * | 2012-12-18 | 2017-03-28 | Rentak Corporation | System and methods for analyzing content engagement in conjunction with social media |
US10810634B2 (en) | 2013-02-08 | 2020-10-20 | The Nielsen Company (Us), Llc | Methods and apparatus for efficient execution of modules |
US20140280609A1 (en) * | 2013-03-13 | 2014-09-18 | Airnet Group, Inc. | Targeted Message Communication System with Improved Efficiency and Duplication Avoidance |
US10333882B2 (en) | 2013-08-28 | 2019-06-25 | The Nielsen Company (Us), Llc | Methods and apparatus to estimate demographics of users employing social media |
US9967619B2 (en) | 2014-12-01 | 2018-05-08 | Google Llc | System and method for associating search queries with remote content display |
US10542315B2 (en) | 2015-11-11 | 2020-01-21 | At&T Intellectual Property I, L.P. | Method and apparatus for content adaptation based on audience monitoring |
US11115359B2 (en) * | 2016-11-03 | 2021-09-07 | Samsung Electronics Co., Ltd. | Method and apparatus for importance filtering a plurality of messages |
US11128675B2 (en) | 2017-03-20 | 2021-09-21 | At&T Intellectual Property I, L.P. | Automatic ad-hoc multimedia conference generator |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5508731A (en) | 1986-03-10 | 1996-04-16 | Response Reward Systems L.C. | Generation of enlarged participatory broadcast audience |
US4907079A (en) | 1987-09-28 | 1990-03-06 | Teleview Rating Corporation, Inc. | System for monitoring and control of home entertainment electronic devices |
US6807566B1 (en) * | 2000-08-16 | 2004-10-19 | International Business Machines Corporation | Method, article of manufacture and apparatus for processing an electronic message on an electronic message board |
US7197470B1 (en) | 2000-10-11 | 2007-03-27 | Buzzmetrics, Ltd. | System and method for collection analysis of electronic discussion methods |
CH695526A5 (en) * | 2001-03-20 | 2006-06-15 | Supercomputing Systems Ag | A method and installation for the measurement of audience ratings. |
US20020152117A1 (en) * | 2001-04-12 | 2002-10-17 | Mike Cristofalo | System and method for targeting object oriented audio and video content to users |
US20030177488A1 (en) * | 2002-03-12 | 2003-09-18 | Smith Geoff S. | Systems and methods for media audience measurement |
US7483975B2 (en) | 2004-03-26 | 2009-01-27 | Arbitron, Inc. | Systems and methods for gathering data concerning usage of media data |
US7941339B2 (en) * | 2004-12-23 | 2011-05-10 | International Business Machines Corporation | Method and system for managing customer network value |
GB2430507A (en) | 2005-09-21 | 2007-03-28 | Stephen Robert Ives | System for managing the display of sponsored links together with search results on a mobile/wireless device |
US9514436B2 (en) * | 2006-09-05 | 2016-12-06 | The Nielsen Company (Us), Llc | Method and system for predicting audience viewing behavior |
US20080140506A1 (en) | 2006-12-08 | 2008-06-12 | The Procter & Gamble Corporation | Systems and methods for the identification, recruitment, and enrollment of influential members of social groups |
US20080154958A1 (en) * | 2006-12-20 | 2008-06-26 | Microsoft Corporation | Expanding media content item information |
US20080183552A1 (en) * | 2007-01-30 | 2008-07-31 | Pied Piper Management Company | Method for evaluating, analyzing, and benchmarking business sales performance |
JP5579595B2 (en) * | 2007-04-03 | 2014-08-27 | グーグル・インコーポレーテッド | Matching expected data with measured data |
US8219447B1 (en) * | 2007-06-06 | 2012-07-10 | Amazon Technologies, Inc. | Real-time adaptive probabilistic selection of messages |
US20090099919A1 (en) * | 2007-07-18 | 2009-04-16 | Freepath, Inc. | Method, system and computer program product for formatting and delivery of playlist presentation content |
US20090164408A1 (en) | 2007-12-21 | 2009-06-25 | Ilya Grigorik | Method, System and Computer Program for Managing Delivery of Online Content |
US8701136B2 (en) * | 2008-01-07 | 2014-04-15 | Nielsen Company (Us), Llc | Methods and apparatus to monitor, verify, and rate the performance of airings of commercials |
US8249912B2 (en) * | 2008-02-20 | 2012-08-21 | Sebastian Elliot | Method for determining, correlating and examining the causal relationships between media program and commercial content with response rates to advertising and product placement |
US7860878B2 (en) | 2008-02-25 | 2010-12-28 | Yahoo! Inc. | Prioritizing media assets for publication |
-
2010
- 2010-12-10 US US12/965,505 patent/US9009298B2/en active Active
-
2015
- 2015-04-13 US US14/685,260 patent/US20150213469A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
US20120150958A1 (en) | 2012-06-14 |
US9009298B2 (en) | 2015-04-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9009298B2 (en) | Methods and apparatus to determine audience engagement indices associated with media presentations | |
US12015681B2 (en) | Methods and apparatus to determine media impressions using distributed demographic information | |
US20190379629A1 (en) | Methods and apparatus to estimate demographics of users employing social media | |
US10154310B2 (en) | System and method for associating individual household members with television programs viewed | |
CN109189951B (en) | Multimedia resource recommendation method, equipment and storage medium | |
Borghol et al. | The untold story of the clones: Content-agnostic factors that impact YouTube video popularity | |
CA2810264C (en) | Methods and apparatus to determine media impressions | |
CN108550068B (en) | Personalized commodity recommendation method and system based on user behavior analysis | |
US9710555B2 (en) | User profile stitching | |
US9098551B1 (en) | Method and system for ranking content by click count and other web popularity signals | |
US9594758B2 (en) | Method and apparatuses for enabling recommendations | |
US8667135B1 (en) | Detecting and reporting on consumption rate changes | |
US20120323675A1 (en) | Methods and apparatus to measure comparative performance of internet and television ad campaigns | |
AU2010292843A1 (en) | Audience segment estimation | |
US20140278796A1 (en) | Identifying Target Audience for a Product or Service | |
CN105843876B (en) | Quality evaluation method and device for multimedia resources | |
Xu et al. | Catch-up TV recommendations: show old favourites and find new ones | |
AU2015213416B2 (en) | Audience segment estimation | |
KR20130049231A (en) | Apparatus for analyzing interests of targeted customers, and method for targeted advertisement | |
Charoenpanich et al. | (How) Does Data-based Music Discovery Work? | |
Akarapat Charoenpanich et al. | Complete Research | |
AU2016200904A1 (en) | Audience segment estimation | |
AU2015200121A1 (en) | Methods and apparatus to determine media impressions |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: THE NIELSEN COMPANY (US), LLC, ILLINOIS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BESEHANIC, JAN;RAMASWAMY, ARUN;REEL/FRAME:035407/0538 Effective date: 20101210 |
|
AS | Assignment |
Owner name: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES, DELAWARE Free format text: SUPPLEMENTAL IP SECURITY AGREEMENT;ASSIGNOR:THE NIELSEN COMPANY ((US), LLC;REEL/FRAME:037172/0415 Effective date: 20151023 Owner name: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST Free format text: SUPPLEMENTAL IP SECURITY AGREEMENT;ASSIGNOR:THE NIELSEN COMPANY ((US), LLC;REEL/FRAME:037172/0415 Effective date: 20151023 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: THE NIELSEN COMPANY (US), LLC, NEW YORK Free format text: RELEASE (REEL 037172 / FRAME 0415);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:061750/0221 Effective date: 20221011 |