US20160063539A1 - Methods and apparatus to associate transactions with media impressions - Google Patents
Methods and apparatus to associate transactions with media impressions Download PDFInfo
- Publication number
- US20160063539A1 US20160063539A1 US14/473,654 US201414473654A US2016063539A1 US 20160063539 A1 US20160063539 A1 US 20160063539A1 US 201414473654 A US201414473654 A US 201414473654A US 2016063539 A1 US2016063539 A1 US 2016063539A1
- Authority
- US
- United States
- Prior art keywords
- media
- product
- transaction
- impression
- identifier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0242—Determining effectiveness of advertisements
- G06Q30/0246—Traffic
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0242—Determining effectiveness of advertisements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0259—Targeted advertisements based on store location
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0261—Targeted advertisements based on user location
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0269—Targeted advertisements based on user profile or attribute
- G06Q30/0271—Personalized advertisement
Definitions
- the present disclosure relates generally to monitoring media and, more particularly, to methods and apparatus to associate transactions with media impressions.
- audience measurement entities determine audience engagement levels for media programming based on registered panel members. That is, an audience measurement entity enrolls people who consent to being monitored into a panel. The audience measurement entity then monitors those panel members to determine media (e.g., television programs or radio programs, movies, DVDs, advertisements, etc.) exposed to those panel members. In this manner, the audience measurement entity can determine exposure measures for different media based on the collected media measurement data.
- media e.g., television programs or radio programs, movies, DVDs, advertisements, etc.
- FIG. 1 depicts an example system to collect impressions of media presented at mobile devices and to collect user information from distributed database proprietors for associating with the collected impressions.
- FIG. 2 is an example impression-transaction analyzer which may be implemented in the example audience measurement server of FIG. 1 to compare and/or match impression information associated with a mobile device to transaction information performed using a user account accessed by the mobile device.
- FIG. 3 illustrates an example table illustrating an example determination of publisher effectiveness.
- FIG. 4 is a graph illustrating the data in the example table of FIG. 3 .
- FIG. 5 is a block diagram of an example transaction information provider that may be used to implement the example merchant database proprietor of FIG. 1 .
- FIG. 6 is a flow diagram representative of example machine readable instructions which may be executed to implement the example impression-transaction analyzer of FIG. 2 to associate media impressions to transaction information.
- FIG. 7 is a flow diagram representative of example machine readable instructions which may be executed to implement the example impression-transaction analyzer of FIG. 2 to correlate transactions involving a product to media impressions corresponding to the product.
- FIGS. 8A and 8B show a flow diagram representative of example machine readable instructions which may be executed to implement the example impression-transaction analyzer of FIG. 2 to determine media and publisher effectiveness.
- FIG. 9 is a flow diagram representative of example machine readable instructions which may be executed to implement the example transaction information provider of FIG. 5 to associate device/user identifiers to merchant database proprietor accounts.
- FIG. 10 is a flow diagram representative of example machine readable instructions which may be executed to implement the example transaction information provider of FIG. 5 to provide transaction information.
- FIG. 11 is a flow diagram representative of example machine readable instructions which may be executed to implement the example transaction information provider of FIG. 5 to provide transaction information.
- FIG. 12 is an example processor platform that may be used to execute the example instructions of FIGS. 6-11 to implement example apparatus and systems disclosed herein.
- server logs can be tampered with either directly or via zombie programs which repeatedly request media from servers to increase the server log counts corresponding to the requested media.
- media is sometimes retrieved once, cached locally and then repeatedly viewed from the local cache without involving the server in the repeat viewings.
- Server logs cannot track these views of cached media because reproducing locally cached media does not require re-requesting the media from a server.
- server logs are susceptible to both over-counting and under-counting errors.
- the beacon instructions cause monitoring data reflecting information about the access to the media to be sent from the client that downloaded the media to a monitoring entity.
- the monitoring entity is an audience measurement entity (AME) (e.g., any entity interested in measuring or tracking audience exposures to advertisements, media, and/or any other media) that did not provide the media to the client and who is a trusted third party for providing accurate usage statistics (e.g., The Nielsen Company, LLC).
- AME audience measurement entity
- the beaconing instructions are associated with the media and executed by the client browser whenever the media is accessed, the monitoring information is provided to the AME irrespective of whether the client is a panelist of the AME.
- the AME establishes a panel of users who have agreed to provide their demographic information and to have their Internet browsing activities monitored. When an individual joins the panel, they provide detailed information concerning their identity and demographics (e.g., gender, race, income, home location, occupation, etc.) to the AME.
- the AME sets a cookie on the panelist computer that enables the AME to identify the panelist whenever the panelist accesses tagged media and, thus, sends monitoring information to the AME.
- database proprietors operating on the Internet. These database proprietors provide services (e.g., social networking services, email services, media access services, etc.) to large numbers of subscribers. In exchange for the provision of such services, the subscribers register with the proprietors. As part of this registration, the subscribers provide detailed demographic information. Examples of such database proprietors include social network providers such as Facebook, Myspace, Twitter, etc. These database proprietors set cookies on the computers of their subscribers to enable the database proprietors to recognize registered users when such registered users visit their websites.
- services e.g., social networking services, email services, media access services, etc.
- the subscribers register with the proprietors. As part of this registration, the subscribers provide detailed demographic information. Examples of such database proprietors include social network providers such as Facebook, Myspace, Twitter, etc. These database proprietors set cookies on the computers of their subscribers to enable the database proprietors to recognize registered users when such registered users visit their websites.
- AMEs (also referred to herein as “ratings entities”) determine reach for advertising and media programming based on registered panel members. That is, an AME enrolls people that consent to being monitored into a panel. During enrollment, the AME receives information from the enrolling people so that subsequent correlations may be made between advertisement/media exposure to those panelists and different demographic markets.
- example methods, apparatus, and/or articles of manufacture disclosed herein enable an AME to share information with other entities that operate based on user registration models.
- a user registration model is a model in which users subscribe to services of those entities by creating an account and providing information about themselves.
- Sharing of information associated with registered users of database proprietors enables an AME to extend or supplement their panel data with substantially reliable information from external sources (e.g., database proprietors), thus extending the coverage, accuracy, and/or completeness of their audience measurements. Such access also enables the AME to monitor persons who would not otherwise have joined an AME panel.
- Any entity having a database identifying characteristics of a set of individuals may cooperate with the AME.
- Such entities may be referred to as “database proprietors” and include entities such as wireless service carriers, mobile software/service providers, social medium sites (e.g., Facebook, Twitter, Google, etc.), and/or any other Internet sites such as Yahoo!, MSN, Apple iTunes, Experian, etc. that collect demographic data of users which may be in exchange for a service.
- Examples disclosed herein may be implemented by an AME (e.g., any entity interested in measuring or tracking audience exposures to advertisements, media, and/or any other media) in cooperation with any number of database proprietors such as online web services providers to develop online media exposure metrics.
- database proprietors/online web services providers may be wireless service carriers, mobile software/service providers, social network sites (e.g., Facebook, Twitter, MySpace, etc.), multi-service sites (e.g., Yahoo!, Google, Experian, etc.), online retailer sites (e.g., Amazon.com, Buy.com, etc.), and/or any other web service(s) site that maintains user registration records.
- An impression corresponds to a home or individual having been exposed to the corresponding media and/or advertisement.
- an impression represents a home or an individual having been exposed to an advertisement or media or group of advertisements or media.
- a quantity of impressions or impression count is the total number of times an advertisement or advertisement campaign has been accessed by a web population (e.g., including number of times accessed as decreased by, for example, pop-up blockers and/or increased by, for example, retrieval from local cache memory).
- the term “product” is expressly defined to refer to any type of purchasable item, whether tangible or intangible.
- product is expressly defined to include goods, services, combinations of goods and/or services, and items that are part-good and part-service.
- Examples methods and apparatus disclosed herein may be used to correlate media impressions occurring on mobile devices to subsequent commercial transactions.
- Example commercial transactions include purchases of a product from an online merchant such as Amazon®, eBay®, or any other online merchant, including online merchants that also have physical locations at which transactions may occur directly with consumers (e.g., brick and mortar stores).
- Example methods and apparatus disclosed herein may be used to measure the effectiveness of mobile advertising campaigns by comparing sales of a product from a time period prior to an advertising campaign to sales of the product from a time period subsequent to an advertising campaign. Additionally or alternatively, disclosed example methods and apparatus may be used to compare the effectiveness of media between different publishers (e.g., publisher effectiveness).
- example methods and apparatus disclosed herein are capable of tracking the correlation of media impressions to changes in purchase habits at the individual user account level (e.g., an account kept with the merchant by a user, which is used to purchase a product from that merchant). For example, a media impression occurring at a device having a unique identifier may be matched to the subsequent purchase of a product advertised in the media impression. In response, examples disclosed herein may be used to draw the inference that the media impression was related to influencing the subsequent purchase. Additionally, the correlation between media impressions and sales can be determined for devices and/or user accounts with which the audience measurement entity does not have any prior information or prior relationship.
- example methods and apparatus disclosed herein utilize a user/device identifier and media impression information collected from a mobile device.
- the example media impression information represents media impressions occurring at the mobile device.
- commercial transaction information associated with the user/device identifier is also obtained.
- Example commercial transaction information includes data describing commercial transactions conducted using an account that has been accessed by a device associated with the user/device identifier.
- a user account may be correlated to multiple unique identifiers.
- Example methods and apparatus disclosed herein associate the media impression information with the commercial transaction information to, for example, determine a cause and effect relationship between the impression and the commercial transaction. Examples disclosed herein may match impressions occurring on one device with transactions performed using a different device.
- Examples of device types from which user/device identifiers may be collected include smartphones (e.g., iPhones, Android OS-based smartphones, Blackberry smartphones, Windows Mobile-based smartphones, etc.), tablet computers (e.g., iPads, Android OS-based tablet computers, etc.), portable media players (e.g., iPods, etc.), and/or other device types.
- Such device types may be cookie-based devices (e.g., devices that run cookie-based applications/software) and/or non-cookie-based devices (e.g., devices such as Apple iOS devices that run applications/software that do not employ cookies).
- examples disclosed herein are described with reference to compensating or adjusting impression information obtained from mobile devices, the examples are also applicable to non-mobile devices such as desktop computers, televisions, video game consoles, and/or other devices.
- example methods and apparatus disclosed herein leverage the computing device-based and network-based delivery of media impressions, as well as the use of online transaction platforms, to evaluate the effectiveness of media at actually driving (or inhibiting) sales activity. Some such example methods and apparatus reduce the manual resources, computing resources, and networking resources used to collect, analyze, and/or correlate impression information and transaction information to evaluate media effectiveness at driving product sales.
- Some examples enable the conservation of computing and/or networking resources by relating transactions to impressions via a unique identifier, thereby reducing or eliminating computations and/or communications previously required to determine a transaction from the occurrence of an impression at a computing device (e.g., identifying the user, retrieving information about the user, determining whether the user has an account at a merchant, obtaining permission from the user to access his or her account information, sorting through the transactions to identify the products, etc.).
- example methods and apparatus disclosed herein provide more accurate measurements than prior methods of estimating media effectiveness at driving product sales, because the impression data and the transaction data more accurately reflect the actual incidences of impressions and sales and because impressions are linked directly to corresponding sales by relating the impression data to the transaction data. This achieves a significant improvement in the audience analytics and advertising field. Such improvements can reduce the amount of network resources used for delivering advertisements by enabling the quick elimination of ineffective advertisements and/or ineffective advertisement platforms. In a world of limited resources, this elimination of waste has the beneficial effect of freeing resources for other beneficial purposes.
- FIG. 1 depicts an example system 100 to collect user information (e.g., user information 102 ) from a database proprietor 104 for associating with impressions of media presented at a mobile device 106 .
- user information 102 or user data includes one or more of demographic data, purchase data, and/or other data indicative of user activities, behaviors, and/or preferences related to information accessed via the Internet, purchases, media accessed on electronic devices, physical locations (e.g., retail or commercial establishments, restaurants, venues, etc.) visited by users, etc.
- Examples disclosed herein are described in connection with a mobile device, which may be a mobile phone, a mobile communication device, a tablet, a gaming device, a portable media presentation device, etc. However, examples disclosed herein may be implemented in connection with non-mobile devices such as internet appliances, smart televisions, internet terminals, computers, or any other device capable of presenting media received via network communications.
- an audience measurement entity (AME) 108 partners with or cooperates with an app publisher 110 to download and install a data collector 112 on the mobile device 106 .
- the AME 108 provides the data collector 112 to the app publisher 110 for inclusion of the data collector 112 in apps downloaded by mobile devices from the app publisher 110 .
- the app publisher 110 of the illustrated example may be a software app developer that develops and distributes apps to mobile devices and/or a distributor that receives apps from software app developers and distributes the apps to mobile devices.
- the data collector 112 may be included in other software loaded onto the mobile device 106 , such as the operating system 114 , an application (or app) 116 , a web browser 117 , and/or any other software.
- Any of the example software 114 - 117 may present media 118 received from a media publisher 120 .
- the media 118 may be an advertisement, video, audio, text, a graphic, a web page, news, educational media, entertainment media, or any other type of media.
- a media ID 122 is provided in the media 118 to enable identifying the media 118 so that the AME 108 can credit the media 118 with media impressions when the media 118 is presented on the mobile device 106 or any other device that is monitored by the AME 108 .
- the data collector 112 of the illustrated example includes instructions (e.g., Java, java script, or any other computer language or script) that, when executed by the mobile device 106 , cause the mobile device 106 to collect the media ID 122 of the media 118 presented by the app program 116 and/or the mobile device 106 , and to collect one or more device/user identifier(s) 124 stored in the mobile device 106 .
- the device/user identifier(s) 124 of the illustrated example include identifiers that can be used by the demographic database proprietor 104 to identify the user or users of the mobile device 106 , and to locate user information 102 corresponding to the user(s).
- the device/user identifier(s) 124 may include hardware identifiers (e.g., an international mobile equipment identity (IMEI), a mobile equipment identifier (MEID), a media access control (MAC) address, etc.), an app store identifier (e.g., a Google Android ID, an Apple ID, an Amazon ID, etc.), an open source unique device identifier (OpenUDID), an open device identification number (ODIN), a login identifier (e.g., a username), an email address, user agent data (e.g., application type, operating system, software vendor, software revision, etc.), third-party service identifiers (e.g., an “Identifier for Advertising” (IDFA), advertising service identifiers, device usage analytics service identifiers, demographics collection service identifiers), web storage data, document object model (DOM) storage data, local shared objects (also referred to as “Flash cookies”), etc.
- hardware identifiers e.g., an international mobile equipment identity (IMEI
- fewer or more device/user identifier(s) 124 may be used.
- the AME 108 may partner with any number of demographic database proprietors to collect distributed user information (e.g., the user information 102 ).
- the mobile device 106 may not allow access to identification information stored in the mobile device 106 .
- the disclosed examples enable the AME 108 to store an AME-provided identifier (e.g., an identifier managed and tracked by the AME 108 ) in the mobile device 106 to track media impressions on the mobile device 106 .
- the AME 108 may provide instructions in the data collector 112 to set an AME-provided identifier in memory space accessible by and/or allocated to the app program 116 .
- the data collector 112 uses the identifier as a device/user identifier 124 .
- the AME-provided identifier set by the data collector 112 persists in the memory space even when the app program 116 and the data collector 112 are not running. In this manner, the same AME-provided identifier can remain associated with the mobile device 106 for extended durations and/or be used across multiple apps.
- the data collector 112 sets an identifier in the mobile device 106
- the AME 108 may recruit a user of the mobile device 106 as a panelist, and may store user information collected from the user during a panelist registration process and/or collected by monitoring user activities/behavior via the mobile device 106 and/or any other device used by the user and monitored by the AME 108 . In this manner, the AME 108 can associate user information of the user (from panelist data stored by the AME 108 ) with media impressions attributed to the user on the mobile device 106 .
- the data collector 112 sends the media ID 122 and the one or more device/user identifier(s) 124 as collected data 126 to the app publisher 110 .
- the data collector 112 may be configured to send the collected data 126 to another collection entity (other than the app publisher 110 ) that has been contracted by the AME 108 or is partnered with the AME 108 to collect media ID's (e.g., the media ID 122 ) and device/user identifiers (e.g., the device/user identifier(s) 124 ) from mobile devices (e.g., the mobile device 106 ).
- the app publisher 110 sends the media ID 122 and the device/user identifier(s) 124 as impression data 130 to a server 132 at the AME 108 .
- the impression data 130 of the illustrated example may include one media ID 122 and one or more device/user identifier(s) 124 to report a single impression of the media 118 , or it may include numerous media ID's 122 and device/user identifier(s) 124 based on numerous instances of collected data (e.g., the collected data 126 ) received from the mobile device 106 and/or other mobile devices to report multiple impressions of media.
- the server 132 stores the impression data 130 in an AME media impressions store 134 (e.g., a database or other data structure).
- the AME 108 sends the device/user identifier(s) 124 to the demographic database proprietor 104 to receive user information 102 corresponding to the device/user identifier(s) 124 from the demographic database proprietor 104 so that the AME 108 can associate the user information with corresponding media impressions of media (e.g., the media 118 ) presented at mobile devices (e.g., the mobile device 106 ).
- the media identifier 122 and/or the device/user identifier(s) 124 are encrypted before they are sent to the AME 108 and/or to the demographic database proprietor 104 . In other examples, the media identifier 122 and/or the device/user identifier(s) 124 are not encrypted.
- each of the device/user identifier logs 136 may include a single device/user identifier 124 , or it may include numerous aggregate device/user identifiers 124 received over time from one or more mobile devices.
- the demographic database proprietor 104 looks up its users corresponding to the device/user identifiers 124 in the respective logs 136 .
- the demographic database proprietor 104 collects user information 102 corresponding to users identified in the device/user identifier logs 136 for sending to the AME 108 .
- the demographic database proprietor 104 is a wireless service provider and the device/user identifier log 136 includes IMEI numbers recognizable by the wireless service provider
- the wireless service provider accesses its subscriber records to find users having IMEI numbers matching the IMEI numbers received in the device/user identifier log 136 .
- the wireless service provider copies the users' user information to the user information 102 for delivery to the AME 108 .
- the data collector 112 is configured to collect the device/user identifier(s) 124 from the mobile device 106 .
- the example data collector 112 sends the device/user identifier(s) 124 to the app publisher 110 in the collected data 126 , and it also sends the device/user identifier(s) 124 to the media publisher 120 .
- the data collector 112 does not collect the media ID 122 from the media 118 at the mobile device 106 as the data collector 112 does in the example system 100 of FIG. 1 . Instead, the media publisher 120 that publishes the media 118 to the mobile device 106 retrieves the media ID 122 from the media 118 that it publishes.
- the media publisher 120 then associates the media ID 122 to the device/user identifier(s) 124 received from the data collector 112 executing in the mobile device 106 , and sends collected data 138 to the app publisher 110 that includes the media ID 122 and the associated device/user identifier(s) 124 of the mobile device 106 .
- the media publisher 120 sends the media 118 to the mobile device 106 , it does so by identifying the mobile device 106 as a destination device for the media 118 using one or more of the device/user identifier(s) 124 received from the mobile device 106 .
- the media publisher 120 can associate the media ID 122 of the media 118 with the device/user identifier(s) 124 of the mobile device 106 indicating that the media 118 was sent to the particular mobile device 106 for presentation (e.g., to generate an impression of the media 118 ).
- the data collector 112 does not collect the media ID 122 from the media 118 at the mobile device 106 . Instead, the media publisher 120 that publishes the media 118 to the mobile device 106 also retrieves the media ID 122 from the media 118 that it publishes. The media publisher 120 then associates the media ID 122 with the device/user identifier(s) 124 of the mobile device 106 . The media publisher 120 then sends the impression data 130 , including the media ID 122 and the device/user identifier(s) 124 , to the AME 108 .
- the media publisher 120 when the media publisher 120 sends the media 118 to the mobile device 106 , it does so by identifying the mobile device 106 as a destination device for the media 118 using one or more of the device/user identifier(s) 124 . In this manner, the media publisher 120 can associate the media ID 122 of the media 118 with the device/user identifier(s) 124 of the mobile device 106 indicating that the media 118 was sent to the particular mobile device 106 for presentation (e.g., to generate an impression of the media 118 ).
- the AME 108 can then send the device/user identifier log 136 to the demographic database proprietor 104 to request the user information 102 as described above in connection with FIG. 1 .
- the app publisher 110 may implement at least some of the operations of the media publisher 120 to send the media 118 to the mobile device 106 for presentation.
- advertisement providers, media providers, or other information providers may send media (e.g., the media 118 ) to the app publisher 110 for publishing to the mobile device 106 via, for example, the app program 116 when it is executing on the mobile device 106 .
- the app publisher 110 implements the operations described above as being performed by the media publisher 120 .
- the mobile device 106 sends device/user identifiers 124 to the audience measurement entity 108 (e.g., via the application publisher 110 , the media publisher 120 , and/or another entity)
- the mobile device 106 e.g., the data collector 112 installed on the mobile device 106
- sends the identifiers e.g., the user/device identifier(s) 124
- the database proprietor 104 e.g., not via the AME 108 .
- the example mobile device 106 sends the media identifier 122 to the audience measurement entity 108 (e.g., directly or through an intermediary such as via the application publisher 110 ), but does not send the media identifier 122 to the database proprietors 104 .
- the example demographic database proprietor 104 provides the user information 102 to the example AME 108 for matching with the media identifier 122 to form media impression information.
- the database proprietor 104 is not provided copies of the media identifier 122 .
- the mobile device 106 provides the database proprietor 104 with impression identifiers 140 .
- An impression identifier 140 uniquely identifies an impression event relative to other impression events of the mobile device 106 (and relative to the impression events of other devices) so that an occurrence of an impression at the mobile device 106 can be distinguished from other occurrences of impressions.
- the impression identifier 140 does not itself identify the media associated with that impression event.
- the impression data 130 from the mobile device 106 to the AME 108 also includes the impression identifier 140 and the corresponding media identifier 122 .
- the example demographic database proprietor 104 provides the user information 102 to the AME 108 in association with the impression identifier 140 for the impression event that triggered the collection of the user information 102 .
- the AME 108 can match the impression identifier 140 received from the mobile device 106 to a corresponding impression identifier 140 received from the demographic database proprietor 104 to associate the media identifier 122 received from the mobile device 106 with demographic information in the user information 102 received from the database proprietor 104 .
- the impression identifier 140 can additionally be used for reducing or avoiding duplication of demographic information.
- the example demographic database proprietor 104 may provide the user information 102 and the impression identifier 140 to the AME 108 on a per-impression basis (e.g., each time a mobile device 106 sends a request including a device/user identifier 124 and an impression identifier 140 to the demographic database proprietor 104 ) and/or on an aggregated basis (e.g., send a set of user information 102 , which may include indications of multiple impressions at a mobile device 102 (e.g., multiple impression identifiers 140 ), to the AME 108 presented at the mobile device 106 ).
- a per-impression basis e.g., each time a mobile device 106 sends a request including a device/user identifier 124 and an impression identifier 140 to the demographic database proprietor 104
- an aggregated basis e.g., send a set of user information 102 , which may include indications of multiple impressions at a mobile device 102 (e.g., multiple impression identifiers
- the above examples illustrate methods and apparatus for collecting impression data at an audience measurement entity (or other entity).
- the examples discussed above may be used to collect impression information for any type of media, including static media (e.g., advertising images), streaming media (e.g., streaming video and/or audio, including content, advertising, and/or other types of media), and/or other types of media.
- static media e.g., media that does not have a time component such as images, text, a webpage, etc.
- the AME 108 records an impression once for each occurrence of the media being presented, delivered, or otherwise provided to the mobile device 106 .
- streaming media e.g., video, audio, etc.
- the example AME 108 measures demographics for media occurring over a period of time.
- the AME 108 (e.g., via the app publisher 110 and/or the media publisher 120 ) provides beacon instructions to a client application or client software (e.g., the OS 114 , the web browser 117 , the app 116 , etc.) executing on the mobile device 106 when media is loaded at client application/software 114 - 117 .
- the beacon instructions cause the client application/software 114 - 117 to transmit a request (e.g., a pingback message) to an impression monitoring server at regular and/or irregular intervals (e.g., every minute, every 30 seconds, every 2 minutes, etc.).
- the example impression monitoring server 132 identifies the requests from the web browser 117 and, in combination with one or more database proprietors, matches the impression information for the media with demographics of the user of the web browser 117 .
- a user loads (e.g., via the browser 117 ) a web page from a web site publisher (e.g., a web page corresponding to a particular 60 minute video).
- a web site publisher e.g., a web page corresponding to a particular 60 minute video.
- An instruction which is a part of or referred to by the example web page causes the browser 117 and/or the data collector 112 to send a pingback message (e.g., a beacon request) to a beacon server 142 .
- the beacon instructions when executed by the example browser 117 , the beacon instructions cause the data collector 112 to send pingback messages (e.g., beacon requests, HTTP requests, pings) to the impression monitoring server 132 at designated intervals (e.g., once every minute or any other suitable interval).
- the example beacon instructions (or a redirect message from, for example, the impression monitoring server 132 or the database proprietor 104 ) further cause the browser 117 and/or the data collector 112 to send pingback messages or beacon requests to the database proprietor 104 that collect and/or maintain demographic information about users.
- the database proprietor 104 transmits demographic information about the user associated with the data collector 112 and/or the browser 117 for combining or associating with the impression determined by the impression monitoring server 132 . If the user closes the web page containing the video before the end of the video, the beacon instructions are stopped, and the data collector 112 stops sending the pingback messages to the impression monitoring server 132 .
- the pingback messages include timestamps and/or other information indicative of the locations in the video to which the numerous pingback messages correspond.
- the example impression monitoring server 132 can determine that the user watched a particular length of the video (e.g., a portion of the video for which pingback messages were received at the impression monitoring server 132 ).
- the mobile device 106 of the illustrated example executes a client application/software 114 - 117 that retrieves data from a host website (e.g., www.acme.com) that provides (e.g., serves) the media 118 (e.g., audio, video, interactive media, streaming media, etc.) is obtained for presenting via the mobile device 106 .
- the media 118 e.g., advertisements and/or content
- identifier information e.g., a media ID 122 , a creative type ID, a placement ID, a publisher source URL, etc.
- the example beacon instruction causes the client application/software 114 - 117 to request further beacon instructions from a beacon server 142 that will instruct the client application/software 114 - 117 on how and where to send beacon requests to report impressions of the media 118 .
- the example client application/software 114 - 117 transmits a request including an identification of the media 118 (e.g., the media identifier 122 ) to the beacon server 142 .
- the beacon server 142 generates and/or returns beacon instructions 144 to the example mobile device 106 .
- the beacon server 142 and the impression monitoring server 132 are shown separately, in some examples the beacon server 142 and the impression monitoring server 132 are combined.
- beacon instructions 144 include a URL of the database proprietor (e.g., the demographic database proprietors 104 ) or any other server to which the mobile device 106 should send beacon requests (e.g., impression requests).
- a pingback message or beacon request may be implemented as an HTTP request.
- audience measurement information e.g., ad campaign identification, content identifier, and/or device/user identification information
- the server to which the pingback message or beacon request is directed is programmed to log the audience measurement data of the pingback message or beacon request as an impression (e.g., an ad and/or content impression depending on the nature of the media tagged with the beaconing instructions).
- the tagged media 118 include the beacon instructions 144 .
- the client application/software 114 - 117 does not need to request beacon instructions 144 from a beacon server 142 because the beacon instructions 144 are already provided in the tagged media 118 .
- the beacon instructions 144 When the beacon instructions 144 are executed by the mobile device 106 , the beacon instructions 144 cause the mobile device 106 to send beacon requests (e.g., repeatedly at designated intervals) to a remote server (e.g., the impression monitoring server 132 , the media publisher 120 , the database proprietor 104 , or another server) specified in the beacon instructions 144 .
- a remote server e.g., the impression monitoring server 132 , the media publisher 120 , the database proprietor 104 , or another server
- the specified server is a server of the audience measurement entity 108 , such as the impression monitoring server 132 .
- the beacon instructions 144 may be implemented using Javascript or any other types of instructions or script executable via a client application (e.g., a web browser) including, for example, Java, HTML, etc.
- While the example system 100 of FIG. 1 is illustrated as having one database proprietor 104 , multiple database proprietors 104 may be used.
- Amazon® provides an application for devices to enable a user of the device to login to an Amazon account, browse and/or search for items, add the items to a shopping cart, enter payment information, configure shipping details, and/or finalize an order.
- Amazon provides such an application for multiple different types of devices (e.g., devices executing different operating systems).
- Many other such applications are available for other merchants.
- Merchants who also have physical locations at which transactions can be performed often provide applications for performing commercial transactions from electronic devices similar to the transaction described above.
- the example system 100 of FIG. 1 includes a merchant database proprietor 146 .
- the example merchant database proprietor 146 of FIG. 1 stores account information for users who have registered with the merchant database proprietor 146 .
- users who register with the merchant database proprietor 146 are then permitted to place orders for (e.g., purchase) products offered by the merchant database proprietor 146 and/or offered by third parties using ordering services provided by the merchant database proprietor 146 .
- the merchant database proprietor 146 may list products offered by a third party, facilitate payment by the user for a purchased product, and/or facilitate shipping of the purchased product to the user.
- the example merchant database proprietor 146 of FIG. 1 provides an application (e.g., the app 116 of FIG. 1 ) for download to the mobile device 106 .
- the mobile device 106 may download the app 116 from the app publisher 110 and/or directly from the merchant database proprietor 146 .
- the example user may login to an account with the merchant database proprietor 146 and/or may register to create an account with the merchant database proprietor 146 .
- the example app 116 transmits merchant account information 148 (e.g., a login name or other account identifier, a password, etc.) to the merchant database proprietor 146 , which identifies the user or account to the merchant database proprietor 146 .
- merchant account information 148 e.g., a login name or other account identifier, a password, etc.
- the example app 116 accesses the device/user identifier 124 in the mobile device 106 .
- the app 116 of the illustrated example transmits the device/user identifier 124 to the merchant database proprietor 146 .
- the example merchant database proprietor 146 Upon receipt of the merchant account information 148 and the device/user identifier 124 and authentication of the corresponding user account, the example merchant database proprietor 146 associates the user account with the device/user identifier 124 . As a result, the example merchant database proprietor 146 can generate transaction information 150 for the user account, including transactions performed using the user account with the device/user identifier 124 .
- a user account is accessed via multiple devices (e.g., a smartphone and a tablet computer that are both owned by the owner of the user account).
- the example merchant database proprietor 146 may associate multiple device/user identifiers 124 with the user account such that media impressions occurring on any of the devices corresponding to the device/user identifiers 124 may be correlated to transactions occurring using the user account.
- the transactions may be independent of the device on which they were performed by the user. That is, in the illustrated example, transactions are associated with the user account.
- the example AME 108 receives the impression data 130 and the device/user identifier 124 from the example mobile device 106 .
- the example AME 108 of FIG. 1 associates transaction information 150 with impression information by matching impressions to transactions using the device/user identifier 124 .
- the AME 108 of FIG. 1 receives, from the merchant database proprietor 146 , transaction information associated with a user account associated with a device/user identifier 124 of the mobile device 106 .
- the example AME 108 also receives the impression data 130 (or impression information) including an indication of the same device/user identifier 124 .
- the example AME 108 of FIG. 1 correlates the transaction information to the impressions by matching the device/user identifier 124 in a transaction request 152 (described below) to the device/user identifier 124 that corresponds to a user account used to perform the transactions.
- the example AME 108 transmits a transaction request 152 to the example merchant database proprietor 146 .
- the example transaction request 152 includes a device/user identifier 124 .
- the AME 108 transmits the device/user identifier 124 that is received in the impression data 130 to, for example, obtain transaction information to potentially be correlated to a media impression.
- the example merchant database proprietor 146 receives the transaction request 152 including the device/user identifier 124 .
- the merchant database proprietor 146 looks up a user account that was previously associated with the device/user identifier 124 (e.g., in a database). If the merchant database proprietor 146 locates a user account associated with the device/user identifier 124 , the example merchant database proprietor 146 generates the transaction information 150 (e.g., based on transaction data stored in a database of the merchant database proprietor 146 ).
- the merchant database proprietor 146 transmits the transaction information 150 to the example AME 108 .
- the merchant database proprietor 146 includes the device/user identifier 124 in its response to the AME 108 to enable the AME 108 to determine the device/user identifier 124 and/or the request 152 for which the transaction information 150 is being provided.
- the example AME 108 of the illustrated example matches the transaction information 150 received from the merchant database proprietor 146 to the impression data 130 .
- the example AME 108 of FIG. 1 determines the product(s) represented in the impression data 130 .
- product(s) represented in media include products represented in advertisements for those products (e.g., a Coca-Cola® soft drink represented in an advertisement for Coca-Cola) and/or intentionally-placed product(s) in non-advertisement media such as television episodes, movies, and/or other content-oriented media (e.g., a Rolex® watch worn by an actor in a television show, a particular car brand used in a movie, etc.).
- the AME 108 may access a database that specifies the products represented in each item of media 118 .
- the example transaction information 150 of FIG. 1 provided by the merchant database proprietor 146 includes an identification of the product(s) purchased in the transactions made by the user account associated with the device/user identifier 124 .
- the example AME 108 compares the product(s) represented in the impression data 130 to the product(s) in the transaction information 150 to determine whether there are any matching product(s). If the AME 108 identifies a product represented in an impression that matches a product involved in a purchase transaction, the example AME 108 determines whether the purchase transaction occurred after the impression.
- the impression data 130 includes time and date information indicating the time and date of the impression on the mobile device 106 .
- the transaction information 150 includes time and date information indicating the time and date of the transaction(s) represented in the transaction information 150 .
- the AME 108 compares the time and date information for the media impression to the time and date information for the transaction to determine which of the media impression or the transaction occurred first.
- the example AME 108 determines that the media impression occurred before the transaction (e.g., the time and date of the media impression occurred before the time and date of the transaction).
- the example AME 108 correlates the media impression to the purchase of the product(s) represented in the impression.
- the example AME 108 determines whether such a correlation occurred for the product(s) for multiple mobile devices 106 and/or user accounts. For example, the AME 108 determines a percentage of a set of mobile devices 106 and/or user accounts for which the media impression of a product occurred before the purchase transaction of that product. In some examples, the AME 108 determines percentages of sets of mobile device 106 for different publishers and/or different media to evaluate the effectiveness of publishers and/or media for influencing purchasing behavior of the product.
- the merchant database proprietor 146 provides transaction information 150 to the AME 108 for all transactions performed using a user account associated with the device/user identifier 124 , for all transactions performed within a specified time period using the user account associated with the device/user identifier 124 , and/or for specified type(s) of transaction(s) performed using a user account associated with the device/user identifier 124 .
- the AME 108 determines the product(s) represented in the media impressions occurring at the mobile device 106 , and transmits product information 154 to the merchant database proprietor 146 in the transaction request 152 . Limiting the transaction request 152 to product(s) of interest may enhance the privacy of the users of the merchant database proprietor 146 by restricting the AME 108 to information about specific product(s).
- the AME 108 may transmit the product information 154 in the request 152 without transmitting the device/user identifier 124 .
- the merchant database proprietor 146 looks up the product information 154 to determine which user accounts have purchased the product identified in the product information 154 .
- the example merchant database proprietor 146 may then return a list of device/user identifiers 124 that correspond to user accounts that have purchased the product identified in the product information 154 .
- the transactions returned in response to a transaction request 152 are limited to transactions occurring within a particular time period, such as a period of time designated in the request 152 , a period of time determined based on the request 152 , a predetermined time period, and/or a standard time period.
- the example merchant database proprietor 146 determines whether the product(s) specified in the product information 154 have been purchased in any transactions performed using the user account associated with the device/user identifier 124 specified in the transaction request 152 . If the product(s) specified in the product information 154 have been purchased, the example merchant database proprietor 146 returns the transaction information 150 for the transactions in which the specified product(s) were purchased. For any product(s) not purchased using the user account, the example merchant database proprietor 146 does not respond or responds with an indication that those product(s) were not purchased using the user account. By requiring the AME 108 to specify the product information 154 , the example AME 108 does not receive transaction information that is not relevant to media impressions occurring on the mobile device 106 .
- the example AME 108 of FIG. 1 aggregates transaction information and media impressions to measure effectiveness of the media corresponding to the media impressions.
- the example AME 108 measures the effectiveness of an item of media by using the transaction information (collected as described above) to measure a change in purchases of a product represented in the item of media from a time period prior to the media impressions to a time period subsequent to the media impressions.
- the AME 108 creates a measurement group that is determined to have been exposed to the item of media and compares the change to a purchase change in a control group. The control group is determined by the AME 108 to not have been exposed to the item of media, according to the impression information.
- FIG. 2 illustrates an example impression-transaction analyzer 200 which may be implemented in the example audience measurement server 132 of FIG. 1 to match impression information associated with a mobile device (e.g., the mobile device 106 of FIG. 1 ) to transaction information corresponding to a purchase made using a user account accessed by the mobile device 106 .
- the example impression-transaction analyzer 200 of FIG. 2 includes an example product checker 202 , an example product database 204 , an example transaction requester 206 , an example impression/transaction matcher 208 , an example group identifier 210 , an example transaction aggregator 212 , and an example effectiveness calculator 214 .
- the example product checker 202 of FIG. 2 identifies products associated with media impressions.
- the product checker 202 of the illustrated example receives impression data from mobile devices (e.g., the impression data 130 from the mobile device 106 of FIG. 1 ).
- the impression data 130 includes a media identifier 122 for media 118 corresponding to an impression occurring at the mobile device 106 .
- the example product checker 202 queries the product database 204 , which stores indications of products represented in the media 118 that corresponds to the media identifier 122 .
- the product checker 202 of the illustrated example looks up a product corresponding to the media 118 in the product database 204 using the media identifier 122 as a key.
- the example product database 204 returns a product identifier of a product (e.g., the product information 154 of FIG. 1 ) to the example product checker 202 .
- the example product database 204 may be updated with new associations of media to products.
- a media item may be associated with multiple products and/or a product may be represented by multiple media items.
- the example impression data 130 also includes the device/user identifier 124 .
- the example product checker 202 provides the device/user identifier 124 and the product information 154 corresponding to the transaction request 152 to the transaction requester 206 .
- the example transaction requester 206 of FIG. 2 generates and sends a transaction request 152 to one or more merchant database proprietors (e.g., the merchant database proprietor 146 of FIG. 1 ).
- the transaction request 152 includes the device/user identifier 124 and the product information 154 .
- the example transaction requester 206 sends the transaction request 152 to the merchant database proprietor 146 to obtain transaction information from the merchant database proprietor 146 .
- the example merchant database proprietor 146 sends the transaction information 150 to the impression-transaction analyzer 200 .
- the merchant database proprietor 146 limits the transaction information 150 that is returned to transactions that correspond to both the device/user identifier 124 and the product information 154 .
- the returned information is not so limited and/or the product information 154 is not provided to the merchant database proprietor 146 .
- the example transaction requester 206 of FIG. 2 receives the transaction information 150 from the merchant database proprietor 146 (e.g., in response to the transaction request 152 ) and provides the transaction information 150 and the impression data 130 to the impression/transaction matcher 208 .
- the example impression/transaction matcher 208 of FIG. 2 matches impressions occurring at the mobile device 106 (e.g., from the impression data 130 ) to transactions of purchases performed using a user account associated with the mobile device 106 (e.g., from the transaction information 150 ).
- the example impression/transaction matcher 208 may determine instances in which an impression corresponding to a product occurred prior to a transaction in which the product was purchased, where both the impression and the transaction correspond to a same device/user identifier 124 . This information can be used to credit the impression with driving the transaction.
- the example impression/transaction matcher 208 compares A) combinations of a device/user identifier 124 and product information 154 that are obtained from the impression data 130 to B) combinations of a device/user identifier 124 and product information 154 that correspond to transaction information 150 obtained from the merchant database proprietor 146 . Combinations of the device/user identifier 124 and the product information 154 that are found in both the impression data 130 and in the transaction information 150 are considered to match.
- Table 1 below includes a set of example combinations of device/user identifiers 124 (e.g., Device/User ID) and product information 154 (e.g., Product ID) obtained from impression data 130 (e.g., Impression ID) (e.g., by the example product checker 202 ) collected at a mobile device 106 .
- device/user identifiers 124 e.g., Device/User ID
- product information 154 e.g., Product ID obtained from impression data 130 (e.g., Impression ID) (e.g., by the example product checker 202 ) collected at a mobile device 106 .
- Table 2 below includes a set of example combinations of device/user identifiers 124 (e.g., Device/User ID) and product information 154 (e.g., Product ID) corresponding to transaction information 150 (e.g., Transaction ID) received by the transaction requester 206 from a merchant database proprietor 146 .
- the combinations in Table 2 may be returned in the transaction information 150 from a merchant database proprietor 146 and/or may be associated with the transaction information 150 by the transaction requester 206 when the transaction information 150 is identified as occurring in response to a transaction request 152 .
- the example impression/transaction matcher 208 of FIG. 2 will identify the impression data 130 having impression ID 11 as having the same combination of device/user identifier 124 (e.g., Device/User ID of HOI35JGETR) and product information 154 (e.g., Product ID of R9ANT20EJY) as transaction information 150 having transaction ID 21 .
- impression data 130 having impression ID 13 in Table 1 above also identifies the impression data 130 having impression ID 13 in Table 1 above as having the same combination of device/user identifier 124 (e.g., Device/User ID of B8PE8JH26N) and product information 154 (e.g., Product ID of NB2EYZ4YOG) as transaction information 150 having transaction ID 24 .
- device/user identifier 124 e.g., Device/User ID of B8PE8JH26N
- product information 154 e.g., Product ID of NB2EYZ4YOG
- Table 2 above shows that the device/user ID HOI35JGETR was used to perform a transaction for the purchase of a product having a Product ID of I9DBW9RC8R (see transaction ID 22 in Table 2).
- Table 1 does not indicate that an impression of media representing that product (i.e., I9DBW9RC8R) occurred on a mobile device 106 that corresponds to the device/user ID HOI35JGETR. Therefore, the impression/transaction matcher 208 of this example does not identify a match for transaction ID 22 .
- the example Table 1 above also includes information indicating the times and dates at which the impressions occurred (Imp. Time/Date).
- the example Table 2 above also includes information indicating the times and dates at which the transactions occurred.
- the impression/transaction matcher 208 of FIG. 2 identifies a transaction (e.g., from Table 2 above) that has a device/user identifier 124 and product information 154 combination that matches the device/user identifier 124 and product information 154 combination of an impression (e.g., from Table 1 above)
- the impression/transaction matcher 208 of the illustrated example determines whether the impression occurred prior to the transaction based on the respective times and dates of the matching impression ID and transaction ID.
- the impression/transaction matcher 208 determines that the matching impression and transaction are related (e.g., that the impression may have resulted in the transaction) when the impression occurred prior to the transaction (according to the respective times and dates).
- the impression/transaction matcher 208 would determine that the impression having impression ID 11 is related to the matching transaction having transaction ID 21 because the impression has a time and date (Jul. 8, 2014, at 09:15:00) that occurred before the time and date of the transaction (Jul. 9, 2014, at 19:12:00).
- the media associated with the impression having impression ID 11 is an advertisement for a product
- the transaction corresponding to transaction ID 21 is a subsequent purchase of that product using a user account associated with the device on which the impression occurred, it is possible or even likely that the impression had an influence on the purchase of the product. Therefore, in view of the time sequence of this example (i.e., the impression occurring before the transaction), the impression is credited with driving the transaction.
- the impression/transaction matcher 208 would determine that the impression having impression ID 13 is not related to the matching transaction having transaction ID 24 because the impression has a time and date (Jul. 8, 2014, at 16:10:00) that occurred after the time and date of the transaction (Jul. 7, 2014, at 04:42:00). For example, where a person purchases a product and then is subsequently exposed to an advertisement for the product, that particular exposure of the person to the advertisement would not be considered to have influenced the prior purchase of that product and, thus, is not credited with driving a transaction.
- the example group identifier 210 of FIG. 2 assigns device/user identifiers 124 to groups based on whether the device/user identifier 124 is associated with an impression of media of interest (e.g., media corresponding to a product of interest). For example, the group identifier 210 of FIG. 2 assigns device/user identifiers 124 that correspond to impressions of the media to an “exposed” group, and assigns device/user identifiers 124 that do not correspond to the media of interest to a “control” group. In some examples, the group identifier 210 further sub-divides the control group and/or the exposed group based on other factors such as time periods during which the impressions of the media of interest occurred for the exposed group.
- the example impression/transaction matcher 208 of FIG. 2 provides the group identifier 210 of FIG. 2 with the impression information (e.g., the impression information of Table 1).
- the example group identifier 210 determines, for each device/user identifier 124 represented in the impressions, whether the device/user identifier 124 has been exposed to media representing a product of interest.
- the group identifier 210 is provided with product information 154 for a product of interest, such as a product for which a media campaign is to be evaluated for effectiveness.
- the group identifier 210 is provided with a media identifier 122 instead of product information 154 .
- a media identifier 122 may be used when, for example, a measurement of the effectiveness of a particular item of media is desired when there are multiple items of media representing a product.
- the group identifier 210 may obtain impression data 130 from the product checker 202 . Using the impression data 130 , the group identifier 210 determines the device/user identifiers 124 corresponding to impressions of the media 118 having the media identifier 122 .
- the example group identifier 210 of FIG. 2 sorts the device/user identifiers 124 (e.g., device/user IDs of Tables 1 and/or 2 above) into two groups.
- the first group is an “exposed group,” which includes the device/identifiers 124 corresponding to impressions of media representing the product of interest.
- the group identifier 210 may populate a table or other data structure corresponding to the exposed group with device/user identifiers 124 that are present in combination with the product ID of interest in an impressions table (e.g., Table 1 above).
- the second group is a “control group,” which includes the device/identifiers 124 for which impressions of media representing the product of interest did not occur.
- the example group identifier 210 if the group identifier 210 receives the Product ID R9ANT20EJY as the product of interest, the example group identifier 210 would place the device/user identifier 124 (device/user ID) of HOI35JGETR in the exposed group because the device/user identifier 124 of HOI35JGETR reported an impression of media corresponding to Product ID R9ANT20EJY.
- the group identifier 210 would place the device/user identifier 124 (device/user ID) of B8PE8JH26N in a table or other data structure corresponding to the control group because the device/user identifier 124 of B8PE8JH26N did not report an impression of media corresponding to Product ID R9ANT20EJY. Therefore, in this example, the exposed group would have a count of one device/user identifier 124 and the control group would have a count of one device/user identifier 124 .
- the example impression/transaction matcher 208 of FIG. 2 provides the transactions (e.g., the transactions of Table 2 above) to the transaction aggregator 212 .
- the example group identifier 210 provides the list of device/user identifiers 124 that belong to each of the groups (e.g., the control group and the exposed group) to the transaction aggregator 212 .
- the group identifier 210 may provide a first list of device/user identifiers 124 that have been determined to be in the control group and a second list of device/user identifiers 124 that have been determined to be in the exposed group. These lists correspond to the data structure for the exposed group and the control group mentioned above.
- the example transaction aggregator 212 of FIG. 2 determines up to four separate sets of purchases or transactions based on the transactions obtained from the impression/transaction matcher 208 and based on the groups identified by the group identifier 210 .
- the transaction aggregator 212 determines 1) the number of the products purchased by user accounts corresponding to device/user identifiers 124 in the control group during a first time period; 2) the number of the products purchased by user accounts corresponding to device/user identifiers 124 in the control group during a second time period occurring after the first time period; 3) the number of the products purchased by user accounts corresponding to device/user identifiers 124 in the exposed group during the first time period; and 4) the number of the products purchased by user accounts corresponding to device/user identifiers 124 in the exposed group during the second time period.
- the first time period is a time period prior to (e.g., ending at) the commencement of a media campaign including media (e.g., the media of interest) representing the products of interest.
- media e.g., the media of interest
- the purchases of the products by the control group and the exposed group may provide a basis for calculating purchase growth attributable to the media.
- differences in purchases or purchase rate by the exposed group as compared to the purchases or purchase rate of the control group provides a measure of the effectiveness of the media in driving and/or slowing sales.
- the second time period is a time period subsequent to (e.g., starting at the end of or consecutive to) the first period.
- the second time period may begin at the end of the first time period, the end of a time period during which a media campaign runs, and/or at any other event.
- the example transaction aggregator 212 To determine the number of the products purchased via user accounts corresponding to device/user identifiers 124 in the control group during a first time period (e.g., the first example set of purchases determined by the transaction aggregator 212 ), the example transaction aggregator 212 identifies transactions (e.g., transactions from Table 2 above) that have a time and date within the first period and have a device/user identifier 124 assigned to the control group by the group identifier 210 . The control group will not have a matching impression (e.g., in Table 1).
- transactions e.g., transactions from Table 2 above
- the control group will not have a matching impression (e.g., in Table 1).
- the example transaction aggregator 212 determines a number of transactions performed using devices corresponding to the control group prior to, for example, the beginning of a media campaign (e.g., a coordinated set of impressions of one or more media items, including audio, video, and/or still media) for the product of interest.
- a media campaign e.g., a coordinated set of impressions of one or more media items, including audio, video, and/or still media
- the example transaction aggregator 212 To determine the number of the products purchased via user accounts corresponding to device/user identifiers 124 in the control group during a second time period (e.g., the second example set of purchases determined by the transaction aggregator 212 ), the example transaction aggregator 212 identifies transactions (e.g., transactions from Table 2 above) that: 1) have a time and date within the second period and have a device/user identifier 124 assigned to the control group by the group identifier 210 . The control group will not have a matching impression (e.g., in Table 1).
- transactions e.g., transactions from Table 2 above
- the example transaction aggregator 212 determines a number of transactions performed using devices corresponding to the control group after the beginning of the media campaign (e.g., during and/or after the media campaign) for the product of interest.
- the example transaction aggregator 212 To determine the number of the products purchased via user accounts corresponding to device/user identifiers 124 in the exposed group during the first time period (e.g., the third example set of purchases determined by the transaction aggregator 212 ), the example transaction aggregator 212 identifies transactions (e.g., transactions from Table 2 above) that have a time and date within the first period and have a device/user identifier 124 assigned to the exposed group by the group identifier 210 .
- transactions e.g., transactions from Table 2 above
- the example transaction aggregator 212 determines a number of transactions performed using devices corresponding to the exposed group prior to the beginning of the media campaign for the product of interest.
- the example transaction aggregator 212 identifies transactions (e.g., transactions from Table 2 above) that: 1) have a time and date within the second period and have a device/user identifier 124 assigned to the exposed group, and 2) have a related matching impression (e.g., an impression in Table 1 above that has a same device/user ID and a same Product ID as the transaction, and where the impression has a time and date that is prior to the time and date of the transaction).
- transactions e.g., transactions from Table 2 above
- a related matching impression e.g., an impression in Table 1 above that has a same device/user ID and a same Product ID as the transaction, and where the impression has a time and date that is prior to the time and date of the transaction.
- the example transaction aggregator 212 determines a number of transactions performed using devices corresponding to the exposed group after the beginning of the media campaign for the product of interest.
- the example effectiveness calculator 214 of FIG. 2 calculates the effectiveness of the media and/or the effectiveness of the publishers (e.g., the delivery methods for the media). For example, the effectiveness calculator 214 calculates the effectiveness of the media and/or the publishers based on the sales of the product represented in the media that occurred in the aggregated transactions. The example effectiveness calculator 214 calculates the sales using the sets of purchases determined by the transaction aggregator 212 for the control and exposed groups during the first and second time periods.
- the effectiveness calculator 214 calculates a publisher effectiveness (e.g., for an app publisher 110 , for a media publisher 120 , etc.) by, for example, dividing the sales lift in an exposed group for a first publisher by the sales lift in an exposed group for a second publisher.
- a publisher effectiveness e.g., for an app publisher 110 , for a media publisher 120 , etc.
- the exposed group for the first publisher is the fourth example group calculated by the transaction aggregator 212 as described above (e.g., the number of the products purchased via user accounts corresponding to device/user identifiers 124 in the exposed group during the second time period) determined using device/user identifiers 124 associated with impressions delivered via the first publisher (e.g., delivered via an app and/or a website associated with the app publisher 110 , delivered in association with media published by the media publisher 120 , etc.).
- the exposed group for the second publisher is the fourth example group calculated by the transaction aggregator 212 as described above (e.g., the number of the products purchased via user accounts corresponding to device/user identifiers 124 in the exposed group during the second time period) determined using device/user identifiers 124 associated with impressions delivered via the second publisher (e.g., delivered via an app and/or a website associated with the app publisher 110 , delivered in association with media published by the media publisher 120 , etc.).
- the example effectiveness calculator 214 calculates the effectiveness of media by, for example, dividing a sales lift from the first time period to the second time period for an exposed group by the sales lift from the first time period to the second time period for a control group.
- the media effectiveness measures for example, the effect of the media of interest on driving sales by determining the difference in sales rates after the media of interest was presented relative to sales rates before the media was presented.
- the effectiveness calculator 214 may determine the media effectiveness metric using the four example sets of purchases determined by the transaction aggregator 212 as described above to be: ((sales in fourth example set of purchases/sales in third example set of purchases)/(sales in second example set of purchases/sales in first example set of purchases)) or ((sales in fourth example set of purchases/sales in third example set of purchases) ⁇ (sales in second example set of purchases/sales in first example set of purchases)/(sales in second example set of purchases/sales in first example set of purchases)).
- FIG. 3 illustrates an example table 300 illustrating an example determination of an effectiveness of media impressions.
- FIG. 4 is a graph 400 illustrating the data in the example table 300 of FIG. 3 .
- the example table 300 and/or the example graph 400 may be generated by the example impression-transaction analyzer 200 of FIG. 2 based on impression data 130 obtained from the mobile device 106 , user information 102 obtained from the example demographic database proprietor 104 , and/or transaction information 150 obtained from the merchant database proprietor 146 of FIG. 1 .
- the impression-transaction analyzer 200 does not calculate the transactions occurring prior to the media impressions (as in the examples described above with reference to FIG. 2 ). Instead, in this example the media effectiveness is determined by comparing sales of the product to the control group with sales of the product to the exposed group to determine a sales lift. Omitting the measurement of different time periods increases the privacy of users of the merchant database proprietor 146 and decreases computational resource requirements, but may also fail to control the measurement for external events, such as media impressions occurring via other media presentation platforms such as television, radio, and/or outdoor advertising.
- the example table 300 of FIG. 3 illustrates a comparison of transactions for a product corresponding to impressions delivered through two different mobile application publishers (e.g., via two different applications that may be installed on a mobile device).
- Publisher A 302 publishes a first application (e.g., the app 116 of FIG. 1 ) and Publisher B 304 publishes a second application (e.g., the browser 117 of FIG. 1 ).
- the example media publisher 120 of FIG. 1 may choose to have the media 118 of FIG. 1 delivered to the mobile device 106 via either or both of the app 116 and/or the browser 117 of FIG. 1 .
- the example group identifier 210 of FIG. 2 determines a number of user accounts (or persons associated with the user accounts) belonging to the control group 306 as described above (e.g., during a time period following the commencement of media impressions at mobile devices 106 via the publishers 302 , 304 ).
- the group identifier 210 also determines a number of user accounts belonging to the exposed group 308 as described above.
- the group identifier 210 identifies (e.g., based on the impression data 130 from those mobile devices 106 ) 12,200 user accounts in the control group for publisher A 302 (e.g., associated with mobile devices 106 using the app 116 from the publisher A 302 that have not had an impression of the media). Similarly, the group identifier 210 identifies (e.g., based on the impression data 130 from those mobile devices 106 ) 17,500 user accounts in the control group for publisher B 304 (e.g., associated with mobile devices 106 using the browser 117 from the publisher B 304 that have not had an impression of the media).
- the group identifier 210 identifies (e.g., based on the impression data 130 from those mobile devices 106 ) 35,400 user accounts in the exposed group for publisher A 302 (e.g., associated with mobile devices 106 using the app 116 from the publisher A 302 that have had an impression of the media). Similarly, the group identifier 210 identifies (e.g., based on the impression data 130 from those mobile devices 106 ) 30,100 user accounts in the exposed group for publisher B 304 (e.g., associated with mobile devices 106 using the browser 117 from the publisher B 304 that have had an impression of the media).
- the example transaction aggregator 212 of FIG. 2 determines a number of control group sales 310 (e.g., transactions involving the product, of a quantity of units of the product, etc.) and a number of exposed group sales 312 of the respective control groups of the example publishers 302 , 304 .
- the example control group sales 310 may be the first or the second example groups of purchases determined by the transaction aggregator 212 as described above.
- the example exposed group sales 312 may be the third or the fourth example groups of purchases determined by the transaction aggregator 212 as described above.
- the transaction aggregator 212 determines a number of transactions for the product corresponding to the members of each of the groups 306 , 308 identified by the group identifier 210 . In the example of FIGS.
- Publisher A 302 is determined to have 4,200 control group sales 310 and 22,100 exposed group sales 312 of the example product. Therefore, 34.4% (e.g., 4,200/12,200) of the example control group 306 of the publisher A 302 purchased the example product of interest during the measured time period, while 62.4% (e.g., 22,100/35,400) of the exposed group 308 of the publisher A 302 purchased the example product during the measured time period. Therefore, the media impressions delivered via the app 116 (e.g., via Publisher A) resulted in a sales lift 314 of 81.3% (e.g., (62.4% ⁇ 34.4%)/34.4%) for the product in the exposed group 308 relative to the control group 306 .
- 34.4% e.g., 4,200/12,200
- 62.4% e.g., 22,100/35,400
- Publisher B 304 is determined to have 5,600 control group sales 310 and 10,600 exposed group sales 312 of the example product. Therefore, 32% (e.g., 5,600/17,500) of the example control group 306 of the publisher B 304 purchased the example product of interest during the measured time period, while 35.2% (e.g., 10,600/30,100)) of the exposed group 308 of the publisher B 304 purchased the example product during the measured time period. Therefore, the media impressions delivered via the browser 117 (e.g., via Publisher B) resulted in a sales lift 314 of 10.0% (e.g., (35.2%-32%)/32%) for the product in the exposed group 308 relative to the control group 306 .
- a sales lift 314 of 10.0% (e.g., (35.2%-32%)/32%) for the product in the exposed group 308 relative to the control group 306 .
- a manufacturer of a product associated with the media of interest may determine that impressions of the media corresponding to the product are more effective when occurring through the app 116 (e.g., via Publisher A 302 ) than through the browser 117 (e.g., via Publisher B 304 ) (or, in some other examples, more effective through a first app than through a second app).
- the example manufacturer may respond to this determination by channeling more of the media impressions to mobile devices 106 via the app 116 (provided by Publisher A 302 ) and fewer via the browser 117 (provided by Publisher B 304 ). Additionally or alternatively, the manufacturer (and/or its advertising agent) replace the browser 117 with another app (e.g., via Publisher C) for delivery of media impressions to mobile devices.
- the replacement app e.g., Publisher C
- the replacement app may be selected to be one that has substantially similar or identical lift performance as the app provided by Publisher A 302 of FIG. 3 .
- FIG. 5 is a block diagram of an example transaction information provider 500 that may be used to implement the example merchant database proprietor 146 of FIG. 1 .
- the example transaction information provider 500 includes an example user authenticator 502 , an example account-identifier correlator 504 , an example transaction engine 506 , an example transaction query generator 508 , and an example transaction reporter 510 .
- the example transaction information provider 500 further includes databases including an example user account database 512 , an example product database 514 , and an example transaction database 516 .
- the example user authenticator 502 of FIG. 5 receives user login requests (e.g., from the mobile device 106 , the app 116 of FIG. 1 ).
- the user login requests include the example merchant account information 148 of FIG. 1 .
- the merchant account information 148 may include a unique account identifier (e.g., a user name, an account number, etc.) and one or more authenticators (e.g., passwords, pass codes, authentication keys, etc.).
- the example user authenticator 502 verifies the merchant account information 148 (e.g., the account identifier and/or the authenticator(s)) in the user account database 512 , which stores the merchant account information 148 for authentication purposes.
- the example user login request that is authenticated by the user authenticator 502 also includes a device/user identifier 124 corresponding to the mobile device 106 (e.g., the device/user identifier 124 of FIG. 1 ).
- the device/user identifier 124 is an identifier (e.g., an IMEI number, an IDFA number, etc.) that is not set by either of the merchant database proprietor 146 of FIG. 1 or the transaction information provider 500 of FIG. 5 . Because the device/user identifier 124 is not set by the transaction information provider 500 , the transaction information provider 500 is required to obtain the device/user identifier 124 from the mobile device 106 .
- the example account-identifier correlator 504 of FIG. 5 matches the merchant account information 148 to the device/user identifier 124 included in the request. For example, the account-identifier correlator 504 stores the device/user identifier 124 in the user account database 512 in association with the merchant account information 148 so that the device/user identifier 124 is associated with the user account at the merchant. Because a user may log in to the merchant database proprietor 146 from multiple devices, the example account-identifier correlator 504 may correlate multiple device/user identifiers 504 to the same merchant account information 148 (e.g., to a same user account).
- the example transaction engine 506 enables users to conduct transactions, such as purchasing products from the merchant database proprietor 146 (e.g., an organization such as a commercial merchant).
- the example transaction engine 506 accesses the product database 514 to determine product identifier(s) of the product(s) and/or service(s) purchased in the transaction.
- the example transaction engine 506 stores transaction information (e.g., the transaction information 150 of FIG. 1 ) in the transaction database 516 .
- the stored transaction information may include, for example, the product identifiers involved in the transaction, the time and/or date of the transaction, and the user account associated with the transaction.
- the device/user identifiers 124 from the mobile device 106 may then be matched to the transactions in the transaction database 516 based on the mapping of user accounts to the device/user identifier 124 in the user account database 512 .
- the example product database 514 may store the same information as the product database 204 of FIG. 2 .
- the product database 204 of FIG. 2 includes a subset of the product identifiers included in the product database 514 of FIG. 5 (e.g., when the product database 204 of FIG. 2 includes product identifiers only for products of interest to the audience measurement entity 108 ).
- the product database 514 of FIG. 5 includes a subset of the product identifiers included in the product database 204 of FIG. 2 (e.g., when there are multiple merchant database proprietors 146 having different products for purchase).
- the example transaction query generator 508 of FIG. 5 receives requests for transaction information (e.g., from the audience measurement entity 108 of FIG. 1 ). For example, the transaction query generator 508 may receive a request 152 for transactions that have been performed using an account corresponding to the device/user identifier 124 and that include product information 154 .
- the example transaction query generator 508 Upon receipt of such a request 152 , the example transaction query generator 508 queries the user account database 512 to determine a user account (e.g., an account identifier, a user name, etc.) that corresponds to the device/user identifier 124 in the request 152 .
- the example user account database 512 determines the user account that matches the device/user identifier 124 (e.g., the account previously correlated to the device/user identifier 124 by the account-identifier correlator 504 ).
- the user account database 512 returns the account identifier to the example transaction query generator 508 .
- the example transaction query generator 508 queries the product database 514 using the product information 154 in the request 152 to determine a product identifier used by the transaction information provider 500 to identify the product (e.g., an internal reference number for the product that is used within the transaction information provider 500 , a universal product code (UPC), an international article number (EAN), a global trade item number (GTIN), a bar code, etc.).
- a product identifier used by the transaction information provider 500 to identify the product
- a product identifier used by the transaction information provider 500 e.g., an internal reference number for the product that is used within the transaction information provider 500 , a universal product code (UPC), an international article number (EAN), a global trade item number (GTIN), a bar code, etc.
- UPC universal product code
- EAN international article number
- GTIN global trade item number
- the example transaction query generator 508 then queries the transaction database 516 using the account identifier (e.g., obtained by querying the user account database 512 ) and the product identifier (e.g., obtained by querying the product database 514 ) to identify transactions involving the product that were conducted using the specified account.
- account identifier e.g., obtained by querying the user account database 512
- product identifier e.g., obtained by querying the product database 514
- the transaction database 516 returns information describing the identified transactions, including the account identifier, the device identifiers, and the date and time of the transaction.
- the example transaction query generator 508 provides the transaction information returned from the transaction database to the transaction reporter 510 .
- the example transaction reporter 510 of FIG. 5 returns transaction information 150 to the AME 108 of FIG. 1 (e.g., in response to a corresponding transaction request 152 ).
- the transaction reporter 510 converts the information received from the transaction database 516 to information usable by the AME 108 .
- the transaction reporter 510 may convert an account identifier associated with a transaction in the transaction database 516 to a device/user identifier 124 recognizable by the AME 108 (e.g., to the device/user identifier 124 included in the transaction request 152 and obtained from the transaction query generator 508 ). Additionally or alternatively, the transaction reporter 510 may convert a product identifier (e.g., a UPC code, a service code, etc.) used by the transaction information provider 500 to corresponding product information 154 (e.g., the product information included in the transaction request 152 and obtained from the transaction query generator 508 ).
- a product identifier e.g., a UPC code, a service code, etc.
- the example transaction reporter 510 of FIG. 5 sends the transaction information 150 to the example AME 108 .
- the AME 108 receives the transaction information 150 and determines the effectiveness of media impressions as described above.
- FIGS. 2 and 5 While example manners of implementing the example impression-transaction analyzer 200 and the transaction information provider have been illustrated in FIGS. 2 and 5 , one or more of the elements, processes and/or devices illustrated in FIGS. 2 and 5 may be combined, divided, re-arranged, omitted, eliminated and/or implemented in any other way.
- At least one of the example product checker 202 , the example product database 204 , the example transaction requester 206 , the example impression/transaction matcher 208 , the example group identifier 210 , the example transaction aggregator 212 , the example effectiveness calculator 214 , the example user authenticator 502 , the example account-identifier correlator 504 , the example transaction engine 506 , the example transaction query generator 508 , the example transaction reporter 510 , the example user account database 512 , the example product database 514 , and/or the example transaction database 516 is/are hereby expressly defined to include a tangible computer readable storage device or storage disk such as a memory, a digital versatile disk (DVD), a compact disk (CD), a Blu-ray disk, etc.
- DVD digital versatile disk
- CD compact disk
- Blu-ray disk etc.
- the example impression-transaction analyzer 200 of FIG. 2 and/or the example transaction information provider 500 of FIG. 5 may include one or more elements, processes and/or devices in addition to, or instead of, those illustrated in FIGS. 2 and/or 5 , and/or may include more than one of any or all of the illustrated elements, processes and devices.
- FIGS. 6-11 Flowcharts representative of example machine readable instructions for implementing the example audience measurement entity 108 , the audience measurement server 132 , and/or the example merchant database proprietor 146 of FIG. 1 , the example impression-transaction analyzer 200 of FIG. 2 , and/or the example transaction information provider 500 of FIG. 5 are shown in FIGS. 6-11 .
- the machine readable instructions comprise one or more programs for execution by a processor such as the processor 1212 shown in the example processor platform 1200 discussed below in connection with FIG. 12 .
- the program(s) may be embodied in software stored on a tangible computer readable storage medium such as a CD-ROM, a floppy disk, a hard drive, a digital versatile disk (DVD), a Blu-ray disk, or a memory associated with the processor 1212 , but the entire program(s) and/or parts thereof could alternatively be executed by a device other than the processor 1212 and/or embodied in firmware or dedicated hardware.
- a tangible computer readable storage medium such as a CD-ROM, a floppy disk, a hard drive, a digital versatile disk (DVD), a Blu-ray disk, or a memory associated with the processor 1212 , but the entire program(s) and/or parts thereof could alternatively be executed by a device other than the processor 1212 and/or embodied in firmware or dedicated hardware.
- a device such as a CD-ROM, a floppy disk, a hard drive, a digital versatile disk (DVD), a Blu-ray disk, or a memory associated with the
- FIGS. 6-11 may be implemented using coded instructions (e.g., computer and/or machine readable instructions) stored on a tangible computer readable storage medium such as a hard disk drive, a flash memory, a read-only memory (ROM), a compact disk (CD), a digital versatile disk (DVD), a cache, a random-access memory (RAM) and/or any other storage device or storage disk in which information is stored for any duration (e.g., for extended time periods, permanently, for brief instances, for temporarily buffering, and/or for caching of the information).
- a tangible computer readable storage medium such as a hard disk drive, a flash memory, a read-only memory (ROM), a compact disk (CD), a digital versatile disk (DVD), a cache, a random-access memory (RAM) and/or any other storage device or storage disk in which information is stored for any duration (e.g., for extended time periods, permanently, for brief instances, for temporarily buffering, and/or for caching of the information).
- tangible computer readable storage medium and “tangible machine readable storage medium” are used interchangeably. Additionally or alternatively, the example processes of FIGS. 6-11 may be implemented using coded instructions (e.g., computer and/or machine readable instructions) stored on a non-transitory computer and/or machine readable medium such as a hard disk drive, a flash memory, a read-only memory, a compact disk, a digital versatile disk, a cache, a random-access memory and/or any other storage device or storage disk in which information is stored for any duration (e.g., for extended time periods, permanently, for brief instances, for temporarily buffering, and/or for caching of the information).
- coded instructions e.g., computer and/or machine readable instructions
- a non-transitory computer and/or machine readable medium such as a hard disk drive, a flash memory, a read-only memory, a compact disk, a digital versatile disk, a cache, a random-access memory and/or any other storage device or storage disk in which
- non-transitory computer readable medium is expressly defined to include any type of computer readable storage device and/or storage disk and to exclude propagating signals and transmission media.
- phrase “at least” is used as the transition term in a preamble of a claim, it is open-ended in the same manner as the term “comprising” is open ended.
- FIG. 6 is a flow diagram representative of example machine readable instructions 600 which may be executed to implement the example audience measurement server 132 of FIG. 1 and/or the example impression-transaction analyzer 200 of FIG. 2 to associate media impressions to transaction information.
- the example instructions 600 of FIG. 6 will be described with reference to the example impression-transaction analyzer 200 of FIG. 2 .
- the example product checker 202 of FIG. 2 receives media impression information from mobile devices (e.g., the mobile device 106 of FIG. 1 ) (block 602 ).
- the received media impression information includes a device/user identifier such as the device/user identifier 124 of FIG. 1 .
- Example types of the device/user identifier 124 received in the media impression information include hardware identifiers (e.g., an international mobile equipment identity (IMEI), a mobile equipment identifier (MEID), a media access control (MAC) address, etc.), an app store identifier (e.g., a Google Android ID, an Apple ID, an Amazon ID, etc.), an open source unique device identifier (OpenUDID), an open device identification number (ODIN), a login identifier (e.g., a username), an email address, user agent data (e.g., application type, operating system, software vendor, software revision, etc.), third-party service identifiers (e.g., an “Identifier for Advertising” (IDFA), advertising service identifiers, device usage analytics service identifiers, demographics collection service identifiers), web storage data, document object model (DOM) storage data, local shared objects (also referred to as “Flash cookies”), etc.
- hardware identifiers e.g., an international mobile
- the example product checker 202 determines product information associated with the media impression information (block 604 ). For example, the product checker 202 may access (e.g., query) the product database 204 of FIG. 2 to determine an identifier of a product that is represented in a media impression at the mobile device 106 and which resulted in receiving the media impression information in block 602 .
- the product checker 202 may access (e.g., query) the product database 204 of FIG. 2 to determine an identifier of a product that is represented in a media impression at the mobile device 106 and which resulted in receiving the media impression information in block 602 .
- the example transaction requester 206 requests transaction information from a merchant database proprietor (e.g., the merchant database proprietor 146 of FIG. 1 ) based on the device/user identifier 124 (e.g., determined in block 602 ) and/or based on the product information (e.g., determined in block 604 ) (block 606 ).
- the transaction requester 206 may generate a transaction request 152 of FIG. 1 including the device/user identifier 124 and/or the product information 154 , and send the transaction request 152 to the merchant database proprietor 146 .
- the example transaction requester 206 receives transaction information 150 from the merchant database proprietor 146 (block 608 ).
- the transaction information 150 may include, for example, a unique transaction identifier, a device/user identifier 124 , a product identifier, and/or a time/date at which the transaction occurred.
- Example transaction information 150 is shown in Table 2 above. If a transaction performed at the merchant database proprietor 146 involved multiple products, the example transaction requester 206 may receive multiple records, each representing one product involved in the transaction.
- the example impression/transaction matcher 208 associates transactions involving a product with media impressions corresponding to the product (block 610 ).
- the impression/transaction matcher 208 may match impression information (e.g., impression records such as those illustrated in Table 1 above) to transaction information (e.g., transaction records such as those illustrated in Table 2 above) by determining that a media impression corresponds to a same device/user identifier 124 as a transaction and that the media impression represents a product involved in the transaction.
- the impression/transaction matcher 208 matches media impressions to transactions.
- the impression/transaction matcher 208 may determine that an impression occurred prior to a transaction based on respective times/dates of the impression and the transaction.
- Example instructions that may be used to implement block 610 are described below with reference to FIG. 7 .
- the example effectiveness calculator 214 of FIG. 2 determines a media effectiveness and/or a publisher effectiveness (block 612 ). For example, the effectiveness calculator 214 may determine whether media impressions delivered via a first publisher (e.g., the app publisher 110 , the media publisher 120 ) result in a higher sales lift (e.g., a larger sales increase). Additionally or alternatively, the example effectiveness calculator 214 may determine a media effectiveness of the media corresponding to the impressions by calculating a sales lift from a first time period prior to beginning a media campaign to a second time period subsequent to beginning the media campaign to determine an effect of the media on sales of the represented product.
- the example instructions 600 of FIG. 6 end.
- FIG. 7 is a flow diagram representative of example machine readable instructions 700 which may be executed to implement the example audience measurement server 132 of FIG. 1 and/or the example impression-transaction analyzer 200 of FIG. 2 to correlate transactions involving a product to media impressions corresponding to the product.
- the example instructions 700 of FIG. 7 may be performed to implement block 610 of FIG. 6 .
- the example instructions 700 of FIG. 7 will be described with reference to the example impression-transaction analyzer 200 of FIG. 2 .
- the example instructions 700 begin after block 608 of FIG. 6 (e.g., receiving transaction information).
- the example impression/transaction matcher 208 of FIG. 2 selects a media impression from the media impression information (block 702 ).
- the impression/transaction matcher 208 may select a media impression record from the records of Table 1 above.
- the impression/transaction matcher 208 selects the first example record of Table 1 above (e.g., Impression ID 11 ).
- the example impression/transaction matcher 208 determines a product represented by the media corresponding to the selected media impression (block 704 ). For example, the impression/transaction matcher 208 may determine the Product ID, from Table 1 above, that corresponds to the selected impression ID. In this example, the determined Product ID is R9ANT20EJY.
- the example impression/transaction matcher 208 of FIG. 2 also determines a device/user identifier 124 corresponding to the selected media impression (block 706 ). For example, the impression/transaction matcher 208 may determine the Device/User ID, from Table 1 above, that corresponds to the selected impression ID. In this example, the determined Device/User ID is HOI35JGETR.
- the example impression/transaction matcher 208 selects a transaction from the transaction information (block 708 ). For example, the impression/transaction matcher 208 may select a transaction record from the records of Table 2 above. In this example, the impression/transaction matcher 208 selects the first example record of Table 2 above (e.g., Transaction ID 21 ).
- the example impression/transaction matcher 208 determines a product purchased in the transaction corresponding to the selected transaction (block 710 ). For example, the impression/transaction matcher 208 may determine the Product ID, from Table 2 above, that corresponds to the selected Transaction ID. In this example, the determined Product ID is R9ANT20EJY.
- the example impression/transaction matcher 208 of FIG. 2 also determines a device/user identifier 124 corresponding to an account used to perform the selected transaction (block 712 ). For example, the impression/transaction matcher 208 may determine the Device/User ID, from Table 1 above, that corresponds to the selected Transaction ID. In this example, the determined Device/User ID is HOI35JGETR.
- the example impression/transaction matcher 208 determines whether the selected media impression matches the selected transaction based on the respective products and the respective device/user identifiers (block 714 ). For example, the impression/transaction matcher 208 compares the Device/User ID of the selected impression (e.g., Device/User ID HOI35JGETR) to the Device/User ID of the selected transaction (e.g., Device/User ID HOI35JGETR) and compares the Product ID of the selected impression (e.g., Product ID R9ANT20EJY) to the Product ID of the selected transaction (e.g., Product ID R9ANT20EJY).
- Device/User ID of the selected impression e.g., Device/User ID HOI35JGETR
- the Product ID of the selected impression e.g., Product ID R9ANT20EJY
- the example impression/transaction matcher 208 of FIG. 2 determines whether a time/date of the selected media impression occurred prior to the time/date of the selected transaction (block 716 ). For example, the impression/transaction matcher 208 compares the time/date of the selected impression (e.g., 2014-07-08:09:15:00) to the time/date of the selected transaction (block 2014-07-09:19:12:00). If the time/date of the selected media impression occurred prior to the time/date of the selected transaction (block 716 ), the example impression/transaction matcher 208 associates the selected transaction to the selected media impression (block 718 ).
- the time/date of the selected impression e.g., 2014-07-08:09:15:00
- the example impression/transaction matcher 208 may infer that the media impression may have contributed or did actually contribute to the occurrence of the transaction (e.g., media corresponding to the media impression influenced a user to make the transaction).
- the example impression/transaction matcher 208 determines whether there are additional transactions to compare to the selected media impression (block 720 ). If there are additional transactions to compare to the selected media impression (block 720 ), control returns to block 708 to select another transaction (e.g., to select another transaction record from Table 2).
- the example impression/transaction matcher 208 determines whether there are additional media impressions (block 722 ). If there are additional media impressions (block 722 ), control returns to block 702 to select another media impression. When there are no more media impressions (block 722 ), the example instructions 700 of FIG. 7 end and control returns to a calling function or process such as the example instructions of FIG. 6 .
- FIGS. 8A and 8B show a flow diagram representative of example machine readable instructions 800 which may be executed to implement the example audience measurement server 132 of FIG. 1 and/or the example impression-transaction analyzer 200 of FIG. 2 to determine media and publisher effectiveness.
- the example instructions 800 of FIGS. 8A and 8B may be performed to implement block 612 of FIG. 6 .
- the example instructions 800 of FIGS. 8A and 8B will be described with reference to the example impression-transaction analyzer 200 of FIG. 2 .
- the example group identifier 210 of FIG. 2 selects a publisher (block 802 ).
- the group identifier 210 may select an app publisher (e.g., a publisher of the app 116 of FIG. 1 , a publisher of the browser 117 of FIG. 1 , etc.) and/or a media publisher (e.g., a publisher of media 118 presented on the mobile device 106 of FIG. 1 via the app 116 and/or via the browser 117 ).
- an app publisher e.g., a publisher of the app 116 of FIG. 1 , a publisher of the browser 117 of FIG. 1 , etc.
- a media publisher e.g., a publisher of media 118 presented on the mobile device 106 of FIG. 1 via the app 116 and/or via the browser 117 .
- the example group identifier 210 assigns device/user identifiers 124 that correspond to media impressions for media of interest and that are presented by the selected publisher to an “exposed group” that corresponds to the selected publisher (block 804 ).
- the exposed group for the selected publisher therefore includes device/user identifiers 124 of those mobile devices 106 from which impression data 130 , specifying the media of interest and the selected publisher, has been received. For example, if the selected publisher is a publisher of the app 116 , the exposed group for the selected publisher includes the device/user identifiers 124 for mobile devices 106 on which media impressions have occurred using the app 116 (e.g., according to the impression data 130 reporting the media impressions to the AME 108 ).
- the example transaction aggregator 212 determines a number of transactions that correspond to the device/user identifiers 124 in the exposed group for the selected publisher (block 806 ). For example, the transaction aggregator 212 may determine a number of transactions that match the device/user identifiers 124 . The identification of matching transactions may be performed prior to executing the instructions 800 (e.g., by the impression/transaction matcher 208 ), such as by executing block 610 of FIG. 6 and/or by executing the instructions 700 of FIG. 7 .
- the example transaction aggregator 212 calculates a proportion of the exposed group for the selected publisher that purchased the product represented in the media of interest (block 808 ). For example, the transaction aggregator 212 determines the number of the device/user identifiers 124 that were associated with a media impression that matched a transaction, as a percentage of the total number of device/user identifiers 124 in the exposed group. The example transaction aggregator 212 may calculate the proportion the first and/or second time periods, individually and/or together as a single time period.
- the example transaction aggregator 212 of FIG. 2 assigns transactions associated with the exposed group for the selected publisher to first and second time periods, based on the times/dates of the transactions (block 810 ).
- the example first and second time periods may be used to divide transactions into 1) transactions occurring prior to media impressions corresponding to the media of interest (e.g., prior to a media campaign in which the media is to be delivered to mobile devices to cause media impressions) and, therefore, not having any effect on sales of the product represented in the media and 2) transactions occurring after media impressions corresponding to the media of interest have begun (e.g., subsequent to the initiation of the media campaign, such as during and/or after the media campaign) and, therefore, potentially having an effect on sales of the product.
- the example group identifier 210 determines a set of device/user identifiers 124 that are not associated with media impressions for the media of interest (block 812 ). For example, the group identifier 210 may use device/user identifiers 124 associated with media impressions for media other than the media of interest, where the impression-transaction analyzer 200 has not received impression data 130 indicating an impression of the media of interest occurring in association with the device/user identifier 124 .
- the group identifier 210 may use device/user identifiers 124 and/or impression data 130 from other media campaigns (e.g., media campaigns not associated with the media of interest, in which other media is presented at the mobile devices) and verify that the device/user identifiers 124 have not had a media impression of the media of interest.
- media campaigns e.g., media campaigns not associated with the media of interest, in which other media is presented at the mobile devices
- the example group identifier 210 assigns the set of device/user identifiers 124 to a “control group” corresponding to the selected publisher (block 814 ).
- the control group represents device/user identifiers 124 and/or mobile devices 106 that have not been exposed to the media of interest.
- the example transaction requester 206 requests transaction information for the device/user identifiers in the control group from the merchant database proprietor 146 (block 816 ).
- the transaction requester 206 may send one or more transaction requests 152 including the device/user identifiers 124 in the control group and product information 154 for a product represented in the media of interest (e.g., the same product used in block 808 ).
- the example transaction aggregator 212 of FIG. 2 assigns transactions associated with the control group for the selected publisher to first and second time periods, based on the times/dates of the transactions (block 818 ).
- the example first and second time periods may be used to divide transactions into the first and second time periods described above with reference to block 810 (e.g., to facilitate comparison of control group and the exposed group during the same time periods).
- the example transaction aggregator 212 of FIG. 2 calculates a proportion of the control group for the selected publisher that purchased the product represented in the media of interest (block 820 ). For example, the transaction aggregator 212 determines a number of the device/user identifiers 124 in the control group for which transactions including the product were received from the merchant database proprietor 146 in response to the request of block 816 . The example transaction aggregator 212 may calculate the proportion for the first and/or second time periods, individually and/or together as a single time period.
- the example group identifier 210 determines whether there are any additional publishers (block 822 ). If there are additional publishers (block 822 ), control returns to block 802 to select another publisher.
- the example effectiveness calculator 214 may compare the exposed group sales 312 of Publisher A 302 (e.g., 22,100 sales from 35,400 device/user identifiers, or 62.4% of the exposed group) to exposed group sales 312 of Publisher B 304 (e.g., 10,600 sales from 30,100 device/user identifiers, or 35.2% of the exposed group).
- the example effectiveness calculator 214 of FIG. 2 determines a sales lift, for each of the example publishers, between the control group and the exposed group and between the first time period and the second time period (block 826 ).
- the sales lift 314 for Publisher A 302 is the increase in the sales proportion between the control group (e.g., 34.4%) and the exposed group (e.g., 62.4%), or 81.3% (e.g., the percentage of sales in the exposed group for publisher A 302 divided by the percentage of sales in the control group for publisher A 302 (62.4%/34.4%)).
- the sales lift 314 for Publisher B 304 is the increase in the sales proportion between the control group (e.g., 32%) and the exposed group (e.g., 35.2%), or 10% (e.g., the percentage of sales in the exposed group for publisher B 304 divided by the percentage of sales in the control group for publisher B 304 (35.2%/32%)).
- the example effectiveness calculator 214 compares the sales lift for each of the example publishers 302 , 304 to determine a publisher effectiveness by the sales lift difference (block 828 ). For example, the effectiveness calculator 214 compares the sales lift 314 of the Publisher A 302 (e.g., 81.3%) to the sales lift 314 of the Publisher B 304 (e.g., 10%). In this example, the effectiveness calculator 214 may determine that Publisher A 302 is more effective than Publisher B 304 for the media of interest. Publisher A 302 may be more effective than Publisher B 304 because, for example, Publisher A 302 may reach an audience that is more likely to be influenced by the media of interest.
- the example effectiveness calculator 214 determines a media effectiveness for the media of interest based on a difference in the changes in sales between the first time period and the second time period for each of the control group and the exposed group (block 830 ). For example, the effectiveness calculator 214 may compare A) the change in sales for the control group between the first time period (e.g., 10% of the device/user identifiers in the control group purchased the product of interest during the first time period) and the second time period (e.g., 12% of the device/user identifiers in the control group purchased the product of interest during the second time period) to B) the change in sales for the exposed group between the first time period (e.g., 16% of the device/user identifiers in the exposed group purchased the product of interest during the first time period) and the second time period (e.g., 46% of the device/user identifiers in the exposed group purchased the product of interest during the second time period). By comparing the changes in sales across the time periods between the groups, the example effectiveness calculator 214 controls
- the example instructions 800 of FIGS. 8A and 8B then end and, for example, control returns to a calling function or process such as the example instructions of FIG. 6 .
- FIG. 9 is a flow diagram representative of example machine readable instructions 900 which may be executed to implement the example merchant database proprietor 146 of FIG. 1 and/or the example transaction information provider 500 of FIG. 5 to associate device/user identifiers to merchant database proprietor accounts.
- the example instructions 900 are described with reference to the example transaction information provider 500 of FIG. 5 .
- the example user authenticator 502 of FIG. 5 receives a request from a mobile device (e.g., merchant account information 148 from the mobile device 106 of FIG. 1 , the app 116 of FIG. 1 ) to access an account at the merchant database proprietor for performing a transaction (block 902 ).
- a mobile device e.g., merchant account information 148 from the mobile device 106 of FIG. 1 , the app 116 of FIG. 1
- the transaction information provider 500 may enable authenticated users to view and/or purchase products from the transaction information provider 500 and/or through the systems of the transaction information provider 500 .
- the example user authenticator 502 determines whether the request is authenticated (block 904 ). For example, the user authenticator 502 may use any past, present, or future authentication techniques to authenticate the merchant account information 148 included in the request.
- the example account-identifier correlator 504 of FIG. 5 extracts a device/user identifier (e.g., the device/user identifier 124 of FIG. 1 ) from the request (block 906 ).
- a device/user identifier e.g., the device/user identifier 124 of FIG. 1
- Example types of a device/user identifier 124 that may be extracted include hardware identifiers (e.g., an international mobile equipment identity (IMEI), a mobile equipment identifier (MEID), a media access control (MAC) address, etc.), an app store identifier (e.g., a Google Android ID, an Apple ID, an Amazon ID, etc.), an open source unique device identifier (OpenUDID), an open device identification number (ODIN), a login identifier (e.g., a username), an email address, user agent data (e.g., application type, operating system, software vendor, software revision, etc.), third-party service identifiers (e.g., an “Identifier for Advertising” (IDFA), advertising service identifiers, device usage analytics service identifiers, demographics collection service identifiers), web storage data, document object model (DOM) storage data, local shared objects (also referred to as “Flash cookies”), etc.
- the transaction information provider 500 agrees with the AME 108 ahead
- the example account-identifier correlator 504 determines whether the extracted device/user identifier 124 is stored in association with any accounts in the user account database 512 of FIG. 5 (block 908 ).
- the user account database 512 stores associations of device/user identifiers 124 and user accounts.
- the example account-identifier correlator 504 stores the extracted device/user identifier 124 in association with the authenticated account (block 910 ).
- the account-identifier correlator 504 stores the extracted device/user identifier 124 in the user account database 512 and indicates that the extracted device/user identifier 124 corresponds to the user account.
- the example instructions 900 of FIG. 9 end.
- FIG. 10 is a flow diagram representative of example machine readable instructions 1000 which may be executed to implement the example merchant database proprietor 146 of FIG. 1 and/or the example transaction information provider 500 of FIG. 5 to provide transaction information.
- the example instructions 1000 are described with reference to the example transaction information provider 500 of FIG. 5 .
- the example transaction query generator 508 of FIG. 5 receives a transaction request including a device/user identifier 124 (block 1002 ).
- the transaction query generator 508 may receive a transaction request 152 from the AME 108 of FIG. 1 .
- the example transaction query generator 508 retrieves account information corresponding to the device/user identifier 124 in the request 152 (block 1004 ). For example, the transaction query generator 508 may query the user account database 512 of FIG. 5 using the device/user identifier 124 , and the user account database 512 determines whether the device/user identifier 124 corresponds to a user account stored in the user account database 512 .
- the example transaction query generator 508 determines whether the device/user identifier 124 is associated with an account identifier (block 1006 ). For example, the device/user identifier 124 may have been previously stored in association with an account identifier in the user account database 512 using the example instructions 900 of FIG. 9 .
- the example transaction query generator 508 of FIG. 5 retrieves transactions performed using the account corresponding to the account identifier (e.g., the account identifier determined in block 1006 ) (block 1008 ). For example, the transaction query generator 508 may query the transaction database 516 of FIG. 5 using the account identifier to determine the transactions performed using the account identifier.
- the transaction database 516 provides transaction information for each retrieved transaction, such as a device/user identifier, a transaction identifier, products purchased in the transaction, and a time/date the transaction occurred.
- the example transaction query generator 508 determines whether the transaction request 152 includes a time/date range (block 1010 ).
- the transaction request 152 may specify a time/date range of interest (e.g., a time/date prior to which transactions are not desired).
- the time/date range may be closed or open-ended. If the transaction request includes a time/date range (block 1010 ), the example transaction query generator 508 filters the retrieved transactions (e.g., the transactions from block 1008 ) to remove transactions falling outside the time/date range specified in the transaction request 152 .
- the example transaction query generator 508 determines whether the transaction request 152 includes product information (e.g., the product information 154 of FIG. 1 ) (block 1014 ).
- product information 154 specifies a product of interest to the AME 108 (e.g., a product that is represented in media corresponding to a media impression at a mobile device 106 ).
- the example transaction query generator 508 retrieves a product identifier based on the product information 154 (block 1016 ). For example, the transaction query generator 508 may query the product database 514 of FIG. 5 to determine a product identifier that corresponds to the product information 154 specified by the AME 108 in the request 152 . The example transaction query generator 508 filters the retrieved transactions to remove transactions that do not include the product identifier (block 1018 ).
- the example transaction reporter 510 After filtering the retrieved transactions (block 1018 ), or if the transaction request 152 does not include product information 154 (block 1014 ), the example transaction reporter 510 returns the transaction information 150 (e.g., the transaction information remaining after filtering in block 1012 and/or block 1018 ) to the AME 108 in response to the transaction request 152 (block 1020 ).
- the transaction reporter 510 may send one or more transaction records (e.g., the example records illustrated in Table 2 above), including a Transaction ID, a Product ID, a Device/User ID, and/or a Time/Date, to the example AME 108 as a response to the transaction request 152 .
- FIG. 11 is a flow diagram representative of example machine readable instructions 1100 which may be executed to implement the example merchant database proprietor 146 of FIG. 1 and/or the example transaction information provider 500 of FIG. 5 to provide transaction information.
- the instructions 1100 of FIG. 11 may be executed when, for example, a transaction request 152 from the AME 108 of FIG. 1 does not include a device/user identifier 124 .
- the example instructions 1100 are described with reference to the example transaction information provider 500 of FIG. 5 .
- the example transaction query generator 508 of FIG. 5 receives a transaction request (e.g., a transaction request 152 from the AME 108 ) that includes product information (e.g., the product information 154 of FIG. 1 ) (block 1102 ).
- a transaction request e.g., a transaction request 152 from the AME 108
- product information e.g., the product information 154 of FIG. 1
- the example transaction query generator 508 retrieves a product identifier based on the product information 154 (block 1104 ). For example, the transaction query generator 508 may query the product database 514 of FIG. 5 to determine a product identifier that corresponds to the product information 154 specified by the AME 108 in the request 152 .
- the example transaction query generator 508 of FIG. 5 retrieves transaction records that include the product identifier (e.g., the product retrieved in block 1104 ) (block 1106 ). For example, the transaction query generator 508 may query the transaction database 516 of FIG. 5 using the product identifier to determine all of the performed transactions involving the product corresponding to the product identifier. In response to the query, the transaction database 516 provides transaction information for each identified transaction, such as a device/user identifier, a transaction identifier, products purchased in the transaction, and a time/date the transaction occurred.
- the product identifier e.g., the product retrieved in block 1104
- the transaction query generator 508 may query the transaction database 516 of FIG. 5 using the product identifier to determine all of the performed transactions involving the product corresponding to the product identifier.
- the transaction database 516 provides transaction information for each identified transaction, such as a device/user identifier, a transaction identifier, products purchased in the transaction, and a time/date
- the example transaction query generator 508 selects a transaction from the retrieved transactions (block 1108 ).
- the example transaction query generator 508 looks up an account used to perform the selected transaction in an account database to identify a device/user identifier 124 corresponding to the account (block 1110 ).
- the transaction query generator 508 may look up an account specified in the selected transaction record, which is used to query the user account database 512 to determine whether any device/user identifiers correspond to the account.
- the transaction query generator 508 determines whether the account used to perform the selected transaction is associated with a device/user identifier 124 (block 1112 ). If the account used to perform the selected transaction is associated with a device/user identifier 124 (block 1112 ), the example transaction query generator 508 determines whether the transaction request 152 includes a time/date range (block 1114 ). For example, the transaction request 152 may specify a time/date range of interest (e.g., a time/date prior to which transactions are not desired). The time/date range may be closed or open-ended.
- the example transaction query generator 508 determines whether the time/date of the selected transaction falls within the time/date range (block 1116 ). If the time/date of the selected transaction does not fall within the time/date range (block 1116 ), or if the account used to perform the selected transaction is not associated with a device/user identifier 124 (block 1112 ), the example transaction query generator 508 removes the selected transaction from the retrieved transactions (e.g., the transactions from block 1106 ).
- the example transaction query generator 508 determines whether there are additional retrieved transactions (block 1120 ). If there are additional retrieved transactions (block 1120 ), control returns to block 1108 to select another transaction.
- the example transaction reporter 510 When there are no more retrieved transactions (block 1120 ), the example transaction reporter 510 returns the transaction information 150 (e.g., the transaction information remaining after filtering in blocks 1110 - 1118 ) to the example AME 108 in response to the transaction request 152 (block 1122 ).
- the transaction reporter 510 may return one or more transaction records (e.g., the example records illustrated in Table 2 above), including a Transaction ID, a Product ID, a Device/User ID, and/or a Time/Date, to the AME 108 .
- the example instructions 1100 of FIG. 11 then end.
- FIG. 12 is a block diagram of an example processor platform 1200 capable of executing the instructions of FIGS. 6 , 7 , 8 , 9 , 10 , and/or 11 to implement the example product checker 202 , the example product database 204 , the example transaction requester 206 , the example impression/transaction matcher 208 , the example group identifier 210 , the example transaction aggregator 212 , the example effectiveness calculator 214 , the example user authenticator 502 , the example account-identifier correlator 504 , the example transaction engine 506 , the example transaction query generator 508 , the example transaction reporter 510 , the example user account database 512 , the example product database 514 , the example transaction database 516 and/or, more generally, the example audience measurement entity 108 , the example audience measurement server 132 , and/or the example merchant database proprietor 146 of FIG.
- the processor platform 1200 can be, for example, a server, a personal computer, a mobile device (e.g., a cell phone, a smart phone, a tablet such as an iPadTM tablet), an Internet appliance, or any other type of computing device.
- a mobile device e.g., a cell phone, a smart phone, a tablet such as an iPadTM tablet
- an Internet appliance or any other type of computing device.
- the processor platform 1200 of the illustrated example includes a processor 1212 .
- the processor 1212 of the illustrated example is hardware.
- the processor 1212 can be implemented by one or more integrated circuits, logic circuits, microprocessors or controllers from any desired family or manufacturer.
- the processor 1212 of the illustrated example includes a local memory 1213 (e.g., a cache).
- the processor 1212 of the illustrated example is in communication with a main memory including a volatile memory 1214 and a non-volatile memory 1216 via a bus 1218 .
- the volatile memory 1214 may be implemented by Synchronous Dynamic Random Access Memory (SDRAM), Dynamic Random Access Memory (DRAM), RAMBUS Dynamic Random Access Memory (RDRAM) and/or any other type of random access memory device.
- the non-volatile memory 1216 may be implemented by flash memory and/or any other desired type of memory device. Access to the main memory 1214 , 1216 is controlled by a memory controller.
- the processor platform 1200 of the illustrated example also includes an interface circuit 1220 .
- the interface circuit 1220 may be implemented by any type of interface standard, such as an Ethernet interface, a universal serial bus (USB), and/or a PCI express interface.
- one or more input devices 1222 are connected to the interface circuit 1220 .
- the input device(s) 1222 permit(s) a user to enter data and commands into the processor 1212 .
- the input device(s) can be implemented by, for example, an audio sensor, a microphone, a camera (still or video), a keyboard, a button, a mouse, a touchscreen, a track-pad, a trackball, isopoint and/or a voice recognition system.
- One or more output devices 1224 are also connected to the interface circuit 1220 of the illustrated example.
- the output devices 1224 can be implemented, for example, by display devices (e.g., a light emitting diode (LED), an organic light emitting diode (OLED), a liquid crystal display, a cathode ray tube display (CRT), a touchscreen, a tactile output device, a light emitting diode (LED), a printer and/or speakers).
- the interface circuit 1220 of the illustrated example thus, typically includes a graphics driver card, a graphics driver chip or a graphics driver processor.
- the interface circuit 1220 of the illustrated example also includes a communication device such as a transmitter, a receiver, a transceiver, a modem and/or network interface card to facilitate exchange of data with external machines (e.g., computing devices of any kind) via a network 1226 (e.g., an Ethernet connection, a digital subscriber line (DSL), a telephone line, coaxial cable, a cellular telephone system, etc.).
- a communication device such as a transmitter, a receiver, a transceiver, a modem and/or network interface card to facilitate exchange of data with external machines (e.g., computing devices of any kind) via a network 1226 (e.g., an Ethernet connection, a digital subscriber line (DSL), a telephone line, coaxial cable, a cellular telephone system, etc.).
- DSL digital subscriber line
- the processor platform 1200 of the illustrated example also includes one or more mass storage devices 1228 for storing software and/or data.
- mass storage devices 1228 include floppy disk drives, hard drive disks, compact disk drives, Blu-ray disk drives, RAID systems, and digital versatile disk (DVD) drives.
- Coded instructions 1232 to implement the example machine readable instructions of FIGS. 6 , 7 , 8 , 9 , 10 , and/or 11 may be stored in the mass storage device 1228 , in the volatile memory 1214 , in the non-volatile memory 1216 , and/or on a removable tangible computer readable storage medium such as a CD or DVD.
Abstract
Description
- The present disclosure relates generally to monitoring media and, more particularly, to methods and apparatus to associate transactions with media impressions.
- Traditionally, audience measurement entities determine audience engagement levels for media programming based on registered panel members. That is, an audience measurement entity enrolls people who consent to being monitored into a panel. The audience measurement entity then monitors those panel members to determine media (e.g., television programs or radio programs, movies, DVDs, advertisements, etc.) exposed to those panel members. In this manner, the audience measurement entity can determine exposure measures for different media based on the collected media measurement data.
- Techniques for monitoring user access to Internet resources such as web pages, advertisements and/or other media have evolved significantly over the years. Some prior systems perform such monitoring primarily through server logs. In particular, entities serving media on the Internet can use such prior systems to log the number of requests received for their media at their server.
-
FIG. 1 depicts an example system to collect impressions of media presented at mobile devices and to collect user information from distributed database proprietors for associating with the collected impressions. -
FIG. 2 is an example impression-transaction analyzer which may be implemented in the example audience measurement server ofFIG. 1 to compare and/or match impression information associated with a mobile device to transaction information performed using a user account accessed by the mobile device. -
FIG. 3 illustrates an example table illustrating an example determination of publisher effectiveness. -
FIG. 4 is a graph illustrating the data in the example table ofFIG. 3 . -
FIG. 5 is a block diagram of an example transaction information provider that may be used to implement the example merchant database proprietor ofFIG. 1 . -
FIG. 6 is a flow diagram representative of example machine readable instructions which may be executed to implement the example impression-transaction analyzer ofFIG. 2 to associate media impressions to transaction information. -
FIG. 7 is a flow diagram representative of example machine readable instructions which may be executed to implement the example impression-transaction analyzer ofFIG. 2 to correlate transactions involving a product to media impressions corresponding to the product. -
FIGS. 8A and 8B show a flow diagram representative of example machine readable instructions which may be executed to implement the example impression-transaction analyzer ofFIG. 2 to determine media and publisher effectiveness. -
FIG. 9 is a flow diagram representative of example machine readable instructions which may be executed to implement the example transaction information provider ofFIG. 5 to associate device/user identifiers to merchant database proprietor accounts. -
FIG. 10 is a flow diagram representative of example machine readable instructions which may be executed to implement the example transaction information provider ofFIG. 5 to provide transaction information. -
FIG. 11 is a flow diagram representative of example machine readable instructions which may be executed to implement the example transaction information provider ofFIG. 5 to provide transaction information. -
FIG. 12 is an example processor platform that may be used to execute the example instructions ofFIGS. 6-11 to implement example apparatus and systems disclosed herein. - Techniques for monitoring user access to Internet resources such as web pages, advertisements and/or other media have evolved significantly over the years. At one point in the past, such monitoring was done primarily through server logs. In particular, entities serving media on the Internet would log the number of requests received for their media at their server. Basing Internet usage research on server logs is problematic for several reasons. For example, server logs can be tampered with either directly or via zombie programs which repeatedly request media from servers to increase the server log counts corresponding to the requested media. Secondly, media is sometimes retrieved once, cached locally and then repeatedly viewed from the local cache without involving the server in the repeat viewings. Server logs cannot track these views of cached media because reproducing locally cached media does not require re-requesting the media from a server. Thus, server logs are susceptible to both over-counting and under-counting errors.
- The inventions disclosed in Blumenau, U.S. Pat. No. 6,108,637, fundamentally changed the way Internet monitoring is performed and overcame the limitations of the server side log monitoring techniques described above. For example, Blumenau disclosed a technique wherein Internet media to be tracked is tagged with beacon instructions. In particular, monitoring instructions are associated with the Hypertext Markup Language (HTML) of the media to be tracked. When a client requests the media, both the media and the beacon instructions are downloaded to the client. The beacon instructions are, thus, executed whenever the media is accessed, be it from a server or from a cache.
- The beacon instructions cause monitoring data reflecting information about the access to the media to be sent from the client that downloaded the media to a monitoring entity. Typically, the monitoring entity is an audience measurement entity (AME) (e.g., any entity interested in measuring or tracking audience exposures to advertisements, media, and/or any other media) that did not provide the media to the client and who is a trusted third party for providing accurate usage statistics (e.g., The Nielsen Company, LLC). Advantageously, because the beaconing instructions are associated with the media and executed by the client browser whenever the media is accessed, the monitoring information is provided to the AME irrespective of whether the client is a panelist of the AME.
- It is useful, however, to link demographics and/or other user information to the monitoring information. To address this issue, the AME establishes a panel of users who have agreed to provide their demographic information and to have their Internet browsing activities monitored. When an individual joins the panel, they provide detailed information concerning their identity and demographics (e.g., gender, race, income, home location, occupation, etc.) to the AME. The AME sets a cookie on the panelist computer that enables the AME to identify the panelist whenever the panelist accesses tagged media and, thus, sends monitoring information to the AME.
- Since most of the clients providing monitoring information from the tagged pages are not panelists and, thus, are unknown to the AME, it is necessary to use statistical methods to impute demographic information based on the data collected for panelists to the larger population of users providing data for the tagged media. However, panel sizes of AMEs remain small compared to the general population of users. Thus, a problem is presented as to how to increase panel sizes while ensuring the demographics data of the panel is accurate.
- There are many database proprietors operating on the Internet. These database proprietors provide services (e.g., social networking services, email services, media access services, etc.) to large numbers of subscribers. In exchange for the provision of such services, the subscribers register with the proprietors. As part of this registration, the subscribers provide detailed demographic information. Examples of such database proprietors include social network providers such as Facebook, Myspace, Twitter, etc. These database proprietors set cookies on the computers of their subscribers to enable the database proprietors to recognize registered users when such registered users visit their websites.
- Traditionally, AMEs (also referred to herein as “ratings entities”) determine reach for advertising and media programming based on registered panel members. That is, an AME enrolls people that consent to being monitored into a panel. During enrollment, the AME receives information from the enrolling people so that subsequent correlations may be made between advertisement/media exposure to those panelists and different demographic markets. Unlike traditional techniques in which AMEs rely solely on their own panel member data to collect demographics-based audience measurement, example methods, apparatus, and/or articles of manufacture disclosed herein enable an AME to share information with other entities that operate based on user registration models. As used herein, a user registration model is a model in which users subscribe to services of those entities by creating an account and providing information about themselves. Sharing of information associated with registered users of database proprietors enables an AME to extend or supplement their panel data with substantially reliable information from external sources (e.g., database proprietors), thus extending the coverage, accuracy, and/or completeness of their audience measurements. Such access also enables the AME to monitor persons who would not otherwise have joined an AME panel. Any entity having a database identifying characteristics of a set of individuals may cooperate with the AME. Such entities may be referred to as “database proprietors” and include entities such as wireless service carriers, mobile software/service providers, social medium sites (e.g., Facebook, Twitter, Google, etc.), and/or any other Internet sites such as Yahoo!, MSN, Apple iTunes, Experian, etc. that collect demographic data of users which may be in exchange for a service.
- Examples disclosed herein may be implemented by an AME (e.g., any entity interested in measuring or tracking audience exposures to advertisements, media, and/or any other media) in cooperation with any number of database proprietors such as online web services providers to develop online media exposure metrics. Such database proprietors/online web services providers may be wireless service carriers, mobile software/service providers, social network sites (e.g., Facebook, Twitter, MySpace, etc.), multi-service sites (e.g., Yahoo!, Google, Experian, etc.), online retailer sites (e.g., Amazon.com, Buy.com, etc.), and/or any other web service(s) site that maintains user registration records.
- An impression corresponds to a home or individual having been exposed to the corresponding media and/or advertisement. Thus, an impression represents a home or an individual having been exposed to an advertisement or media or group of advertisements or media. In Internet advertising, a quantity of impressions or impression count is the total number of times an advertisement or advertisement campaign has been accessed by a web population (e.g., including number of times accessed as decreased by, for example, pop-up blockers and/or increased by, for example, retrieval from local cache memory).
- As used herein, the term “product” is expressly defined to refer to any type of purchasable item, whether tangible or intangible. In particular, the term “product” is expressly defined to include goods, services, combinations of goods and/or services, and items that are part-good and part-service.
- Examples methods and apparatus disclosed herein may be used to correlate media impressions occurring on mobile devices to subsequent commercial transactions. Example commercial transactions include purchases of a product from an online merchant such as Amazon®, eBay®, or any other online merchant, including online merchants that also have physical locations at which transactions may occur directly with consumers (e.g., brick and mortar stores). Example methods and apparatus disclosed herein may be used to measure the effectiveness of mobile advertising campaigns by comparing sales of a product from a time period prior to an advertising campaign to sales of the product from a time period subsequent to an advertising campaign. Additionally or alternatively, disclosed example methods and apparatus may be used to compare the effectiveness of media between different publishers (e.g., publisher effectiveness).
- Significantly, example methods and apparatus disclosed herein are capable of tracking the correlation of media impressions to changes in purchase habits at the individual user account level (e.g., an account kept with the merchant by a user, which is used to purchase a product from that merchant). For example, a media impression occurring at a device having a unique identifier may be matched to the subsequent purchase of a product advertised in the media impression. In response, examples disclosed herein may be used to draw the inference that the media impression was related to influencing the subsequent purchase. Additionally, the correlation between media impressions and sales can be determined for devices and/or user accounts with which the audience measurement entity does not have any prior information or prior relationship.
- To match media impressions to purchases, example methods and apparatus disclosed herein utilize a user/device identifier and media impression information collected from a mobile device. The example media impression information represents media impressions occurring at the mobile device. In example methods and apparatus, commercial transaction information associated with the user/device identifier is also obtained. Example commercial transaction information includes data describing commercial transactions conducted using an account that has been accessed by a device associated with the user/device identifier. A user account may be correlated to multiple unique identifiers. Example methods and apparatus disclosed herein associate the media impression information with the commercial transaction information to, for example, determine a cause and effect relationship between the impression and the commercial transaction. Examples disclosed herein may match impressions occurring on one device with transactions performed using a different device.
- Examples of device types from which user/device identifiers may be collected include smartphones (e.g., iPhones, Android OS-based smartphones, Blackberry smartphones, Windows Mobile-based smartphones, etc.), tablet computers (e.g., iPads, Android OS-based tablet computers, etc.), portable media players (e.g., iPods, etc.), and/or other device types. Such device types may be cookie-based devices (e.g., devices that run cookie-based applications/software) and/or non-cookie-based devices (e.g., devices such as Apple iOS devices that run applications/software that do not employ cookies).
- While examples disclosed herein are described with reference to compensating or adjusting impression information obtained from mobile devices, the examples are also applicable to non-mobile devices such as desktop computers, televisions, video game consoles, and/or other devices.
- In contrast to prior art methods of evaluating the effectiveness of media, example methods and apparatus disclosed herein leverage the computing device-based and network-based delivery of media impressions, as well as the use of online transaction platforms, to evaluate the effectiveness of media at actually driving (or inhibiting) sales activity. Some such example methods and apparatus reduce the manual resources, computing resources, and networking resources used to collect, analyze, and/or correlate impression information and transaction information to evaluate media effectiveness at driving product sales. Some examples enable the conservation of computing and/or networking resources by relating transactions to impressions via a unique identifier, thereby reducing or eliminating computations and/or communications previously required to determine a transaction from the occurrence of an impression at a computing device (e.g., identifying the user, retrieving information about the user, determining whether the user has an account at a merchant, obtaining permission from the user to access his or her account information, sorting through the transactions to identify the products, etc.).
- Furthermore, example methods and apparatus disclosed herein provide more accurate measurements than prior methods of estimating media effectiveness at driving product sales, because the impression data and the transaction data more accurately reflect the actual incidences of impressions and sales and because impressions are linked directly to corresponding sales by relating the impression data to the transaction data. This achieves a significant improvement in the audience analytics and advertising field. Such improvements can reduce the amount of network resources used for delivering advertisements by enabling the quick elimination of ineffective advertisements and/or ineffective advertisement platforms. In a world of limited resources, this elimination of waste has the beneficial effect of freeing resources for other beneficial purposes.
-
FIG. 1 depicts anexample system 100 to collect user information (e.g., user information 102) from adatabase proprietor 104 for associating with impressions of media presented at amobile device 106. In the illustrated examples,user information 102 or user data includes one or more of demographic data, purchase data, and/or other data indicative of user activities, behaviors, and/or preferences related to information accessed via the Internet, purchases, media accessed on electronic devices, physical locations (e.g., retail or commercial establishments, restaurants, venues, etc.) visited by users, etc. Examples disclosed herein are described in connection with a mobile device, which may be a mobile phone, a mobile communication device, a tablet, a gaming device, a portable media presentation device, etc. However, examples disclosed herein may be implemented in connection with non-mobile devices such as internet appliances, smart televisions, internet terminals, computers, or any other device capable of presenting media received via network communications. - In the illustrated example of
FIG. 1 , to track media impressions on themobile device 106, an audience measurement entity (AME) 108 partners with or cooperates with anapp publisher 110 to download and install adata collector 112 on themobile device 106. In the example ofFIG. 1 , theAME 108 provides thedata collector 112 to theapp publisher 110 for inclusion of thedata collector 112 in apps downloaded by mobile devices from theapp publisher 110. Theapp publisher 110 of the illustrated example may be a software app developer that develops and distributes apps to mobile devices and/or a distributor that receives apps from software app developers and distributes the apps to mobile devices. Thedata collector 112 may be included in other software loaded onto themobile device 106, such as theoperating system 114, an application (or app) 116, aweb browser 117, and/or any other software. - Any of the example software 114-117 may present
media 118 received from amedia publisher 120. Themedia 118 may be an advertisement, video, audio, text, a graphic, a web page, news, educational media, entertainment media, or any other type of media. In the illustrated example, amedia ID 122 is provided in themedia 118 to enable identifying themedia 118 so that theAME 108 can credit themedia 118 with media impressions when themedia 118 is presented on themobile device 106 or any other device that is monitored by theAME 108. - The
data collector 112 of the illustrated example includes instructions (e.g., Java, java script, or any other computer language or script) that, when executed by themobile device 106, cause themobile device 106 to collect themedia ID 122 of themedia 118 presented by theapp program 116 and/or themobile device 106, and to collect one or more device/user identifier(s) 124 stored in themobile device 106. The device/user identifier(s) 124 of the illustrated example include identifiers that can be used by thedemographic database proprietor 104 to identify the user or users of themobile device 106, and to locateuser information 102 corresponding to the user(s). For example, the device/user identifier(s) 124 may include hardware identifiers (e.g., an international mobile equipment identity (IMEI), a mobile equipment identifier (MEID), a media access control (MAC) address, etc.), an app store identifier (e.g., a Google Android ID, an Apple ID, an Amazon ID, etc.), an open source unique device identifier (OpenUDID), an open device identification number (ODIN), a login identifier (e.g., a username), an email address, user agent data (e.g., application type, operating system, software vendor, software revision, etc.), third-party service identifiers (e.g., an “Identifier for Advertising” (IDFA), advertising service identifiers, device usage analytics service identifiers, demographics collection service identifiers), web storage data, document object model (DOM) storage data, local shared objects (also referred to as “Flash cookies”), etc. In some examples, fewer or more device/user identifier(s) 124 may be used. In addition, although only onedemographic database proprietor 104 is shown inFIG. 1 , theAME 108 may partner with any number of demographic database proprietors to collect distributed user information (e.g., the user information 102). - In some examples, the
mobile device 106 may not allow access to identification information stored in themobile device 106. For such instances, the disclosed examples enable theAME 108 to store an AME-provided identifier (e.g., an identifier managed and tracked by the AME 108) in themobile device 106 to track media impressions on themobile device 106. For example, theAME 108 may provide instructions in thedata collector 112 to set an AME-provided identifier in memory space accessible by and/or allocated to theapp program 116. In some such examples, thedata collector 112 uses the identifier as a device/user identifier 124. In such examples, the AME-provided identifier set by thedata collector 112 persists in the memory space even when theapp program 116 and thedata collector 112 are not running. In this manner, the same AME-provided identifier can remain associated with themobile device 106 for extended durations and/or be used across multiple apps. In some examples in which thedata collector 112 sets an identifier in themobile device 106, theAME 108 may recruit a user of themobile device 106 as a panelist, and may store user information collected from the user during a panelist registration process and/or collected by monitoring user activities/behavior via themobile device 106 and/or any other device used by the user and monitored by theAME 108. In this manner, theAME 108 can associate user information of the user (from panelist data stored by the AME 108) with media impressions attributed to the user on themobile device 106. - In the illustrated example, the
data collector 112 sends themedia ID 122 and the one or more device/user identifier(s) 124 as collecteddata 126 to theapp publisher 110. Alternatively, thedata collector 112 may be configured to send the collecteddata 126 to another collection entity (other than the app publisher 110) that has been contracted by theAME 108 or is partnered with theAME 108 to collect media ID's (e.g., the media ID 122) and device/user identifiers (e.g., the device/user identifier(s) 124) from mobile devices (e.g., the mobile device 106). - In the illustrated example, the app publisher 110 (or a collection entity) sends the
media ID 122 and the device/user identifier(s) 124 asimpression data 130 to aserver 132 at theAME 108. Theimpression data 130 of the illustrated example may include onemedia ID 122 and one or more device/user identifier(s) 124 to report a single impression of themedia 118, or it may include numerous media ID's 122 and device/user identifier(s) 124 based on numerous instances of collected data (e.g., the collected data 126) received from themobile device 106 and/or other mobile devices to report multiple impressions of media. - In the illustrated example, the
server 132 stores theimpression data 130 in an AME media impressions store 134 (e.g., a database or other data structure). Subsequently, theAME 108 sends the device/user identifier(s) 124 to thedemographic database proprietor 104 to receiveuser information 102 corresponding to the device/user identifier(s) 124 from thedemographic database proprietor 104 so that theAME 108 can associate the user information with corresponding media impressions of media (e.g., the media 118) presented at mobile devices (e.g., the mobile device 106). - In some examples, to protect the privacy of the user of the
mobile device 106, themedia identifier 122 and/or the device/user identifier(s) 124 are encrypted before they are sent to theAME 108 and/or to thedemographic database proprietor 104. In other examples, themedia identifier 122 and/or the device/user identifier(s) 124 are not encrypted. - After the
AME 108 receives the device/user identifier(s) 124, theAME 108 sends device/user identifier logs 136 to thedemographic database proprietor 104. In some examples, each of the device/user identifier logs 136 may include a single device/user identifier 124, or it may include numerous aggregate device/user identifiers 124 received over time from one or more mobile devices. After receiving the device/user identifier logs 136, thedemographic database proprietor 104 looks up its users corresponding to the device/user identifiers 124 in therespective logs 136. In this manner, thedemographic database proprietor 104 collectsuser information 102 corresponding to users identified in the device/user identifier logs 136 for sending to theAME 108. For example, if thedemographic database proprietor 104 is a wireless service provider and the device/user identifier log 136 includes IMEI numbers recognizable by the wireless service provider, the wireless service provider accesses its subscriber records to find users having IMEI numbers matching the IMEI numbers received in the device/user identifier log 136. When the users are identified, the wireless service provider copies the users' user information to theuser information 102 for delivery to theAME 108. - In some other examples, the
data collector 112 is configured to collect the device/user identifier(s) 124 from themobile device 106. Theexample data collector 112 sends the device/user identifier(s) 124 to theapp publisher 110 in the collecteddata 126, and it also sends the device/user identifier(s) 124 to themedia publisher 120. In some such other examples, thedata collector 112 does not collect themedia ID 122 from themedia 118 at themobile device 106 as thedata collector 112 does in theexample system 100 ofFIG. 1 . Instead, themedia publisher 120 that publishes themedia 118 to themobile device 106 retrieves themedia ID 122 from themedia 118 that it publishes. Themedia publisher 120 then associates themedia ID 122 to the device/user identifier(s) 124 received from thedata collector 112 executing in themobile device 106, and sends collecteddata 138 to theapp publisher 110 that includes themedia ID 122 and the associated device/user identifier(s) 124 of themobile device 106. For example, when themedia publisher 120 sends themedia 118 to themobile device 106, it does so by identifying themobile device 106 as a destination device for themedia 118 using one or more of the device/user identifier(s) 124 received from themobile device 106. In this manner, themedia publisher 120 can associate themedia ID 122 of themedia 118 with the device/user identifier(s) 124 of themobile device 106 indicating that themedia 118 was sent to the particularmobile device 106 for presentation (e.g., to generate an impression of the media 118). - In some other examples in which the
data collector 112 is configured to send the device/user identifier(s) 124 to themedia publisher 120, thedata collector 112 does not collect themedia ID 122 from themedia 118 at themobile device 106. Instead, themedia publisher 120 that publishes themedia 118 to themobile device 106 also retrieves themedia ID 122 from themedia 118 that it publishes. Themedia publisher 120 then associates themedia ID 122 with the device/user identifier(s) 124 of themobile device 106. Themedia publisher 120 then sends theimpression data 130, including themedia ID 122 and the device/user identifier(s) 124, to theAME 108. For example, when themedia publisher 120 sends themedia 118 to themobile device 106, it does so by identifying themobile device 106 as a destination device for themedia 118 using one or more of the device/user identifier(s) 124. In this manner, themedia publisher 120 can associate themedia ID 122 of themedia 118 with the device/user identifier(s) 124 of themobile device 106 indicating that themedia 118 was sent to the particularmobile device 106 for presentation (e.g., to generate an impression of the media 118). In the illustrated example, after theAME 108 receives theimpression data 130 from themedia publisher 120, theAME 108 can then send the device/user identifier log 136 to thedemographic database proprietor 104 to request theuser information 102 as described above in connection withFIG. 1 . - Although the
media publisher 120 is shown separate from theapp publisher 110 inFIG. 1 , theapp publisher 110 may implement at least some of the operations of themedia publisher 120 to send themedia 118 to themobile device 106 for presentation. For example, advertisement providers, media providers, or other information providers may send media (e.g., the media 118) to theapp publisher 110 for publishing to themobile device 106 via, for example, theapp program 116 when it is executing on themobile device 106. In some such examples, theapp publisher 110 implements the operations described above as being performed by themedia publisher 120. - Additionally or alternatively, in contrast with the examples described above in which the
mobile device 106 sends device/user identifiers 124 to the audience measurement entity 108 (e.g., via theapplication publisher 110, themedia publisher 120, and/or another entity), in other examples the mobile device 106 (e.g., thedata collector 112 installed on the mobile device 106) sends the identifiers (e.g., the user/device identifier(s) 124) directly to the database proprietor 104 (e.g., not via the AME 108). In some such examples, the examplemobile device 106 sends themedia identifier 122 to the audience measurement entity 108 (e.g., directly or through an intermediary such as via the application publisher 110), but does not send themedia identifier 122 to thedatabase proprietors 104. - As mentioned above, the example
demographic database proprietor 104 provides theuser information 102 to theexample AME 108 for matching with themedia identifier 122 to form media impression information. As also mentioned above, thedatabase proprietor 104 is not provided copies of themedia identifier 122. Instead, themobile device 106 provides thedatabase proprietor 104 with impression identifiers 140. An impression identifier 140 uniquely identifies an impression event relative to other impression events of the mobile device 106 (and relative to the impression events of other devices) so that an occurrence of an impression at themobile device 106 can be distinguished from other occurrences of impressions. However, the impression identifier 140 does not itself identify the media associated with that impression event. In such examples, theimpression data 130 from themobile device 106 to theAME 108 also includes the impression identifier 140 and thecorresponding media identifier 122. - To match the
user information 102 with themedia identifier 122, the exampledemographic database proprietor 104 provides theuser information 102 to theAME 108 in association with the impression identifier 140 for the impression event that triggered the collection of theuser information 102. In this manner, theAME 108 can match the impression identifier 140 received from themobile device 106 to a corresponding impression identifier 140 received from thedemographic database proprietor 104 to associate themedia identifier 122 received from themobile device 106 with demographic information in theuser information 102 received from thedatabase proprietor 104. The impression identifier 140 can additionally be used for reducing or avoiding duplication of demographic information. For example, the exampledemographic database proprietor 104 may provide theuser information 102 and the impression identifier 140 to theAME 108 on a per-impression basis (e.g., each time amobile device 106 sends a request including a device/user identifier 124 and an impression identifier 140 to the demographic database proprietor 104) and/or on an aggregated basis (e.g., send a set ofuser information 102, which may include indications of multiple impressions at a mobile device 102 (e.g., multiple impression identifiers 140), to theAME 108 presented at the mobile device 106). - The above examples illustrate methods and apparatus for collecting impression data at an audience measurement entity (or other entity). The examples discussed above may be used to collect impression information for any type of media, including static media (e.g., advertising images), streaming media (e.g., streaming video and/or audio, including content, advertising, and/or other types of media), and/or other types of media. For static media (e.g., media that does not have a time component such as images, text, a webpage, etc.), in some examples the
AME 108 records an impression once for each occurrence of the media being presented, delivered, or otherwise provided to themobile device 106. For streaming media (e.g., video, audio, etc.), in some examples theexample AME 108 measures demographics for media occurring over a period of time. For example, the AME 108 (e.g., via theapp publisher 110 and/or the media publisher 120) provides beacon instructions to a client application or client software (e.g., theOS 114, theweb browser 117, theapp 116, etc.) executing on themobile device 106 when media is loaded at client application/software 114-117. In some such examples, the beacon instructions cause the client application/software 114-117 to transmit a request (e.g., a pingback message) to an impression monitoring server at regular and/or irregular intervals (e.g., every minute, every 30 seconds, every 2 minutes, etc.). The exampleimpression monitoring server 132 identifies the requests from theweb browser 117 and, in combination with one or more database proprietors, matches the impression information for the media with demographics of the user of theweb browser 117. - In some examples, a user loads (e.g., via the browser 117) a web page from a web site publisher (e.g., a web page corresponding to a particular 60 minute video). An instruction which is a part of or referred to by the example web page (e.g., a beacon instruction) causes the
browser 117 and/or thedata collector 112 to send a pingback message (e.g., a beacon request) to abeacon server 142. For example, when the beacon instructions are executed by theexample browser 117, the beacon instructions cause thedata collector 112 to send pingback messages (e.g., beacon requests, HTTP requests, pings) to theimpression monitoring server 132 at designated intervals (e.g., once every minute or any other suitable interval). The example beacon instructions (or a redirect message from, for example, theimpression monitoring server 132 or the database proprietor 104) further cause thebrowser 117 and/or thedata collector 112 to send pingback messages or beacon requests to thedatabase proprietor 104 that collect and/or maintain demographic information about users. - The
database proprietor 104 transmits demographic information about the user associated with thedata collector 112 and/or thebrowser 117 for combining or associating with the impression determined by theimpression monitoring server 132. If the user closes the web page containing the video before the end of the video, the beacon instructions are stopped, and thedata collector 112 stops sending the pingback messages to theimpression monitoring server 132. In some examples, the pingback messages include timestamps and/or other information indicative of the locations in the video to which the numerous pingback messages correspond. By determining a number and/or content of the pingback messages received at theimpression monitoring server 132 from themobile device 106, the exampleimpression monitoring server 132 can determine that the user watched a particular length of the video (e.g., a portion of the video for which pingback messages were received at the impression monitoring server 132). - The
mobile device 106 of the illustrated example executes a client application/software 114-117 that retrieves data from a host website (e.g., www.acme.com) that provides (e.g., serves) the media 118 (e.g., audio, video, interactive media, streaming media, etc.) is obtained for presenting via themobile device 106. In the illustrated example, the media 118 (e.g., advertisements and/or content) is tagged with identifier information (e.g., amedia ID 122, a creative type ID, a placement ID, a publisher source URL, etc.) and a beacon instruction. The example beacon instruction causes the client application/software 114-117 to request further beacon instructions from abeacon server 142 that will instruct the client application/software 114-117 on how and where to send beacon requests to report impressions of themedia 118. For example, the example client application/software 114-117 transmits a request including an identification of the media 118 (e.g., the media identifier 122) to thebeacon server 142. Thebeacon server 142 generates and/or returnsbeacon instructions 144 to the examplemobile device 106. Although thebeacon server 142 and theimpression monitoring server 132 are shown separately, in some examples thebeacon server 142 and theimpression monitoring server 132 are combined. In the illustrated example,beacon instructions 144 include a URL of the database proprietor (e.g., the demographic database proprietors 104) or any other server to which themobile device 106 should send beacon requests (e.g., impression requests). In some examples, a pingback message or beacon request may be implemented as an HTTP request. However, whereas a transmitted HTTP request identifies a webpage or other resource to be downloaded, the pingback message or beacon request includes audience measurement information (e.g., ad campaign identification, content identifier, and/or device/user identification information) as its payload. The server to which the pingback message or beacon request is directed is programmed to log the audience measurement data of the pingback message or beacon request as an impression (e.g., an ad and/or content impression depending on the nature of the media tagged with the beaconing instructions). In some examples, the taggedmedia 118 include thebeacon instructions 144. In such examples, the client application/software 114-117 does not need to requestbeacon instructions 144 from abeacon server 142 because thebeacon instructions 144 are already provided in the taggedmedia 118. - When the
beacon instructions 144 are executed by themobile device 106, thebeacon instructions 144 cause themobile device 106 to send beacon requests (e.g., repeatedly at designated intervals) to a remote server (e.g., theimpression monitoring server 132, themedia publisher 120, thedatabase proprietor 104, or another server) specified in thebeacon instructions 144. In the illustrated example, the specified server is a server of theaudience measurement entity 108, such as theimpression monitoring server 132. Thebeacon instructions 144 may be implemented using Javascript or any other types of instructions or script executable via a client application (e.g., a web browser) including, for example, Java, HTML, etc. - While the
example system 100 ofFIG. 1 is illustrated as having onedatabase proprietor 104,multiple database proprietors 104 may be used. - Many applications and websites are available that enable users of mobile devices to perform commercial transactions with a merchant (e.g., a retailer, an online merchant, a club store, a wholesaler, or any other purveyor of goods or services). For example, Amazon® provides an application for devices to enable a user of the device to login to an Amazon account, browse and/or search for items, add the items to a shopping cart, enter payment information, configure shipping details, and/or finalize an order. Amazon provides such an application for multiple different types of devices (e.g., devices executing different operating systems). Many other such applications are available for other merchants. Merchants who also have physical locations at which transactions can be performed often provide applications for performing commercial transactions from electronic devices similar to the transaction described above.
- The
example system 100 ofFIG. 1 includes amerchant database proprietor 146. The examplemerchant database proprietor 146 ofFIG. 1 stores account information for users who have registered with themerchant database proprietor 146. In the example ofFIG. 1 , users who register with themerchant database proprietor 146 are then permitted to place orders for (e.g., purchase) products offered by themerchant database proprietor 146 and/or offered by third parties using ordering services provided by themerchant database proprietor 146. For example, themerchant database proprietor 146 may list products offered by a third party, facilitate payment by the user for a purchased product, and/or facilitate shipping of the purchased product to the user. - The example
merchant database proprietor 146 ofFIG. 1 provides an application (e.g., theapp 116 ofFIG. 1 ) for download to themobile device 106. For example, themobile device 106 may download theapp 116 from theapp publisher 110 and/or directly from themerchant database proprietor 146. - When the
app 116 is installed on themobile device 106, the example user may login to an account with themerchant database proprietor 146 and/or may register to create an account with themerchant database proprietor 146. In either case, theexample app 116 transmits merchant account information 148 (e.g., a login name or other account identifier, a password, etc.) to themerchant database proprietor 146, which identifies the user or account to themerchant database proprietor 146. - In addition to the
merchant account information 148, theexample app 116 accesses the device/user identifier 124 in themobile device 106. Theapp 116 of the illustrated example transmits the device/user identifier 124 to themerchant database proprietor 146. - Upon receipt of the
merchant account information 148 and the device/user identifier 124 and authentication of the corresponding user account, the examplemerchant database proprietor 146 associates the user account with the device/user identifier 124. As a result, the examplemerchant database proprietor 146 can generatetransaction information 150 for the user account, including transactions performed using the user account with the device/user identifier 124. - In some cases, a user account is accessed via multiple devices (e.g., a smartphone and a tablet computer that are both owned by the owner of the user account). The example
merchant database proprietor 146 may associate multiple device/user identifiers 124 with the user account such that media impressions occurring on any of the devices corresponding to the device/user identifiers 124 may be correlated to transactions occurring using the user account. The transactions may be independent of the device on which they were performed by the user. That is, in the illustrated example, transactions are associated with the user account. - As mentioned above, the
example AME 108 receives theimpression data 130 and the device/user identifier 124 from the examplemobile device 106. Theexample AME 108 ofFIG. 1 associates transaction information 150 with impression information by matching impressions to transactions using the device/user identifier 124. For example, theAME 108 ofFIG. 1 receives, from themerchant database proprietor 146, transaction information associated with a user account associated with a device/user identifier 124 of themobile device 106. Theexample AME 108 also receives the impression data 130 (or impression information) including an indication of the same device/user identifier 124. Theexample AME 108 ofFIG. 1 correlates the transaction information to the impressions by matching the device/user identifier 124 in a transaction request 152 (described below) to the device/user identifier 124 that corresponds to a user account used to perform the transactions. - To obtain the transaction information, the
example AME 108 transmits atransaction request 152 to the examplemerchant database proprietor 146. Theexample transaction request 152 includes a device/user identifier 124. TheAME 108 transmits the device/user identifier 124 that is received in theimpression data 130 to, for example, obtain transaction information to potentially be correlated to a media impression. - The example
merchant database proprietor 146 receives thetransaction request 152 including the device/user identifier 124. Themerchant database proprietor 146 looks up a user account that was previously associated with the device/user identifier 124 (e.g., in a database). If themerchant database proprietor 146 locates a user account associated with the device/user identifier 124, the examplemerchant database proprietor 146 generates the transaction information 150 (e.g., based on transaction data stored in a database of the merchant database proprietor 146). - In the illustrated example, the
merchant database proprietor 146 transmits thetransaction information 150 to theexample AME 108. In some examples, themerchant database proprietor 146 includes the device/user identifier 124 in its response to theAME 108 to enable theAME 108 to determine the device/user identifier 124 and/or therequest 152 for which thetransaction information 150 is being provided. Theexample AME 108 of the illustrated example matches thetransaction information 150 received from themerchant database proprietor 146 to theimpression data 130. - To match the impressions in the
impression data 130 to the transactions in thetransaction information 150, theexample AME 108 ofFIG. 1 determines the product(s) represented in theimpression data 130. Examples of product(s) represented in media include products represented in advertisements for those products (e.g., a Coca-Cola® soft drink represented in an advertisement for Coca-Cola) and/or intentionally-placed product(s) in non-advertisement media such as television episodes, movies, and/or other content-oriented media (e.g., a Rolex® watch worn by an actor in a television show, a particular car brand used in a movie, etc.). For example, theAME 108 may access a database that specifies the products represented in each item ofmedia 118. Similarly, theexample transaction information 150 ofFIG. 1 provided by themerchant database proprietor 146 includes an identification of the product(s) purchased in the transactions made by the user account associated with the device/user identifier 124. - The
example AME 108 compares the product(s) represented in theimpression data 130 to the product(s) in thetransaction information 150 to determine whether there are any matching product(s). If theAME 108 identifies a product represented in an impression that matches a product involved in a purchase transaction, theexample AME 108 determines whether the purchase transaction occurred after the impression. For example, theimpression data 130 includes time and date information indicating the time and date of the impression on themobile device 106. Similarly, thetransaction information 150 includes time and date information indicating the time and date of the transaction(s) represented in thetransaction information 150. TheAME 108 compares the time and date information for the media impression to the time and date information for the transaction to determine which of the media impression or the transaction occurred first. - When the
AME 108 determines that the media impression occurred before the transaction (e.g., the time and date of the media impression occurred before the time and date of the transaction), theexample AME 108 correlates the media impression to the purchase of the product(s) represented in the impression. Theexample AME 108 determines whether such a correlation occurred for the product(s) for multiplemobile devices 106 and/or user accounts. For example, theAME 108 determines a percentage of a set ofmobile devices 106 and/or user accounts for which the media impression of a product occurred before the purchase transaction of that product. In some examples, theAME 108 determines percentages of sets ofmobile device 106 for different publishers and/or different media to evaluate the effectiveness of publishers and/or media for influencing purchasing behavior of the product. - In some examples, the
merchant database proprietor 146 providestransaction information 150 to theAME 108 for all transactions performed using a user account associated with the device/user identifier 124, for all transactions performed within a specified time period using the user account associated with the device/user identifier 124, and/or for specified type(s) of transaction(s) performed using a user account associated with the device/user identifier 124. In some other examples, theAME 108 determines the product(s) represented in the media impressions occurring at themobile device 106, and transmitsproduct information 154 to themerchant database proprietor 146 in thetransaction request 152. Limiting thetransaction request 152 to product(s) of interest may enhance the privacy of the users of themerchant database proprietor 146 by restricting theAME 108 to information about specific product(s). - In some examples, the
AME 108 may transmit theproduct information 154 in therequest 152 without transmitting the device/user identifier 124. In such examples, themerchant database proprietor 146 looks up theproduct information 154 to determine which user accounts have purchased the product identified in theproduct information 154. The examplemerchant database proprietor 146 may then return a list of device/user identifiers 124 that correspond to user accounts that have purchased the product identified in theproduct information 154. In some examples, the transactions returned in response to atransaction request 152 are limited to transactions occurring within a particular time period, such as a period of time designated in therequest 152, a period of time determined based on therequest 152, a predetermined time period, and/or a standard time period. - When the example
merchant database proprietor 146 receives atransaction request 152 including theproduct information 154, the examplemerchant database proprietor 146 determines whether the product(s) specified in theproduct information 154 have been purchased in any transactions performed using the user account associated with the device/user identifier 124 specified in thetransaction request 152. If the product(s) specified in theproduct information 154 have been purchased, the examplemerchant database proprietor 146 returns thetransaction information 150 for the transactions in which the specified product(s) were purchased. For any product(s) not purchased using the user account, the examplemerchant database proprietor 146 does not respond or responds with an indication that those product(s) were not purchased using the user account. By requiring theAME 108 to specify theproduct information 154, theexample AME 108 does not receive transaction information that is not relevant to media impressions occurring on themobile device 106. - The
example AME 108 ofFIG. 1 aggregates transaction information and media impressions to measure effectiveness of the media corresponding to the media impressions. As explained in more detail below, theexample AME 108 measures the effectiveness of an item of media by using the transaction information (collected as described above) to measure a change in purchases of a product represented in the item of media from a time period prior to the media impressions to a time period subsequent to the media impressions. In some examples, theAME 108 creates a measurement group that is determined to have been exposed to the item of media and compares the change to a purchase change in a control group. The control group is determined by theAME 108 to not have been exposed to the item of media, according to the impression information. - Examples that may be used to implement the system of
FIG. 1 are disclosed in U.S. patent application Ser. No. 14/127,414, filed on Aug. 28, 2013, U.S. patent application Ser. No. 14/261,085, filed on Apr. 24, 2014, U.S. Provisional Patent Application Ser. No. 61/952,726, filed on Mar. 13, 2014, U.S. Provisional Patent Application Ser. No. 61/979,391, filed on Apr. 14, 2014, U.S. Provisional Patent Application Ser. No. 61/986,784, filed on Apr. 30, 2014, U.S. Provisional Patent Application Ser. No. 61/991,286, filed on May 9, 2014, and U.S. Provisional Patent Application Ser. No. 62/014,659, filed Jun. 19, 2014. The entireties of U.S. patent application Ser. No. 14/127,414, U.S. patent application Ser. No. 14/261,085, U.S. Provisional Patent Application Ser. No. 61/952,726, U.S. Provisional Patent Application Ser. No. 61/979,391, U.S. Provisional Patent Application Ser. No. 61/986,784, U.S. Provisional Patent Application Ser. No. 61/991,286, and U.S. Provisional Patent Application Ser. No. 62/014,659 are incorporated by reference herein. -
FIG. 2 illustrates an example impression-transaction analyzer 200 which may be implemented in the exampleaudience measurement server 132 ofFIG. 1 to match impression information associated with a mobile device (e.g., themobile device 106 ofFIG. 1 ) to transaction information corresponding to a purchase made using a user account accessed by themobile device 106. The example impression-transaction analyzer 200 ofFIG. 2 includes anexample product checker 202, anexample product database 204, an example transaction requester 206, an example impression/transaction matcher 208, anexample group identifier 210, anexample transaction aggregator 212, and anexample effectiveness calculator 214. - The
example product checker 202 ofFIG. 2 identifies products associated with media impressions. For example, theproduct checker 202 of the illustrated example receives impression data from mobile devices (e.g., theimpression data 130 from themobile device 106 ofFIG. 1 ). In this example, theimpression data 130 includes amedia identifier 122 formedia 118 corresponding to an impression occurring at themobile device 106. Theexample product checker 202 queries theproduct database 204, which stores indications of products represented in themedia 118 that corresponds to themedia identifier 122. Theproduct checker 202 of the illustrated example looks up a product corresponding to themedia 118 in theproduct database 204 using themedia identifier 122 as a key. In response to the query, theexample product database 204 returns a product identifier of a product (e.g., theproduct information 154 ofFIG. 1 ) to theexample product checker 202. Over time, theexample product database 204 may be updated with new associations of media to products. In the illustratedexample product database 204, a media item may be associated with multiple products and/or a product may be represented by multiple media items. - In addition to the
media identifier 122, theexample impression data 130 also includes the device/user identifier 124. In the illustrated example, theexample product checker 202 provides the device/user identifier 124 and theproduct information 154 corresponding to thetransaction request 152 to thetransaction requester 206. - The example transaction requester 206 of
FIG. 2 generates and sends atransaction request 152 to one or more merchant database proprietors (e.g., themerchant database proprietor 146 ofFIG. 1 ). In the example ofFIG. 2 , thetransaction request 152 includes the device/user identifier 124 and theproduct information 154. The example transaction requester 206 sends thetransaction request 152 to themerchant database proprietor 146 to obtain transaction information from themerchant database proprietor 146. - If the
merchant database proprietor 146 hastransaction information 150 corresponding to the device/user identifier 124, the examplemerchant database proprietor 146 sends thetransaction information 150 to the impression-transaction analyzer 200. In some examples, themerchant database proprietor 146 limits thetransaction information 150 that is returned to transactions that correspond to both the device/user identifier 124 and theproduct information 154. In other examples, the returned information is not so limited and/or theproduct information 154 is not provided to themerchant database proprietor 146. - The example transaction requester 206 of
FIG. 2 receives thetransaction information 150 from the merchant database proprietor 146 (e.g., in response to the transaction request 152) and provides thetransaction information 150 and theimpression data 130 to the impression/transaction matcher 208. The example impression/transaction matcher 208 ofFIG. 2 matches impressions occurring at the mobile device 106 (e.g., from the impression data 130) to transactions of purchases performed using a user account associated with the mobile device 106 (e.g., from the transaction information 150). By matching the impressions to the transactions, the example impression/transaction matcher 208 may determine instances in which an impression corresponding to a product occurred prior to a transaction in which the product was purchased, where both the impression and the transaction correspond to a same device/user identifier 124. This information can be used to credit the impression with driving the transaction. - To match an impression to a transaction, the example impression/
transaction matcher 208 compares A) combinations of a device/user identifier 124 andproduct information 154 that are obtained from theimpression data 130 to B) combinations of a device/user identifier 124 andproduct information 154 that correspond totransaction information 150 obtained from themerchant database proprietor 146. Combinations of the device/user identifier 124 and theproduct information 154 that are found in both theimpression data 130 and in thetransaction information 150 are considered to match. - As an example, Table 1 below includes a set of example combinations of device/user identifiers 124 (e.g., Device/User ID) and product information 154 (e.g., Product ID) obtained from impression data 130 (e.g., Impression ID) (e.g., by the example product checker 202) collected at a
mobile device 106. -
TABLE 1 EXAMPLE COMBINATIONS OF DEVICE/USER IDENTIFIERS AND PRODUCT IDENTIFIERS FROM IMPRESSION DATA Impression ID Device/User ID Product ID Imp. Time/Date 11 HOI35JGETR R9ANT20EJY 2014-07-08:09:15:00 12 HOI35JGETR 7ZFF46F77Z 2014-07-08:13:05:00 13 B8PE8JH26N NB2EYZ4YOG 2014-07-08:16:10:00 - Table 2 below includes a set of example combinations of device/user identifiers 124 (e.g., Device/User ID) and product information 154 (e.g., Product ID) corresponding to transaction information 150 (e.g., Transaction ID) received by the transaction requester 206 from a
merchant database proprietor 146. The combinations in Table 2 may be returned in thetransaction information 150 from amerchant database proprietor 146 and/or may be associated with thetransaction information 150 by thetransaction requester 206 when thetransaction information 150 is identified as occurring in response to atransaction request 152. -
TABLE 2 EXAMPLE COMBINATIONS OF DEVICE/USER IDENTIFIERS AND PRODUCT IDENTIFIERS FROM TRANSACTION DATA Transaction ID Device/User ID Product ID Trans. Time/Date 21 HOI35JGETR R9ANT20EJY 2014-07-09:19:12:00 22 HOI35JGETR I9DBW9RC8R 2014-07-09:19:12:00 23 OBU2434KTL R9ANT20EJY 2014-07-08:11:49:00 24 B8PE8JH26N NB2EYZ4YOG 2014-07-07:04:42:00 - By comparing the combinations in Table 1 above (e.g., records, impressions) to the combinations in Table 2 above (e.g., records, transactions), in this example the example impression/
transaction matcher 208 ofFIG. 2 will identify theimpression data 130 having impression ID 11 as having the same combination of device/user identifier 124 (e.g., Device/User ID of HOI35JGETR) and product information 154 (e.g., Product ID of R9ANT20EJY) astransaction information 150 having transaction ID 21. In this example, the impression/transaction matcher 208 ofFIG. 2 also identifies theimpression data 130 having impression ID 13 in Table 1 above as having the same combination of device/user identifier 124 (e.g., Device/User ID of B8PE8JH26N) and product information 154 (e.g., Product ID of NB2EYZ4YOG) astransaction information 150 having transaction ID 24. - While Table 1 above shows that
additional impressions data 130 associated with the device/user identifier 124 of HOI35JGETR (Device/User ID) was received (e.g., data with an impression ID of 12), there are no corresponding transactions in Table 2 above for that device/user identifier 124 that are also associated with the product having a Product ID of 7ZFF46F77Z (i.e., the Product ID associated with impression ID 12). Therefore, the impression/transaction matcher 208 does not identify a match for impression ID 12. - Similarly, Table 2 above shows that the device/user ID HOI35JGETR was used to perform a transaction for the purchase of a product having a Product ID of I9DBW9RC8R (see transaction ID 22 in Table 2). However, Table 1 does not indicate that an impression of media representing that product (i.e., I9DBW9RC8R) occurred on a
mobile device 106 that corresponds to the device/user ID HOI35JGETR. Therefore, the impression/transaction matcher 208 of this example does not identify a match for transaction ID 22. - The example Table 1 above also includes information indicating the times and dates at which the impressions occurred (Imp. Time/Date). The example Table 2 above also includes information indicating the times and dates at which the transactions occurred. When the example impression/
transaction matcher 208 ofFIG. 2 identifies a transaction (e.g., from Table 2 above) that has a device/user identifier 124 andproduct information 154 combination that matches the device/user identifier 124 andproduct information 154 combination of an impression (e.g., from Table 1 above), the impression/transaction matcher 208 of the illustrated example determines whether the impression occurred prior to the transaction based on the respective times and dates of the matching impression ID and transaction ID. In the example ofFIG. 2 , the impression/transaction matcher 208 determines that the matching impression and transaction are related (e.g., that the impression may have resulted in the transaction) when the impression occurred prior to the transaction (according to the respective times and dates). - In the example of Tables 1 and 2 above, the impression/
transaction matcher 208 would determine that the impression having impression ID 11 is related to the matching transaction having transaction ID 21 because the impression has a time and date (Jul. 8, 2014, at 09:15:00) that occurred before the time and date of the transaction (Jul. 9, 2014, at 19:12:00). For example, where the media associated with the impression having impression ID 11 is an advertisement for a product, and the transaction corresponding to transaction ID 21 is a subsequent purchase of that product using a user account associated with the device on which the impression occurred, it is possible or even likely that the impression had an influence on the purchase of the product. Therefore, in view of the time sequence of this example (i.e., the impression occurring before the transaction), the impression is credited with driving the transaction. - Conversely, in the example of Tables 1 and 2 above, the impression/
transaction matcher 208 would determine that the impression having impression ID 13 is not related to the matching transaction having transaction ID 24 because the impression has a time and date (Jul. 8, 2014, at 16:10:00) that occurred after the time and date of the transaction (Jul. 7, 2014, at 04:42:00). For example, where a person purchases a product and then is subsequently exposed to an advertisement for the product, that particular exposure of the person to the advertisement would not be considered to have influenced the prior purchase of that product and, thus, is not credited with driving a transaction. - The
example group identifier 210 ofFIG. 2 assigns device/user identifiers 124 to groups based on whether the device/user identifier 124 is associated with an impression of media of interest (e.g., media corresponding to a product of interest). For example, thegroup identifier 210 ofFIG. 2 assigns device/user identifiers 124 that correspond to impressions of the media to an “exposed” group, and assigns device/user identifiers 124 that do not correspond to the media of interest to a “control” group. In some examples, thegroup identifier 210 further sub-divides the control group and/or the exposed group based on other factors such as time periods during which the impressions of the media of interest occurred for the exposed group. - The example impression/
transaction matcher 208 ofFIG. 2 provides thegroup identifier 210 ofFIG. 2 with the impression information (e.g., the impression information of Table 1). Theexample group identifier 210 determines, for each device/user identifier 124 represented in the impressions, whether the device/user identifier 124 has been exposed to media representing a product of interest. For example, thegroup identifier 210 is provided withproduct information 154 for a product of interest, such as a product for which a media campaign is to be evaluated for effectiveness. - In some examples, the
group identifier 210 is provided with amedia identifier 122 instead ofproduct information 154. Amedia identifier 122 may be used when, for example, a measurement of the effectiveness of a particular item of media is desired when there are multiple items of media representing a product. In such examples, thegroup identifier 210 may obtainimpression data 130 from theproduct checker 202. Using theimpression data 130, thegroup identifier 210 determines the device/user identifiers 124 corresponding to impressions of themedia 118 having themedia identifier 122. - The
example group identifier 210 ofFIG. 2 sorts the device/user identifiers 124 (e.g., device/user IDs of Tables 1 and/or 2 above) into two groups. The first group is an “exposed group,” which includes the device/identifiers 124 corresponding to impressions of media representing the product of interest. For example, thegroup identifier 210 may populate a table or other data structure corresponding to the exposed group with device/user identifiers 124 that are present in combination with the product ID of interest in an impressions table (e.g., Table 1 above). The second group is a “control group,” which includes the device/identifiers 124 for which impressions of media representing the product of interest did not occur. Using the example Table 1 above, if thegroup identifier 210 receives the Product ID R9ANT20EJY as the product of interest, theexample group identifier 210 would place the device/user identifier 124 (device/user ID) of HOI35JGETR in the exposed group because the device/user identifier 124 of HOI35JGETR reported an impression of media corresponding to Product ID R9ANT20EJY. In this example, thegroup identifier 210 would place the device/user identifier 124 (device/user ID) of B8PE8JH26N in a table or other data structure corresponding to the control group because the device/user identifier 124 of B8PE8JH26N did not report an impression of media corresponding to Product ID R9ANT20EJY. Therefore, in this example, the exposed group would have a count of one device/user identifier 124 and the control group would have a count of one device/user identifier 124. - The example impression/
transaction matcher 208 ofFIG. 2 provides the transactions (e.g., the transactions of Table 2 above) to thetransaction aggregator 212. Additionally, theexample group identifier 210 provides the list of device/user identifiers 124 that belong to each of the groups (e.g., the control group and the exposed group) to thetransaction aggregator 212. For example, thegroup identifier 210 may provide a first list of device/user identifiers 124 that have been determined to be in the control group and a second list of device/user identifiers 124 that have been determined to be in the exposed group. These lists correspond to the data structure for the exposed group and the control group mentioned above. - The
example transaction aggregator 212 ofFIG. 2 determines up to four separate sets of purchases or transactions based on the transactions obtained from the impression/transaction matcher 208 and based on the groups identified by thegroup identifier 210. In the illustrated example, thetransaction aggregator 212 determines 1) the number of the products purchased by user accounts corresponding to device/user identifiers 124 in the control group during a first time period; 2) the number of the products purchased by user accounts corresponding to device/user identifiers 124 in the control group during a second time period occurring after the first time period; 3) the number of the products purchased by user accounts corresponding to device/user identifiers 124 in the exposed group during the first time period; and 4) the number of the products purchased by user accounts corresponding to device/user identifiers 124 in the exposed group during the second time period. - In the illustrated example, the first time period is a time period prior to (e.g., ending at) the commencement of a media campaign including media (e.g., the media of interest) representing the products of interest. Thus, the purchases of the products by the control group and the exposed group may provide a basis for calculating purchase growth attributable to the media. In particular, differences in purchases or purchase rate by the exposed group as compared to the purchases or purchase rate of the control group provides a measure of the effectiveness of the media in driving and/or slowing sales.
- In the illustrated example, the second time period is a time period subsequent to (e.g., starting at the end of or consecutive to) the first period. For example, the second time period may begin at the end of the first time period, the end of a time period during which a media campaign runs, and/or at any other event.
- To determine the number of the products purchased via user accounts corresponding to device/
user identifiers 124 in the control group during a first time period (e.g., the first example set of purchases determined by the transaction aggregator 212), theexample transaction aggregator 212 identifies transactions (e.g., transactions from Table 2 above) that have a time and date within the first period and have a device/user identifier 124 assigned to the control group by thegroup identifier 210. The control group will not have a matching impression (e.g., in Table 1). In other words, to determine the number of the products purchased via user accounts corresponding to device/user identifiers 124 in the control group during the first time period, theexample transaction aggregator 212 determines a number of transactions performed using devices corresponding to the control group prior to, for example, the beginning of a media campaign (e.g., a coordinated set of impressions of one or more media items, including audio, video, and/or still media) for the product of interest. - To determine the number of the products purchased via user accounts corresponding to device/
user identifiers 124 in the control group during a second time period (e.g., the second example set of purchases determined by the transaction aggregator 212), theexample transaction aggregator 212 identifies transactions (e.g., transactions from Table 2 above) that: 1) have a time and date within the second period and have a device/user identifier 124 assigned to the control group by thegroup identifier 210. The control group will not have a matching impression (e.g., in Table 1). In other words, to determine the number of the products purchased via user accounts corresponding to device/user identifiers 124 assigned to the control group during the second time period, theexample transaction aggregator 212 determines a number of transactions performed using devices corresponding to the control group after the beginning of the media campaign (e.g., during and/or after the media campaign) for the product of interest. - To determine the number of the products purchased via user accounts corresponding to device/
user identifiers 124 in the exposed group during the first time period (e.g., the third example set of purchases determined by the transaction aggregator 212), theexample transaction aggregator 212 identifies transactions (e.g., transactions from Table 2 above) that have a time and date within the first period and have a device/user identifier 124 assigned to the exposed group by thegroup identifier 210. In other words, to determine the number of the products purchased via user accounts corresponding to device/user identifiers 124 assigned to the exposed group during the first time period, theexample transaction aggregator 212 determines a number of transactions performed using devices corresponding to the exposed group prior to the beginning of the media campaign for the product of interest. - To determine the number of the products purchased via user accounts corresponding to device/
user identifiers 124 in the exposed group during the second time period (e.g., the fourth example set of purchases determined by the transaction aggregator 212), theexample transaction aggregator 212 identifies transactions (e.g., transactions from Table 2 above) that: 1) have a time and date within the second period and have a device/user identifier 124 assigned to the exposed group, and 2) have a related matching impression (e.g., an impression in Table 1 above that has a same device/user ID and a same Product ID as the transaction, and where the impression has a time and date that is prior to the time and date of the transaction). In other words, to determine the number of the products purchased via user accounts corresponding to device/user identifiers 124 in the exposed group during the second time period, theexample transaction aggregator 212 determines a number of transactions performed using devices corresponding to the exposed group after the beginning of the media campaign for the product of interest. - The
example effectiveness calculator 214 ofFIG. 2 calculates the effectiveness of the media and/or the effectiveness of the publishers (e.g., the delivery methods for the media). For example, theeffectiveness calculator 214 calculates the effectiveness of the media and/or the publishers based on the sales of the product represented in the media that occurred in the aggregated transactions. Theexample effectiveness calculator 214 calculates the sales using the sets of purchases determined by thetransaction aggregator 212 for the control and exposed groups during the first and second time periods. - In some examples, the
effectiveness calculator 214 calculates a publisher effectiveness (e.g., for anapp publisher 110, for amedia publisher 120, etc.) by, for example, dividing the sales lift in an exposed group for a first publisher by the sales lift in an exposed group for a second publisher. The exposed group for the first publisher is the fourth example group calculated by thetransaction aggregator 212 as described above (e.g., the number of the products purchased via user accounts corresponding to device/user identifiers 124 in the exposed group during the second time period) determined using device/user identifiers 124 associated with impressions delivered via the first publisher (e.g., delivered via an app and/or a website associated with theapp publisher 110, delivered in association with media published by themedia publisher 120, etc.). Similarly, the exposed group for the second publisher is the fourth example group calculated by thetransaction aggregator 212 as described above (e.g., the number of the products purchased via user accounts corresponding to device/user identifiers 124 in the exposed group during the second time period) determined using device/user identifiers 124 associated with impressions delivered via the second publisher (e.g., delivered via an app and/or a website associated with theapp publisher 110, delivered in association with media published by themedia publisher 120, etc.). - Additionally or alternatively, the
example effectiveness calculator 214 calculates the effectiveness of media by, for example, dividing a sales lift from the first time period to the second time period for an exposed group by the sales lift from the first time period to the second time period for a control group. The media effectiveness measures, for example, the effect of the media of interest on driving sales by determining the difference in sales rates after the media of interest was presented relative to sales rates before the media was presented. For example, theeffectiveness calculator 214 may determine the media effectiveness metric using the four example sets of purchases determined by thetransaction aggregator 212 as described above to be: ((sales in fourth example set of purchases/sales in third example set of purchases)/(sales in second example set of purchases/sales in first example set of purchases)) or ((sales in fourth example set of purchases/sales in third example set of purchases)−(sales in second example set of purchases/sales in first example set of purchases)/(sales in second example set of purchases/sales in first example set of purchases)). -
FIG. 3 illustrates an example table 300 illustrating an example determination of an effectiveness of media impressions.FIG. 4 is agraph 400 illustrating the data in the example table 300 ofFIG. 3 . The example table 300 and/or theexample graph 400 may be generated by the example impression-transaction analyzer 200 ofFIG. 2 based onimpression data 130 obtained from themobile device 106,user information 102 obtained from the exampledemographic database proprietor 104, and/ortransaction information 150 obtained from themerchant database proprietor 146 ofFIG. 1 . - In the examples of
FIGS. 3 and 4 , the impression-transaction analyzer 200 does not calculate the transactions occurring prior to the media impressions (as in the examples described above with reference toFIG. 2 ). Instead, in this example the media effectiveness is determined by comparing sales of the product to the control group with sales of the product to the exposed group to determine a sales lift. Omitting the measurement of different time periods increases the privacy of users of themerchant database proprietor 146 and decreases computational resource requirements, but may also fail to control the measurement for external events, such as media impressions occurring via other media presentation platforms such as television, radio, and/or outdoor advertising. - The example table 300 of
FIG. 3 illustrates a comparison of transactions for a product corresponding to impressions delivered through two different mobile application publishers (e.g., via two different applications that may be installed on a mobile device). For this example, assumePublisher A 302 publishes a first application (e.g., theapp 116 ofFIG. 1 ) andPublisher B 304 publishes a second application (e.g., thebrowser 117 ofFIG. 1 ). Theexample media publisher 120 ofFIG. 1 may choose to have themedia 118 ofFIG. 1 delivered to themobile device 106 via either or both of theapp 116 and/or thebrowser 117 ofFIG. 1 . - For each of the
publishers FIG. 3 , theexample group identifier 210 ofFIG. 2 determines a number of user accounts (or persons associated with the user accounts) belonging to thecontrol group 306 as described above (e.g., during a time period following the commencement of media impressions atmobile devices 106 via thepublishers 302, 304). Thegroup identifier 210 also determines a number of user accounts belonging to the exposedgroup 308 as described above. - In the example of
FIGS. 3 and 4 , thegroup identifier 210 identifies (e.g., based on theimpression data 130 from those mobile devices 106) 12,200 user accounts in the control group for publisher A 302 (e.g., associated withmobile devices 106 using theapp 116 from thepublisher A 302 that have not had an impression of the media). Similarly, thegroup identifier 210 identifies (e.g., based on theimpression data 130 from those mobile devices 106) 17,500 user accounts in the control group for publisher B 304 (e.g., associated withmobile devices 106 using thebrowser 117 from thepublisher B 304 that have not had an impression of the media). - Continuing the example, the
group identifier 210 identifies (e.g., based on theimpression data 130 from those mobile devices 106) 35,400 user accounts in the exposed group for publisher A 302 (e.g., associated withmobile devices 106 using theapp 116 from thepublisher A 302 that have had an impression of the media). Similarly, thegroup identifier 210 identifies (e.g., based on theimpression data 130 from those mobile devices 106) 30,100 user accounts in the exposed group for publisher B 304 (e.g., associated withmobile devices 106 using thebrowser 117 from thepublisher B 304 that have had an impression of the media). - The
example transaction aggregator 212 ofFIG. 2 determines a number of control group sales 310 (e.g., transactions involving the product, of a quantity of units of the product, etc.) and a number of exposedgroup sales 312 of the respective control groups of theexample publishers control group sales 310 may be the first or the second example groups of purchases determined by thetransaction aggregator 212 as described above. The example exposedgroup sales 312 may be the third or the fourth example groups of purchases determined by thetransaction aggregator 212 as described above. Thetransaction aggregator 212 determines a number of transactions for the product corresponding to the members of each of thegroups group identifier 210. In the example ofFIGS. 3 and 4 ,Publisher A 302 is determined to have 4,200control group sales 310 and 22,100 exposedgroup sales 312 of the example product. Therefore, 34.4% (e.g., 4,200/12,200) of theexample control group 306 of thepublisher A 302 purchased the example product of interest during the measured time period, while 62.4% (e.g., 22,100/35,400) of the exposedgroup 308 of thepublisher A 302 purchased the example product during the measured time period. Therefore, the media impressions delivered via the app 116 (e.g., via Publisher A) resulted in asales lift 314 of 81.3% (e.g., (62.4%−34.4%)/34.4%) for the product in the exposedgroup 308 relative to thecontrol group 306. -
Publisher B 304 is determined to have 5,600control group sales 310 and 10,600 exposedgroup sales 312 of the example product. Therefore, 32% (e.g., 5,600/17,500) of theexample control group 306 of thepublisher B 304 purchased the example product of interest during the measured time period, while 35.2% (e.g., 10,600/30,100)) of the exposedgroup 308 of thepublisher B 304 purchased the example product during the measured time period. Therefore, the media impressions delivered via the browser 117 (e.g., via Publisher B) resulted in asales lift 314 of 10.0% (e.g., (35.2%-32%)/32%) for the product in the exposedgroup 308 relative to thecontrol group 306. - By comparing the
example sales lifts 314 for thepublishers FIGS. 3 and 4 , a manufacturer of a product associated with the media of interest (or, for example, the manufacturer's advertising agent) may determine that impressions of the media corresponding to the product are more effective when occurring through the app 116 (e.g., via Publisher A 302) than through the browser 117 (e.g., via Publisher B 304) (or, in some other examples, more effective through a first app than through a second app). The example manufacturer (and/or its advertising agent) may respond to this determination by channeling more of the media impressions tomobile devices 106 via the app 116 (provided by Publisher A 302) and fewer via the browser 117 (provided by Publisher B 304). Additionally or alternatively, the manufacturer (and/or its advertising agent) replace thebrowser 117 with another app (e.g., via Publisher C) for delivery of media impressions to mobile devices. For example, the replacement app (e.g., Publisher C) may be selected to be one that has substantially similar or identical lift performance as the app provided byPublisher A 302 ofFIG. 3 . -
FIG. 5 is a block diagram of an exampletransaction information provider 500 that may be used to implement the examplemerchant database proprietor 146 ofFIG. 1 . The exampletransaction information provider 500 includes anexample user authenticator 502, an example account-identifier correlator 504, anexample transaction engine 506, an exampletransaction query generator 508, and anexample transaction reporter 510. The exampletransaction information provider 500 further includes databases including an exampleuser account database 512, anexample product database 514, and anexample transaction database 516. - The
example user authenticator 502 ofFIG. 5 receives user login requests (e.g., from themobile device 106, theapp 116 ofFIG. 1 ). In the example ofFIG. 5 , the user login requests include the examplemerchant account information 148 ofFIG. 1 . Themerchant account information 148 may include a unique account identifier (e.g., a user name, an account number, etc.) and one or more authenticators (e.g., passwords, pass codes, authentication keys, etc.). In the illustrated example, theexample user authenticator 502 verifies the merchant account information 148 (e.g., the account identifier and/or the authenticator(s)) in theuser account database 512, which stores themerchant account information 148 for authentication purposes. - As mentioned above with reference to
FIG. 1 , the example user login request that is authenticated by theuser authenticator 502 also includes a device/user identifier 124 corresponding to the mobile device 106 (e.g., the device/user identifier 124 ofFIG. 1 ). In the example ofFIG. 5 , the device/user identifier 124 is an identifier (e.g., an IMEI number, an IDFA number, etc.) that is not set by either of themerchant database proprietor 146 ofFIG. 1 or thetransaction information provider 500 ofFIG. 5 . Because the device/user identifier 124 is not set by thetransaction information provider 500, thetransaction information provider 500 is required to obtain the device/user identifier 124 from themobile device 106. - The example account-
identifier correlator 504 ofFIG. 5 matches themerchant account information 148 to the device/user identifier 124 included in the request. For example, the account-identifier correlator 504 stores the device/user identifier 124 in theuser account database 512 in association with themerchant account information 148 so that the device/user identifier 124 is associated with the user account at the merchant. Because a user may log in to themerchant database proprietor 146 from multiple devices, the example account-identifier correlator 504 may correlate multiple device/user identifiers 504 to the same merchant account information 148 (e.g., to a same user account). - The
example transaction engine 506 enables users to conduct transactions, such as purchasing products from the merchant database proprietor 146 (e.g., an organization such as a commercial merchant). When a user (e.g., a user having a user account with the merchant database proprietor 146) purchases a product via thetransaction engine 506, theexample transaction engine 506 accesses theproduct database 514 to determine product identifier(s) of the product(s) and/or service(s) purchased in the transaction. Theexample transaction engine 506 stores transaction information (e.g., thetransaction information 150 ofFIG. 1 ) in thetransaction database 516. The stored transaction information may include, for example, the product identifiers involved in the transaction, the time and/or date of the transaction, and the user account associated with the transaction. As discussed below, the device/user identifiers 124 from themobile device 106 may then be matched to the transactions in thetransaction database 516 based on the mapping of user accounts to the device/user identifier 124 in theuser account database 512. - The
example product database 514 may store the same information as theproduct database 204 ofFIG. 2 . In some examples, theproduct database 204 ofFIG. 2 includes a subset of the product identifiers included in theproduct database 514 ofFIG. 5 (e.g., when theproduct database 204 ofFIG. 2 includes product identifiers only for products of interest to the audience measurement entity 108). In some other examples, theproduct database 514 ofFIG. 5 includes a subset of the product identifiers included in theproduct database 204 ofFIG. 2 (e.g., when there are multiplemerchant database proprietors 146 having different products for purchase). - The example
transaction query generator 508 ofFIG. 5 receives requests for transaction information (e.g., from theaudience measurement entity 108 of FIG. 1). For example, thetransaction query generator 508 may receive arequest 152 for transactions that have been performed using an account corresponding to the device/user identifier 124 and that includeproduct information 154. - Upon receipt of such a
request 152, the exampletransaction query generator 508 queries theuser account database 512 to determine a user account (e.g., an account identifier, a user name, etc.) that corresponds to the device/user identifier 124 in therequest 152. The exampleuser account database 512 determines the user account that matches the device/user identifier 124 (e.g., the account previously correlated to the device/user identifier 124 by the account-identifier correlator 504). Theuser account database 512 returns the account identifier to the exampletransaction query generator 508. - Using the account identifier, the example
transaction query generator 508 queries theproduct database 514 using theproduct information 154 in therequest 152 to determine a product identifier used by thetransaction information provider 500 to identify the product (e.g., an internal reference number for the product that is used within thetransaction information provider 500, a universal product code (UPC), an international article number (EAN), a global trade item number (GTIN), a bar code, etc.). For example, a UPC code uniquely identifies a trade item and/or a variant or specific configuration of a trade item, and may be used by thetransaction information provider 500. The exampletransaction query generator 508 then queries thetransaction database 516 using the account identifier (e.g., obtained by querying the user account database 512) and the product identifier (e.g., obtained by querying the product database 514) to identify transactions involving the product that were conducted using the specified account. - The
transaction database 516 returns information describing the identified transactions, including the account identifier, the device identifiers, and the date and time of the transaction. The exampletransaction query generator 508 provides the transaction information returned from the transaction database to thetransaction reporter 510. Theexample transaction reporter 510 ofFIG. 5 returns transaction information 150 to theAME 108 ofFIG. 1 (e.g., in response to a corresponding transaction request 152). In the example ofFIG. 5 , thetransaction reporter 510 converts the information received from thetransaction database 516 to information usable by theAME 108. For example, thetransaction reporter 510 may convert an account identifier associated with a transaction in thetransaction database 516 to a device/user identifier 124 recognizable by the AME 108 (e.g., to the device/user identifier 124 included in thetransaction request 152 and obtained from the transaction query generator 508). Additionally or alternatively, thetransaction reporter 510 may convert a product identifier (e.g., a UPC code, a service code, etc.) used by thetransaction information provider 500 to corresponding product information 154 (e.g., the product information included in thetransaction request 152 and obtained from the transaction query generator 508). - The
example transaction reporter 510 ofFIG. 5 sends thetransaction information 150 to theexample AME 108. TheAME 108 receives thetransaction information 150 and determines the effectiveness of media impressions as described above. - While example manners of implementing the example impression-
transaction analyzer 200 and the transaction information provider have been illustrated inFIGS. 2 and 5 , one or more of the elements, processes and/or devices illustrated inFIGS. 2 and 5 may be combined, divided, re-arranged, omitted, eliminated and/or implemented in any other way. Further, theexample product checker 202, theexample product database 204, the example transaction requester 206, the example impression/transaction matcher 208, theexample group identifier 210, theexample transaction aggregator 212, theexample effectiveness calculator 214, theexample user authenticator 502, the example account-identifier correlator 504, theexample transaction engine 506, the exampletransaction query generator 508, theexample transaction reporter 510, the exampleuser account database 512, theexample product database 514, theexample transaction database 516 and/or, more generally, the example impression-transaction analyzer 200 ofFIG. 2 , and/or the exampletransaction information provider 500 ofFIG. 5 may be implemented using hardware, software, firmware and/or any combination of hardware, software and/or firmware. Thus, for example, any of theexample product checker 202, theexample product database 204, the example transaction requester 206, the example impression/transaction matcher 208, theexample group identifier 210, theexample transaction aggregator 212, theexample effectiveness calculator 214, theexample user authenticator 502, the example account-identifier correlator 504, theexample transaction engine 506, the exampletransaction query generator 508, theexample transaction reporter 510, the exampleuser account database 512, theexample product database 514, the example transaction database and/or, more generally, the example impression-transaction analyzer 200, and/or the exampletransaction information provider 500 could be implemented using one or more analog or digital circuit(s), logical circuit(s), programmable processor(s), application specific integrated circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)) and/or field programmable logic device(s) (FPLD(s)), etc. When reading any of the apparatus or system claims of this patent to cover a purely software and/or firmware implementation, at least one of theexample product checker 202, theexample product database 204, the example transaction requester 206, the example impression/transaction matcher 208, theexample group identifier 210, theexample transaction aggregator 212, theexample effectiveness calculator 214, theexample user authenticator 502, the example account-identifier correlator 504, theexample transaction engine 506, the exampletransaction query generator 508, theexample transaction reporter 510, the exampleuser account database 512, theexample product database 514, and/or theexample transaction database 516 is/are hereby expressly defined to include a tangible computer readable storage device or storage disk such as a memory, a digital versatile disk (DVD), a compact disk (CD), a Blu-ray disk, etc. storing the software and/or firmware. Further still, the example the example impression-transaction analyzer 200 ofFIG. 2 and/or the exampletransaction information provider 500 ofFIG. 5 may include one or more elements, processes and/or devices in addition to, or instead of, those illustrated inFIGS. 2 and/or 5, and/or may include more than one of any or all of the illustrated elements, processes and devices. - Flowcharts representative of example machine readable instructions for implementing the example
audience measurement entity 108, theaudience measurement server 132, and/or the examplemerchant database proprietor 146 ofFIG. 1 , the example impression-transaction analyzer 200 ofFIG. 2 , and/or the exampletransaction information provider 500 ofFIG. 5 are shown inFIGS. 6-11 . In these examples, the machine readable instructions comprise one or more programs for execution by a processor such as theprocessor 1212 shown in theexample processor platform 1200 discussed below in connection withFIG. 12 . The program(s) may be embodied in software stored on a tangible computer readable storage medium such as a CD-ROM, a floppy disk, a hard drive, a digital versatile disk (DVD), a Blu-ray disk, or a memory associated with theprocessor 1212, but the entire program(s) and/or parts thereof could alternatively be executed by a device other than theprocessor 1212 and/or embodied in firmware or dedicated hardware. Further, although the example one or more programs are described with reference to the flowcharts illustrated inFIGS. 6-11 , many other methods of implementing the example impression data compensator 200 may alternatively be used. For example, the order of execution of the blocks may be changed, and/or some of the blocks described may be changed, eliminated, or combined. - As mentioned above, the example processes of
FIGS. 6-11 may be implemented using coded instructions (e.g., computer and/or machine readable instructions) stored on a tangible computer readable storage medium such as a hard disk drive, a flash memory, a read-only memory (ROM), a compact disk (CD), a digital versatile disk (DVD), a cache, a random-access memory (RAM) and/or any other storage device or storage disk in which information is stored for any duration (e.g., for extended time periods, permanently, for brief instances, for temporarily buffering, and/or for caching of the information). As used herein, the term tangible computer readable storage medium is expressly defined to include any type of computer readable storage device and/or storage disk and to exclude propagating signals and transmission media. As used herein, “tangible computer readable storage medium” and “tangible machine readable storage medium” are used interchangeably. Additionally or alternatively, the example processes ofFIGS. 6-11 may be implemented using coded instructions (e.g., computer and/or machine readable instructions) stored on a non-transitory computer and/or machine readable medium such as a hard disk drive, a flash memory, a read-only memory, a compact disk, a digital versatile disk, a cache, a random-access memory and/or any other storage device or storage disk in which information is stored for any duration (e.g., for extended time periods, permanently, for brief instances, for temporarily buffering, and/or for caching of the information). As used herein, the term non-transitory computer readable medium is expressly defined to include any type of computer readable storage device and/or storage disk and to exclude propagating signals and transmission media. As used herein, when the phrase “at least” is used as the transition term in a preamble of a claim, it is open-ended in the same manner as the term “comprising” is open ended. -
FIG. 6 is a flow diagram representative of example machinereadable instructions 600 which may be executed to implement the exampleaudience measurement server 132 ofFIG. 1 and/or the example impression-transaction analyzer 200 ofFIG. 2 to associate media impressions to transaction information. Theexample instructions 600 ofFIG. 6 will be described with reference to the example impression-transaction analyzer 200 ofFIG. 2 . - The
example product checker 202 ofFIG. 2 receives media impression information from mobile devices (e.g., themobile device 106 ofFIG. 1 ) (block 602). In the illustrated example, the received media impression information includes a device/user identifier such as the device/user identifier 124 ofFIG. 1 . Example types of the device/user identifier 124 received in the media impression information include hardware identifiers (e.g., an international mobile equipment identity (IMEI), a mobile equipment identifier (MEID), a media access control (MAC) address, etc.), an app store identifier (e.g., a Google Android ID, an Apple ID, an Amazon ID, etc.), an open source unique device identifier (OpenUDID), an open device identification number (ODIN), a login identifier (e.g., a username), an email address, user agent data (e.g., application type, operating system, software vendor, software revision, etc.), third-party service identifiers (e.g., an “Identifier for Advertising” (IDFA), advertising service identifiers, device usage analytics service identifiers, demographics collection service identifiers), web storage data, document object model (DOM) storage data, local shared objects (also referred to as “Flash cookies”), etc. - The
example product checker 202 determines product information associated with the media impression information (block 604). For example, theproduct checker 202 may access (e.g., query) theproduct database 204 ofFIG. 2 to determine an identifier of a product that is represented in a media impression at themobile device 106 and which resulted in receiving the media impression information inblock 602. - The example transaction requester 206 requests transaction information from a merchant database proprietor (e.g., the
merchant database proprietor 146 ofFIG. 1 ) based on the device/user identifier 124 (e.g., determined in block 602) and/or based on the product information (e.g., determined in block 604) (block 606). For example, thetransaction requester 206 may generate atransaction request 152 ofFIG. 1 including the device/user identifier 124 and/or theproduct information 154, and send thetransaction request 152 to themerchant database proprietor 146. - The example transaction requester 206 receives
transaction information 150 from the merchant database proprietor 146 (block 608). Thetransaction information 150 may include, for example, a unique transaction identifier, a device/user identifier 124, a product identifier, and/or a time/date at which the transaction occurred.Example transaction information 150 is shown in Table 2 above. If a transaction performed at themerchant database proprietor 146 involved multiple products, the example transaction requester 206 may receive multiple records, each representing one product involved in the transaction. - The example impression/
transaction matcher 208 associates transactions involving a product with media impressions corresponding to the product (block 610). For example, the impression/transaction matcher 208 may match impression information (e.g., impression records such as those illustrated in Table 1 above) to transaction information (e.g., transaction records such as those illustrated in Table 2 above) by determining that a media impression corresponds to a same device/user identifier 124 as a transaction and that the media impression represents a product involved in the transaction. In some examples, the impression/transaction matcher 208 matches media impressions to transactions. For example, the impression/transaction matcher 208 may determine that an impression occurred prior to a transaction based on respective times/dates of the impression and the transaction. Example instructions that may be used to implement block 610 are described below with reference toFIG. 7 . - When the appropriate media impressions and transactions have been associated (block 610), the
example effectiveness calculator 214 ofFIG. 2 determines a media effectiveness and/or a publisher effectiveness (block 612). For example, theeffectiveness calculator 214 may determine whether media impressions delivered via a first publisher (e.g., theapp publisher 110, the media publisher 120) result in a higher sales lift (e.g., a larger sales increase). Additionally or alternatively, theexample effectiveness calculator 214 may determine a media effectiveness of the media corresponding to the impressions by calculating a sales lift from a first time period prior to beginning a media campaign to a second time period subsequent to beginning the media campaign to determine an effect of the media on sales of the represented product. Theexample instructions 600 ofFIG. 6 end. -
FIG. 7 is a flow diagram representative of example machinereadable instructions 700 which may be executed to implement the exampleaudience measurement server 132 ofFIG. 1 and/or the example impression-transaction analyzer 200 ofFIG. 2 to correlate transactions involving a product to media impressions corresponding to the product. In some examples, theexample instructions 700 ofFIG. 7 may be performed to implement block 610 ofFIG. 6 . Theexample instructions 700 ofFIG. 7 will be described with reference to the example impression-transaction analyzer 200 ofFIG. 2 . - The
example instructions 700 begin afterblock 608 ofFIG. 6 (e.g., receiving transaction information). The example impression/transaction matcher 208 ofFIG. 2 selects a media impression from the media impression information (block 702). For example, the impression/transaction matcher 208 may select a media impression record from the records of Table 1 above. In this example, the impression/transaction matcher 208 selects the first example record of Table 1 above (e.g., Impression ID 11). - The example impression/
transaction matcher 208 determines a product represented by the media corresponding to the selected media impression (block 704). For example, the impression/transaction matcher 208 may determine the Product ID, from Table 1 above, that corresponds to the selected impression ID. In this example, the determined Product ID is R9ANT20EJY. - The example impression/
transaction matcher 208 ofFIG. 2 also determines a device/user identifier 124 corresponding to the selected media impression (block 706). For example, the impression/transaction matcher 208 may determine the Device/User ID, from Table 1 above, that corresponds to the selected impression ID. In this example, the determined Device/User ID is HOI35JGETR. - The example impression/
transaction matcher 208 selects a transaction from the transaction information (block 708). For example, the impression/transaction matcher 208 may select a transaction record from the records of Table 2 above. In this example, the impression/transaction matcher 208 selects the first example record of Table 2 above (e.g., Transaction ID 21). - The example impression/
transaction matcher 208 determines a product purchased in the transaction corresponding to the selected transaction (block 710). For example, the impression/transaction matcher 208 may determine the Product ID, from Table 2 above, that corresponds to the selected Transaction ID. In this example, the determined Product ID is R9ANT20EJY. - The example impression/
transaction matcher 208 ofFIG. 2 also determines a device/user identifier 124 corresponding to an account used to perform the selected transaction (block 712). For example, the impression/transaction matcher 208 may determine the Device/User ID, from Table 1 above, that corresponds to the selected Transaction ID. In this example, the determined Device/User ID is HOI35JGETR. - The example impression/
transaction matcher 208 determines whether the selected media impression matches the selected transaction based on the respective products and the respective device/user identifiers (block 714). For example, the impression/transaction matcher 208 compares the Device/User ID of the selected impression (e.g., Device/User ID HOI35JGETR) to the Device/User ID of the selected transaction (e.g., Device/User ID HOI35JGETR) and compares the Product ID of the selected impression (e.g., Product ID R9ANT20EJY) to the Product ID of the selected transaction (e.g., Product ID R9ANT20EJY). - If the selected media impression matches the selected transaction (block 714), the example impression/
transaction matcher 208 ofFIG. 2 determines whether a time/date of the selected media impression occurred prior to the time/date of the selected transaction (block 716). For example, the impression/transaction matcher 208 compares the time/date of the selected impression (e.g., 2014-07-08:09:15:00) to the time/date of the selected transaction (block 2014-07-09:19:12:00). If the time/date of the selected media impression occurred prior to the time/date of the selected transaction (block 716), the example impression/transaction matcher 208 associates the selected transaction to the selected media impression (block 718). By associating the selected transaction to the selected media impression (block 718), the example impression/transaction matcher 208 may infer that the media impression may have contributed or did actually contribute to the occurrence of the transaction (e.g., media corresponding to the media impression influenced a user to make the transaction). - If the time/date of the selected media impression does not occur prior to the time/date of the selected transaction (block 716), or if the selected media impression does not match the selected transaction (block 714), the example impression/
transaction matcher 208 determines whether there are additional transactions to compare to the selected media impression (block 720). If there are additional transactions to compare to the selected media impression (block 720), control returns to block 708 to select another transaction (e.g., to select another transaction record from Table 2). - If there are no more transactions to compare to the selected media impression (block 720), or after associating the selected transaction to the selected media impression (block 718), the example impression/
transaction matcher 208 determines whether there are additional media impressions (block 722). If there are additional media impressions (block 722), control returns to block 702 to select another media impression. When there are no more media impressions (block 722), theexample instructions 700 ofFIG. 7 end and control returns to a calling function or process such as the example instructions ofFIG. 6 . -
FIGS. 8A and 8B show a flow diagram representative of example machinereadable instructions 800 which may be executed to implement the exampleaudience measurement server 132 ofFIG. 1 and/or the example impression-transaction analyzer 200 ofFIG. 2 to determine media and publisher effectiveness. In some examples, theexample instructions 800 ofFIGS. 8A and 8B may be performed to implement block 612 ofFIG. 6 . Theexample instructions 800 ofFIGS. 8A and 8B will be described with reference to the example impression-transaction analyzer 200 ofFIG. 2 . - The
example group identifier 210 ofFIG. 2 selects a publisher (block 802). For example, thegroup identifier 210 may select an app publisher (e.g., a publisher of theapp 116 ofFIG. 1 , a publisher of thebrowser 117 ofFIG. 1 , etc.) and/or a media publisher (e.g., a publisher ofmedia 118 presented on themobile device 106 ofFIG. 1 via theapp 116 and/or via the browser 117). - The
example group identifier 210 assigns device/user identifiers 124 that correspond to media impressions for media of interest and that are presented by the selected publisher to an “exposed group” that corresponds to the selected publisher (block 804). The exposed group for the selected publisher therefore includes device/user identifiers 124 of thosemobile devices 106 from whichimpression data 130, specifying the media of interest and the selected publisher, has been received. For example, if the selected publisher is a publisher of theapp 116, the exposed group for the selected publisher includes the device/user identifiers 124 formobile devices 106 on which media impressions have occurred using the app 116 (e.g., according to theimpression data 130 reporting the media impressions to the AME 108). - The
example transaction aggregator 212 determines a number of transactions that correspond to the device/user identifiers 124 in the exposed group for the selected publisher (block 806). For example, thetransaction aggregator 212 may determine a number of transactions that match the device/user identifiers 124. The identification of matching transactions may be performed prior to executing the instructions 800 (e.g., by the impression/transaction matcher 208), such as by executingblock 610 ofFIG. 6 and/or by executing theinstructions 700 ofFIG. 7 . - The
example transaction aggregator 212 calculates a proportion of the exposed group for the selected publisher that purchased the product represented in the media of interest (block 808). For example, thetransaction aggregator 212 determines the number of the device/user identifiers 124 that were associated with a media impression that matched a transaction, as a percentage of the total number of device/user identifiers 124 in the exposed group. Theexample transaction aggregator 212 may calculate the proportion the first and/or second time periods, individually and/or together as a single time period. - The
example transaction aggregator 212 ofFIG. 2 assigns transactions associated with the exposed group for the selected publisher to first and second time periods, based on the times/dates of the transactions (block 810). The example first and second time periods may be used to divide transactions into 1) transactions occurring prior to media impressions corresponding to the media of interest (e.g., prior to a media campaign in which the media is to be delivered to mobile devices to cause media impressions) and, therefore, not having any effect on sales of the product represented in the media and 2) transactions occurring after media impressions corresponding to the media of interest have begun (e.g., subsequent to the initiation of the media campaign, such as during and/or after the media campaign) and, therefore, potentially having an effect on sales of the product. - The
example group identifier 210 determines a set of device/user identifiers 124 that are not associated with media impressions for the media of interest (block 812). For example, thegroup identifier 210 may use device/user identifiers 124 associated with media impressions for media other than the media of interest, where the impression-transaction analyzer 200 has not receivedimpression data 130 indicating an impression of the media of interest occurring in association with the device/user identifier 124. In some examples, thegroup identifier 210 may use device/user identifiers 124 and/orimpression data 130 from other media campaigns (e.g., media campaigns not associated with the media of interest, in which other media is presented at the mobile devices) and verify that the device/user identifiers 124 have not had a media impression of the media of interest. - The
example group identifier 210 assigns the set of device/user identifiers 124 to a “control group” corresponding to the selected publisher (block 814). The control group represents device/user identifiers 124 and/ormobile devices 106 that have not been exposed to the media of interest. - The example transaction requester 206 requests transaction information for the device/user identifiers in the control group from the merchant database proprietor 146 (block 816). For example, the
transaction requester 206 may send one ormore transaction requests 152 including the device/user identifiers 124 in the control group andproduct information 154 for a product represented in the media of interest (e.g., the same product used in block 808). - The
example transaction aggregator 212 ofFIG. 2 assigns transactions associated with the control group for the selected publisher to first and second time periods, based on the times/dates of the transactions (block 818). The example first and second time periods may be used to divide transactions into the first and second time periods described above with reference to block 810 (e.g., to facilitate comparison of control group and the exposed group during the same time periods). - Based on
transaction information 150 received from the merchant database proprietor 146 (e.g., in response to the request of block 814), theexample transaction aggregator 212 ofFIG. 2 calculates a proportion of the control group for the selected publisher that purchased the product represented in the media of interest (block 820). For example, thetransaction aggregator 212 determines a number of the device/user identifiers 124 in the control group for which transactions including the product were received from themerchant database proprietor 146 in response to the request ofblock 816. Theexample transaction aggregator 212 may calculate the proportion for the first and/or second time periods, individually and/or together as a single time period. - The
example group identifier 210 determines whether there are any additional publishers (block 822). If there are additional publishers (block 822), control returns to block 802 to select another publisher. - When there are no more publishers, control is passed to block 824 of
FIG. 8B , where theexample effectiveness calculator 214 ofFIG. 2 compares proportions of sales for each of the publishers to determine a publisher effectiveness by sales differences. Using the table 300 and theexample publishers FIG. 3 , theexample effectiveness calculator 214 may compare the exposedgroup sales 312 of Publisher A 302 (e.g., 22,100 sales from 35,400 device/user identifiers, or 62.4% of the exposed group) to exposedgroup sales 312 of Publisher B 304 (e.g., 10,600 sales from 30,100 device/user identifiers, or 35.2% of the exposed group). - The
example effectiveness calculator 214 ofFIG. 2 determines a sales lift, for each of the example publishers, between the control group and the exposed group and between the first time period and the second time period (block 826). For example, using the example ofFIG. 3 described above, thesales lift 314 forPublisher A 302 is the increase in the sales proportion between the control group (e.g., 34.4%) and the exposed group (e.g., 62.4%), or 81.3% (e.g., the percentage of sales in the exposed group forpublisher A 302 divided by the percentage of sales in the control group for publisher A 302 (62.4%/34.4%)). Similarly, thesales lift 314 forPublisher B 304 is the increase in the sales proportion between the control group (e.g., 32%) and the exposed group (e.g., 35.2%), or 10% (e.g., the percentage of sales in the exposed group forpublisher B 304 divided by the percentage of sales in the control group for publisher B 304 (35.2%/32%)). - The
example effectiveness calculator 214 compares the sales lift for each of theexample publishers effectiveness calculator 214 compares the sales lift 314 of the Publisher A 302 (e.g., 81.3%) to the sales lift 314 of the Publisher B 304 (e.g., 10%). In this example, theeffectiveness calculator 214 may determine thatPublisher A 302 is more effective thanPublisher B 304 for the media of interest.Publisher A 302 may be more effective thanPublisher B 304 because, for example,Publisher A 302 may reach an audience that is more likely to be influenced by the media of interest. - The
example effectiveness calculator 214 determines a media effectiveness for the media of interest based on a difference in the changes in sales between the first time period and the second time period for each of the control group and the exposed group (block 830). For example, theeffectiveness calculator 214 may compare A) the change in sales for the control group between the first time period (e.g., 10% of the device/user identifiers in the control group purchased the product of interest during the first time period) and the second time period (e.g., 12% of the device/user identifiers in the control group purchased the product of interest during the second time period) to B) the change in sales for the exposed group between the first time period (e.g., 16% of the device/user identifiers in the exposed group purchased the product of interest during the first time period) and the second time period (e.g., 46% of the device/user identifiers in the exposed group purchased the product of interest during the second time period). By comparing the changes in sales across the time periods between the groups, theexample effectiveness calculator 214 controls for extraneous influences (e.g., non-mobile device media impressions for the same product) to more accurately capture the effect of the media of interest. - The
example instructions 800 ofFIGS. 8A and 8B then end and, for example, control returns to a calling function or process such as the example instructions ofFIG. 6 . -
FIG. 9 is a flow diagram representative of example machinereadable instructions 900 which may be executed to implement the examplemerchant database proprietor 146 ofFIG. 1 and/or the exampletransaction information provider 500 ofFIG. 5 to associate device/user identifiers to merchant database proprietor accounts. Theexample instructions 900 are described with reference to the exampletransaction information provider 500 ofFIG. 5 . - The
example user authenticator 502 ofFIG. 5 receives a request from a mobile device (e.g.,merchant account information 148 from themobile device 106 ofFIG. 1 , theapp 116 ofFIG. 1 ) to access an account at the merchant database proprietor for performing a transaction (block 902). For example, thetransaction information provider 500 may enable authenticated users to view and/or purchase products from thetransaction information provider 500 and/or through the systems of thetransaction information provider 500. - The
example user authenticator 502 determines whether the request is authenticated (block 904). For example, theuser authenticator 502 may use any past, present, or future authentication techniques to authenticate themerchant account information 148 included in the request. - If the request is authenticated (block 904), the example account-
identifier correlator 504 ofFIG. 5 extracts a device/user identifier (e.g., the device/user identifier 124 ofFIG. 1 ) from the request (block 906). Example types of a device/user identifier 124 that may be extracted include hardware identifiers (e.g., an international mobile equipment identity (IMEI), a mobile equipment identifier (MEID), a media access control (MAC) address, etc.), an app store identifier (e.g., a Google Android ID, an Apple ID, an Amazon ID, etc.), an open source unique device identifier (OpenUDID), an open device identification number (ODIN), a login identifier (e.g., a username), an email address, user agent data (e.g., application type, operating system, software vendor, software revision, etc.), third-party service identifiers (e.g., an “Identifier for Advertising” (IDFA), advertising service identifiers, device usage analytics service identifiers, demographics collection service identifiers), web storage data, document object model (DOM) storage data, local shared objects (also referred to as “Flash cookies”), etc. In some examples, thetransaction information provider 500 agrees with theAME 108 ahead of time on a same type of device/user identifier 124 that is accessible to both entities. - The example account-
identifier correlator 504 determines whether the extracted device/user identifier 124 is stored in association with any accounts in theuser account database 512 ofFIG. 5 (block 908). For example, theuser account database 512 stores associations of device/user identifiers 124 and user accounts. - When the extracted device/
user identifier 124 is not yet stored in association with any accounts in theuser account database 512 ofFIG. 5 (block 908), the example account-identifier correlator 504 stores the extracted device/user identifier 124 in association with the authenticated account (block 910). For example, the account-identifier correlator 504 stores the extracted device/user identifier 124 in theuser account database 512 and indicates that the extracted device/user identifier 124 corresponds to the user account. - After storing the device/user identifier 124 (block 910), if the extracted device/
user identifier 124 is associated with an accounts in theuser account database 512 ofFIG. 5 (block 908), or if the request to access the account is not authenticated (block 904), theexample instructions 900 ofFIG. 9 end. -
FIG. 10 is a flow diagram representative of example machinereadable instructions 1000 which may be executed to implement the examplemerchant database proprietor 146 ofFIG. 1 and/or the exampletransaction information provider 500 ofFIG. 5 to provide transaction information. Theexample instructions 1000 are described with reference to the exampletransaction information provider 500 ofFIG. 5 . - The example
transaction query generator 508 ofFIG. 5 receives a transaction request including a device/user identifier 124 (block 1002). For example, thetransaction query generator 508 may receive atransaction request 152 from theAME 108 ofFIG. 1 . - The example
transaction query generator 508 retrieves account information corresponding to the device/user identifier 124 in the request 152 (block 1004). For example, thetransaction query generator 508 may query theuser account database 512 ofFIG. 5 using the device/user identifier 124, and theuser account database 512 determines whether the device/user identifier 124 corresponds to a user account stored in theuser account database 512. - The example
transaction query generator 508 determines whether the device/user identifier 124 is associated with an account identifier (block 1006). For example, the device/user identifier 124 may have been previously stored in association with an account identifier in theuser account database 512 using theexample instructions 900 ofFIG. 9 . - When the device/
user identifier 124 is associated with an account identifier (block 1006), the exampletransaction query generator 508 ofFIG. 5 retrieves transactions performed using the account corresponding to the account identifier (e.g., the account identifier determined in block 1006) (block 1008). For example, thetransaction query generator 508 may query thetransaction database 516 ofFIG. 5 using the account identifier to determine the transactions performed using the account identifier. Thetransaction database 516 provides transaction information for each retrieved transaction, such as a device/user identifier, a transaction identifier, products purchased in the transaction, and a time/date the transaction occurred. - The example
transaction query generator 508 determines whether thetransaction request 152 includes a time/date range (block 1010). For example, thetransaction request 152 may specify a time/date range of interest (e.g., a time/date prior to which transactions are not desired). The time/date range may be closed or open-ended. If the transaction request includes a time/date range (block 1010), the exampletransaction query generator 508 filters the retrieved transactions (e.g., the transactions from block 1008) to remove transactions falling outside the time/date range specified in thetransaction request 152. - After filtering the retrieved transactions (block 1012), or if the
transaction request 152 does not include a time/date range (block 1010), the exampletransaction query generator 508 determines whether thetransaction request 152 includes product information (e.g., theproduct information 154 ofFIG. 1 ) (block 1014).Example product information 154 specifies a product of interest to the AME 108 (e.g., a product that is represented in media corresponding to a media impression at a mobile device 106). - If the transaction request includes product information 154 (block 1014), the example
transaction query generator 508 retrieves a product identifier based on the product information 154 (block 1016). For example, thetransaction query generator 508 may query theproduct database 514 ofFIG. 5 to determine a product identifier that corresponds to theproduct information 154 specified by theAME 108 in therequest 152. The exampletransaction query generator 508 filters the retrieved transactions to remove transactions that do not include the product identifier (block 1018). - After filtering the retrieved transactions (block 1018), or if the
transaction request 152 does not include product information 154 (block 1014), theexample transaction reporter 510 returns the transaction information 150 (e.g., the transaction information remaining after filtering inblock 1012 and/or block 1018) to theAME 108 in response to the transaction request 152 (block 1020). For example, thetransaction reporter 510 may send one or more transaction records (e.g., the example records illustrated in Table 2 above), including a Transaction ID, a Product ID, a Device/User ID, and/or a Time/Date, to theexample AME 108 as a response to thetransaction request 152. - After returning the transaction information (block 1020), or if the device/
user identifier 124 is not associated with an account identifier (block 1006), theexample instructions 1000 ofFIG. 10 end. -
FIG. 11 is a flow diagram representative of example machinereadable instructions 1100 which may be executed to implement the examplemerchant database proprietor 146 ofFIG. 1 and/or the exampletransaction information provider 500 ofFIG. 5 to provide transaction information. In contrast to theexample instructions 1000 ofFIG. 10 described above, theinstructions 1100 ofFIG. 11 may be executed when, for example, atransaction request 152 from theAME 108 ofFIG. 1 does not include a device/user identifier 124. Theexample instructions 1100 are described with reference to the exampletransaction information provider 500 ofFIG. 5 . - The example
transaction query generator 508 ofFIG. 5 receives a transaction request (e.g., atransaction request 152 from the AME 108) that includes product information (e.g., theproduct information 154 ofFIG. 1 ) (block 1102). - The example
transaction query generator 508 retrieves a product identifier based on the product information 154 (block 1104). For example, thetransaction query generator 508 may query theproduct database 514 ofFIG. 5 to determine a product identifier that corresponds to theproduct information 154 specified by theAME 108 in therequest 152. - The example
transaction query generator 508 ofFIG. 5 retrieves transaction records that include the product identifier (e.g., the product retrieved in block 1104) (block 1106). For example, thetransaction query generator 508 may query thetransaction database 516 ofFIG. 5 using the product identifier to determine all of the performed transactions involving the product corresponding to the product identifier. In response to the query, thetransaction database 516 provides transaction information for each identified transaction, such as a device/user identifier, a transaction identifier, products purchased in the transaction, and a time/date the transaction occurred. - The example
transaction query generator 508 selects a transaction from the retrieved transactions (block 1108). The exampletransaction query generator 508 looks up an account used to perform the selected transaction in an account database to identify a device/user identifier 124 corresponding to the account (block 1110). For example, thetransaction query generator 508 may look up an account specified in the selected transaction record, which is used to query theuser account database 512 to determine whether any device/user identifiers correspond to the account. - The
transaction query generator 508 determines whether the account used to perform the selected transaction is associated with a device/user identifier 124 (block 1112). If the account used to perform the selected transaction is associated with a device/user identifier 124 (block 1112), the exampletransaction query generator 508 determines whether thetransaction request 152 includes a time/date range (block 1114). For example, thetransaction request 152 may specify a time/date range of interest (e.g., a time/date prior to which transactions are not desired). The time/date range may be closed or open-ended. - If the
transaction request 152 includes a time/date range (block 1114), the exampletransaction query generator 508 determines whether the time/date of the selected transaction falls within the time/date range (block 1116). If the time/date of the selected transaction does not fall within the time/date range (block 1116), or if the account used to perform the selected transaction is not associated with a device/user identifier 124 (block 1112), the exampletransaction query generator 508 removes the selected transaction from the retrieved transactions (e.g., the transactions from block 1106). - After removing the selected transaction (block 1118), or if 1) the account used to perform the selected transaction is associated with a device/user identifier 124 (block 1112) and 2) either A) the time/date of the selected transaction falls within the time/date range (block 1116) or B) the
transaction request 152 does not include a time/date range (block 1114), the exampletransaction query generator 508 determines whether there are additional retrieved transactions (block 1120). If there are additional retrieved transactions (block 1120), control returns to block 1108 to select another transaction. - When there are no more retrieved transactions (block 1120), the
example transaction reporter 510 returns the transaction information 150 (e.g., the transaction information remaining after filtering in blocks 1110-1118) to theexample AME 108 in response to the transaction request 152 (block 1122). For example, thetransaction reporter 510 may return one or more transaction records (e.g., the example records illustrated in Table 2 above), including a Transaction ID, a Product ID, a Device/User ID, and/or a Time/Date, to theAME 108. Theexample instructions 1100 ofFIG. 11 then end. -
FIG. 12 is a block diagram of anexample processor platform 1200 capable of executing the instructions ofFIGS. 6 , 7, 8, 9, 10, and/or 11 to implement theexample product checker 202, theexample product database 204, the example transaction requester 206, the example impression/transaction matcher 208, theexample group identifier 210, theexample transaction aggregator 212, theexample effectiveness calculator 214, theexample user authenticator 502, the example account-identifier correlator 504, theexample transaction engine 506, the exampletransaction query generator 508, theexample transaction reporter 510, the exampleuser account database 512, theexample product database 514, theexample transaction database 516 and/or, more generally, the exampleaudience measurement entity 108, the exampleaudience measurement server 132, and/or the examplemerchant database proprietor 146 ofFIG. 1 , the example impression-transaction analyzer 200 ofFIG. 2 , and/or the exampletransaction information provider 500 ofFIG. 5 . Theprocessor platform 1200 can be, for example, a server, a personal computer, a mobile device (e.g., a cell phone, a smart phone, a tablet such as an iPad™ tablet), an Internet appliance, or any other type of computing device. - The
processor platform 1200 of the illustrated example includes aprocessor 1212. Theprocessor 1212 of the illustrated example is hardware. For example, theprocessor 1212 can be implemented by one or more integrated circuits, logic circuits, microprocessors or controllers from any desired family or manufacturer. - The
processor 1212 of the illustrated example includes a local memory 1213 (e.g., a cache). Theprocessor 1212 of the illustrated example is in communication with a main memory including avolatile memory 1214 and anon-volatile memory 1216 via abus 1218. Thevolatile memory 1214 may be implemented by Synchronous Dynamic Random Access Memory (SDRAM), Dynamic Random Access Memory (DRAM), RAMBUS Dynamic Random Access Memory (RDRAM) and/or any other type of random access memory device. Thenon-volatile memory 1216 may be implemented by flash memory and/or any other desired type of memory device. Access to themain memory - The
processor platform 1200 of the illustrated example also includes aninterface circuit 1220. Theinterface circuit 1220 may be implemented by any type of interface standard, such as an Ethernet interface, a universal serial bus (USB), and/or a PCI express interface. - In the illustrated example, one or
more input devices 1222 are connected to theinterface circuit 1220. The input device(s) 1222 permit(s) a user to enter data and commands into theprocessor 1212. The input device(s) can be implemented by, for example, an audio sensor, a microphone, a camera (still or video), a keyboard, a button, a mouse, a touchscreen, a track-pad, a trackball, isopoint and/or a voice recognition system. - One or
more output devices 1224 are also connected to theinterface circuit 1220 of the illustrated example. Theoutput devices 1224 can be implemented, for example, by display devices (e.g., a light emitting diode (LED), an organic light emitting diode (OLED), a liquid crystal display, a cathode ray tube display (CRT), a touchscreen, a tactile output device, a light emitting diode (LED), a printer and/or speakers). Theinterface circuit 1220 of the illustrated example, thus, typically includes a graphics driver card, a graphics driver chip or a graphics driver processor. - The
interface circuit 1220 of the illustrated example also includes a communication device such as a transmitter, a receiver, a transceiver, a modem and/or network interface card to facilitate exchange of data with external machines (e.g., computing devices of any kind) via a network 1226 (e.g., an Ethernet connection, a digital subscriber line (DSL), a telephone line, coaxial cable, a cellular telephone system, etc.). - The
processor platform 1200 of the illustrated example also includes one or moremass storage devices 1228 for storing software and/or data. Examples of suchmass storage devices 1228 include floppy disk drives, hard drive disks, compact disk drives, Blu-ray disk drives, RAID systems, and digital versatile disk (DVD) drives. -
Coded instructions 1232 to implement the example machine readable instructions ofFIGS. 6 , 7, 8, 9, 10, and/or 11 may be stored in themass storage device 1228, in thevolatile memory 1214, in thenon-volatile memory 1216, and/or on a removable tangible computer readable storage medium such as a CD or DVD. - Although certain example methods, apparatus and articles of manufacture have been disclosed herein, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all methods, apparatus and articles of manufacture fairly falling within the scope of the claims of this patent.
Claims (23)
Priority Applications (9)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/473,654 US20160063539A1 (en) | 2014-08-29 | 2014-08-29 | Methods and apparatus to associate transactions with media impressions |
EP14004028.8A EP2991018A1 (en) | 2014-08-29 | 2014-11-28 | Methods and apparatus to associate transactions with media impressions |
CA3156903A CA3156903A1 (en) | 2014-08-29 | 2014-11-28 | Methods and apparatus to associate transactions with media impressions |
CA2872704A CA2872704C (en) | 2014-08-29 | 2014-11-28 | Methods and apparatus to associate transactions with media impressions |
CA3040572A CA3040572C (en) | 2014-08-29 | 2014-11-28 | Methods and apparatus to associate transactions with media impressions |
MX2014014747A MX2014014747A (en) | 2014-08-29 | 2014-12-03 | Methods and apparatus to associate transactions with media impressions. |
CN201410858245.8A CN105894313A (en) | 2014-08-29 | 2014-12-03 | Methods And Apparatus To Associate Transactions With Media Impressions |
US16/943,905 US11562394B2 (en) | 2014-08-29 | 2020-07-30 | Methods and apparatus to associate transactions with media impressions |
US18/158,340 US20230162229A1 (en) | 2014-08-29 | 2023-01-23 | Methods and apparatus to associate transactions with media impressions |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/473,654 US20160063539A1 (en) | 2014-08-29 | 2014-08-29 | Methods and apparatus to associate transactions with media impressions |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/943,905 Continuation US11562394B2 (en) | 2014-08-29 | 2020-07-30 | Methods and apparatus to associate transactions with media impressions |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160063539A1 true US20160063539A1 (en) | 2016-03-03 |
Family
ID=52006786
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/473,654 Abandoned US20160063539A1 (en) | 2014-08-29 | 2014-08-29 | Methods and apparatus to associate transactions with media impressions |
US16/943,905 Active US11562394B2 (en) | 2014-08-29 | 2020-07-30 | Methods and apparatus to associate transactions with media impressions |
US18/158,340 Pending US20230162229A1 (en) | 2014-08-29 | 2023-01-23 | Methods and apparatus to associate transactions with media impressions |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/943,905 Active US11562394B2 (en) | 2014-08-29 | 2020-07-30 | Methods and apparatus to associate transactions with media impressions |
US18/158,340 Pending US20230162229A1 (en) | 2014-08-29 | 2023-01-23 | Methods and apparatus to associate transactions with media impressions |
Country Status (5)
Country | Link |
---|---|
US (3) | US20160063539A1 (en) |
EP (1) | EP2991018A1 (en) |
CN (1) | CN105894313A (en) |
CA (3) | CA3040572C (en) |
MX (1) | MX2014014747A (en) |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9596151B2 (en) | 2010-09-22 | 2017-03-14 | The Nielsen Company (Us), Llc. | Methods and apparatus to determine impressions using distributed demographic information |
US9641336B2 (en) | 2013-12-31 | 2017-05-02 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US20170345050A1 (en) * | 2016-05-24 | 2017-11-30 | Trever Gregory | Attribution system and method |
US9912482B2 (en) | 2012-08-30 | 2018-03-06 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US10038968B2 (en) | 2013-07-17 | 2018-07-31 | PlaceIQ, Inc. | Branching mobile-device to system-namespace identifier mappings |
US10068246B2 (en) | 2013-07-12 | 2018-09-04 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US10205994B2 (en) | 2015-12-17 | 2019-02-12 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US10311464B2 (en) * | 2014-07-17 | 2019-06-04 | The Nielsen Company (Us), Llc | Methods and apparatus to determine impressions corresponding to market segments |
US10462609B1 (en) * | 2017-11-06 | 2019-10-29 | Christopher Paul Carroll | Systems and methods for tracking a person |
US20200242658A1 (en) * | 2019-01-24 | 2020-07-30 | Walmart Apollo, Llc | Method and apparatus for determining effectiveness of digital advertisements |
US10956947B2 (en) | 2013-12-23 | 2021-03-23 | The Nielsen Company (Us), Llc | Methods and apparatus to measure media using media object characteristics |
US11245536B2 (en) * | 2019-04-16 | 2022-02-08 | Meta Platforms, Inc. | Secure multi-party computation attribution |
US11562394B2 (en) | 2014-08-29 | 2023-01-24 | The Nielsen Company (Us), Llc | Methods and apparatus to associate transactions with media impressions |
US11856264B2 (en) * | 2016-11-15 | 2023-12-26 | Google Llc | Systems and methods for reducing download requirements |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106600327A (en) * | 2016-12-15 | 2017-04-26 | 有米科技股份有限公司 | iOS advertisement unique identifier generation method |
US11348116B2 (en) * | 2017-11-07 | 2022-05-31 | Mastercard International Incorporated | Systems and methods for enhancing online user authentication using a personal cloud platform |
CN110099252B (en) * | 2019-05-06 | 2021-01-08 | 四川效率源信息安全技术股份有限公司 | Method for converting monitoring video into playable video |
US10984425B1 (en) * | 2020-12-22 | 2021-04-20 | Braze, Inc. | Systems and methods for delivering in-application messages |
Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020128925A1 (en) * | 2000-12-11 | 2002-09-12 | Patrick Angeles | system and method for detecting and reporting online activity using real-time content-based network monitoring |
US20050038900A1 (en) * | 2003-08-14 | 2005-02-17 | Brad Krassner | Internet-based system and method for distributing interstitial advertisements |
US20090018895A1 (en) * | 2007-03-12 | 2009-01-15 | Lee S. Weinblatt | Technique for correlating purchasing behavior of a consumer to advertisements |
US20110066497A1 (en) * | 2009-09-14 | 2011-03-17 | Choicestream, Inc. | Personalized advertising and recommendation |
US20110093324A1 (en) * | 2009-10-19 | 2011-04-21 | Visa U.S.A. Inc. | Systems and Methods to Provide Intelligent Analytics to Cardholders and Merchants |
US20120046996A1 (en) * | 2010-08-17 | 2012-02-23 | Vishal Shah | Unified data management platform |
US20120130799A1 (en) * | 2010-05-20 | 2012-05-24 | Telcordia Technologies, Inc. | System and methodology for determination of advertisement effectiveness |
US20130073388A1 (en) * | 2011-09-15 | 2013-03-21 | Stephan HEATH | System and method for using impressions tracking and analysis, location information, 2d and 3d mapping, mobile mapping, social media, and user behavior and information for generating mobile and internet posted promotions or offers for, and/or sales of, products and/or services |
US20130080259A1 (en) * | 2011-09-26 | 2013-03-28 | American Express Travel Related Services Company, Inc. | Systems and methods for targeting ad impressions |
US20130085894A1 (en) * | 2011-09-30 | 2013-04-04 | Jimmy Honlam CHAN | System and method for presenting product information in connection with e-commerce activity of a user |
US20130268365A1 (en) * | 2012-04-06 | 2013-10-10 | Andrew Gildfind | Method and System for Launching a Generic Marketing Campaign by Pooling Small Advertisers |
US20130290096A1 (en) * | 2012-03-15 | 2013-10-31 | Catalina Marketing Corporation | System and method of measuring lift in a marketing program |
US20140207567A1 (en) * | 2013-01-18 | 2014-07-24 | Digital River, Inc. | Cross Channel Conversion Tracking System and Method |
US20140278981A1 (en) * | 2011-10-06 | 2014-09-18 | Gueorgui Mersov | Automated allocation of media via network |
US20150066586A1 (en) * | 2013-08-28 | 2015-03-05 | Yahoo Japan Corporation | Evaluation calculating device, evaluation calculating method, and recording medium |
US9449290B1 (en) * | 2007-05-04 | 2016-09-20 | At&T Intellectual Property I, L.P. | Product and service purchase-cycle tracking |
US9589271B2 (en) * | 2011-08-05 | 2017-03-07 | American Express Travel Related Services Company, Inc. | Systems and methods for determining ad impression utility |
Family Cites Families (392)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3540003A (en) | 1968-06-10 | 1970-11-10 | Ibm | Computer monitoring system |
US3906450A (en) | 1970-10-09 | 1975-09-16 | Jr Eduardo Da Silva Prado | Electronic system for the recording of periodically sampled variables |
US3818458A (en) | 1972-11-08 | 1974-06-18 | Comress | Method and apparatus for monitoring a general purpose digital computer |
US3906454A (en) | 1973-05-18 | 1975-09-16 | Bell Telephone Labor Inc | Computer monitoring system |
UST955010I4 (en) | 1975-03-12 | 1977-02-01 | International Business Machines Corporation | Hardware/software monitoring system |
US4361832A (en) | 1977-01-28 | 1982-11-30 | Cole Martin T | Automatic centralized monitoring system |
GB1553027A (en) | 1977-05-12 | 1979-09-19 | Marconi Co Ltd | Message signal scrambling apparatus |
US4168396A (en) | 1977-10-31 | 1979-09-18 | Best Robert M | Microprocessor for executing enciphered programs |
US4230990C1 (en) | 1979-03-16 | 2002-04-09 | John G Lert Jr | Broadcast program identification method and system |
US4319079A (en) | 1979-09-13 | 1982-03-09 | Best Robert M | Crypto microprocessor using block cipher |
US4306289A (en) | 1980-02-04 | 1981-12-15 | Western Electric Company, Inc. | Digital computer having code conversion apparatus for an encrypted program |
US4367525A (en) | 1980-06-06 | 1983-01-04 | Tesdata Systems Corporation | CPU Channel monitoring system |
EP0067998B1 (en) | 1980-09-26 | 1986-04-16 | Bo LÖFBERG | Method for processing an information signal and means for carrying out the method |
GB2128453A (en) | 1982-10-08 | 1984-04-26 | Philips Electronic Associated | System identification in communications systems |
US4588991A (en) | 1983-03-07 | 1986-05-13 | Atalla Corporation | File access security method and means |
US4590550A (en) | 1983-06-29 | 1986-05-20 | International Business Machines Corporation | Internally distributed monitoring system |
US4658093A (en) | 1983-07-11 | 1987-04-14 | Hellman Martin E | Software distribution system |
US4558413A (en) | 1983-11-21 | 1985-12-10 | Xerox Corporation | Software version management system |
US4740890A (en) | 1983-12-22 | 1988-04-26 | Software Concepts, Inc. | Software protection system with trial period usage code and unlimited use unlocking code both recorded on program storage media |
US4718005A (en) | 1984-05-03 | 1988-01-05 | International Business Machines Corporation | Distributed control of alias name usage in networks |
US4672572A (en) | 1984-05-21 | 1987-06-09 | Gould Inc. | Protector system for computer access and use |
US4791565A (en) | 1984-06-20 | 1988-12-13 | Effective Security Systems, Inc. | Apparatus for controlling the use of computer software |
US4747139A (en) | 1984-08-27 | 1988-05-24 | Taaffe James L | Software security method and systems |
US4696034A (en) | 1984-10-12 | 1987-09-22 | Signal Security Technologies | High security pay television system |
GB2176639B (en) | 1985-05-31 | 1988-11-23 | Mars Inc | Data acquisition system |
US4685056A (en) | 1985-06-11 | 1987-08-04 | Pueblo Technologies, Inc. | Computer security device |
US4757533A (en) | 1985-09-11 | 1988-07-12 | Computer Security Corporation | Security system for microcomputers |
US4825354A (en) | 1985-11-12 | 1989-04-25 | American Telephone And Telegraph Company, At&T Bell Laboratories | Method of file access in a distributed processing computer network |
US4720782A (en) | 1986-01-13 | 1988-01-19 | Digital Equipment Corporation | Console unit for clustered digital data processing system |
US4734865A (en) | 1986-01-28 | 1988-03-29 | Bell & Howell Company | Insertion machine with audit trail and command protocol |
US4926255A (en) | 1986-03-10 | 1990-05-15 | Kohorn H Von | System for evaluation of response to broadcast transmissions |
US4821178A (en) | 1986-08-15 | 1989-04-11 | International Business Machines Corporation | Internal performance monitoring by event sampling |
US4977594A (en) | 1986-10-14 | 1990-12-11 | Electronic Publishing Resources, Inc. | Database usage metering and protection system and method |
US5050213A (en) | 1986-10-14 | 1991-09-17 | Electronic Publishing Resources, Inc. | Database usage metering and protection system and method |
US4827508A (en) | 1986-10-14 | 1989-05-02 | Personal Library Software, Inc. | Database usage metering and protection system and method |
US4866769A (en) | 1987-08-05 | 1989-09-12 | Ibm Corporation | Hardware assist for protecting PC software |
US4914689A (en) | 1987-12-22 | 1990-04-03 | Bell Mountain States Telephone & Telegraph Co. | Reverse automatic number identification system |
US4943963A (en) | 1988-01-19 | 1990-07-24 | A. C. Nielsen Company | Data collection and transmission system with real time clock |
US4940976A (en) | 1988-02-05 | 1990-07-10 | Utilicom Inc. | Automated remote water meter readout system |
US4956769A (en) | 1988-05-16 | 1990-09-11 | Sysmith, Inc. | Occurence and value based security system for computer databases |
US5023907A (en) | 1988-09-30 | 1991-06-11 | Apollo Computer, Inc. | Network license server |
US4926162A (en) | 1988-10-28 | 1990-05-15 | Honeywell Inc. | High security communication line monitor |
WO1990007828A1 (en) | 1989-01-09 | 1990-07-12 | Kabushikigaisha Shogakuikueisha Kyoikukenkyusho | Apparatus for grasping tv viewing condition in household |
CA2053261A1 (en) | 1989-04-28 | 1990-10-29 | Gary D. Hornbuckle | Method and apparatus for remotely controlling and monitoring the use of computer software |
AU641397B2 (en) | 1989-04-28 | 1993-09-23 | Softel, Inc. | Method and apparatus for remotely controlling and monitoring the use of computer software |
US5086386A (en) | 1990-03-23 | 1992-02-04 | Sun Microsystems, Inc. | Method and apparatus for benchmarking the working set of window-based computer systems |
CA2036205C (en) | 1990-06-01 | 1996-11-19 | Russell J. Welsh | Program monitoring unit |
US5182770A (en) | 1991-04-19 | 1993-01-26 | Geza Medveczky | System and apparatus for protecting computer software |
US5444642A (en) | 1991-05-07 | 1995-08-22 | General Signal Corporation | Computer system for monitoring events and which is capable of automatically configuring itself responsive to changes in system hardware |
US5440738A (en) | 1991-05-16 | 1995-08-08 | Tally Systems Corporation | Method and apparatus for digital data processor file configuration detection |
US5233642A (en) | 1991-05-24 | 1993-08-03 | Omnitronix, Inc. | Cellular telephone usage monitoring system |
US5204897A (en) | 1991-06-28 | 1993-04-20 | Digital Equipment Corporation | Management interface for license management system |
US5406269A (en) | 1991-07-05 | 1995-04-11 | David Baran | Method and apparatus for the remote verification of the operation of electronic devices by standard transmission mediums |
US5355484A (en) | 1991-08-12 | 1994-10-11 | International Business Machines Corporation | Dynamically established event monitors in event management services of a computer system |
US5343239A (en) | 1991-11-20 | 1994-08-30 | Zing Systems, L.P. | Transaction based interactive television system |
JPH05324352A (en) | 1992-05-22 | 1993-12-07 | Nec Corp | Device for monitoring computer usage |
US5287408A (en) | 1992-08-31 | 1994-02-15 | Autodesk, Inc. | Apparatus and method for serializing and validating copies of computer software |
US5377269A (en) | 1992-10-29 | 1994-12-27 | Intelligent Security Systems, Inc. | Security access and monitoring system for personal computer |
US5450134A (en) | 1993-01-12 | 1995-09-12 | Visual Automation Systems, Inc. | Video facility management system for encoding and decoding video signals to facilitate identification of the video signals |
US5483658A (en) | 1993-02-26 | 1996-01-09 | Grube; Gary W. | Detection of unauthorized use of software applications in processing devices |
US5499340A (en) | 1994-01-12 | 1996-03-12 | Isogon Corporation | Method and apparatus for computer program usage monitoring |
JP3400068B2 (en) | 1994-03-18 | 2003-04-28 | 富士通株式会社 | Response amount prediction system |
CA2119970A1 (en) | 1994-03-25 | 1995-09-26 | Michael A. Lyons | Program monitoring system |
IL114359A0 (en) | 1994-06-30 | 1995-10-31 | Walker Asset Management Ltd | System and method for remote gaming |
US5594934A (en) | 1994-09-21 | 1997-01-14 | A.C. Nielsen Company | Real time correlation meter |
US5758257A (en) | 1994-11-29 | 1998-05-26 | Herz; Frederick | System and method for scheduling broadcast of and access to video programs and other data using customer profiles |
WO1996028904A1 (en) | 1995-03-16 | 1996-09-19 | Bell Atlantic Network Services, Inc. | Simulcasting digital video programs for broadcast and interactive services |
US5812928A (en) | 1995-04-12 | 1998-09-22 | Watson Technologies | Cable television control apparatus and method with channel access controller at node of network including channel filtering system |
JPH0944432A (en) | 1995-05-24 | 1997-02-14 | Fuji Xerox Co Ltd | Information processing method and information processor |
US5940738A (en) | 1995-05-26 | 1999-08-17 | Hyundai Electronics America, Inc. | Video pedestal network |
US5675510A (en) | 1995-06-07 | 1997-10-07 | Pc Meter L.P. | Computer use meter and analyzer |
US8574074B2 (en) | 2005-09-30 | 2013-11-05 | Sony Computer Entertainment America Llc | Advertising impression determination |
US6829368B2 (en) | 2000-01-26 | 2004-12-07 | Digimarc Corporation | Establishing and interacting with on-line media collections using identifiers in media signals |
US5848396A (en) | 1996-04-26 | 1998-12-08 | Freedom Of Information, Inc. | Method and apparatus for determining behavioral profile of a computer user |
US5832520A (en) | 1996-07-03 | 1998-11-03 | Miller, Call, Plauck And Miller | Automatic file differencing and updating system |
US6108637A (en) | 1996-09-03 | 2000-08-22 | Nielsen Media Research, Inc. | Content display monitor |
US5870740A (en) | 1996-09-30 | 1999-02-09 | Apple Computer, Inc. | System and method for improving the ranking of information retrieval results for short queries |
US5948061A (en) | 1996-10-29 | 1999-09-07 | Double Click, Inc. | Method of delivery, targeting, and measuring advertising over networks |
US6052730A (en) | 1997-01-10 | 2000-04-18 | The Board Of Trustees Of The Leland Stanford Junior University | Method for monitoring and/or modifying web browsing sessions |
US6035339A (en) | 1997-03-13 | 2000-03-07 | At&T Corporation | Network information delivery system for delivering information based on end user terminal requirements |
US5796952A (en) | 1997-03-21 | 1998-08-18 | Dot Com Development, Inc. | Method and apparatus for tracking client interaction with a network resource and creating client profiles and resource database |
US6643696B2 (en) | 1997-03-21 | 2003-11-04 | Owen Davis | Method and apparatus for tracking client interaction with a network resource and creating client profiles and resource database |
US6247050B1 (en) | 1997-09-12 | 2001-06-12 | Intel Corporation | System for collecting and displaying performance improvement information for a computer |
US6141694A (en) | 1997-09-16 | 2000-10-31 | Webtv Networks, Inc. | Determining and verifying user data |
US6286140B1 (en) | 1997-11-20 | 2001-09-04 | Thomas P. Ivanyi | System and method for measuring and storing information pertaining to television viewer or user behavior |
US6098093A (en) | 1998-03-19 | 2000-08-01 | International Business Machines Corp. | Maintaining sessions in a clustered server environment |
US20020095676A1 (en) | 1998-05-15 | 2002-07-18 | Robert A. Knee | Interactive television program guide system for determining user values for demographic categories |
US6279036B1 (en) | 1998-05-15 | 2001-08-21 | International Business Machines Corporation | Method and apparatus for detecting actual viewing or electronic advertisements |
US7240022B1 (en) | 1998-05-19 | 2007-07-03 | Mypoints.Com Inc. | Demographic information gathering and incentive award system and method |
US6434614B1 (en) | 1998-05-29 | 2002-08-13 | Nielsen Media Research, Inc. | Tracking of internet advertisements using banner tags |
US6223215B1 (en) | 1998-09-22 | 2001-04-24 | Sony Corporation | Tracking a user's purchases on the internet by associating the user with an inbound source and a session identifier |
US7949565B1 (en) | 1998-12-03 | 2011-05-24 | Prime Research Alliance E., Inc. | Privacy-protected advertising system |
US6457010B1 (en) | 1998-12-03 | 2002-09-24 | Expanse Networks, Inc. | Client-server based subscriber characterization system |
US7150030B1 (en) | 1998-12-03 | 2006-12-12 | Prime Research Alliance, Inc. | Subscriber characterization system |
US6684194B1 (en) | 1998-12-03 | 2004-01-27 | Expanse Network, Inc. | Subscriber identification system |
US6164975A (en) | 1998-12-11 | 2000-12-26 | Marshall Weingarden | Interactive instructional system using adaptive cognitive profiling |
US6055573A (en) | 1998-12-30 | 2000-04-25 | Supermarkets Online, Inc. | Communicating with a computer based on an updated purchase behavior classification of a particular consumer |
US6460079B1 (en) | 1999-03-04 | 2002-10-01 | Nielsen Media Research, Inc. | Method and system for the discovery of cookies and other client information |
US6529952B1 (en) | 1999-04-02 | 2003-03-04 | Nielsen Media Research, Inc. | Method and system for the collection of cookies and other information from a panel |
US6721713B1 (en) | 1999-05-27 | 2004-04-13 | Andersen Consulting Llp | Business alliance identification in a web architecture framework |
US7523191B1 (en) | 2000-06-02 | 2009-04-21 | Yahoo! Inc. | System and method for monitoring user interaction with web pages |
US6102406A (en) | 1999-06-07 | 2000-08-15 | Steven A. Miles | Internet-based advertising scheme employing scavenger hunt metaphor |
EP1059599A3 (en) | 1999-06-08 | 2002-09-25 | Nokia Corporation | Method and apparatus for retrieving specific information associated with an obtained indentifier |
US6606657B1 (en) | 1999-06-22 | 2003-08-12 | Comverse, Ltd. | System and method for processing and presenting internet usage information |
US7010497B1 (en) | 1999-07-08 | 2006-03-07 | Dynamiclogic, Inc. | System and method for evaluating and/or monitoring effectiveness of on-line advertising |
AUPQ206399A0 (en) | 1999-08-06 | 1999-08-26 | Imr Worldwide Pty Ltd. | Network user measurement system and method |
US6415323B1 (en) | 1999-09-03 | 2002-07-02 | Fastforward Networks | Proximity-based redirection system for robust and scalable service-node location in an internetwork |
US6839680B1 (en) | 1999-09-30 | 2005-01-04 | Fujitsu Limited | Internet profiling |
US6704787B1 (en) | 1999-12-03 | 2004-03-09 | Intercard Payments, Inc. | Date of birth authentication system and method using demographic and/or geographic data supplied by a subscriber that is verified by a third party |
US7007080B2 (en) | 1999-12-23 | 2006-02-28 | Solution Inc Limited | System for reconfiguring and registering a new IP address for a computer to access a different network without user intervention |
US6691163B1 (en) | 1999-12-23 | 2004-02-10 | Alexa Internet | Use of web usage trail data to identify related links |
US7146329B2 (en) | 2000-01-13 | 2006-12-05 | Erinmedia, Llc | Privacy compliant multiple dataset correlation and content delivery system and methods |
US6993590B1 (en) | 2000-01-13 | 2006-01-31 | Inktomi Corporation | Method of creating data streams for user-specific usage data gathering systems |
US7139723B2 (en) | 2000-01-13 | 2006-11-21 | Erinmedia, Llc | Privacy compliant multiple dataset correlation system |
WO2001052168A1 (en) | 2000-01-14 | 2001-07-19 | Matsushita Electric Industrial Company, Limited | Cookie data stored on transportable recording medium |
US7065503B2 (en) | 2000-01-14 | 2006-06-20 | Matsushita Electric Industrial Co., Ltd. | Cookie data stored on transportable recording medium |
US20130080256A1 (en) | 2011-09-22 | 2013-03-28 | Gregory A. Piccionelli | Telepresence system for providing information to a user through an agent based on the location of the agent |
US7181412B1 (en) | 2000-03-22 | 2007-02-20 | Comscore Networks Inc. | Systems and methods for collecting consumer data |
US7260837B2 (en) | 2000-03-22 | 2007-08-21 | Comscore Networks, Inc. | Systems and methods for user identification, user demographic reporting and collecting usage data usage biometrics |
US7930285B2 (en) | 2000-03-22 | 2011-04-19 | Comscore, Inc. | Systems for and methods of user demographic reporting usable for identifying users and collecting usage data |
JP2001338176A (en) | 2000-03-23 | 2001-12-07 | Casio Comput Co Ltd | Method and system for information transmission and intermediation |
JP2001282982A (en) | 2000-03-28 | 2001-10-12 | Hisahiro Negi | Web marketing system |
US7039699B1 (en) | 2000-05-02 | 2006-05-02 | Microsoft Corporation | Tracking usage behavior in computer systems |
US7962603B1 (en) | 2000-06-06 | 2011-06-14 | Nobuyoshi Morimoto | System and method for identifying individual users accessing a web site |
JP2001357192A (en) | 2000-06-12 | 2001-12-26 | Toshiba Corp | Method and system for customer awareness research and storage medium storing program |
KR100765735B1 (en) | 2000-07-03 | 2007-10-15 | 삼성전자주식회사 | System for protecting user information using internet and method thereof |
WO2002007054A2 (en) | 2000-07-18 | 2002-01-24 | Yahoo Inc. | System and method for selecting alternative advertising inventory in place of sold out advertising inventory |
WO2002019717A2 (en) | 2000-08-31 | 2002-03-07 | Myrio Corporation | Real-time audience monitoring, content rating, and content enhancing |
JP2002091852A (en) | 2000-09-18 | 2002-03-29 | Seino Information Service Co Ltd | Access history acquiring method and information providing method |
KR20020037980A (en) | 2000-11-16 | 2002-05-23 | 김형순 | System for retrieving and providing information |
US7600014B2 (en) | 2000-11-16 | 2009-10-06 | Symantec Corporation | Method and system for monitoring the performance of a distributed application |
JP2002163562A (en) | 2000-11-27 | 2002-06-07 | Dainippon Printing Co Ltd | Information distribution server device |
US6879960B2 (en) | 2000-12-01 | 2005-04-12 | Claritas, Inc. | Method and system for using customer preferences in real time to customize a commercial transaction |
US20030006911A1 (en) | 2000-12-22 | 2003-01-09 | The Cadre Group Inc. | Interactive advertising system and method |
JP4248183B2 (en) | 2001-02-26 | 2009-04-02 | パナソニック株式会社 | Cookie processing program and image data display device |
WO2002082214A2 (en) | 2001-04-06 | 2002-10-17 | Predictive Media Corporation | Method and apparatus for identifying unique client users from user behavioral data |
WO2002084507A1 (en) | 2001-04-13 | 2002-10-24 | Netiq Corporation | User-side tracking of multimedia application usage within a web page |
US7647418B2 (en) | 2001-06-19 | 2010-01-12 | Savvis Communications Corporation | Real-time streaming media measurement system and method |
US20030037131A1 (en) | 2001-08-17 | 2003-02-20 | International Business Machines Corporation | User information coordination across multiple domains |
US7257546B2 (en) | 2001-09-04 | 2007-08-14 | Yahoo! Inc. | System and method for correlating user data from a content provider and user data from an advertising provider that is stored on autonomous systems |
JPWO2003027860A1 (en) | 2001-09-19 | 2005-01-13 | 株式会社エヌ・ティ・ティ・アド | Content distribution system for distributing content changing on time axis, content distribution server, log collection server, content relay server, user terminal, content viewing state grasping method, recommendation method, and content providing method |
US6877007B1 (en) | 2001-10-16 | 2005-04-05 | Anna M. Hentzel | Method and apparatus for tracking a user's interaction with a resource supplied by a server computer |
US7343417B2 (en) | 2001-11-30 | 2008-03-11 | Knowledge Networks, Inc. | System and method for rating media information |
US7272617B1 (en) | 2001-11-30 | 2007-09-18 | Ncr Corp. | Analytic data set creation for modeling in a customer relationship management system |
US7369984B2 (en) | 2002-02-01 | 2008-05-06 | John Fairweather | Platform-independent real-time interface translation by token mapping without modification of application code |
JP4179535B2 (en) | 2002-09-03 | 2008-11-12 | インターナショナル・ビジネス・マシーンズ・コーポレーション | Network system, reverse proxy, computer apparatus, data processing method and program |
US20030177488A1 (en) | 2002-03-12 | 2003-09-18 | Smith Geoff S. | Systems and methods for media audience measurement |
US20030220901A1 (en) | 2002-05-21 | 2003-11-27 | Hewlett-Packard Development Company | Interaction manager |
US20040167763A1 (en) | 2002-05-31 | 2004-08-26 | Liebman Michael N | Information processing method for evaluating biochemical pathway models using clinical data |
US20060184617A1 (en) | 2005-02-11 | 2006-08-17 | Nicholas Frank C | Method and system for the creating, managing, and delivery of feed formatted content |
US20040098229A1 (en) | 2002-06-28 | 2004-05-20 | Brett Error | Efficient click-stream data collection |
US8086559B2 (en) | 2002-09-24 | 2011-12-27 | Google, Inc. | Serving content-relevant advertisements with client-side device support |
US7890451B2 (en) | 2002-10-09 | 2011-02-15 | Compete, Inc. | Computer program product and method for refining an estimate of internet traffic |
US20040088212A1 (en) | 2002-10-31 | 2004-05-06 | Hill Clarke R. | Dynamic audience analysis for computer content |
US7574423B2 (en) | 2003-03-20 | 2009-08-11 | International Business Machines Corporation | Partial data model exposure through client side caching |
US7505958B2 (en) | 2004-09-30 | 2009-03-17 | International Business Machines Corporation | Metadata management for a data abstraction model |
CA2686265A1 (en) | 2003-06-17 | 2004-12-17 | Ibm Canada Limited - Ibm Canada Limitee | Multiple identity management in an electronic commerce site |
US7127305B1 (en) | 2003-07-21 | 2006-10-24 | Eyecon Technologies, Inc. | Method and apparatus for unified control of multiple devices |
US20050033657A1 (en) | 2003-07-25 | 2005-02-10 | Keepmedia, Inc., A Delaware Corporation | Personalized content management and presentation systems |
ZA200600900B (en) | 2003-08-01 | 2007-05-30 | Tacoda Systems Inc | System and method for segmenting and targeting audience members |
US8464290B2 (en) | 2003-08-01 | 2013-06-11 | Tacoda, Inc. | Network for matching an audience with deliverable content |
US7805332B2 (en) | 2003-08-01 | 2010-09-28 | AOL, Inc. | System and method for segmenting and targeting audience members |
US9117217B2 (en) | 2003-08-01 | 2015-08-25 | Advertising.Com Llc | Audience targeting with universal profile synchronization |
US20070198327A1 (en) | 2003-08-15 | 2007-08-23 | Amir Yazdani | Systems and methods for measuring, targeting, verifying, and reporting advertising impressions |
WO2005024689A1 (en) | 2003-09-04 | 2005-03-17 | Interscope Inc. | Nsumer’s purchase behavior analysis method and device |
US7152074B2 (en) | 2003-09-19 | 2006-12-19 | International Business Machines Corporation | Extensible framework supporting deposit of heterogenous data sources into a target data repository |
EP1680878A1 (en) | 2003-10-24 | 2006-07-19 | Telefonaktiebolaget Lm Ericsson | A method and device for audience monitoring on multicast capable networks |
US20050144069A1 (en) | 2003-12-23 | 2005-06-30 | Wiseman Leora R. | Method and system for providing targeted graphical advertisements |
US7949639B2 (en) | 2004-02-20 | 2011-05-24 | Symphonyiri Group, Inc. | Attribute segments and data table bias reduction |
US7792954B2 (en) | 2004-04-02 | 2010-09-07 | Webtrends, Inc. | Systems and methods for tracking web activity |
US20050267799A1 (en) | 2004-05-10 | 2005-12-01 | Wesley Chan | System and method for enabling publishers to select preferred types of electronic documents |
SG138452A1 (en) | 2004-05-18 | 2008-01-28 | Victor Company Of Japan | Content presentation |
US7302447B2 (en) | 2005-01-14 | 2007-11-27 | International Business Machines Corporation | Virtual columns |
CN101077014B (en) | 2004-08-09 | 2013-09-25 | 尼尔森(美国)有限公司 | Methods and apparatus to monitor audio/visual content from various sources |
US7546370B1 (en) | 2004-08-18 | 2009-06-09 | Google Inc. | Search engine with multiple crawlers sharing cookies |
US20060089754A1 (en) | 2004-10-27 | 2006-04-27 | Andrew Mortenson | An installed Vehicle Personal Computing (VPC) system with touch interaction, voice interaction or sensor interaction(s) that provides access to multiple information sources and software applications such as internet connected data applications, dynamic traffic-aware navigational routing, vehicle tracking, emergency accident dispatching, business applications, office applications, music and video player(s), personal info portal, vehicle monitoring, alarm and camera security and recording. |
JP2006127320A (en) | 2004-10-29 | 2006-05-18 | Solid Technology Kk | Terminal attribute estimation apparatus and terminal attribute estimation method |
JP2006127321A (en) | 2004-10-29 | 2006-05-18 | Solid Technology Kk | Terminal attribute addition device and terminal attribute addition method |
US20060190616A1 (en) | 2005-02-04 | 2006-08-24 | John Mayerhofer | System and method for aggregating, delivering and sharing audio content |
JP2008065664A (en) | 2006-09-08 | 2008-03-21 | Victor Co Of Japan Ltd | Content data utilization system, data utilization apparatus, utilization history information management apparatus, and content data distribution apparatus |
US7323991B1 (en) | 2005-05-12 | 2008-01-29 | Exavera Technologies Incorporated | System and method for locating and communicating with personnel and equipment in a facility |
US8131861B2 (en) | 2005-05-20 | 2012-03-06 | Webtrends, Inc. | Method for cross-domain tracking of web site traffic |
US8856279B2 (en) | 2005-05-26 | 2014-10-07 | Citrix Systems Inc. | Method and system for object prediction |
US7849154B2 (en) | 2005-06-27 | 2010-12-07 | M:Metrics, Inc. | Acquiring, storing, and correlating profile data of cellular mobile communications system's users to events |
JP4764103B2 (en) | 2005-08-18 | 2011-08-31 | 株式会社東芝 | Content data distribution system and information processing apparatus |
CN100452781C (en) | 2005-10-26 | 2009-01-14 | 华为技术有限公司 | Method for transmitting partial unavailable information to destination user |
US20080086356A1 (en) | 2005-12-09 | 2008-04-10 | Steve Glassman | Determining advertisements using user interest information and map-based location information |
JP5016610B2 (en) | 2005-12-21 | 2012-09-05 | ディジマーク コーポレイション | Rule-driven pan ID metadata routing system and network |
US20090030780A1 (en) | 2006-01-03 | 2009-01-29 | Ds-Iq, Inc. | Measuring effectiveness of marketing campaigns presented on media devices in public places using audience exposure data |
KR101583268B1 (en) | 2006-03-27 | 2016-01-08 | 닐슨 미디어 리서치 인코퍼레이티드 | Methods and systems to meter media content presented on a wireless communication device |
MX2007015979A (en) | 2006-03-31 | 2009-04-07 | Nielsen Media Res Inc | Methods, systems, and apparatus for multi-purpose metering. |
US7941525B1 (en) | 2006-04-01 | 2011-05-10 | ClickTale, Ltd. | Method and system for monitoring an activity of a user |
US7444388B1 (en) | 2006-04-13 | 2008-10-28 | Concert Technology Corporation | System and method for obtaining media content for a portable media player |
US20070244746A1 (en) * | 2006-04-18 | 2007-10-18 | Issen Daniel A | Correlating an advertisement click event with a purchase event |
US8131763B2 (en) | 2006-05-03 | 2012-03-06 | Cellco Partnership | Age verification and content filtering systems and methods |
US20070271580A1 (en) | 2006-05-16 | 2007-11-22 | Bellsouth Intellectual Property Corporation | Methods, Apparatus and Computer Program Products for Audience-Adaptive Control of Content Presentation Based on Sensed Audience Demographics |
US20070271518A1 (en) | 2006-05-16 | 2007-11-22 | Bellsouth Intellectual Property Corporation | Methods, Apparatus and Computer Program Products for Audience-Adaptive Control of Content Presentation Based on Sensed Audience Attentiveness |
WO2007149341A2 (en) | 2006-06-14 | 2007-12-27 | Agent Science Technologies, Inc. | System to associate a demographic to a user of an electronic system |
EP2030439B1 (en) | 2006-06-15 | 2018-09-19 | The Nielsen Company (US), LLC | Methods and apparatus to meter content exposure using closed caption information |
US20080004958A1 (en) | 2006-06-29 | 2008-01-03 | Tony Ralph | Client side counting verification testing |
CN100456298C (en) | 2006-07-12 | 2009-01-28 | 百度在线网络技术(北京)有限公司 | Advertisement information retrieval system and method therefor |
US20080086523A1 (en) | 2006-08-18 | 2008-04-10 | Akamai Technologies, Inc. | Method of data collection in a distributed network |
US20100004977A1 (en) | 2006-09-05 | 2010-01-07 | Innerscope Research Llc | Method and System For Measuring User Experience For Interactive Activities |
US8700457B2 (en) | 2007-01-03 | 2014-04-15 | William H. Bollman | Mobile phone based rebate device for redemption at a point of sale terminal |
CN101222348B (en) | 2007-01-10 | 2011-05-11 | 阿里巴巴集团控股有限公司 | Method and system for calculating number of website real user |
US8060601B1 (en) | 2007-03-07 | 2011-11-15 | Comscore, Inc. | Detecting content and user response to content |
US8166076B2 (en) | 2007-03-08 | 2012-04-24 | Microsoft Corporation | Digital media metadata management |
KR100910517B1 (en) | 2007-03-21 | 2009-07-31 | 엔에이치엔비즈니스플랫폼 주식회사 | System and method for expanding target inventory according to borwser-login mapping |
US8229458B2 (en) | 2007-04-08 | 2012-07-24 | Enhanced Geographic Llc | Systems and methods to determine the name of a location visited by a user of a wireless device |
US20080262928A1 (en) | 2007-04-18 | 2008-10-23 | Oliver Michaelis | Method and apparatus for distribution and personalization of e-coupons |
US20080276179A1 (en) | 2007-05-05 | 2008-11-06 | Intapp Inc. | Monitoring and Aggregating User Activities in Heterogeneous Systems |
US20090217315A1 (en) | 2008-02-26 | 2009-08-27 | Cognovision Solutions Inc. | Method and system for audience measurement and targeting media |
EP2153559A2 (en) | 2007-05-31 | 2010-02-17 | The Nielsen Company | Methods and apparatus to model set-top box data |
US8099315B2 (en) | 2007-06-05 | 2012-01-17 | At&T Intellectual Property I, L.P. | Interest profiles for audio and/or video streams |
US7890592B2 (en) | 2007-06-29 | 2011-02-15 | Microsoft Corporation | Processing data obtained from a presence-based system |
US8229780B2 (en) | 2007-07-30 | 2012-07-24 | Silvercarrot, Inc. | System and method for online lead generation |
US20090055241A1 (en) | 2007-08-23 | 2009-02-26 | Att Knowledge Ventures L.P. | System and Method for Estimating a Qualiifed Impression Count for Advertising Data in a Communication System |
US7698422B2 (en) | 2007-09-10 | 2010-04-13 | Specific Media, Inc. | System and method of determining user demographic profiles of anonymous users |
US20090076899A1 (en) | 2007-09-14 | 2009-03-19 | Gbodimowo Gbeminiyi A | Method for analyzing, searching for, and trading targeted advertisement spaces |
US7925694B2 (en) | 2007-10-19 | 2011-04-12 | Citrix Systems, Inc. | Systems and methods for managing cookies via HTTP content layer |
US8073807B1 (en) | 2007-11-02 | 2011-12-06 | Google Inc | Inferring demographics for website members |
US20090125934A1 (en) | 2007-11-11 | 2009-05-14 | Microsoft Corporation | User rating mechanism for media content |
WO2009076617A2 (en) | 2007-12-13 | 2009-06-18 | Google Inc. | Impression normalization |
US8117193B2 (en) | 2007-12-21 | 2012-02-14 | Lemi Technology, Llc | Tunersphere |
US20090171762A1 (en) | 2008-01-02 | 2009-07-02 | Microsoft Corporation | Advertising in an Entertainment Access Service |
US8180112B2 (en) | 2008-01-21 | 2012-05-15 | Eastman Kodak Company | Enabling persistent recognition of individuals in images |
US8302120B2 (en) | 2008-02-19 | 2012-10-30 | The Nielsen Company (Us), Llc | Methods and apparatus to monitor advertisement exposure |
CN101540734A (en) | 2008-03-21 | 2009-09-23 | 阿里巴巴集团控股有限公司 | Method, system and device for accessing Cookie by crossing domain names |
US8151194B1 (en) | 2008-03-26 | 2012-04-03 | Google Inc. | Visual presentation of video usage statistics |
US20090254633A1 (en) | 2008-04-03 | 2009-10-08 | Olive Bentley J | Methods, systems, and computer program products for distributing profile-based advertisement content and user identification-tagged media content |
US8112301B2 (en) | 2008-04-14 | 2012-02-07 | Tra, Inc. | Using consumer purchase behavior for television targeting |
US20090292587A1 (en) | 2008-04-17 | 2009-11-26 | Arbitron, Inc. | Cross-media interactivity metrics |
US9083853B2 (en) | 2008-06-02 | 2015-07-14 | Intent IQ, LLC | Targeted television advertisements associated with online users' preferred television programs or channels |
US20090307084A1 (en) | 2008-06-10 | 2009-12-10 | Integrated Media Measurement, Inc. | Measuring Exposure To Media Across Multiple Media Delivery Mechanisms |
US20100010866A1 (en) | 2008-07-11 | 2010-01-14 | Microsoft Corporation | Advertising across social network communication pathways |
US8280683B2 (en) | 2008-07-17 | 2012-10-02 | International Business Machines Corporation | Probabilistic framework for the highly efficient correlation of call chains with hardware events |
JP4834042B2 (en) | 2008-08-06 | 2011-12-07 | ヤフー株式会社 | User-created content management device, user-created content management system, and browser preference survey method |
WO2010028071A1 (en) | 2008-09-03 | 2010-03-11 | Owjo Ltd. | Systems and methods for a comprehensive integrated and universal content selling and buying platform |
US8549163B2 (en) | 2008-09-18 | 2013-10-01 | Jonathan M. Urdan | Passive parameter based demographics generation |
US20100088152A1 (en) | 2008-10-02 | 2010-04-08 | Dominic Bennett | Predicting user response to advertisements |
US20100088373A1 (en) | 2008-10-06 | 2010-04-08 | Jeremy Pinkham | Method of Tracking & Targeting Internet Payloads based on Time Spent Actively Viewing |
US20100306080A1 (en) | 2008-10-08 | 2010-12-02 | Trandal David S | Methods and systems for receipt management and price comparison |
KR20110086095A (en) | 2008-10-20 | 2011-07-27 | 비욘드 오블리비언 인크. | A method and system for accounting for download transactions and social network interaction |
AU2008363490A1 (en) | 2008-10-28 | 2010-05-06 | Norwell Sa | Audience measurement system |
US20100121676A1 (en) | 2008-11-11 | 2010-05-13 | Yahoo! Inc. | Method and system for logging impressions of online advertisments |
US8087041B2 (en) | 2008-12-10 | 2011-12-27 | Google Inc. | Estimating reach and frequency of advertisements |
US20100153207A1 (en) | 2008-12-11 | 2010-06-17 | Randy Roberts | Method and system for providing consumer services with a telematics system |
US20100153175A1 (en) | 2008-12-12 | 2010-06-17 | At&T Intellectual Property I, L.P. | Correlation of Psycho-Demographic Data and Social Network Data to Initiate an Action |
US8356247B2 (en) | 2008-12-16 | 2013-01-15 | Rich Media Worldwide, Llc | Content rendering control system and method |
US20100161385A1 (en) | 2008-12-19 | 2010-06-24 | Nxn Tech, Llc | Method and System for Content Based Demographics Prediction for Websites |
WO2010088372A1 (en) | 2009-01-29 | 2010-08-05 | The Nielsen Company (Us), Llc | Methods and apparatus to measure market statistics |
US20100205057A1 (en) | 2009-02-06 | 2010-08-12 | Rodney Hook | Privacy-sensitive methods, systems, and media for targeting online advertisements using brand affinity modeling |
KR101168705B1 (en) | 2009-02-18 | 2012-08-02 | 김기미 | Customized and intellectual symbol, icon internet information searching system utilizing a mobile communication terminal and IP-based information terminal |
GB2468414A (en) | 2009-03-06 | 2010-09-08 | Appnexus Inc | A computer system for buying and selling online advertising |
CN101505247A (en) | 2009-03-09 | 2009-08-12 | 成都市华为赛门铁克科技有限公司 | Detection method and apparatus for number of shared access hosts |
KR101073112B1 (en) | 2009-03-11 | 2011-10-12 | 박상호 | A management method for contents combined work and advertising using an open license and apparatus thereof |
US8150974B2 (en) | 2009-03-17 | 2012-04-03 | Kindsight, Inc. | Character differentiation system generating session fingerprint using events associated with subscriber ID and session ID |
US7882054B2 (en) | 2009-03-19 | 2011-02-01 | Gutman Levitan | System for estimating audience size in a digital broadcast environment using control packets and predictions |
US8266687B2 (en) | 2009-03-27 | 2012-09-11 | Sophos Plc | Discovery of the use of anonymizing proxies by analysis of HTTP cookies |
JP5492630B2 (en) | 2009-03-31 | 2014-05-14 | 株式会社ビデオリサーチ | Content contact investigation system and content contact investigation method |
US20100268573A1 (en) | 2009-04-17 | 2010-10-21 | Anand Jain | System and method for utilizing supplemental audio beaconing in audience measurement |
US20100268540A1 (en) | 2009-04-17 | 2010-10-21 | Taymoor Arshi | System and method for utilizing audio beaconing in audience measurement |
US10008212B2 (en) | 2009-04-17 | 2018-06-26 | The Nielsen Company (Us), Llc | System and method for utilizing audio encoding for measuring media exposure with environmental masking |
US8429287B2 (en) | 2009-04-29 | 2013-04-23 | Rangecast Technologies, Llc | Network audio distribution system and method |
US8990337B2 (en) | 2009-06-08 | 2015-03-24 | Collective, Inc. | Tracking advertising abandonment rates |
US20100313009A1 (en) | 2009-06-09 | 2010-12-09 | Jacques Combet | System and method to enable tracking of consumer behavior and activity |
US20100325051A1 (en) | 2009-06-22 | 2010-12-23 | Craig Stephen Etchegoyen | System and Method for Piracy Reduction in Software Activation |
WO2011005155A1 (en) | 2009-07-08 | 2011-01-13 | Telefonaktiebolaget Lm Ericsson (Publ) | A method and arrangements for analysing multimedia content |
US9178634B2 (en) | 2009-07-15 | 2015-11-03 | Time Warner Cable Enterprises Llc | Methods and apparatus for evaluating an audience in a content-based network |
US8612860B2 (en) | 2009-08-12 | 2013-12-17 | Warner Music Inc. | Systems, methods, and media for coordinating the presentation of media with an event |
US20120192214A1 (en) | 2009-12-22 | 2012-07-26 | Resonate Networks | Method and apparatus for delivering targeted content to television viewers |
KR101118741B1 (en) | 2009-08-31 | 2012-03-12 | 주식회사 나스미디어 | A method for providing internet advertisement popularity rating |
US8234408B2 (en) | 2009-09-10 | 2012-07-31 | Cloudshield Technologies, Inc. | Differentiating unique systems sharing a common address |
US8504411B1 (en) | 2009-09-14 | 2013-08-06 | Aol Advertising Inc. | Systems and methods for online user profiling and segmentation |
US20110087519A1 (en) | 2009-10-09 | 2011-04-14 | Visa U.S.A. Inc. | Systems and Methods for Panel Enhancement with Transaction Data |
US8082464B2 (en) | 2009-10-13 | 2011-12-20 | International Business Machines Corporation | Managing availability of a component having a closed address space |
US8595058B2 (en) | 2009-10-15 | 2013-11-26 | Visa U.S.A. | Systems and methods to match identifiers |
US8549552B2 (en) | 2009-11-03 | 2013-10-01 | The Nielsen Company (Us), Llc | Methods and apparatus to monitor media exposure in vehicles |
US8566856B2 (en) | 2009-12-01 | 2013-10-22 | International Business Machines Corporation | Video stream measurement method and system |
EP2510487A4 (en) | 2009-12-08 | 2014-11-19 | Comscore Inc | Systems and methods for identification and reporting of ad delivery hierarchy |
US20110153391A1 (en) | 2009-12-21 | 2011-06-23 | Michael Tenbrock | Peer-to-peer privacy panel for audience measurement |
US8925024B2 (en) | 2009-12-31 | 2014-12-30 | The Nielsen Company (Us), Llc | Methods and apparatus to detect commercial advertisements associated with media presentations |
US20110246306A1 (en) | 2010-01-29 | 2011-10-06 | Bank Of America Corporation | Mobile location tracking integrated merchant offer program and customer shopping |
US20110191184A1 (en) | 2010-01-29 | 2011-08-04 | Bank Of America Corporation | Mobile location integrated merchant offer program and customer shopping |
US20110191664A1 (en) | 2010-02-04 | 2011-08-04 | At&T Intellectual Property I, L.P. | Systems for and methods for detecting url web tracking and consumer opt-out cookies |
US20110196735A1 (en) | 2010-02-05 | 2011-08-11 | Von Sydow Gustav | System and method for measuring effectiveness of electronically presented advertizing |
EP2569743A4 (en) | 2010-02-08 | 2014-11-19 | Brook Lang | System and method of delivering ads |
JP5911432B2 (en) | 2010-02-08 | 2016-04-27 | フェイスブック,インク. | Communication of information about activities from different domains in social network systems |
US8280844B2 (en) | 2010-02-15 | 2012-10-02 | Bank Of America Corporation | Anomalous activity detection |
US20120310729A1 (en) | 2010-03-16 | 2012-12-06 | Dalto John H | Targeted learning in online advertising auction exchanges |
US9105053B2 (en) | 2010-03-23 | 2015-08-11 | Nokia Technologies Oy | Method and apparatus for determining a user age range |
US20110238520A1 (en) | 2010-03-26 | 2011-09-29 | Selley Jonathan W | Wireless jukebox ordering and administration application with restaurant and administrative support |
CA2795128A1 (en) | 2010-03-31 | 2011-10-06 | Mediamath, Inc. | Systems and methods for integration of a demand side platform |
US9009330B2 (en) | 2010-04-01 | 2015-04-14 | Cloudflare, Inc. | Internet-based proxy service to limit internet visitor connection speed |
US8626901B2 (en) | 2010-04-05 | 2014-01-07 | Comscore, Inc. | Measurements based on panel and census data |
US8626084B2 (en) | 2010-05-13 | 2014-01-07 | Qualcomm, Incorporated | Area efficient concurrent matching transceiver |
US20110282730A1 (en) | 2010-05-13 | 2011-11-17 | AdChoice, Inc. | System and method for selecting and implementing an internet advertising campaign |
US8307006B2 (en) | 2010-06-30 | 2012-11-06 | The Nielsen Company (Us), Llc | Methods and apparatus to obtain anonymous audience measurement data from network server data for particular demographic and usage profiles |
US20130080268A1 (en) | 2011-09-26 | 2013-03-28 | Unicorn Media, Inc. | Multi-platform media syndication customization |
US8484511B2 (en) | 2010-07-01 | 2013-07-09 | Time Warner Cable Enterprises Llc | Apparatus and methods for data collection, analysis and validation including error correction in a content delivery network |
EP2409755A1 (en) | 2010-07-22 | 2012-01-25 | Siemens Aktiengesellschaft | Method and device for processing an impure alkaline solution of an amino acid salt |
US9747605B2 (en) | 2010-08-02 | 2017-08-29 | Facebook, Inc. | Measuring quality of user interaction with third party content |
EP2603893A1 (en) | 2010-08-10 | 2013-06-19 | Telefonaktiebolaget LM Ericsson (publ) | Aggregating demographic distribution information |
US8886773B2 (en) | 2010-08-14 | 2014-11-11 | The Nielsen Company (Us), Llc | Systems, methods, and apparatus to monitor mobile internet activity |
US9092797B2 (en) | 2010-09-22 | 2015-07-28 | The Nielsen Company (Us), Llc | Methods and apparatus to analyze and adjust demographic information |
AU2013203898B2 (en) | 2010-09-22 | 2015-07-02 | The Nielsen Company (Us), Llc | Methods and apparatus to determine impressions using distributed demographic information |
JP5462418B2 (en) | 2010-09-22 | 2014-04-02 | ザ ニールセン カンパニー (ユー エス) エルエルシー | Method and apparatus for identifying impressions using distributed demographic information |
US20120215878A1 (en) | 2010-09-28 | 2012-08-23 | Adam Kidron | Content delivery platform apparatuses, methods and systems |
US9122760B2 (en) | 2010-10-12 | 2015-09-01 | Robert Osann, Jr. | User preference correlation for web-based selection |
US20120094639A1 (en) | 2010-10-15 | 2012-04-19 | Mark Carlson | Heat maps applying location-based information to transaction processing data |
US8495143B2 (en) | 2010-10-29 | 2013-07-23 | Facebook, Inc. | Inferring user profile attributes from social information |
US8484241B2 (en) | 2010-10-29 | 2013-07-09 | Russell Kent Bouse | Systems and methods to consolidate and communicate user profiles and modality preferences information for content delivery or interaction experiences |
US10034034B2 (en) | 2011-07-06 | 2018-07-24 | Symphony Advanced Media | Mobile remote media control platform methods |
US8631122B2 (en) | 2010-11-29 | 2014-01-14 | Viralheat, Inc. | Determining demographics based on user interaction |
US20120143713A1 (en) | 2010-12-06 | 2012-06-07 | Campaigngrid, Llc | Electronic and network-based franking |
US9497154B2 (en) | 2010-12-13 | 2016-11-15 | Facebook, Inc. | Measuring social network-based interaction with web content external to a social networking system |
US8453173B1 (en) | 2010-12-13 | 2013-05-28 | Google Inc. | Estimating demographic compositions of television audiences from audience similarities |
US20120151079A1 (en) | 2010-12-13 | 2012-06-14 | Jan Besehanic | Methods and apparatus to measure media exposure |
US20120158490A1 (en) | 2010-12-16 | 2012-06-21 | Yahoo! Inc. | Sponsored search auction mechanism for rich media advertising |
CA2977942C (en) * | 2010-12-20 | 2021-08-03 | The Nielsen Company (Us), Llc | Methods and apparatus to determine media impressions using distributed demographic information |
US8874639B2 (en) | 2010-12-22 | 2014-10-28 | Facebook, Inc. | Determining advertising effectiveness outside of a social networking system |
US20120173701A1 (en) | 2010-12-30 | 2012-07-05 | Arbitron Inc. | Matching techniques for cross-platform monitoring and information |
US20120185274A1 (en) | 2011-01-14 | 2012-07-19 | Guzihou Hu | System and Method for Predicting Inner Age |
US20120209920A1 (en) | 2011-02-10 | 2012-08-16 | Microsoft Corporation | Social influencers discovery |
US20120206331A1 (en) | 2011-02-14 | 2012-08-16 | Gandhi Sidhant D | Methods and Systems for Supporting Gesture Recognition Applications across Devices |
US8543454B2 (en) | 2011-02-18 | 2013-09-24 | Bluefin Labs, Inc. | Generating audience response metrics and ratings from social interest in time-based media |
EP2686779A4 (en) | 2011-03-18 | 2014-09-17 | Nielsen Co Us Llc | Methods and apparatus to determine media impressions |
US8984547B2 (en) | 2011-04-11 | 2015-03-17 | Google Inc. | Estimating demographic compositions of television audiences |
JP5430797B2 (en) | 2011-04-12 | 2014-03-05 | パナソニック株式会社 | Authentication system, information registration system, server, program, and authentication method |
US20120265606A1 (en) | 2011-04-14 | 2012-10-18 | Patnode Michael L | System and method for obtaining consumer information |
US8315620B1 (en) | 2011-05-27 | 2012-11-20 | The Nielsen Company (Us), Llc | Methods and apparatus to associate a mobile device with a panelist profile |
US9282158B2 (en) | 2011-06-06 | 2016-03-08 | Google Inc. | Reducing redirects |
US8560683B2 (en) | 2011-06-10 | 2013-10-15 | Google Inc. | Video and site analytics |
US9515904B2 (en) | 2011-06-21 | 2016-12-06 | The Nielsen Company (Us), Llc | Monitoring streaming media content |
US8688524B1 (en) | 2011-06-28 | 2014-04-01 | Amazon Technologies, Inc. | Tracking online impressions to offline purchases |
US8498491B1 (en) | 2011-08-10 | 2013-07-30 | Google Inc. | Estimating age using multiple classifiers |
US10783547B2 (en) | 2011-08-17 | 2020-09-22 | Facebook, Inc. | Approximating unique advertisement impressions on a social networking system |
US20130060629A1 (en) | 2011-09-07 | 2013-03-07 | Joshua Rangsikitpho | Optimization of Content Placement |
JP2013057918A (en) | 2011-09-09 | 2013-03-28 | Shigeto Umeda | System for displaying and bidding for variable-length advertisement |
US9424603B2 (en) | 2011-09-13 | 2016-08-23 | Visa International Service Association | Mobile location notifications system and method |
US8909771B2 (en) | 2011-09-15 | 2014-12-09 | Stephan HEATH | System and method for using global location information, 2D and 3D mapping, social media, and user behavior and information for a consumer feedback social media analytics platform for providing analytic measurements data of online consumer feedback for global brand products or services of past, present or future customers, users, and/or target markets |
US8838982B2 (en) | 2011-09-21 | 2014-09-16 | Visa International Service Association | Systems and methods to secure user identification |
US9106709B2 (en) | 2011-09-22 | 2015-08-11 | Opera Software Asa | Server side mobile audience intelligence creation |
US20130080263A1 (en) | 2011-09-23 | 2013-03-28 | Jonathan Goldman | Per-view charging for video advertisements |
US9298900B2 (en) | 2011-09-24 | 2016-03-29 | Elwha Llc | Behavioral fingerprinting via inferred personal relation |
US8387084B1 (en) | 2011-09-28 | 2013-02-26 | United Video Properties, Inc. | Systems and methods for detecting unauthorized use of a user equipment device |
US20130117103A1 (en) | 2011-11-08 | 2013-05-09 | Insightexpress, Llc | Universal control |
US20130124628A1 (en) | 2011-11-15 | 2013-05-16 | Srilal Weerasinghe | Method and apparatus for providing social network based advertising with user control and privacy |
US10290017B2 (en) * | 2011-11-15 | 2019-05-14 | Tapad, Inc. | Managing associations between device identifiers |
WO2013078640A1 (en) | 2011-11-30 | 2013-06-06 | Google Inc. | Estimating user demographics |
US9331975B2 (en) | 2011-12-16 | 2016-05-03 | The Nielsen Company (Us), Llc | Systems, methods, and apparatus to identify media presentation devices |
WO2013106195A2 (en) | 2012-01-09 | 2013-07-18 | Catch Media, Inc. | Campaign manager |
US9479488B2 (en) | 2012-01-26 | 2016-10-25 | Facebook, Inc. | Network access based on social-networking information |
US9224094B2 (en) | 2012-01-26 | 2015-12-29 | The Nielsen Company (Us), Llc | Systems, methods, and articles of manufacture to measure online audiences |
US8600796B1 (en) | 2012-01-30 | 2013-12-03 | Bazaarvoice, Inc. | System, method and computer program product for identifying products associated with polarized sentiments |
US20130204694A1 (en) | 2012-02-07 | 2013-08-08 | Sayso, Llc | Context-Based Study Generation and Administration |
US9521166B2 (en) | 2012-02-09 | 2016-12-13 | Aol Inc. | Systems and methods for testing online systems and content |
US9015255B2 (en) | 2012-02-14 | 2015-04-21 | The Nielsen Company (Us), Llc | Methods and apparatus to identify session users with cookie information |
US8973023B1 (en) | 2012-02-29 | 2015-03-03 | The Nielsen Company (Us), Llc | Methods and apparatus to determine audience duplication in cross-media campaigns |
WO2013134290A2 (en) | 2012-03-05 | 2013-09-12 | R. R. Donnelley & Sons Company | Digital content delivery |
US9491603B2 (en) | 2012-03-09 | 2016-11-08 | Facebook, Inc. | Substantially continuous location logging for geographic-positioning capable devices |
US9659105B2 (en) | 2012-03-15 | 2017-05-23 | The Nielsen Company (Us), Llc | Methods and apparatus to track web browsing sessions |
CA2791935A1 (en) | 2012-03-30 | 2013-09-30 | Disternet Technology, Inc. | Transcoding system and method |
US9965767B2 (en) | 2012-04-20 | 2018-05-08 | Comscore, Inc. | Attribution of demographics to census data |
US20130325588A1 (en) | 2012-06-04 | 2013-12-05 | The Board of Trustees for the Leland Stanford, Junior, University | Method and System for Measuring the Effectiveness of Search Advertising |
US20130331971A1 (en) | 2012-06-10 | 2013-12-12 | Eran Bida | Watermarking and using same for audience measurement |
AU2013204865B2 (en) | 2012-06-11 | 2015-07-09 | The Nielsen Company (Us), Llc | Methods and apparatus to share online media impressions data |
US9786176B2 (en) | 2012-06-22 | 2017-10-10 | Zonal Systems, Llc | System and method for placing virtual geographic zone markers |
US9430778B2 (en) | 2012-07-30 | 2016-08-30 | Kount Inc. | Authenticating users for accurate online audience measurement |
US20140040171A1 (en) | 2012-07-31 | 2014-02-06 | Triapodi Ltd | Content-based demographic estimation of users of mobile devices and usage thereof |
US9461876B2 (en) | 2012-08-29 | 2016-10-04 | Loci | System and method for fuzzy concept mapping, voting ontology crowd sourcing, and technology prediction |
AU2013204953B2 (en) | 2012-08-30 | 2016-09-08 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US20140108130A1 (en) * | 2012-10-12 | 2014-04-17 | Google Inc. | Calculating audience metrics for online campaigns |
US9621446B2 (en) | 2012-10-26 | 2017-04-11 | Comscore, Inc. | Combining measurements based on beacon data |
US9055021B2 (en) | 2012-11-30 | 2015-06-09 | The Nielsen Company (Us), Llc | Methods and apparatus to monitor impressions of social media messages |
US20140173746A1 (en) | 2012-12-13 | 2014-06-19 | Apple Inc. | Application repository |
US20140279074A1 (en) | 2013-03-15 | 2014-09-18 | Turn Inc. | Data management platform for digital advertising |
US10356579B2 (en) | 2013-03-15 | 2019-07-16 | The Nielsen Company (Us), Llc | Methods and apparatus to credit usage of mobile devices |
US9697533B2 (en) | 2013-04-17 | 2017-07-04 | The Nielsen Company (Us), Llc | Methods and apparatus to monitor media presentations |
US20140324544A1 (en) | 2013-04-26 | 2014-10-30 | Paul Donato | Methods and apparatus to determine demographic distributions of online users |
US9519914B2 (en) | 2013-04-30 | 2016-12-13 | The Nielsen Company (Us), Llc | Methods and apparatus to determine ratings information for online media presentations |
US20140337104A1 (en) | 2013-05-09 | 2014-11-13 | Steven J. Splaine | Methods and apparatus to determine impressions using distributed demographic information |
US8775332B1 (en) | 2013-06-13 | 2014-07-08 | InsideSales.com, Inc. | Adaptive user interfaces |
US10068246B2 (en) | 2013-07-12 | 2018-09-04 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US9313294B2 (en) | 2013-08-12 | 2016-04-12 | The Nielsen Company (Us), Llc | Methods and apparatus to de-duplicate impression information |
US8938686B1 (en) | 2013-10-03 | 2015-01-20 | Palantir Technologies Inc. | Systems and methods for analyzing performance of an entity |
US9852163B2 (en) | 2013-12-30 | 2017-12-26 | The Nielsen Company (Us), Llc | Methods and apparatus to de-duplicate impression information |
US9237138B2 (en) | 2013-12-31 | 2016-01-12 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US20150193816A1 (en) | 2014-01-06 | 2015-07-09 | The Nielsen Company (Us), Llc | Methods and apparatus to correct misattributions of media impressions |
US8910195B1 (en) | 2014-02-20 | 2014-12-09 | Google Inc. | Systems and methods for enhancing audience measurement data |
EP3117385A4 (en) | 2014-03-13 | 2017-08-02 | The Nielsen Company (US), LLC | Methods and apparatus to compensate impression data for misattribution and/or non-coverage by a database proprietor |
US20160063539A1 (en) | 2014-08-29 | 2016-03-03 | The Nielsen Company (Us), Llc | Methods and apparatus to associate transactions with media impressions |
-
2014
- 2014-08-29 US US14/473,654 patent/US20160063539A1/en not_active Abandoned
- 2014-11-28 EP EP14004028.8A patent/EP2991018A1/en not_active Ceased
- 2014-11-28 CA CA3040572A patent/CA3040572C/en active Active
- 2014-11-28 CA CA2872704A patent/CA2872704C/en active Active
- 2014-11-28 CA CA3156903A patent/CA3156903A1/en active Pending
- 2014-12-03 CN CN201410858245.8A patent/CN105894313A/en active Pending
- 2014-12-03 MX MX2014014747A patent/MX2014014747A/en unknown
-
2020
- 2020-07-30 US US16/943,905 patent/US11562394B2/en active Active
-
2023
- 2023-01-23 US US18/158,340 patent/US20230162229A1/en active Pending
Patent Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020128925A1 (en) * | 2000-12-11 | 2002-09-12 | Patrick Angeles | system and method for detecting and reporting online activity using real-time content-based network monitoring |
US20050038900A1 (en) * | 2003-08-14 | 2005-02-17 | Brad Krassner | Internet-based system and method for distributing interstitial advertisements |
US20090018895A1 (en) * | 2007-03-12 | 2009-01-15 | Lee S. Weinblatt | Technique for correlating purchasing behavior of a consumer to advertisements |
US9449290B1 (en) * | 2007-05-04 | 2016-09-20 | At&T Intellectual Property I, L.P. | Product and service purchase-cycle tracking |
US20110066497A1 (en) * | 2009-09-14 | 2011-03-17 | Choicestream, Inc. | Personalized advertising and recommendation |
US20110093324A1 (en) * | 2009-10-19 | 2011-04-21 | Visa U.S.A. Inc. | Systems and Methods to Provide Intelligent Analytics to Cardholders and Merchants |
US20120130799A1 (en) * | 2010-05-20 | 2012-05-24 | Telcordia Technologies, Inc. | System and methodology for determination of advertisement effectiveness |
US20120046996A1 (en) * | 2010-08-17 | 2012-02-23 | Vishal Shah | Unified data management platform |
US9589271B2 (en) * | 2011-08-05 | 2017-03-07 | American Express Travel Related Services Company, Inc. | Systems and methods for determining ad impression utility |
US20130073388A1 (en) * | 2011-09-15 | 2013-03-21 | Stephan HEATH | System and method for using impressions tracking and analysis, location information, 2d and 3d mapping, mobile mapping, social media, and user behavior and information for generating mobile and internet posted promotions or offers for, and/or sales of, products and/or services |
US20130080259A1 (en) * | 2011-09-26 | 2013-03-28 | American Express Travel Related Services Company, Inc. | Systems and methods for targeting ad impressions |
US20130085894A1 (en) * | 2011-09-30 | 2013-04-04 | Jimmy Honlam CHAN | System and method for presenting product information in connection with e-commerce activity of a user |
US20140278981A1 (en) * | 2011-10-06 | 2014-09-18 | Gueorgui Mersov | Automated allocation of media via network |
US20130290096A1 (en) * | 2012-03-15 | 2013-10-31 | Catalina Marketing Corporation | System and method of measuring lift in a marketing program |
US20130268365A1 (en) * | 2012-04-06 | 2013-10-10 | Andrew Gildfind | Method and System for Launching a Generic Marketing Campaign by Pooling Small Advertisers |
US20140207567A1 (en) * | 2013-01-18 | 2014-07-24 | Digital River, Inc. | Cross Channel Conversion Tracking System and Method |
US20150066586A1 (en) * | 2013-08-28 | 2015-03-05 | Yahoo Japan Corporation | Evaluation calculating device, evaluation calculating method, and recording medium |
Cited By (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11682048B2 (en) | 2010-09-22 | 2023-06-20 | The Nielsen Company (Us), Llc | Methods and apparatus to determine impressions using distributed demographic information |
US11144967B2 (en) | 2010-09-22 | 2021-10-12 | The Nielsen Company (Us), Llc | Methods and apparatus to determine impressions using distributed demographic information |
US10504157B2 (en) | 2010-09-22 | 2019-12-10 | The Nielsen Company (Us), Llc | Methods and apparatus to determine impressions using distributed demographic information |
US9596151B2 (en) | 2010-09-22 | 2017-03-14 | The Nielsen Company (Us), Llc. | Methods and apparatus to determine impressions using distributed demographic information |
US11792016B2 (en) | 2012-08-30 | 2023-10-17 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US10063378B2 (en) | 2012-08-30 | 2018-08-28 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US9912482B2 (en) | 2012-08-30 | 2018-03-06 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US11483160B2 (en) | 2012-08-30 | 2022-10-25 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US10778440B2 (en) | 2012-08-30 | 2020-09-15 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US11870912B2 (en) | 2012-08-30 | 2024-01-09 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US10068246B2 (en) | 2013-07-12 | 2018-09-04 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US11830028B2 (en) | 2013-07-12 | 2023-11-28 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US11205191B2 (en) | 2013-07-12 | 2021-12-21 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US10038968B2 (en) | 2013-07-17 | 2018-07-31 | PlaceIQ, Inc. | Branching mobile-device to system-namespace identifier mappings |
US10956947B2 (en) | 2013-12-23 | 2021-03-23 | The Nielsen Company (Us), Llc | Methods and apparatus to measure media using media object characteristics |
US11854049B2 (en) | 2013-12-23 | 2023-12-26 | The Nielsen Company (Us), Llc | Methods and apparatus to measure media using media object characteristics |
US11562098B2 (en) | 2013-12-31 | 2023-01-24 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US10846430B2 (en) | 2013-12-31 | 2020-11-24 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US9641336B2 (en) | 2013-12-31 | 2017-05-02 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US9979544B2 (en) | 2013-12-31 | 2018-05-22 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US10498534B2 (en) | 2013-12-31 | 2019-12-03 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions and search terms |
US11068928B2 (en) | 2014-07-17 | 2021-07-20 | The Nielsen Company (Us), Llc | Methods and apparatus to determine impressions corresponding to market segments |
US11854041B2 (en) | 2014-07-17 | 2023-12-26 | The Nielsen Company (Us), Llc | Methods and apparatus to determine impressions corresponding to market segments |
US10311464B2 (en) * | 2014-07-17 | 2019-06-04 | The Nielsen Company (Us), Llc | Methods and apparatus to determine impressions corresponding to market segments |
US11562394B2 (en) | 2014-08-29 | 2023-01-24 | The Nielsen Company (Us), Llc | Methods and apparatus to associate transactions with media impressions |
US11272249B2 (en) | 2015-12-17 | 2022-03-08 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US11785293B2 (en) | 2015-12-17 | 2023-10-10 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US10205994B2 (en) | 2015-12-17 | 2019-02-12 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US10827217B2 (en) | 2015-12-17 | 2020-11-03 | The Nielsen Company (Us), Llc | Methods and apparatus to collect distributed user information for media impressions |
US20170345050A1 (en) * | 2016-05-24 | 2017-11-30 | Trever Gregory | Attribution system and method |
US11856264B2 (en) * | 2016-11-15 | 2023-12-26 | Google Llc | Systems and methods for reducing download requirements |
US11856265B2 (en) * | 2016-11-15 | 2023-12-26 | Google Llc | Systems and methods for reducing download requirements |
US10462609B1 (en) * | 2017-11-06 | 2019-10-29 | Christopher Paul Carroll | Systems and methods for tracking a person |
US20200242658A1 (en) * | 2019-01-24 | 2020-07-30 | Walmart Apollo, Llc | Method and apparatus for determining effectiveness of digital advertisements |
US11245536B2 (en) * | 2019-04-16 | 2022-02-08 | Meta Platforms, Inc. | Secure multi-party computation attribution |
Also Published As
Publication number | Publication date |
---|---|
US20210012373A1 (en) | 2021-01-14 |
CA3156903A1 (en) | 2016-02-29 |
EP2991018A1 (en) | 2016-03-02 |
MX2014014747A (en) | 2016-02-29 |
US11562394B2 (en) | 2023-01-24 |
CA2872704A1 (en) | 2016-02-29 |
CA3040572C (en) | 2022-07-26 |
CA3040572A1 (en) | 2016-02-29 |
CA2872704C (en) | 2019-06-11 |
CN105894313A (en) | 2016-08-24 |
US20230162229A1 (en) | 2023-05-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11562394B2 (en) | Methods and apparatus to associate transactions with media impressions | |
US11830028B2 (en) | Methods and apparatus to collect distributed user information for media impressions | |
JP7121159B2 (en) | Method, Apparatus and Machine-readable Storage Medium for Collecting Distributed User Information Regarding Media Impressions and Search Terms | |
US10846430B2 (en) | Methods and apparatus to collect distributed user information for media impressions and search terms | |
WO2018107459A1 (en) | Methods and apparatus to estimate media impression frequency distributions | |
US20160019580A1 (en) | Methods and apparatus to determine impressions corresponding to market segments | |
US11397965B2 (en) | Processor systems to estimate audience sizes and impression counts for different frequency intervals |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: THE NIELSEN COMPANY (US), LLC, ILLINOIS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ALLA, MADHUSUDHAN REDDY;ROLLINGER, JILLIAN RENEE;SIGNING DATES FROM 20140825 TO 20140829;REEL/FRAME:035272/0971 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
AS | Assignment |
Owner name: CITIBANK, N.A., NEW YORK Free format text: SUPPLEMENTAL SECURITY AGREEMENT;ASSIGNORS:A. C. NIELSEN COMPANY, LLC;ACN HOLDINGS INC.;ACNIELSEN CORPORATION;AND OTHERS;REEL/FRAME:053473/0001 Effective date: 20200604 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: CITIBANK, N.A, NEW YORK Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT;ASSIGNORS:A.C. NIELSEN (ARGENTINA) S.A.;A.C. NIELSEN COMPANY, LLC;ACN HOLDINGS INC.;AND OTHERS;REEL/FRAME:054066/0064 Effective date: 20200604 |
|
AS | Assignment |
Owner name: NETRATINGS, LLC, NEW YORK Free format text: RELEASE (REEL 053473 / FRAME 0001);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063603/0001 Effective date: 20221011 Owner name: THE NIELSEN COMPANY (US), LLC, NEW YORK Free format text: RELEASE (REEL 053473 / FRAME 0001);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063603/0001 Effective date: 20221011 Owner name: GRACENOTE MEDIA SERVICES, LLC, NEW YORK Free format text: RELEASE (REEL 053473 / FRAME 0001);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063603/0001 Effective date: 20221011 Owner name: GRACENOTE, INC., NEW YORK Free format text: RELEASE (REEL 053473 / FRAME 0001);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063603/0001 Effective date: 20221011 Owner name: EXELATE, INC., NEW YORK Free format text: RELEASE (REEL 053473 / FRAME 0001);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063603/0001 Effective date: 20221011 Owner name: A. C. NIELSEN COMPANY, LLC, NEW YORK Free format text: RELEASE (REEL 053473 / FRAME 0001);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063603/0001 Effective date: 20221011 Owner name: NETRATINGS, LLC, NEW YORK Free format text: RELEASE (REEL 054066 / FRAME 0064);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063605/0001 Effective date: 20221011 Owner name: THE NIELSEN COMPANY (US), LLC, NEW YORK Free format text: RELEASE (REEL 054066 / FRAME 0064);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063605/0001 Effective date: 20221011 Owner name: GRACENOTE MEDIA SERVICES, LLC, NEW YORK Free format text: RELEASE (REEL 054066 / FRAME 0064);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063605/0001 Effective date: 20221011 Owner name: GRACENOTE, INC., NEW YORK Free format text: RELEASE (REEL 054066 / FRAME 0064);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063605/0001 Effective date: 20221011 Owner name: EXELATE, INC., NEW YORK Free format text: RELEASE (REEL 054066 / FRAME 0064);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063605/0001 Effective date: 20221011 Owner name: A. C. NIELSEN COMPANY, LLC, NEW YORK Free format text: RELEASE (REEL 054066 / FRAME 0064);ASSIGNOR:CITIBANK, N.A.;REEL/FRAME:063605/0001 Effective date: 20221011 |