US20120046993A1 - Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding - Google Patents
Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding Download PDFInfo
- Publication number
- US20120046993A1 US20120046993A1 US13/088,528 US201113088528A US2012046993A1 US 20120046993 A1 US20120046993 A1 US 20120046993A1 US 201113088528 A US201113088528 A US 201113088528A US 2012046993 A1 US2012046993 A1 US 2012046993A1
- Authority
- US
- United States
- Prior art keywords
- stimulus
- coded
- emotions
- facial
- report
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5854—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using shape and object relationship
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
Definitions
- the invention relates to methods of measuring consumer reaction to business stimuli.
- Awareness concerns the ability to ascertain whether consumers have noticed a stimulus, typically in terms of being able to recall it later by memory.
- consideration concerns the ability to move the consumer to a point of engaging with the stimulus in hopes of promoting a sales opportunity.
- both methods of evaluation have customarily been based on asking consumers to verbally recount whether they remember being exposed to a stimulus and whether their attitude toward the offer has become more positive.
- Inherent in this approach is the limitation that people may provide a knowingly false assessment to appease the interviewer or else may not readily know or be able to verbalize their response.
- awareness asking a consumer whether they recall a stimulus does not provide actionable insight as to how precisely they processed the stimulus.
- a first aspect of the invention is a method of reporting consumer reaction to a stimulus.
- a second aspect of the invention is a report on consumer reaction to a stimulus.
- a first embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions and eye positions of a human subject while exposed to a stimulus throughout a time period, (ii) coding recorded facial expressions to emotions, and (iii) reporting recorded eye positions and coded emotions, along with an identification of the stimulus.
- a second embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions and eye positions of a human subject while exposed to a stimulus throughout a time period, (ii) coding and translating recorded facial expressions to at least one of an impact score and an appeal score, and (iii) reporting recorded eye positions and at least one of a coded impact score and a coded appeal score, along with an identification of the stimulus.
- a third embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions and eye positions of a plurality of human subjects while each is exposed to a stimulus throughout a time period, (ii) ascertaining the number of human subjects who exhibited at least one recorded facial expression capable of being coded to an emotion while exposed to the stimulus, and (iii) reporting recorded eye positions and information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded, along with an identification of the stimulus to which the subject was exposed.
- a fourth embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (ii) coding recorded facial expressions to emotions when the eye position is fixed upon the given attribute of the stimulus, and (iii) reporting coded emotions along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- a fifth embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (ii) coding and translating recorded facial expressions to at least one of an impact score and an appeal score when the eye position is fixed upon the given attribute of the stimulus, and (iii) reporting at least one of the coded impact score and the coded appeal score, along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- a sixth embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (ii) ascertaining the number of human subjects exposed to the stimulus who exhibited at least one recorded facial expression capable of being coded to an emotion when the eye position was fixed upon the given attribute of the stimulus, and (iii) reporting information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded when the eye position was fixed upon the given attribute of the stimulus, along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- a first embodiment of the second aspect of the invention includes (i) a visual indication of the eye positions of a human subject while exposed to a stimulus during a time period, (ii) a list of at least one emotion coded from facial expressions exhibited by the subject while exposed to the stimulus, and (iii) an identification of the stimulus to which the subject was exposed.
- a second embodiment of the second aspect of the invention includes (i) a visual indication of the eye positions of a human subject while exposed to a stimulus during a time period, (ii) at least one of an impact score and an appeal score, coded and translated from facial expressions exhibited by the subject while exposed to the stimulus, and (iii) an identification of the stimulus to which the subject was exposed.
- a third embodiment of the second aspect of the invention includes (i) a visual indication of the eye positions of a human subject while exposed to a stimulus, (ii) information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded while exposed to the stimulus, and (iii) an identification of the stimulus to which the subject was exposed.
- a fourth embodiment of the second aspect of the invention includes (i) a visual indication of a stimulus to which a human subject was exposed, (ii) an identification of a given attribute of the stimulus, and (iii) a list of at least one emotion coded from facial expressions exhibited by the subject when the eye position is fixed upon the given attribute of the stimulus.
- a fifth embodiment of the second aspect of the invention includes (i) a visual indication of a stimulus to which a human subject was exposed, (ii) an identification of a given attribute of the stimulus, and (iii) at least one of an impact score and an appeal score coded and translated from facial expressions exhibited by the subject when the eye position of the subject is fixed upon the given attribute of the stimulus.
- a sixth embodiment of the second aspect of the invention includes (i) a visual indication of a stimulus to which a human subject was exposed, (b) an identification of a given attribute of the stimulus, and (c) information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded when the eye position was fixed upon the given attribute of the stimulus.
- a method of reporting consumer reaction to a stimulus comprising: (a) recording facial expressions and eye positions of a human subject while exposed to a stimulus throughout a time period, (b) coding and translating recorded facial expressions to at least one of an impact score and an appeal score, and (c) reporting recorded eye positions and at least one of a coded impact score and a coded appeal score, along with an identification of the stimulus.
- reporting recorded eye positions comprises superimposing a visual indication of the location of the recorded eye positions upon a depiction of the stimulus.
- reporting recorded eye positions comprises superimposing a visual indication of the density of recorded eye positions upon a depiction of the stimulus.
- a report on consumer reaction to a stimulus comprising: (a) a visual indication of the eye positions of a human subject while exposed to a stimulus during a time period, (b) at least one of an impact score and an appeal score, coded and translated from facial expressions exhibited by the subject while exposed to the stimulus, and (c) an identification of the stimulus to which the subject was exposed.
- a method of reporting consumer reaction to a stimulus comprising: (a) recording facial expressions and eye positions of a plurality of human subjects while each is exposed to a stimulus throughout a time period, (b) ascertaining the number of human subjects who exhibited at least one recorded facial expression capable of being coded to an emotion while exposed to the stimulus, and (c) reporting recorded eye positions and information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded, along with an identification of the stimulus to which the subject was exposed.
- steps (a) through (c) are repeated for a plurality of consecutive time periods.
- reporting recorded eye positions comprises superimposing a visual indication of the location of the recorded eye positions upon a depiction of the stimulus.
- reporting recorded eye positions comprises superimposing a visual indication of the density of recorded eye positions upon a depiction of the stimulus.
- a report on consumer reaction to a stimulus comprising: (a) a visual indication of the eye positions of a human subject while exposed to a stimulus, (b) information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded while exposed to the stimulus, and (c) an identification of the stimulus to which the subject was exposed.
- a method of reporting consumer reaction to an attribute of a stimulus comprising: (a) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (b) coding recorded facial expressions to emotions when the eye position is fixed upon the given attribute of the stimulus, and (c) reporting coded emotions along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- steps (a) through (c) are performed for a plurality of different attributes of the same stimulus.
- reporting coded emotions comprises reporting a tally of coded emotions as a percentage of each coded emotion relative to all coded emotions.
- coding recorded facial expressions to emotions comprises coding recorded facial expressions to positive and negative emotions
- reporting coded emotions comprises reporting at least one of ( ⁇ ) the percentage of all coded emotions comprising positive emotions, ( ⁇ ) the percentage of all coded emotions comprising negative emotions, and ( ⁇ ) an average of the positive and negative coded emotions.
- a report on consumer reaction to an attribute of a stimulus comprising: (a) a visual indication of a stimulus to which a human subject was exposed, (b) an identification of a given attribute of the stimulus, and (c) a list of at least one emotion coded from facial expressions exhibited by the subject when the eye position is fixed upon the given attribute of the stimulus.
- the list of at least one emotion includes a tally of emotions coded from facial expressions exhibited by the subject when the eye position is fixed upon the given attribute of the stimulus, reported as a percentage of each emotion relative to all emotions.
- the report of paragraph [0066] wherein the list of at least one emotion comprises a listing of emotions grouped as positive and negative emotions.
- a method of reporting consumer reaction to an attribute of a stimulus comprising: (a) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (b) coding and translating recorded facial expressions to at least one of an impact score and an appeal score when the eye position is fixed upon the given attribute of the stimulus, and (c) reporting at least one of the coded impact score and the coded appeal score, along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- steps (a) through (c) are performed for a plurality of different attributes of the same stimulus.
- a report on consumer reaction to an attribute of a stimulus comprising: (a) a visual indication of a stimulus to which a human subject was exposed, (b) an identification of a given attribute of the stimulus, and (c) at least one of an impact score and an appeal score coded and translated from facial expressions exhibited by the subject when the eye position of the subject is fixed upon the given attribute of the stimulus.
- a method of reporting consumer reaction to an attribute of a stimulus comprising: (a) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (b) ascertaining the number of human subjects exposed to the stimulus who exhibited at least one recorded facial expression capable of being coded to an emotion when the eye position was fixed upon the given attribute of the stimulus, and (c) reporting information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded when the eye position was fixed upon the given attribute of the stimulus, along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- a report on consumer reaction to an attribute of a stimulus comprising: (a) a visual indication of a stimulus to which a human subject was exposed, (b) an identification of a given attribute of the stimulus, and (c) information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded when the eye position was fixed upon the given attribute of the stimulus.
- FIG. 1 is one embodiment of a set of facial features suitable for tracking by the ffTTM facial feature tracking software.
- FIG. 2 is an example of the report aspect of the invention.
- FIG. 3 is an example of the report aspect of the invention.
- FIG. 4 is an example of the report aspect of the invention.
- FIG. 5 is an example of the report aspect of the invention.
- FIG. 6 is an example of the report aspect of the invention.
- FIG. 7 is an example of the report aspect of the invention.
- FIG. 8 is an example of the report aspect of the invention.
- business stimulus means both company stimulus and marketing stimulus.
- company stimulus refers to an item pertaining to the governance, organization, management, structure, policies, procedures, work-place environment, etc. of a company.
- exemplary company stimuli include announcements to employees, reporting obligations of employees, physical location of management relative to employees reporting to management, lunch break policy, smoking ban policy, bonus pay policy and procedure, type of work-stations, etc.
- marketing stimulus refers to an item selected and designed to (i) advertise, promote and/or enhance the sales or acceptance of a product and/or service, (ii) advertise, promote, improve and/or enhance customer recognition and/or the public image of a person and/or business, (iii) position a product, and/or (iv) enhance brand identity.
- Exemplary marketing stimuli include, television commercials, radio advertisements, print advertisements, billboard advertisements, point-of-purchase displays, live inquiry such as questions regarding pricing, questions regarding attitudes and questions regarding purchasing preferences, store-front signage, packaging, Yellow Pages advertisements, brochures, literature used in mass mailings, web sites, individual web pages, store layouts, interior design of a store, product appearance, product operation, presentation materials, computer generated virtual shopping experiences, etc.
- FACS Facial Action Coding System
- the tracking of facial muscle activity provides a method for gauging consideration through the degree of emotional buy-in.
- This method is commonly known as facial coding, and it typically involves using either comprehensive facial measurements or selective facial measurements.
- Comprehensive facial measurements include open-ended observations of what is casually seen or direct measurements such as the Facial Action Coding System (“FACS”) originally described in Ekman, P., Friesen, W. V., Facial Action Coding System: A Technique for the Measurement of Facial Movement , consulting Psychologists Press, Palo Alto, Calif. (1978).
- FACS Facial Action Coding System
- the invention provides a synchronized means of assessing the look and feel responses of consumers to business stimuli in order to aid companies and agencies as they seek to enhance the effectiveness of their advertising and general marketing efforts.
- the method involves (a) capturing what specifically the test participants are looking at when they visually inspect stimulus, typically a marketing stimulus, through the use of an eye tracking unit, (b) taking the recorded output and displaying it as a series of diagrams that indicate on an individual or collective basis where the subjects specifically looked, for how long, and the order in which they most commonly reviewed the pictorial object, (c) visually recording facial expressions of a human subject as the subject is exposed to the pictorial object so as to generate a chronological sequence of recorded facial images, (d) reviewing the videotape of the facial expressions in order to detect and record the expressions using the FACS system or a system based upon FACS; (e) coding contemporaneously detected and recorded expressional repositionings to at least one of an action unit, one or more emotions, or a combination of an appeal value and an impact value,
- the method can further include combining the eye tracking and facial coding results by providing a display of the eye tracking output in conjunction with the appeal and impact tallies, the percentage of positive and negative emotions, and/or the specific emotions felt by the test subjects in relation to the pictorial object, in general, as well as to specific elements within the object.
- a subject is recruited for participation as a member of a sample population, sometimes after responding appropriately to several qualification questions (e.g., are they a member of the product target market).
- the portions of the interview session that will involve the simultaneously capturing of eye tracking data and videotape to be used for facial coding analysis purposes is facilitated by a video camera positioned atop the eye tracker unit.
- a video camera positioned atop the eye tracker unit.
- One possible embodiment of the method is to utilize a Tobii Model 1750 Eye Tracker available from Tobii Technology AB of Sweden. It comes equipped with five miniature cameras set into a monitor, above and below and computer screen on which the stimuli are presented.
- the stimuli will be shown on the eye tracker unit's screen, causing the participant to look slightly up and ahead, thus enabling the capture of high quality images of the participant's facial expressions through a video camera (i.e., a web camera) while the participants are looking at the business stimuli to be presented to them.
- a video camera i.e., a web camera
- Another option is to mount a camera on the table or desktop in front of the participant.
- the participant At the start of an interview session, the participant will take a seat in front of the eye tracking unit and go through a brief calibration phrases, where a series of red dots are shown on screen and the participant is asked to focus on each dot, in turn, to ensure that the machine is tracking their eye gaze accurately. Once that exercise is complete, the testing session can begin.
- the participant is then exposed to the stimuli on the eye tracking unit screen (i.e., a business stimuli).
- the exposure is likely to be for a specific timed duration, with the stimuli either shown in a set order or in randomized fashion.
- the camera will be on so as to record the participant's non-verbal, facial response to the stimulus the participants are experiencing. Questions or ratings may or may not occur between the exposure periods for the variety of stimuli to be shown as part of the testing session. Whatever the procedure, care should be taken to ensure that the procedure of presenting the stimuli does not distract or inhibit the participant's natural responses to the experience more so than necessary.
- the videotape Upon completion of the session (i.e., exposure to the entire collection of stimuli) the videotape is shut off and the participant dismissed.
- the session is repeated for about 10 to 200, preferably about 20 to 100 participants.
- Eye tracking output is based on securing gaze fixations. For example, output from a Tobii Model 1750 Eye Tracker shows a blue dot for individual output anytime a person has observed a specific detail in the pictorial object for at least 50 milliseconds. That threshold is used because research indicates that a person needs a gaze of at least that duration to be able to process a visual element, whether that element consists of words (text), an image or some combination thereof. The blue dot will increase in size to the extent that the stabilized gaze duration exceeds the 50 millisecond threshold. A gaze duration that reaches that threshold is referred to as a fixation.
- a second output at the individual level consists of blue tracer lines that indicate saccades, or rapid eye scans that don't reach the 50 millisecond threshold.
- the tracer lines or saccades are useful in indicating the path or flow the eye is taking in assessing the pictorial object.
- hot spot map(s) can be generated that show where on the pictorial element the subjects collectively concentrated their gaze the most.
- a print ad may be coded with a dark red hot spot that indicates that a majority of the gaze durations, or fixations, were devoted to the key visual image dominating the middle of the screen.
- a green spot on the company's logo can indicate that a much less dense mass of gaze durations were devoted to the company sponsoring the ad.
- Stimuli which changes during the testing period e.g., a TV spot
- a hot spot map may be generated frame-by-frame or second-by-second throughout the testing period.
- consumer reaction to the stimulus is assessed utilizing facial coding (e.g., FACS), to obtain information about the emotional response to what the subjects are viewing.
- facial coding e.g., FACS
- This assessment may be done manually or automated through the use of a computer, typically involving a series of viewing periods each as short as 1/30 th of a second.
- the review may involve a variety of approaches, including: (a) a computer that detects instances where there is sufficient facial muscle activity to suggest a codeable event, with a manual review and coding of the activity during such detected instances using the FACS system, (b) a fully computerized system in which the videotape of the session can be analyzed by software having facial feature tracking capabilities, whereby expressional repositioning of selected facial features by the participant in the videotape can be automatically detected and recorded, and (c) a manual review of the videotape, for the same purpose of assessing whether significant facial muscle activity occurs that can then be coded using the FACS system.
- ffTTM facial feature tracking
- a preferred set of facial features suitable for tracking by the ffTTM facial feature tracking software is described in Table Two below and depicted in FIG. 1 .
- This preferred set of facial features allows the detection of facial feature movements (FFMs) suitable for coding to action units (AUs), Emotions, Emotional Values, and Appeal and Impact Values suitable for use in the present invention.
- FFMs facial feature movements
- AUs action units
- Emotions Emotional Values
- Appeal and Impact Values suitable for use in the present invention.
- the software can conduct a computerized comparison of the facial position of each of the selected facial features through sequential facial images and automatically code contemporaneously detected and recorded expressional repositionings to at least one of an AU, one or more Emotions and Emotional Values, or a combination of an Appeal Value and an Impact Value (A&I Values) in accordance with a coding and translation system, such as the specific coding system set forth below.
- the software notes the location of any detected smile (i.e., facial expression involving upward and outward movement of one or both corners of mouth (nodes 11 )) so that a trained individual can quickly locate occurrences of a smile on the videotape, manually view the smile, categorize the smile as a true smile (expansive smile that also may include crow's feet around the eyes and the relaxation of the muscle circling the eye such that the eye acquires the tell-tale glint or “twinkle” of joy), a robust social smile involving only the lower part of the face, a weak social smile also involving only the lower part of the face and not as uplifted as a robust social smile, or a micro-smile (on one side of the face only and more briefly), and input such categorization data into the computer system for use in coding.
- An optional smile category is skepticism (a social smile that is accompanied by a negative or sarcastic comment, such that the smile “masks”
- Detected and reported FFMs can be automatically coded to AUs by a computer in accordance with a predetermined code, such as that set forth in Table Three.
- Coded AUs can be translated to Emotions and Emotional Values by a computer in accordance with a predetermined correlation system, such as that set forth in Table Four. Since AU12F can translate for more than one set of Emotions and Emotional Values, additional information is required.
- a true smile is identified as AU12T and translates as set forth in Table Four.
- a robust social smile is an AU12R and translates as set forth in Table Four.
- a weak social smile is an AU12W.
- a social smile accompanied by a negative or sarcastic comment is an AU12S and translates as set forth in Table Four.
- a unilateral micro smile is an AU12U and translates as set forth in Table Four.
- the additional information necessary to determine with a coded AU12F as an AU12T, AU12R, AU12W or an AU12S can be manually input into the computer by a trained individual after viewing that segment of the videotape corresponding to the coded AU12F and observing whether the AU12F is expansive and involving the eyes, full, less robust, or perhaps accompanied by a negative or sarcastic comment.
- the computer can be programmed to bypass the step of coding FFMs to AUs and simply code the FFMs directly to Emotions and Emotional Values when this correlation is known.
- Translated Emotions and Emotional Values may be further translated into A&I Values by a computer in accordance with a predetermined correlation system, such as that set forth in Table Five.
- the computer can be programmed to bypass the step of coding FFMs to AUs and/or translating coded AUs to Emotions and Emotional Values and simply code FFMs directly to A&I Values when this correlation is known.
- the Emotional Values and/or A&I Values may be reported for each participant, segmented groups of the participants (e.g., men v. women or those who had purchased the advertised product before v. those who had not purchased the advertised product before) or all participants.
- the Emotional Values and/or A&I Values may also be reported at selected time intervals (e.g., every second), at selected points in the session (e.g., one report during viewing of the stimulus and another report during the interview), or the entire session.
- reports include specifically, but not exclusively, (i) reporting the data separately for each individual stimuli, (ii) reporting the data for a plurality of stimuli in comparative form, (iii) reporting the data separately for each member of the sample population, (iv) graphically reporting the average appeal and impact values with each score forming an axis of the graph, (v) graphically reporting the average appeal and impact values for only a selected portion of the exposure period (e.g., the first two seconds of exposure to the business stimuli, the reaction to a specific question, etc.), (vi) graphically reporting the average appeal and impact values for a plurality of distinct portions of the exposure period together on the same graph (e.g., scores during exposure to the business stimuli and scores during questioning), (vii) graphically reporting the appeal and impact values for each participant to ascertain the distribution of the participants, (viii) graphically reporting the percentage of each emotional value, (ix) graphically reporting the percentage of each coded emotion relative to all coded emotions, by percentage or otherwise;
- Another reporting option is reporting the level of emotional engagement.
- the goal here is to indicate the degree to which the sampled participants had a discernible emotional response to the stimuli for which gaze attention is being recorded, using a FACS based system.
- the preferred embodiment is to record the percentage of participants who had at least one emotional response based on at least one discernable AU being detected and recorded per participant, regardless of the overall volume of AU's by the participant.
- Other methods could include: (a) recording the overall volume of AU's for comparative purposes against other stimuli, or (b) recording the average number of AU's discernable by all participants who had at least AU recorded.
- Combining eye tracking output with a facial coding system especially when it includes a unique scoring system for determining the extent to which consumers are impacted by a business stimulus and whether such impact was favorable or unfavorable, provides a truer scientific means of gauging awareness and consideration effectiveness. Such a presentation of consumer reaction facilitates the decision making process for companies and agencies seeking to make judgments about how best to enhance the effectiveness of their marketing efforts.
- the stimuli can be placed within a comparative or even directly competitive context when desired.
- Use of the method with competing stimuli can be evaluated, providing not only a summary of the eye tracking and facial coding behavioral responses but also a comparison between two stimuli performances, revealing subtle differences.
- Use of the method enhances the ability of a company to tailor product and marketing efforts to existing and prospective customers.
- the method possesses several advantages, including: (1) the ability to capture the subtle, otherwise undetectable ways in which our bodies register and reflect our actions and emotions, (2) the ability to capture subconscious behavioral responses to stimuli beyond what might be otherwise consciously known and verbally acknowledged, (3) the ability to practice real-time and frame-by-frame assessment of responses during the initial experience of a stimulus, (4) the ability to conduct the study in an unobtrusive and non-invasive manner, and (5) an objective based scientific system for monitoring gaze attention and emotional responses which is more accurate and precise than subjective reports.
- the method can be usefully and successfully employed in connection with substantially any stimuli, finding excellent commercial application to business stimuli, including specifically, but not exclusively, television advertising, movie trailers, customer service dynamics, signage, uniforms, vehicles, print ads, direct mail, product packaging and design, point of purchase displays, actual packaged or unpackaged products, store environments, corporate lobbies, logos, brand names, taglines, catalogs, entire web sites, individual web pages, Power PointTM presentations, company announcements, etc.
- a participant was exposed to a stimuli depicted on a computer monitor set at a screen resolution of 1024 ⁇ 768.
- the eye movements were captured using a Tobii Model 1750 Eye Tracker.
- Minimum duration of fixation was set at 50 milliseconds. The time, duration and location of detected fixations are reported in TABLE SIX below.
- a participant was exposed to a stimuli depicted on a computer monitor.
- the eye movements were captured using a Tobii Model 1750 Eye Tracker.
- Minimum duration of fixation was set at 50 milliseconds.
- the initial saccade and first detected fixation point are shown in FIG. 2 as a gray line and gray dot respectively, superimposed on the stimuli.
- the eye movements were captured using a Tobii Model 1750 Eye Tracker.
- the faces of the participants were also videotaped during the 30 second exposure period.
- the eye tracking output consisted of a dot map for each second of the television spot, with dots showing where the participants directed most of their gaze attention and dot size representing duration of fixation and number of participants.
- the videotape of each participant was analyzed using FACS.
- One of the resultant reports is depicted in FIG. 3 .
- the eye tracking output consisted of a hot spot map for each second of the television spot with a variation in color intensity and/or color selection depicting where the participants directed most of their gaze attention.
- the videotape of each participant was analyzed using FACS. The percentage of positive and negative facial coding activity, as well as the top three coded emotions by percentage of activity elicited by the television spot was displayed alongside the hot spot gaze-density map. The resultant report is depicted in FIG. 4 .
- the eye tracking output consisted (i) of a single hot spot gaze-density map showing where the participants directed most of their gaze attention, and (ii) a table listing number of eye fixations and/or cumulative eye fixation duration as a % of the total number of eye fixations and/or eye fixation duration, for various areas of interest on the print ad input into the eye tracking system.
- the videotape of each participant was analyzed using FACS.
- the top two coded emotions by percentage of activity elicited by the print ad was displayed alongside the hot spot gaze-density map and eye fixation table.
- the resultant report is depicted in FIG. 5 .
- the report consists of a second-by-second display of the hot spot gaze-density maps, along with a sliding line on the Impact and Appeal graph indicating the time at which the currently displayed hot spot gaze-density map occurred.
- the report at one point in time is depicted in FIG. 6 .
- the eye movements are captured using a Tobii Model 1750 Eye Tracker.
- the faces of the participants are also videotaped during the 60 second exposure period.
- the eye tracking output consists of second-by-second hot spot gaze-density maps of the in-store video, showing where the participants directed most of their gaze attention during that second.
- the videotape of each participant is analyzed using FACS.
- the sum of positive and negative facial coding activity elicited by the in-store video during each second of the exposure period is determined and displayed on a chronological graph.
- the report consists of a second-by-second display of the hot spot gaze-density maps, along with a sliding line on the positive and negative emotional graph indicating the time at which the currently displayed hot spot gaze-density map occurs.
- the report at one point in time is depicted in FIG. 7 .
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Entrepreneurship & Innovation (AREA)
- General Physics & Mathematics (AREA)
- Game Theory and Decision Science (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Economics (AREA)
- Data Mining & Analysis (AREA)
- Library & Information Science (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
A method of reporting consumer reaction to a stimulus and resultant report generated by (i) recording facial expressions and eye positions of a human subject while exposed to a stimulus throughout a time period, (ii) coding recorded facial expressions to emotions, and (iii) reporting recorded eye positions and coded emotions, along with an identification of the stimulus.
Description
- The invention relates to methods of measuring consumer reaction to business stimuli.
- Two key terms of importance to companies, their agencies, and marketing researchers in evaluating the effectiveness of advertising and other promotional materials are awareness and consideration. Awareness concerns the ability to ascertain whether consumers have noticed a stimulus, typically in terms of being able to recall it later by memory. Meanwhile, consideration concerns the ability to move the consumer to a point of engaging with the stimulus in hopes of promoting a sales opportunity. To date, however, both methods of evaluation have customarily been based on asking consumers to verbally recount whether they remember being exposed to a stimulus and whether their attitude toward the offer has become more positive. Inherent in this approach is the limitation that people may provide a knowingly false assessment to appease the interviewer or else may not readily know or be able to verbalize their response. Furthermore, in the case of awareness asking a consumer whether they recall a stimulus does not provide actionable insight as to how precisely they processed the stimulus.
- The phenomenon of visual attention has been studied for over a century, but it is within the last few decades that advancements in eye tracking technology have made eye tracking feasible for business applications. Comprehensive eye tracking involves both the “what” and “where” of visual attention, which means the gauging of what specific details within a pictorial object get noticed by consumers and for what duration, and where in terms of the path the eye takes in sequentially noticing specific regions of interest within the pictorial object.
- Means of tracking eye movements to assess awareness have been practiced by companies using stationary models to test consumers' gaze patterns. But despite the ability to learn where the subjects are looking on a real-time, behavioral, and in effect largely subconscious basis, those practitioners of eye tracking have been unable to report back to their clients how the test subjects are responding to the specific objects of their attention other than through conscious, cognitive, verbalized and generally after-the-fact summations.
- Accordingly, a need exists for an improved method of marrying the unique capabilities of eye tracking with a means of assessing consideration.
- A first aspect of the invention is a method of reporting consumer reaction to a stimulus. A second aspect of the invention is a report on consumer reaction to a stimulus.
- A first embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions and eye positions of a human subject while exposed to a stimulus throughout a time period, (ii) coding recorded facial expressions to emotions, and (iii) reporting recorded eye positions and coded emotions, along with an identification of the stimulus.
- A second embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions and eye positions of a human subject while exposed to a stimulus throughout a time period, (ii) coding and translating recorded facial expressions to at least one of an impact score and an appeal score, and (iii) reporting recorded eye positions and at least one of a coded impact score and a coded appeal score, along with an identification of the stimulus.
- A third embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions and eye positions of a plurality of human subjects while each is exposed to a stimulus throughout a time period, (ii) ascertaining the number of human subjects who exhibited at least one recorded facial expression capable of being coded to an emotion while exposed to the stimulus, and (iii) reporting recorded eye positions and information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded, along with an identification of the stimulus to which the subject was exposed.
- A fourth embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (ii) coding recorded facial expressions to emotions when the eye position is fixed upon the given attribute of the stimulus, and (iii) reporting coded emotions along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- A fifth embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (ii) coding and translating recorded facial expressions to at least one of an impact score and an appeal score when the eye position is fixed upon the given attribute of the stimulus, and (iii) reporting at least one of the coded impact score and the coded appeal score, along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- A sixth embodiment of the first aspect of the invention includes the steps of (i) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (ii) ascertaining the number of human subjects exposed to the stimulus who exhibited at least one recorded facial expression capable of being coded to an emotion when the eye position was fixed upon the given attribute of the stimulus, and (iii) reporting information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded when the eye position was fixed upon the given attribute of the stimulus, along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- A first embodiment of the second aspect of the invention includes (i) a visual indication of the eye positions of a human subject while exposed to a stimulus during a time period, (ii) a list of at least one emotion coded from facial expressions exhibited by the subject while exposed to the stimulus, and (iii) an identification of the stimulus to which the subject was exposed.
- A second embodiment of the second aspect of the invention includes (i) a visual indication of the eye positions of a human subject while exposed to a stimulus during a time period, (ii) at least one of an impact score and an appeal score, coded and translated from facial expressions exhibited by the subject while exposed to the stimulus, and (iii) an identification of the stimulus to which the subject was exposed.
- A third embodiment of the second aspect of the invention includes (i) a visual indication of the eye positions of a human subject while exposed to a stimulus, (ii) information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded while exposed to the stimulus, and (iii) an identification of the stimulus to which the subject was exposed.
- A fourth embodiment of the second aspect of the invention includes (i) a visual indication of a stimulus to which a human subject was exposed, (ii) an identification of a given attribute of the stimulus, and (iii) a list of at least one emotion coded from facial expressions exhibited by the subject when the eye position is fixed upon the given attribute of the stimulus.
- A fifth embodiment of the second aspect of the invention includes (i) a visual indication of a stimulus to which a human subject was exposed, (ii) an identification of a given attribute of the stimulus, and (iii) at least one of an impact score and an appeal score coded and translated from facial expressions exhibited by the subject when the eye position of the subject is fixed upon the given attribute of the stimulus.
- A sixth embodiment of the second aspect of the invention includes (i) a visual indication of a stimulus to which a human subject was exposed, (b) an identification of a given attribute of the stimulus, and (c) information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded when the eye position was fixed upon the given attribute of the stimulus.
- A method of reporting consumer reaction to a stimulus, comprising: (a) recording facial expressions and eye positions of a human subject while exposed to a stimulus throughout a time period, (b) coding and translating recorded facial expressions to at least one of an impact score and an appeal score, and (c) reporting recorded eye positions and at least one of a coded impact score and a coded appeal score, along with an identification of the stimulus.
- The method of paragraph [0019] wherein recorded facial expressions are coded and translated to both an impact score and an appeal score, and both the impact score and the appeal score are reported.
- The method of paragraph [0019] further comprising (i) repeating steps (a) through (c) for a plurality of human subjects with the same stimulus, and (ii) reporting information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded.
- The method of paragraph [0019] further comprising (i) coding recorded facial expressions to emotions, and (ii) reporting the coded emotions along with the recorded eye positions.
- The method of paragraph [0019] wherein an eye position is detected and recorded when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The method of paragraph [0019] wherein exposure to the stimulus lasts for a time period of about 1 to 10 seconds.
- The method of paragraph [0022] wherein facial expressions are coded by a facial coding technique.
- The method of paragraph [0025] wherein the facial coding technique is based upon FACS.
- The method of paragraph [0019] wherein reporting recorded eye positions comprises superimposing a visual indication of the location of the recorded eye positions upon a depiction of the stimulus.
- The method of paragraph [0019] wherein reporting recorded eye positions comprises superimposing a visual indication of the density of recorded eye positions upon a depiction of the stimulus.
- A report on consumer reaction to a stimulus, comprising: (a) a visual indication of the eye positions of a human subject while exposed to a stimulus during a time period, (b) at least one of an impact score and an appeal score, coded and translated from facial expressions exhibited by the subject while exposed to the stimulus, and (c) an identification of the stimulus to which the subject was exposed.
- The report of paragraph [0029] wherein the report includes both an impact score and an appeal score coded and translated from facial expressions exhibited by the subject while exposed to the stimulus.
- The report of paragraph [0029] further comprising information from which can be ascertained the percentage of human subjects who exhibited at least one facial expression capable of being coded to an emotion while exposed to the stimulus.
- The report of paragraph [0029] wherein a plurality of reports are provided for a plurality of consecutive time periods.
- The report of paragraph [0029] wherein the stimulus is a business stimulus.
- The report of paragraph [0029] wherein eye positions are visually indicated when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The report of paragraph [0029] wherein the subject was exposed to the stimulus for a period of about 1 to 10 seconds.
- The report of paragraph [0029] wherein the impact score and/or appeal score are coded from facial expressions by a facial coding technique.
- The report of paragraph [0036] wherein the facial coding technique is based upon FACS.
- The report of paragraph [0034] wherein the location of the eye positions are superimposed upon a depiction of the stimulus.
- The report of paragraph [0034] wherein the location of the eye positions are reported as a density of eye positions superimposed upon a depiction of the stimulus.
- A method of reporting consumer reaction to a stimulus, comprising: (a) recording facial expressions and eye positions of a plurality of human subjects while each is exposed to a stimulus throughout a time period, (b) ascertaining the number of human subjects who exhibited at least one recorded facial expression capable of being coded to an emotion while exposed to the stimulus, and (c) reporting recorded eye positions and information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded, along with an identification of the stimulus to which the subject was exposed.
- The method of paragraph [0040] wherein steps (a) through (c) are repeated for a plurality of consecutive time periods.
- The method of paragraph [0040] wherein recording facial expressions involves video recording the human subject.
- The method of paragraph [0040] wherein an eye position is detected and recorded when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The method of paragraph [0040] wherein exposure to the stimulus lasts for a time period of about 1 to 10 seconds.
- The method of paragraph [0040] wherein facial expressions are coded by a facial coding technique.
- The method of paragraph [0045] wherein the facial coding technique is based upon FACS.
- The method of paragraph [0043] wherein reporting recorded eye positions comprises superimposing a visual indication of the location of the recorded eye positions upon a depiction of the stimulus.
- The method of paragraph [0043] wherein reporting recorded eye positions comprises superimposing a visual indication of the density of recorded eye positions upon a depiction of the stimulus.
- A report on consumer reaction to a stimulus, comprising: (a) a visual indication of the eye positions of a human subject while exposed to a stimulus, (b) information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded while exposed to the stimulus, and (c) an identification of the stimulus to which the subject was exposed.
- The report of paragraph [0049] wherein a plurality of reports are provided for a plurality of consecutive time periods.
- The report of paragraph [0049] wherein the stimulus is a business stimulus.
- The report of paragraph [0049] wherein eye positions are visually indicated when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The report of paragraph [0049] wherein each subject is exposed to the stimulus for a period of about 1 to 10 seconds.
- The report of paragraph [0049] wherein the facial expressions are coded to emotions by a facial coding technique.
- The report of paragraph [0054] wherein the facial coding technique is based upon FACS.
- The report of paragraph [0049] wherein the location of the eye positions are superimposed upon a depiction of the stimulus.
- The report of paragraph [0049] wherein the location of the eye positions are reported as a density of eye positions superimposed upon a depiction of the stimulus.
- A method of reporting consumer reaction to an attribute of a stimulus, comprising: (a) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (b) coding recorded facial expressions to emotions when the eye position is fixed upon the given attribute of the stimulus, and (c) reporting coded emotions along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- The method of paragraph [0058] further comprising (i) repeating steps (a) through (c) for a number of human subjects with the same stimulus, and (ii) reporting information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded when the eye position is fixed upon the given attribute of the stimulus.
- The method of paragraph [0058] wherein steps (a) through (c) are performed for a plurality of different attributes of the same stimulus.
- The method of paragraph [0058] wherein an eye position is detected and recorded when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The method of paragraph [0058] wherein facial expressions are coded by a facial coding technique.
- The method of paragraph [0062] wherein the facial coding technique is based upon FACS.
- The method of paragraph [0058] wherein reporting coded emotions comprises reporting a tally of coded emotions as a percentage of each coded emotion relative to all coded emotions.
- The method of paragraph [0058] wherein (i) coding recorded facial expressions to emotions comprises coding recorded facial expressions to positive and negative emotions, and (ii) reporting coded emotions comprises reporting at least one of (−) the percentage of all coded emotions comprising positive emotions, (−) the percentage of all coded emotions comprising negative emotions, and (−) an average of the positive and negative coded emotions.
- A report on consumer reaction to an attribute of a stimulus, comprising: (a) a visual indication of a stimulus to which a human subject was exposed, (b) an identification of a given attribute of the stimulus, and (c) a list of at least one emotion coded from facial expressions exhibited by the subject when the eye position is fixed upon the given attribute of the stimulus.
- The report of paragraph [0066] further comprising information from which can be ascertained the percentage of human subjects who exhibited at least one facial expression capable of being coded to an emotion when the eye position was fixed upon the given attribute of the stimulus.
- The report of paragraph [0066] wherein a plurality of reports are provided for a plurality of consecutive time periods.
- The report of paragraph [0066] wherein the stimulus is a business stimulus.
- The report of paragraph [0066] wherein eye positions are visually indicated when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The report of paragraph [0066] wherein the subject was exposed to the stimulus for a period of about 1 to 10 seconds.
- The report of paragraph [0066] wherein the list of at least one emotion is coded from facial expressions by a facial coding technique.
- The report of paragraph [0072] wherein the facial coding technique is based upon FACS.
- The report of paragraph [0066] wherein the list of at least one emotion includes a tally of emotions coded from facial expressions exhibited by the subject when the eye position is fixed upon the given attribute of the stimulus, reported as a percentage of each emotion relative to all emotions.
- The report of paragraph [0066] wherein the list of at least one emotion comprises a listing of emotions grouped as positive and negative emotions.
- A method of reporting consumer reaction to an attribute of a stimulus, comprising: (a) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (b) coding and translating recorded facial expressions to at least one of an impact score and an appeal score when the eye position is fixed upon the given attribute of the stimulus, and (c) reporting at least one of the coded impact score and the coded appeal score, along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- The method of paragraph [0076] wherein recorded facial expressions are coded and translated to both an impact score and an appeal score and both the impact score and the appeal score are reported.
- The method of paragraph [0076] further comprising (i) repeating steps (a) through (c) for a plurality of human subjects with the same stimulus, and (ii) reporting information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded and translated when the eye position is fixed upon the given attribute of the stimulus.
- The method of paragraph [0076] further comprising (i) coding recorded facial expressions to emotions, and (ii) reporting the coded emotions along with the recorded eye positions.
- The method of paragraph [0076] wherein steps (a) through (c) are performed for a plurality of different attributes of the same stimulus.
- The method of paragraph [0076] wherein an eye position is detected and recorded when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The method of paragraph [0076] wherein exposure to the stimulus lasts for a time period of about 1 to 10 seconds.
- The method of paragraph [0076] wherein facial expressions are coded by a facial coding technique.
- The method of paragraph [0083] wherein the facial coding technique is based upon FACS.
- A report on consumer reaction to an attribute of a stimulus, comprising: (a) a visual indication of a stimulus to which a human subject was exposed, (b) an identification of a given attribute of the stimulus, and (c) at least one of an impact score and an appeal score coded and translated from facial expressions exhibited by the subject when the eye position of the subject is fixed upon the given attribute of the stimulus.
- The report of paragraph [0085] wherein the report includes both an impact score and an appeal score coded and translated from facial expressions exhibited by the subject when the eye position of the subject was fixed upon the given attribute of the stimulus.
- The report of paragraph [0085] further comprising information from which can be ascertained the percentage of human subjects who exhibited at least one facial expression capable of being coded to an emotion when the eye position was fixed upon the given attribute of the stimulus.
- The report of paragraph [0085] wherein a plurality of reports are provided for a plurality of consecutive time periods.
- The report of paragraph [0085] wherein the stimulus is a business stimulus.
- The report of paragraph [0085] wherein eye positions are visually indicated when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The report of paragraph [0085] wherein the defined period is a period of about 1 to 10 seconds.
- The report of paragraph [0085] wherein the impact and/or appeal scores are coded from facial expressions by a facial coding technique.
- The report of paragraph [0085] wherein the facial coding technique is based upon FACS.
- A method of reporting consumer reaction to an attribute of a stimulus, comprising: (a) recording facial expressions at least when the eye position of a human subject exposed to a stimulus is fixed upon a given attribute of the stimulus, (b) ascertaining the number of human subjects exposed to the stimulus who exhibited at least one recorded facial expression capable of being coded to an emotion when the eye position was fixed upon the given attribute of the stimulus, and (c) reporting information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded when the eye position was fixed upon the given attribute of the stimulus, along with an identification of the stimulus to which the subject was exposed and an identification of the given attribute of the stimulus.
- The method of paragraph [0094] wherein recording facial expressions involves video recording the human subject.
- The method of paragraph [0094] wherein an eye position is detected and recorded when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The method of paragraph [0094] wherein exposure to the stimulus lasts for a time period of about 1 to 10 seconds.
- The method of paragraph [0094] wherein facial expressions are coded by a facial coding technique.
- The method of paragraph [0098] wherein the facial coding technique is based upon FACS.
- A report on consumer reaction to an attribute of a stimulus, comprising: (a) a visual indication of a stimulus to which a human subject was exposed, (b) an identification of a given attribute of the stimulus, and (c) information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded when the eye position was fixed upon the given attribute of the stimulus.
- The report of paragraph [0100] wherein the stimulus is a business stimulus.
- The report of paragraph [0100] wherein eye positions are visually indicated when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
- The report of paragraph [0100] wherein exposure to the stimulus lasted for a time period of about 1 to 10 seconds.
- The report of paragraph [0103] wherein facial expressions were coded by a facial coding technique.
- The report of paragraph [0100] wherein the facial coding technique is based upon FACS.
-
FIG. 1 is one embodiment of a set of facial features suitable for tracking by the ffT™ facial feature tracking software. -
FIG. 2 is an example of the report aspect of the invention. -
FIG. 3 is an example of the report aspect of the invention. -
FIG. 4 is an example of the report aspect of the invention. -
FIG. 5 is an example of the report aspect of the invention. -
FIG. 6 is an example of the report aspect of the invention. -
FIG. 7 is an example of the report aspect of the invention. -
FIG. 8 is an example of the report aspect of the invention. - As utilized herein, including the claims, the phrase “business stimulus,” means both company stimulus and marketing stimulus.
- As utilized herein, including the claims, the phrase “company stimulus,” refers to an item pertaining to the governance, organization, management, structure, policies, procedures, work-place environment, etc. of a company. Exemplary company stimuli include announcements to employees, reporting obligations of employees, physical location of management relative to employees reporting to management, lunch break policy, smoking ban policy, bonus pay policy and procedure, type of work-stations, etc.
- As utilized herein, including the claims, the phrase “marketing stimulus,” refers to an item selected and designed to (i) advertise, promote and/or enhance the sales or acceptance of a product and/or service, (ii) advertise, promote, improve and/or enhance customer recognition and/or the public image of a person and/or business, (iii) position a product, and/or (iv) enhance brand identity. Exemplary marketing stimuli include, television commercials, radio advertisements, print advertisements, billboard advertisements, point-of-purchase displays, live inquiry such as questions regarding pricing, questions regarding attitudes and questions regarding purchasing preferences, store-front signage, packaging, Yellow Pages advertisements, brochures, literature used in mass mailings, web sites, individual web pages, store layouts, interior design of a store, product appearance, product operation, presentation materials, computer generated virtual shopping experiences, etc.
- As utilized herein, including the claims, the acronym “FACS,” refers to the Facial Action Coding System originally described in Ekman, P., Friesen, W. V., Facial Action Coding System: A Technique for the Measurement of Facial Movement, Consulting Psychologists Press, Palo Alto, Calif. (1978).
- The tracking of facial muscle activity provides a method for gauging consideration through the degree of emotional buy-in. This method is commonly known as facial coding, and it typically involves using either comprehensive facial measurements or selective facial measurements. Comprehensive facial measurements include open-ended observations of what is casually seen or direct measurements such as the Facial Action Coding System (“FACS”) originally described in Ekman, P., Friesen, W. V., Facial Action Coding System: A Technique for the Measurement of Facial Movement, Consulting Psychologists Press, Palo Alto, Calif. (1978).
- The invention provides a synchronized means of assessing the look and feel responses of consumers to business stimuli in order to aid companies and agencies as they seek to enhance the effectiveness of their advertising and general marketing efforts. The method involves (a) capturing what specifically the test participants are looking at when they visually inspect stimulus, typically a marketing stimulus, through the use of an eye tracking unit, (b) taking the recorded output and displaying it as a series of diagrams that indicate on an individual or collective basis where the subjects specifically looked, for how long, and the order in which they most commonly reviewed the pictorial object, (c) visually recording facial expressions of a human subject as the subject is exposed to the pictorial object so as to generate a chronological sequence of recorded facial images, (d) reviewing the videotape of the facial expressions in order to detect and record the expressions using the FACS system or a system based upon FACS; (e) coding contemporaneously detected and recorded expressional repositionings to at least one of an action unit, one or more emotions, or a combination of an appeal value and an impact value, and (f) reporting what the participants looked at and the contemporaneously coded data, along with an identification of the stimulus to which the subject was exposed.
- The method can further include combining the eye tracking and facial coding results by providing a display of the eye tracking output in conjunction with the appeal and impact tallies, the percentage of positive and negative emotions, and/or the specific emotions felt by the test subjects in relation to the pictorial object, in general, as well as to specific elements within the object.
- By synchronizing the real-time readings of both gaze and facial muscle activity, the opportunity exists for knowing on a truer scientific basis the relative effectiveness of various business stimuli in eliciting the desired responses.
- Capturing Data
- Generally, a subject is recruited for participation as a member of a sample population, sometimes after responding appropriately to several qualification questions (e.g., are they a member of the product target market). The portions of the interview session that will involve the simultaneously capturing of eye tracking data and videotape to be used for facial coding analysis purposes is facilitated by a video camera positioned atop the eye tracker unit. One possible embodiment of the method is to utilize a Tobii Model 1750 Eye Tracker available from Tobii Technology AB of Stockholm, Sweden. It comes equipped with five miniature cameras set into a monitor, above and below and computer screen on which the stimuli are presented. The stimuli will be shown on the eye tracker unit's screen, causing the participant to look slightly up and ahead, thus enabling the capture of high quality images of the participant's facial expressions through a video camera (i.e., a web camera) while the participants are looking at the business stimuli to be presented to them. Another option is to mount a camera on the table or desktop in front of the participant.
- At the start of an interview session, the participant will take a seat in front of the eye tracking unit and go through a brief calibration phrases, where a series of red dots are shown on screen and the participant is asked to focus on each dot, in turn, to ensure that the machine is tracking their eye gaze accurately. Once that exercise is complete, the testing session can begin.
- The participant is then exposed to the stimuli on the eye tracking unit screen (i.e., a business stimuli). The exposure is likely to be for a specific timed duration, with the stimuli either shown in a set order or in randomized fashion. During the exposure period, the camera will be on so as to record the participant's non-verbal, facial response to the stimulus the participants are experiencing. Questions or ratings may or may not occur between the exposure periods for the variety of stimuli to be shown as part of the testing session. Whatever the procedure, care should be taken to ensure that the procedure of presenting the stimuli does not distract or inhibit the participant's natural responses to the experience more so than necessary.
- Upon completion of the session (i.e., exposure to the entire collection of stimuli) the videotape is shut off and the participant dismissed. Preferably, the session is repeated for about 10 to 200, preferably about 20 to 100 participants.
- Data Generation
- Eye tracking output is based on securing gaze fixations. For example, output from a Tobii Model 1750 Eye Tracker shows a blue dot for individual output anytime a person has observed a specific detail in the pictorial object for at least 50 milliseconds. That threshold is used because research indicates that a person needs a gaze of at least that duration to be able to process a visual element, whether that element consists of words (text), an image or some combination thereof. The blue dot will increase in size to the extent that the stabilized gaze duration exceeds the 50 millisecond threshold. A gaze duration that reaches that threshold is referred to as a fixation. A second output at the individual level consists of blue tracer lines that indicate saccades, or rapid eye scans that don't reach the 50 millisecond threshold. The tracer lines or saccades are useful in indicating the path or flow the eye is taking in assessing the pictorial object.
- Once a plurality of individual subjects have been tested and their eye tracking data captured, “hot spot” map(s) can be generated that show where on the pictorial element the subjects collectively concentrated their gaze the most. Thus for example, a print ad may be coded with a dark red hot spot that indicates that a majority of the gaze durations, or fixations, were devoted to the key visual image dominating the middle of the screen. A green spot on the company's logo can indicate that a much less dense mass of gaze durations were devoted to the company sponsoring the ad. Stimuli which changes during the testing period (e.g., a TV spot) a hot spot map may be generated frame-by-frame or second-by-second throughout the testing period.
- At the same time, consumer reaction to the stimulus is assessed utilizing facial coding (e.g., FACS), to obtain information about the emotional response to what the subjects are viewing. This assessment may be done manually or automated through the use of a computer, typically involving a series of viewing periods each as short as 1/30th of a second.
- The review may involve a variety of approaches, including: (a) a computer that detects instances where there is sufficient facial muscle activity to suggest a codeable event, with a manual review and coding of the activity during such detected instances using the FACS system, (b) a fully computerized system in which the videotape of the session can be analyzed by software having facial feature tracking capabilities, whereby expressional repositioning of selected facial features by the participant in the videotape can be automatically detected and recorded, and (c) a manual review of the videotape, for the same purpose of assessing whether significant facial muscle activity occurs that can then be coded using the FACS system.
- Software with facial feature tracking capabilities is commercially available from Neven Vision, Inc. of Santa Monica, Calif. under the designations ffT™ (facial feature tracking). A preferred set of facial features suitable for tracking by the ffT™ facial feature tracking software is described in Table Two below and depicted in
FIG. 1 . This preferred set of facial features allows the detection of facial feature movements (FFMs) suitable for coding to action units (AUs), Emotions, Emotional Values, and Appeal and Impact Values suitable for use in the present invention. - Facial Coding Analysis
-
TABLE TWO FACIAL FEATURES FACIAL FEATURE NUMBER LOCATION DESCRIPTION FF1 Outer Edge of Brow FF2 Middle of Brow FF3 Inner Edge of Brow FF4 Outer Edge of Eye FF5 Lower Edge of Eye FF6 Inside Edge of Eye FF7 Bridge of Nose FF8 Tip of Nose FF9 Lateral Sides of Nose FF10 Area Below Each Nostril FF11 Outside Edges of Mouth FF12 Left and Right Medial Points on Upper Lip FF13 Center of Upper Lip FF14 Left and Right Medial Points on Lower Lip FF15 Outside Edge at Center of Lower Lip FF16 Inside Edge at Center of Lower Lip - The software can conduct a computerized comparison of the facial position of each of the selected facial features through sequential facial images and automatically code contemporaneously detected and recorded expressional repositionings to at least one of an AU, one or more Emotions and Emotional Values, or a combination of an Appeal Value and an Impact Value (A&I Values) in accordance with a coding and translation system, such as the specific coding system set forth below.
- Optionally, but preferably, the software notes the location of any detected smile (i.e., facial expression involving upward and outward movement of one or both corners of mouth (nodes 11)) so that a trained individual can quickly locate occurrences of a smile on the videotape, manually view the smile, categorize the smile as a true smile (expansive smile that also may include crow's feet around the eyes and the relaxation of the muscle circling the eye such that the eye acquires the tell-tale glint or “twinkle” of joy), a robust social smile involving only the lower part of the face, a weak social smile also involving only the lower part of the face and not as uplifted as a robust social smile, or a micro-smile (on one side of the face only and more briefly), and input such categorization data into the computer system for use in coding. An optional smile category is skepticism (a social smile that is accompanied by a negative or sarcastic comment, such that the smile “masks” a negative response).
- Detected and reported FFMs can be automatically coded to AUs by a computer in accordance with a predetermined code, such as that set forth in Table Three.
-
TABLE THREE CODING OF FACIAL FEATURE MOVEMENT (FFM) TO AU FACIAL FEATURE ACTION MOVEMENT UNIT NUMBER DIRECTION AU1 FF3 Up AU2 FF1 Up AU4 FF2 Down and/or FF3 In AU5 FF5 Up or Down AU6 FF1 Down and/or FF5 Together AU7 FF5 Together AU9 FF9 Up & Out or FF9 & FF12 Up/Up AU10 FF10 Wider and/or FF12 Up AU11 FF10 Wider AU12U FF11 Up & Out (one) AU12F FF11 Up & Out (both) AU14 FF11 Slight Out & Down and FF16 Tighter AU15 F11 Down AU16 FF14 Down and FF15 Down AU17 FF13 Up and FF15 Up AU20 FF10 Down & Out and/or FF11 Down & Wider AU22 FF11 Closer and FF16 Wider AU23 FF11 Closer and FF16 Tighter AU24 FF16 Tighter AU26 FF16 Wider AU27 FF11 Closer and FF16 Widest - Translating
- Coded AUs can be translated to Emotions and Emotional Values by a computer in accordance with a predetermined correlation system, such as that set forth in Table Four. Since AU12F can translate for more than one set of Emotions and Emotional Values, additional information is required. A true smile is identified as AU12T and translates as set forth in Table Four. A robust social smile is an AU12R and translates as set forth in Table Four. A weak social smile is an AU12W. A social smile accompanied by a negative or sarcastic comment is an AU12S and translates as set forth in Table Four. A unilateral micro smile is an AU12U and translates as set forth in Table Four. The additional information necessary to determine with a coded AU12F as an AU12T, AU12R, AU12W or an AU12S can be manually input into the computer by a trained individual after viewing that segment of the videotape corresponding to the coded AU12F and observing whether the AU12F is expansive and involving the eyes, full, less robust, or perhaps accompanied by a negative or sarcastic comment.
-
TABLE FOUR CORRELATION OF AUS TO EMOTION(S) EMOTION ACTION WEIGHTED UNIT TYPE VALUE AU1 Fear 0.50 Sadness 0.25 Surprise 0.25 AU2 Fear 0.33 Surprise 0.67 AU4 Anger 0.34 Fear 0.33 Sadness 0.33 AU5 Anger 0.34 Fear 0.33 Surprise 0.33 AU6 Sadness 1.00 AU6 + AU12 True Smile 1.00 (AU12T) AU7 Anger 1.00 AU9 Disgust 1.00 AU10 Anger 0.33 Disgust 0.67 AU11 Sadness 1.00 AU12U Micro Smile 1.00 AU12R Robust Social 1.00 Smile AU12W Weak Social 1.00 Smile AU12S Skepticism 1.00 AU14 Disgust 1.00 AU15 Disgust 0.50 Sadness 0.50 AU16 Disgust 1.00 AU17 Anger 0.34 Disgust 0.33 Sadness 0.33 AU20 Fear 1.00 AU22 Anger 1.00 AU23 Anger 1.00 AU24 Anger 1.00 AU25 Disgust 0.25 Sadness 0.25 Anger 0.25 Fear 0.25 AU26 Anger 0.20 Fear 0.20 Disgust 0.20 Sadness 0.20 Surprise 0.20 AU27 Fear 0.50 Surprise 0.50 - Alternatively, the computer can be programmed to bypass the step of coding FFMs to AUs and simply code the FFMs directly to Emotions and Emotional Values when this correlation is known.
- Translated Emotions and Emotional Values may be further translated into A&I Values by a computer in accordance with a predetermined correlation system, such as that set forth in Table Five.
-
TABLE FIVE CORRELATION OF EMOTION(S) TO A&M VALUES A&I COEFFICIENTS EMOTION IMPACT APPEAL AU1 0.2 to 0.6 0 to −0.5 AU2 0.2 to 0.6 0 to −0.5 AU4 1.5 to 2.0 −1.0 to −1.5 AU5 1.0 to 1.5 0 to −0.5 AU7 1.0 to 1.5 −0.5 to −1.0 AU9 0 to −0.5 0 to 0.5 AU10 0 to 0.5 0.5 to 1.0 AU11 0.5 to 1.0 0 to 0.5 AU12T 0.5 to 1.0 0 to 0.5 AU12R 0.5 to 1.0 0 to 0.5 AU12W 1.5 to 2.0 1.0 to 1.5 AU12M 0.5 to 1.0 0.2 to 0.6 AU12S 2.0 to 2.5 −0.5 to −1.0 AU14 1.0 to 1.5 −1.0 to −1.5 AU15 1.0 to 1.5 −0.5 to −1.0 AU16 1.5 to 2.0 −0.5 to −1.0 AU17 1.0 to 1.5 −0.5 to −1.0 AU20 1.5 to 2.0 −1.5 to −2.0 AU22 1.5 to 2.0 −1.5 to −2.0 AU23 1.5 to 2.0 −1.0 to −1.5 AU24 1.0 to 1.5 −0.5 to −1.0 AU25 0.5 to 1.0 0 to −0.5 AU26 1.0 to 1.5 0 to −0.5 AU27 1.5 to 2.0 −0.5 to −1.0 - Alternatively, the computer can be programmed to bypass the step of coding FFMs to AUs and/or translating coded AUs to Emotions and Emotional Values and simply code FFMs directly to A&I Values when this correlation is known.
- For display purposes, including presentation to clients, it may be the preferred mode to translate each of the FACS emotions into more business-friendly terms. Thus among the negative emotions, disgust becomes dislike; anger becomes frustration; and fear becomes anxiety.
- Reporting
- A number of reporting options exists for representing the data. Briefly, the Emotional Values and/or A&I Values may be reported for each participant, segmented groups of the participants (e.g., men v. women or those who had purchased the advertised product before v. those who had not purchased the advertised product before) or all participants. The Emotional Values and/or A&I Values may also be reported at selected time intervals (e.g., every second), at selected points in the session (e.g., one report during viewing of the stimulus and another report during the interview), or the entire session. Several exemplary options of specific types of reports include specifically, but not exclusively, (i) reporting the data separately for each individual stimuli, (ii) reporting the data for a plurality of stimuli in comparative form, (iii) reporting the data separately for each member of the sample population, (iv) graphically reporting the average appeal and impact values with each score forming an axis of the graph, (v) graphically reporting the average appeal and impact values for only a selected portion of the exposure period (e.g., the first two seconds of exposure to the business stimuli, the reaction to a specific question, etc.), (vi) graphically reporting the average appeal and impact values for a plurality of distinct portions of the exposure period together on the same graph (e.g., scores during exposure to the business stimuli and scores during questioning), (vii) graphically reporting the appeal and impact values for each participant to ascertain the distribution of the participants, (viii) graphically reporting the percentage of each emotional value, (ix) graphically reporting the percentage of each coded emotion relative to all coded emotions, by percentage or otherwise; (x) graphically reporting the percentage of positive and negative emotions.
- Another reporting option is reporting the level of emotional engagement. Essentially, the goal here is to indicate the degree to which the sampled participants had a discernible emotional response to the stimuli for which gaze attention is being recorded, using a FACS based system. Thus, the preferred embodiment is to record the percentage of participants who had at least one emotional response based on at least one discernable AU being detected and recorded per participant, regardless of the overall volume of AU's by the participant. Other methods could include: (a) recording the overall volume of AU's for comparative purposes against other stimuli, or (b) recording the average number of AU's discernable by all participants who had at least AU recorded.
- Utility
- Combining eye tracking output with a facial coding system, especially when it includes a unique scoring system for determining the extent to which consumers are impacted by a business stimulus and whether such impact was favorable or unfavorable, provides a truer scientific means of gauging awareness and consideration effectiveness. Such a presentation of consumer reaction facilitates the decision making process for companies and agencies seeking to make judgments about how best to enhance the effectiveness of their marketing efforts.
- To further enhance the usefulness of the data, the stimuli can be placed within a comparative or even directly competitive context when desired. Use of the method with competing stimuli can be evaluated, providing not only a summary of the eye tracking and facial coding behavioral responses but also a comparison between two stimuli performances, revealing subtle differences. Use of the method enhances the ability of a company to tailor product and marketing efforts to existing and prospective customers.
- The method possesses several advantages, including: (1) the ability to capture the subtle, otherwise undetectable ways in which our bodies register and reflect our actions and emotions, (2) the ability to capture subconscious behavioral responses to stimuli beyond what might be otherwise consciously known and verbally acknowledged, (3) the ability to practice real-time and frame-by-frame assessment of responses during the initial experience of a stimulus, (4) the ability to conduct the study in an unobtrusive and non-invasive manner, and (5) an objective based scientific system for monitoring gaze attention and emotional responses which is more accurate and precise than subjective reports.
- The method can be usefully and successfully employed in connection with substantially any stimuli, finding excellent commercial application to business stimuli, including specifically, but not exclusively, television advertising, movie trailers, customer service dynamics, signage, uniforms, vehicles, print ads, direct mail, product packaging and design, point of purchase displays, actual packaged or unpackaged products, store environments, corporate lobbies, logos, brand names, taglines, catalogs, entire web sites, individual web pages, Power Point™ presentations, company announcements, etc.
- A participant was exposed to a stimuli depicted on a computer monitor set at a screen resolution of 1024×768. The eye movements were captured using a Tobii Model 1750 Eye Tracker. Minimum duration of fixation was set at 50 milliseconds. The time, duration and location of detected fixations are reported in TABLE SIX below.
-
TABLE SIX PIXEL ELAPSED TIME DURATION LOCATION FIXATION # (milliseconds) (milliseconds) X Y 1 67 100 489 310 2 286 100 296 360 3 964 60 490 324 4 1343 80 486 328 5 2739 60 404 277 6 2858 100 402 273 7 3117 80 508 447 8 4593 100 517 345 9 5270 60 484 381 10 5390 100 484 377 11 6008 120 470 391 12 6267 60 500 341 13 7065 60 518 385 14 7244 80 516 387 15 7802 60 428 270 16 8121 60 572 394 17 8400 100 573 395 18 8819 60 436 266 19 9019 80 606 352 20 9317 80 433 284 21 9517 80 435 281 22 9716 80 438 287 23 10394 100 528 281 24 10733 60 524 288 25 10853 80 523 290 26 11052 80 567 291 27 11530 80 548 321 28 11630 100 575 325 29 11850 80 574 324 30 12049 80 553 380 31 12687 80 518 349 32 13644 120 428 337 33 14062 120 332 382 34 14421 179 371 365 35 15378 60 594 320 36 15797 60 483 341 37 16176 60 512 345 38 16335 80 515 350 39 16475 60 509 346 40 17771 100 439 288 41 18030 80 431 334 42 19126 119 680 341 43 19964 80 307 207 44 20342 60 463 337 45 20522 119 529 360 46 20921 120 526 362 47 21260 80 483 264 48 21658 119 470 263 49 22316 80 556 381 50 22515 159 529 272 51 24429 80 524 376 52 24669 80 483 259 53 24848 80 483 264 54 25067 80 432 370 55 25386 80 513 307 56 25526 60 513 308 57 25944 60 520 276 58 27001 80 514 314 59 27500 80 560 322 60 28397 60 519 359 61 28596 119 490 344 62 29134 82 501 203 63 29373 80 494 192 64 29872 80 473 299 65 30869 80 486 349 66 31507 160 481 362 67 31726 60 483 359 68 32523 60 524 534 69 33261 60 520 444 70 33740 80 466 575 71 33939 60 361 545 72 34059 100 358 541 73 34497 179 493 326 74 34697 60 494 384 - A participant was exposed to a stimuli depicted on a computer monitor. The eye movements were captured using a Tobii Model 1750 Eye Tracker. Minimum duration of fixation was set at 50 milliseconds. The initial saccade and first detected fixation point are shown in
FIG. 2 as a gray line and gray dot respectively, superimposed on the stimuli. - About thirty five participants were each exposed to a television spot, in each case for a duration of 30 seconds. The eye movements were captured using a Tobii Model 1750 Eye Tracker. The faces of the participants were also videotaped during the 30 second exposure period. The eye tracking output consisted of a dot map for each second of the television spot, with dots showing where the participants directed most of their gaze attention and dot size representing duration of fixation and number of participants. The videotape of each participant was analyzed using FACS. The top three coded emotions, by percentage of activity elicited by the television spot, was displayed alongside each dot map. One of the resultant reports is depicted in
FIG. 3 . - About thirty five participants were each exposed to a television spot, in each case for a duration of 30 seconds. The eye movements were captured using a Tobii Model 1750 Eye Tracker. The faces of the participants were also videotaped during the 30 second exposure period. The eye tracking output consisted of a hot spot map for each second of the television spot with a variation in color intensity and/or color selection depicting where the participants directed most of their gaze attention. The videotape of each participant was analyzed using FACS. The percentage of positive and negative facial coding activity, as well as the top three coded emotions by percentage of activity elicited by the television spot was displayed alongside the hot spot gaze-density map. The resultant report is depicted in
FIG. 4 . - About thirty five participants were each exposed to a print ad, in each case for a duration of 10 seconds. The eye movements were captured using a Tobii Model 1750 Eye Tracker. The faces of the participants were also videotaped during the 10 second exposure period. The eye tracking output consisted (i) of a single hot spot gaze-density map showing where the participants directed most of their gaze attention, and (ii) a table listing number of eye fixations and/or cumulative eye fixation duration as a % of the total number of eye fixations and/or eye fixation duration, for various areas of interest on the print ad input into the eye tracking system. The videotape of each participant was analyzed using FACS. The top two coded emotions by percentage of activity elicited by the print ad was displayed alongside the hot spot gaze-density map and eye fixation table. The resultant report is depicted in
FIG. 5 . - About fifteen participants were each exposed to a video of the interior design of a store, in each case for a duration of 60 seconds. The eye movements were captured using a Tobii Model 1750 Eye Tracker. The faces of the participants were also videotaped during the 60 second exposure period. The eye tracking output consisted of second-by-second hot spot gaze-density maps of the in-store video, showing where the participants directed most of their gaze attention during that second. The videotape of each participant was analyzed using FACS. The Impact and Appeal scores elicited by the in-store video during the exposure period was determined and displayed on a chronological graph. The report consists of a second-by-second display of the hot spot gaze-density maps, along with a sliding line on the Impact and Appeal graph indicating the time at which the currently displayed hot spot gaze-density map occurred. The report at one point in time is depicted in
FIG. 6 . - About fifteen participants are each exposed to a video of the interior design of a store, in each case for a duration of 60 seconds. The eye movements are captured using a Tobii Model 1750 Eye Tracker. The faces of the participants are also videotaped during the 60 second exposure period. The eye tracking output consists of second-by-second hot spot gaze-density maps of the in-store video, showing where the participants directed most of their gaze attention during that second. The videotape of each participant is analyzed using FACS. The sum of positive and negative facial coding activity elicited by the in-store video during each second of the exposure period is determined and displayed on a chronological graph. The report consists of a second-by-second display of the hot spot gaze-density maps, along with a sliding line on the positive and negative emotional graph indicating the time at which the currently displayed hot spot gaze-density map occurs. The report at one point in time is depicted in
FIG. 7 . - About two hundred and forty participants grouped into
Segment 1 andSegment 2 based upon personality type, were each exposed to eight different stimuli of various types for various durations ranging from a duration of about 10 seconds for a print ad to about 120 seconds for a booklet. The eye movements of thirty five of the participants were captured when viewing stimuli 1-3 and 5-7 using a Tobii Model 1750 Eye Tracker. The faces of all two hundred and forty participants were also videotaped during the exposure periods. The eye tracking output consisted of hot spot gaze-density maps for stimuli 1-3 and 5-7 showing where the thirty five participants directed most of their gaze attention. The videotape of all two hundred and forty participants was analyzed using FACS. The percentage of participants in each segment who demonstrated an emotional engagement with the stimuli is represented as a bar graph on the report depicted inFIG. 8 .
Claims (24)
1. A method of reporting consumer reaction to a stimulus, comprising:
(a) recording facial expressions and eye positions of a human subject while exposed to a stimulus throughout a time period,
(b) coding recorded facial expressions to emotions, and
(c) reporting recorded eye positions and coded emotions, along with an identification of the stimulus.
2. The method of claim 1 further comprising (i) repeating steps (a) through (c) for a plurality of human subjects with the same stimulus, and (ii) reporting information from which can be ascertained the percentage of human subjects who exhibited at least one recorded facial expression capable of being coded can be ascertained.
3. The method of claim 1 wherein steps (a) through (c) are repeated for a plurality of consecutive time periods.
4. The method of claim 1 wherein the recording of facial expressions involves video recording the human subject.
5. The method of claim 1 wherein an eye position is detected and recorded when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
6. The method of claim 1 wherein exposure to the stimulus lasts for a time period of about 1 to 10 seconds.
7. The method of claim 1 wherein facial expressions are coded by a facial coding technique.
8. The method of claim 7 wherein the facial coding technique is based upon FACS.
9. The method of claim 5 wherein reporting recorded eye positions comprises superimposing a visual indication of the location of the recorded eye positions upon a depiction of the stimulus.
10. The method of claim 5 wherein reporting recorded eye positions comprises superimposing a visual indication of the density of recorded eye positions upon a depiction of the stimulus.
11. The method of claim 1 wherein reporting coded emotions comprises reporting a tally of coded emotions as a percentage of each coded emotion relative to all coded emotions.
12. The method of claim 1 wherein (i) coding recorded facial expressions to emotions comprises coding recorded facial expressions to positive and negative emotions, and (ii) reporting coded emotions comprises reporting at least one of (−) the percentage of all coded emotions comprising positive emotions, (−) the percentage of all coded emotions comprising negative emotions, and (−) an average of positive and negative coded emotions.
13. A report on consumer reaction to a stimulus, comprising:
(a) a visual indication of the eye positions of a human subject while exposed to a stimulus during a time period,
(b) a list of at least one emotion coded from facial expressions exhibited by the subject while exposed to the stimulus, and
(c) an identification of the stimulus to which the subject was exposed.
14. The report of claim 13 further comprising information from which can be ascertained the percentage of human subjects who exhibited at least one facial expression capable of being coded to an emotion while exposed to the stimulus.
15. The report of claim 13 wherein a plurality of reports are provided for a plurality of consecutive time periods.
16. The report of claim 13 wherein the stimulus is a business stimulus.
17. The report of claim 13 wherein eye positions are visually indicated when the eyes of the subject remain fixed on a location for at least about 50 milliseconds.
18. The report of claim 13 wherein the subject was exposed to the stimulus for a period of about 1 to 10 seconds.
19. The report of claim 13 wherein the list of at least one emotion is coded from facial expressions by a facial coding technique.
20. The report of claim 19 wherein the facial coding technique is based upon FACS.
21. (canceled)
22. (canceled)
23. (canceled)
24. (canceled)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/088,528 US20120046993A1 (en) | 2006-07-21 | 2011-04-18 | Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/491,535 US7930199B1 (en) | 2006-07-21 | 2006-07-21 | Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding |
US13/088,528 US20120046993A1 (en) | 2006-07-21 | 2011-04-18 | Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/491,535 Continuation US7930199B1 (en) | 2006-07-21 | 2006-07-21 | Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding |
Publications (1)
Publication Number | Publication Date |
---|---|
US20120046993A1 true US20120046993A1 (en) | 2012-02-23 |
Family
ID=43858709
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/491,535 Expired - Fee Related US7930199B1 (en) | 2006-07-21 | 2006-07-21 | Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding |
US13/088,528 Abandoned US20120046993A1 (en) | 2006-07-21 | 2011-04-18 | Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/491,535 Expired - Fee Related US7930199B1 (en) | 2006-07-21 | 2006-07-21 | Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding |
Country Status (1)
Country | Link |
---|---|
US (2) | US7930199B1 (en) |
Cited By (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090024475A1 (en) * | 2007-05-01 | 2009-01-22 | Neurofocus Inc. | Neuro-feedback based stimulus compression device |
US20090328089A1 (en) * | 2007-05-16 | 2009-12-31 | Neurofocus Inc. | Audience response measurement and tracking system |
US20110106750A1 (en) * | 2009-10-29 | 2011-05-05 | Neurofocus, Inc. | Generating ratings predictions using neuro-response data |
US20110105937A1 (en) * | 2009-10-29 | 2011-05-05 | Neurofocus, Inc. | Analysis of controlled and automatic attention for introduction of stimulus material |
US20130117259A1 (en) * | 2011-11-04 | 2013-05-09 | Nathan J. Ackerman | Search Query Context |
WO2014088637A1 (en) * | 2012-12-07 | 2014-06-12 | Cascade Strategies, Inc. | Biosensitive response evaluation for design and research |
US20140164056A1 (en) * | 2012-12-07 | 2014-06-12 | Cascade Strategies, Inc. | Biosensitive response evaluation for design and research |
US8903176B2 (en) | 2011-11-14 | 2014-12-02 | Sensory Logic, Inc. | Systems and methods using observed emotional data |
US8973022B2 (en) | 2007-03-07 | 2015-03-03 | The Nielsen Company (Us), Llc | Method and system for using coherence of biological responses as a measure of performance of a media |
US9215996B2 (en) | 2007-03-02 | 2015-12-22 | The Nielsen Company (Us), Llc | Apparatus and method for objectively determining human response to media |
US9292858B2 (en) | 2012-02-27 | 2016-03-22 | The Nielsen Company (Us), Llc | Data collection system for aggregating biologically based measures in asynchronous geographically distributed public environments |
US9336535B2 (en) | 2010-05-12 | 2016-05-10 | The Nielsen Company (Us), Llc | Neuro-response data synchronization |
US9351658B2 (en) | 2005-09-02 | 2016-05-31 | The Nielsen Company (Us), Llc | Device and method for sensing electrical activity in tissue |
US9451303B2 (en) | 2012-02-27 | 2016-09-20 | The Nielsen Company (Us), Llc | Method and system for gathering and computing an audience's neurologically-based reactions in a distributed framework involving remote storage and computing |
US9454646B2 (en) | 2010-04-19 | 2016-09-27 | The Nielsen Company (Us), Llc | Short imagery task (SIT) research method |
US9569986B2 (en) | 2012-02-27 | 2017-02-14 | The Nielsen Company (Us), Llc | System and method for gathering and analyzing biometric user feedback for use in social media and advertising applications |
US9569734B2 (en) | 2011-10-20 | 2017-02-14 | Affectomatics Ltd. | Utilizing eye-tracking to estimate affective response to a token instance of interest |
US9936250B2 (en) | 2015-05-19 | 2018-04-03 | The Nielsen Company (Us), Llc | Methods and apparatus to adjust content presented to an individual |
US10127572B2 (en) | 2007-08-28 | 2018-11-13 | The Nielsen Company, (US), LLC | Stimulus placement system using subject neuro-response measurements |
US10140628B2 (en) | 2007-08-29 | 2018-11-27 | The Nielsen Company, (US), LLC | Content based selection and meta tagging of advertisement breaks |
US10580031B2 (en) | 2007-05-16 | 2020-03-03 | The Nielsen Company (Us), Llc | Neuro-physiology and neuro-behavioral based stimulus targeting system |
US10679241B2 (en) | 2007-03-29 | 2020-06-09 | The Nielsen Company (Us), Llc | Analysis of marketing and entertainment effectiveness using central nervous system, autonomic nervous system, and effector data |
US10733625B2 (en) | 2007-07-30 | 2020-08-04 | The Nielsen Company (Us), Llc | Neuro-response stimulus and stimulus attribute resonance estimator |
US10963895B2 (en) | 2007-09-20 | 2021-03-30 | Nielsen Consumer Llc | Personalized content delivery using neuro-response priming data |
US10987015B2 (en) | 2009-08-24 | 2021-04-27 | Nielsen Consumer Llc | Dry electrodes for electroencephalography |
US20220270116A1 (en) * | 2021-02-24 | 2022-08-25 | Neil Fleischer | Methods to identify critical customer experience incidents using remotely captured eye-tracking recording combined with automatic facial emotion detection via mobile phone or webcams. |
US11704681B2 (en) | 2009-03-24 | 2023-07-18 | Nielsen Consumer Llc | Neurological profiles for market matching and stimulus presentation |
JP7398854B1 (en) | 2023-06-30 | 2023-12-15 | ヴィアゲート株式会社 | Web page viewing analysis system, web page viewing analysis method, and web page viewing analysis program |
JP7398853B1 (en) | 2023-06-30 | 2023-12-15 | ヴィアゲート株式会社 | Video viewing analysis system, video viewing analysis method, and video viewing analysis program |
US11980469B2 (en) | 2012-08-17 | 2024-05-14 | Nielsen Company | Systems and methods to gather and analyze electroencephalographic data |
Families Citing this family (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090030780A1 (en) * | 2006-01-03 | 2009-01-29 | Ds-Iq, Inc. | Measuring effectiveness of marketing campaigns presented on media devices in public places using audience exposure data |
AU2007247852B2 (en) * | 2006-05-04 | 2012-01-19 | Commonwealth Scientific And Industrial Research Organisation | An electronic media system |
US20100004977A1 (en) * | 2006-09-05 | 2010-01-07 | Innerscope Research Llc | Method and System For Measuring User Experience For Interactive Activities |
JP5194015B2 (en) * | 2006-09-05 | 2013-05-08 | インナースコープ リサーチ, インコーポレイテッド | Method and system for determining viewer response to sensory stimuli |
US9514436B2 (en) | 2006-09-05 | 2016-12-06 | The Nielsen Company (Us), Llc | Method and system for predicting audience viewing behavior |
US9740949B1 (en) * | 2007-06-14 | 2017-08-22 | Hrl Laboratories, Llc | System and method for detection of objects of interest in imagery |
US8327395B2 (en) | 2007-10-02 | 2012-12-04 | The Nielsen Company (Us), Llc | System providing actionable insights based on physiological responses from viewers of media |
US20090112693A1 (en) * | 2007-10-24 | 2009-04-30 | Jung Edward K Y | Providing personalized advertising |
US20090113297A1 (en) * | 2007-10-24 | 2009-04-30 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Requesting a second content based on a user's reaction to a first content |
US20090112696A1 (en) * | 2007-10-24 | 2009-04-30 | Jung Edward K Y | Method of space-available advertising in a mobile device |
US9513699B2 (en) * | 2007-10-24 | 2016-12-06 | Invention Science Fund I, LL | Method of selecting a second content based on a user's reaction to a first content |
US9582805B2 (en) * | 2007-10-24 | 2017-02-28 | Invention Science Fund I, Llc | Returning a personalized advertisement |
US20090112694A1 (en) * | 2007-10-24 | 2009-04-30 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Targeted-advertising based on a sensed physiological response by a person to a general advertisement |
JP2011505175A (en) | 2007-10-31 | 2011-02-24 | エムセンス コーポレイション | System and method for providing distributed collection and centralized processing of physiological responses from viewers |
US20090157625A1 (en) * | 2007-12-13 | 2009-06-18 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Methods and systems for identifying an avatar-linked population cohort |
US8615479B2 (en) | 2007-12-13 | 2013-12-24 | The Invention Science Fund I, Llc | Methods and systems for indicating behavior in a population cohort |
US9418368B2 (en) | 2007-12-20 | 2016-08-16 | Invention Science Fund I, Llc | Methods and systems for determining interest in a cohort-linked avatar |
US9775554B2 (en) | 2007-12-31 | 2017-10-03 | Invention Science Fund I, Llc | Population cohort-linked avatar |
US20100169792A1 (en) * | 2008-12-29 | 2010-07-01 | Seif Ascar | Web and visual content interaction analytics |
US8326002B2 (en) * | 2009-08-13 | 2012-12-04 | Sensory Logic, Inc. | Methods of facial coding scoring for optimally identifying consumers' responses to arrive at effective, incisive, actionable conclusions |
US20110099483A1 (en) * | 2009-10-25 | 2011-04-28 | Bruce James Navin | Website Recording of Reactions of a Designated User through interaction with characters |
CN102129824A (en) * | 2010-01-20 | 2011-07-20 | 鸿富锦精密工业(深圳)有限公司 | Information control system and method |
DE102010016541A1 (en) * | 2010-04-20 | 2011-10-20 | Sabrina Duda | Computer-assisted method for generating a software-based analysis module |
US20130238394A1 (en) * | 2010-06-07 | 2013-09-12 | Affectiva, Inc. | Sales projections based on mental states |
US20130151333A1 (en) * | 2011-12-07 | 2013-06-13 | Affectiva, Inc. | Affect based evaluation of advertisement effectiveness |
US20130102854A1 (en) * | 2010-06-07 | 2013-04-25 | Affectiva, Inc. | Mental state evaluation learning for advertising |
WO2012044883A2 (en) * | 2010-09-30 | 2012-04-05 | Affectiva, Inc. | Measuring affective data for web-enabled applications |
CN103168314B (en) * | 2010-10-21 | 2016-03-16 | 三星电子株式会社 | For the method and apparatus of the mood based on Facial action unit identification individuality |
US8938403B2 (en) | 2011-05-11 | 2015-01-20 | Ari M. Frank | Computing token-dependent affective response baseline levels utilizing a database storing affective responses |
US20130194177A1 (en) * | 2011-07-29 | 2013-08-01 | Kotaro Sakata | Presentation control device and presentation control method |
US20130325546A1 (en) * | 2012-05-29 | 2013-12-05 | Shopper Scientist, Llc | Purchase behavior analysis based on visual history |
US9265458B2 (en) | 2012-12-04 | 2016-02-23 | Sync-Think, Inc. | Application of smooth pursuit cognitive testing paradigms to clinical drug development |
US8769557B1 (en) | 2012-12-27 | 2014-07-01 | The Nielsen Company (Us), Llc | Methods and apparatus to determine engagement levels of audience members |
US9380976B2 (en) | 2013-03-11 | 2016-07-05 | Sync-Think, Inc. | Optical neuroinformatics |
US20140278745A1 (en) * | 2013-03-15 | 2014-09-18 | Toshiba Global Commerce Solutions Holdings Corporation | Systems and methods for providing retail process analytics information based on physiological indicator data |
KR102004990B1 (en) * | 2014-05-13 | 2019-07-29 | 삼성전자주식회사 | Device and method of processing images |
WO2016112531A1 (en) * | 2015-01-16 | 2016-07-21 | Hewlett-Packard Development Company, L.P. | User gaze detection |
JP2017117384A (en) | 2015-12-25 | 2017-06-29 | 東芝テック株式会社 | Information processing apparatus |
US10775882B2 (en) * | 2016-01-21 | 2020-09-15 | Microsoft Technology Licensing, Llc | Implicitly adaptive eye-tracking user interface |
US10657718B1 (en) | 2016-10-31 | 2020-05-19 | Wells Fargo Bank, N.A. | Facial expression tracking during augmented and virtual reality sessions |
US11205127B2 (en) * | 2017-01-30 | 2021-12-21 | International Business Machines Corporation | Computer program product for sensory stimulation to ameliorate a cognitive state |
US10929860B2 (en) * | 2017-03-28 | 2021-02-23 | Adobe Inc. | Viewed location metric generation and engagement attribution within an AR or VR environment |
BE1026133B1 (en) * | 2018-03-20 | 2019-10-23 | Eyesee Nv | METHOD FOR REGISTERING AND ANALYZING CONSUMER BEHAVIOR |
US11144118B2 (en) | 2018-12-17 | 2021-10-12 | Citrix Systems, Inc. | Distraction factor used in A/B testing of a web application |
CN112535479B (en) * | 2020-12-04 | 2023-07-18 | 中国科学院深圳先进技术研究院 | Method for determining emotion processing tendency and related products |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6346929B1 (en) * | 1994-04-22 | 2002-02-12 | Canon Kabushiki Kaisha | Display apparatus which detects an observer body part motion in correspondence to a displayed element used to input operation instructions to start a process |
US20030133599A1 (en) * | 2002-01-17 | 2003-07-17 | International Business Machines Corporation | System method for automatically detecting neutral expressionless faces in digital images |
US6637883B1 (en) * | 2003-01-23 | 2003-10-28 | Vishwas V. Tengshe | Gaze tracking system and method |
US7120880B1 (en) * | 1999-02-25 | 2006-10-10 | International Business Machines Corporation | Method and system for real-time determination of a subject's interest level to media content |
US20070066916A1 (en) * | 2005-09-16 | 2007-03-22 | Imotions Emotion Technology Aps | System and method for determining human emotion by analyzing eye properties |
US7233684B2 (en) * | 2002-11-25 | 2007-06-19 | Eastman Kodak Company | Imaging method and system using affective information |
Family Cites Families (53)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3034500A (en) | 1957-05-02 | 1962-05-15 | Jr Grover C Backster | Method and apparatus for measuring and recording group reactions |
US3548806A (en) | 1968-06-26 | 1970-12-22 | Gen Electric | Mass emotional reaction measurement system |
US3870034A (en) | 1973-03-26 | 1975-03-11 | Cyborg Corp | Personal galvanic skin response monitoring instrument |
US4448203A (en) | 1982-09-24 | 1984-05-15 | "A" Company | Electromyographic diagnostic device |
DE3529301A1 (en) | 1984-08-28 | 1986-03-27 | Jost von Dr. Grüningen Fellenberg | Psychotechnical method and device for conducting the method |
US4975960A (en) | 1985-06-03 | 1990-12-04 | Petajan Eric D | Electronic facial tracking and detection system and method and apparatus for automated speech recognition |
US4807642A (en) | 1985-08-16 | 1989-02-28 | Brown David A | Electromyographic repetitive strain injury monitor |
US4817628A (en) | 1985-10-18 | 1989-04-04 | David L. Zealear | System and method for evaluating neurological function controlling muscular movements |
US6443840B2 (en) | 1986-03-10 | 2002-09-03 | Response Reward Systems, L.C. | Evaluation of responses of participatory broadcast audience with prediction of winning contestants; monitoring, checking and controlling of wagering, and automatic crediting and couponing |
US4859050A (en) | 1986-04-04 | 1989-08-22 | Applied Science Group, Inc. | Method and system for generating a synchronous display of a visual presentation and the looking response of many viewers |
US4794533A (en) | 1986-11-07 | 1988-12-27 | Cns, Inc. | System activity change indicator |
US5092343A (en) | 1988-02-17 | 1992-03-03 | Wayne State University | Waveform analysis apparatus and method using neural network techniques |
US5124911A (en) | 1988-04-15 | 1992-06-23 | Image Engineering, Inc. | Method of evaluating consumer choice through concept testing for the marketing and development of consumer products |
US5031228A (en) | 1988-09-14 | 1991-07-09 | A. C. Nielsen Company | Image recognition system and method |
US5084819A (en) | 1988-11-10 | 1992-01-28 | Response Technologies Inc. | Data collection, analysis, and response system and method |
US4964411A (en) | 1989-07-13 | 1990-10-23 | Empi, Inc. | Evoked EMG signal processing |
US5247938A (en) | 1990-01-11 | 1993-09-28 | University Of Washington | Method and apparatus for determining the motility of a region in the human body |
US5148477A (en) | 1990-08-24 | 1992-09-15 | Board Of Regents Of The University Of Oklahoma | Method and apparatus for detecting and quantifying motion of a body part |
US6026322A (en) | 1991-08-07 | 2000-02-15 | Ultramind International Limited | Biofeedback apparatus for use in therapy |
US5903454A (en) | 1991-12-23 | 1999-05-11 | Hoffberg; Linda Irene | Human-factored interface corporating adaptive pattern recognition based controller apparatus |
US5875108A (en) | 1991-12-23 | 1999-02-23 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5219322A (en) | 1992-06-01 | 1993-06-15 | Weathers Lawrence R | Psychotherapy apparatus and method for treating undesirable emotional arousal of a patient |
US5436830A (en) | 1993-02-01 | 1995-07-25 | Zaltman; Gerald | Metaphor elicitation method and apparatus |
US5663900A (en) | 1993-09-10 | 1997-09-02 | Vasona Systems, Inc. | Electronic simulation and emulation system |
JPH08115367A (en) | 1994-10-14 | 1996-05-07 | Hitachi Ltd | Method and system for client server service |
US5607186A (en) | 1995-04-24 | 1997-03-04 | Schroeder; Michael J. | Survey apparatus |
US5772591A (en) | 1995-06-06 | 1998-06-30 | Patient Comfort, Inc. | Electrode assembly for signaling a monitor |
US5802220A (en) | 1995-12-15 | 1998-09-01 | Xerox Corporation | Apparatus and method for tracking facial motion through a sequence of images |
US5774591A (en) | 1995-12-15 | 1998-06-30 | Xerox Corporation | Apparatus and method for recognizing facial expressions and facial gestures in a sequence of images |
US5725472A (en) | 1995-12-18 | 1998-03-10 | Weathers; Lawrence R. | Psychotherapy apparatus and method for the inputting and shaping new emotional physiological and cognitive response patterns in patients |
US5676138A (en) | 1996-03-15 | 1997-10-14 | Zawilinski; Kenneth Michael | Emotional response analyzer system with multimedia display |
US5802208A (en) | 1996-05-06 | 1998-09-01 | Lucent Technologies Inc. | Face recognition using DCT-based feature vectors |
US5741217A (en) | 1996-07-30 | 1998-04-21 | Gero; Jeffrey | Biofeedback apparatus |
JP2918499B2 (en) | 1996-09-17 | 1999-07-12 | 株式会社エイ・ティ・アール人間情報通信研究所 | Face image information conversion method and face image information conversion device |
US6009210A (en) | 1997-03-05 | 1999-12-28 | Digital Equipment Corporation | Hands-free interface to a virtual reality environment using head tracking |
US6026321A (en) | 1997-04-02 | 2000-02-15 | Suzuki Motor Corporation | Apparatus and system for measuring electrical potential variations in human body |
US6004312A (en) | 1997-04-15 | 1999-12-21 | Paraspinal Diagnostic Corporation | Computerized EMG diagnostic system |
US5871211A (en) | 1997-07-14 | 1999-02-16 | Was; Michael C. | Method and device for typing thinking styles |
US6008817A (en) | 1997-12-31 | 1999-12-28 | Comparative Visual Assessments, Inc. | Comparative visual assessment system and method |
US6099319A (en) | 1998-02-24 | 2000-08-08 | Zaltman; Gerald | Neuroimaging as a marketing tool |
US6102846A (en) | 1998-02-26 | 2000-08-15 | Eastman Kodak Company | System and method of managing a psychological state of an individual using images |
US6185534B1 (en) | 1998-03-23 | 2001-02-06 | Microsoft Corporation | Modeling emotion and personality in a computer user interface |
US6311190B1 (en) | 1999-02-02 | 2001-10-30 | Harris Interactive Inc. | System for conducting surveys in different languages over a network with survey voter registration |
US6422999B1 (en) | 1999-05-13 | 2002-07-23 | Daniel A. Hill | Method of measuring consumer reaction |
US6453194B1 (en) | 2000-03-29 | 2002-09-17 | Daniel A. Hill | Method of measuring consumer reaction while participating in a consumer activity |
US20020108125A1 (en) | 2001-02-07 | 2002-08-08 | Joao Raymond Anthony | Apparatus and method for facilitating viewer or listener interaction |
GB0110480D0 (en) | 2001-04-28 | 2001-06-20 | Univ Manchester Metropolitan | Methods and apparatus for analysing the behaviour of a subject |
US6533583B1 (en) | 2001-06-18 | 2003-03-18 | Victoria C. Sportelli | Instructional plan generating and monitoring system |
US7113916B1 (en) | 2001-09-07 | 2006-09-26 | Hill Daniel A | Method of facial coding monitoring for the purpose of gauging the impact and appeal of commercially-related stimuli |
US7327505B2 (en) | 2002-02-19 | 2008-02-05 | Eastman Kodak Company | Method for providing affective information in an imaging system |
US7271809B2 (en) | 2002-02-19 | 2007-09-18 | Eastman Kodak Company | Method for using viewing time to determine affective information in an imaging system |
US7003139B2 (en) | 2002-02-19 | 2006-02-21 | Eastman Kodak Company | Method for using facial expression to determine affective information in an imaging system |
US20040210159A1 (en) | 2003-04-15 | 2004-10-21 | Osman Kibar | Determining a psychological state of a subject |
-
2006
- 2006-07-21 US US11/491,535 patent/US7930199B1/en not_active Expired - Fee Related
-
2011
- 2011-04-18 US US13/088,528 patent/US20120046993A1/en not_active Abandoned
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6346929B1 (en) * | 1994-04-22 | 2002-02-12 | Canon Kabushiki Kaisha | Display apparatus which detects an observer body part motion in correspondence to a displayed element used to input operation instructions to start a process |
US7120880B1 (en) * | 1999-02-25 | 2006-10-10 | International Business Machines Corporation | Method and system for real-time determination of a subject's interest level to media content |
US20030133599A1 (en) * | 2002-01-17 | 2003-07-17 | International Business Machines Corporation | System method for automatically detecting neutral expressionless faces in digital images |
US7233684B2 (en) * | 2002-11-25 | 2007-06-19 | Eastman Kodak Company | Imaging method and system using affective information |
US6637883B1 (en) * | 2003-01-23 | 2003-10-28 | Vishwas V. Tengshe | Gaze tracking system and method |
US20070066916A1 (en) * | 2005-09-16 | 2007-03-22 | Imotions Emotion Technology Aps | System and method for determining human emotion by analyzing eye properties |
Non-Patent Citations (3)
Title |
---|
60/717,268 Lemos, Jakob de. Provisional Application of 2007/0066916 A1. System and Method for Determining Human Emotion by Analyzing Eye Properties, September 16, 2005. * |
Ekman, Paul; Huang, Thomas S; Sejnowski, Terrence J; Hager, Joseph C; "Final Report to NSF of the Planning Workshop on Facial Expression", pp. 1-87, http://mambo.usc.edu/psl/nsf.txt. * |
Hazlett, Richard L; Hazlett, Sasha Yassky; "Emotional Response to Television Commercials: Facial EMG vs. Self-Report. (statistical data included)", march 1999, Journal of Advertising Research, v39, n2, p.7, Dialog 07379551 60072159. * |
Cited By (53)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11638547B2 (en) | 2005-08-09 | 2023-05-02 | Nielsen Consumer Llc | Device and method for sensing electrical activity in tissue |
US10506941B2 (en) | 2005-08-09 | 2019-12-17 | The Nielsen Company (Us), Llc | Device and method for sensing electrical activity in tissue |
US9351658B2 (en) | 2005-09-02 | 2016-05-31 | The Nielsen Company (Us), Llc | Device and method for sensing electrical activity in tissue |
US9215996B2 (en) | 2007-03-02 | 2015-12-22 | The Nielsen Company (Us), Llc | Apparatus and method for objectively determining human response to media |
US8973022B2 (en) | 2007-03-07 | 2015-03-03 | The Nielsen Company (Us), Llc | Method and system for using coherence of biological responses as a measure of performance of a media |
US11250465B2 (en) | 2007-03-29 | 2022-02-15 | Nielsen Consumer Llc | Analysis of marketing and entertainment effectiveness using central nervous system, autonomic nervous sytem, and effector data |
US10679241B2 (en) | 2007-03-29 | 2020-06-09 | The Nielsen Company (Us), Llc | Analysis of marketing and entertainment effectiveness using central nervous system, autonomic nervous system, and effector data |
US11790393B2 (en) | 2007-03-29 | 2023-10-17 | Nielsen Consumer Llc | Analysis of marketing and entertainment effectiveness using central nervous system, autonomic nervous system, and effector data |
US20090024475A1 (en) * | 2007-05-01 | 2009-01-22 | Neurofocus Inc. | Neuro-feedback based stimulus compression device |
US9886981B2 (en) | 2007-05-01 | 2018-02-06 | The Nielsen Company (Us), Llc | Neuro-feedback based stimulus compression device |
US11049134B2 (en) | 2007-05-16 | 2021-06-29 | Nielsen Consumer Llc | Neuro-physiology and neuro-behavioral based stimulus targeting system |
US10580031B2 (en) | 2007-05-16 | 2020-03-03 | The Nielsen Company (Us), Llc | Neuro-physiology and neuro-behavioral based stimulus targeting system |
US20090328089A1 (en) * | 2007-05-16 | 2009-12-31 | Neurofocus Inc. | Audience response measurement and tracking system |
US11244345B2 (en) | 2007-07-30 | 2022-02-08 | Nielsen Consumer Llc | Neuro-response stimulus and stimulus attribute resonance estimator |
US10733625B2 (en) | 2007-07-30 | 2020-08-04 | The Nielsen Company (Us), Llc | Neuro-response stimulus and stimulus attribute resonance estimator |
US11763340B2 (en) | 2007-07-30 | 2023-09-19 | Nielsen Consumer Llc | Neuro-response stimulus and stimulus attribute resonance estimator |
US10127572B2 (en) | 2007-08-28 | 2018-11-13 | The Nielsen Company, (US), LLC | Stimulus placement system using subject neuro-response measurements |
US10937051B2 (en) | 2007-08-28 | 2021-03-02 | The Nielsen Company (Us), Llc | Stimulus placement system using subject neuro-response measurements |
US11488198B2 (en) | 2007-08-28 | 2022-11-01 | Nielsen Consumer Llc | Stimulus placement system using subject neuro-response measurements |
US10140628B2 (en) | 2007-08-29 | 2018-11-27 | The Nielsen Company, (US), LLC | Content based selection and meta tagging of advertisement breaks |
US11610223B2 (en) | 2007-08-29 | 2023-03-21 | Nielsen Consumer Llc | Content based selection and meta tagging of advertisement breaks |
US11023920B2 (en) | 2007-08-29 | 2021-06-01 | Nielsen Consumer Llc | Content based selection and meta tagging of advertisement breaks |
US10963895B2 (en) | 2007-09-20 | 2021-03-30 | Nielsen Consumer Llc | Personalized content delivery using neuro-response priming data |
US11704681B2 (en) | 2009-03-24 | 2023-07-18 | Nielsen Consumer Llc | Neurological profiles for market matching and stimulus presentation |
US10987015B2 (en) | 2009-08-24 | 2021-04-27 | Nielsen Consumer Llc | Dry electrodes for electroencephalography |
US20110105937A1 (en) * | 2009-10-29 | 2011-05-05 | Neurofocus, Inc. | Analysis of controlled and automatic attention for introduction of stimulus material |
US10269036B2 (en) | 2009-10-29 | 2019-04-23 | The Nielsen Company (Us), Llc | Analysis of controlled and automatic attention for introduction of stimulus material |
US11481788B2 (en) | 2009-10-29 | 2022-10-25 | Nielsen Consumer Llc | Generating ratings predictions using neuro-response data |
US20110106750A1 (en) * | 2009-10-29 | 2011-05-05 | Neurofocus, Inc. | Generating ratings predictions using neuro-response data |
US11170400B2 (en) | 2009-10-29 | 2021-11-09 | Nielsen Consumer Llc | Analysis of controlled and automatic attention for introduction of stimulus material |
US10068248B2 (en) | 2009-10-29 | 2018-09-04 | The Nielsen Company (Us), Llc | Analysis of controlled and automatic attention for introduction of stimulus material |
US9560984B2 (en) | 2009-10-29 | 2017-02-07 | The Nielsen Company (Us), Llc | Analysis of controlled and automatic attention for introduction of stimulus material |
US11669858B2 (en) | 2009-10-29 | 2023-06-06 | Nielsen Consumer Llc | Analysis of controlled and automatic attention for introduction of stimulus material |
US10248195B2 (en) | 2010-04-19 | 2019-04-02 | The Nielsen Company (Us), Llc. | Short imagery task (SIT) research method |
US9454646B2 (en) | 2010-04-19 | 2016-09-27 | The Nielsen Company (Us), Llc | Short imagery task (SIT) research method |
US11200964B2 (en) | 2010-04-19 | 2021-12-14 | Nielsen Consumer Llc | Short imagery task (SIT) research method |
US9336535B2 (en) | 2010-05-12 | 2016-05-10 | The Nielsen Company (Us), Llc | Neuro-response data synchronization |
US9569734B2 (en) | 2011-10-20 | 2017-02-14 | Affectomatics Ltd. | Utilizing eye-tracking to estimate affective response to a token instance of interest |
US20130117259A1 (en) * | 2011-11-04 | 2013-05-09 | Nathan J. Ackerman | Search Query Context |
US8903176B2 (en) | 2011-11-14 | 2014-12-02 | Sensory Logic, Inc. | Systems and methods using observed emotional data |
US9569986B2 (en) | 2012-02-27 | 2017-02-14 | The Nielsen Company (Us), Llc | System and method for gathering and analyzing biometric user feedback for use in social media and advertising applications |
US10881348B2 (en) | 2012-02-27 | 2021-01-05 | The Nielsen Company (Us), Llc | System and method for gathering and analyzing biometric user feedback for use in social media and advertising applications |
US9451303B2 (en) | 2012-02-27 | 2016-09-20 | The Nielsen Company (Us), Llc | Method and system for gathering and computing an audience's neurologically-based reactions in a distributed framework involving remote storage and computing |
US9292858B2 (en) | 2012-02-27 | 2016-03-22 | The Nielsen Company (Us), Llc | Data collection system for aggregating biologically based measures in asynchronous geographically distributed public environments |
US11980469B2 (en) | 2012-08-17 | 2024-05-14 | Nielsen Company | Systems and methods to gather and analyze electroencephalographic data |
WO2014088637A1 (en) * | 2012-12-07 | 2014-06-12 | Cascade Strategies, Inc. | Biosensitive response evaluation for design and research |
US20140164056A1 (en) * | 2012-12-07 | 2014-06-12 | Cascade Strategies, Inc. | Biosensitive response evaluation for design and research |
US9936250B2 (en) | 2015-05-19 | 2018-04-03 | The Nielsen Company (Us), Llc | Methods and apparatus to adjust content presented to an individual |
US11290779B2 (en) | 2015-05-19 | 2022-03-29 | Nielsen Consumer Llc | Methods and apparatus to adjust content presented to an individual |
US10771844B2 (en) | 2015-05-19 | 2020-09-08 | The Nielsen Company (Us), Llc | Methods and apparatus to adjust content presented to an individual |
US20220270116A1 (en) * | 2021-02-24 | 2022-08-25 | Neil Fleischer | Methods to identify critical customer experience incidents using remotely captured eye-tracking recording combined with automatic facial emotion detection via mobile phone or webcams. |
JP7398854B1 (en) | 2023-06-30 | 2023-12-15 | ヴィアゲート株式会社 | Web page viewing analysis system, web page viewing analysis method, and web page viewing analysis program |
JP7398853B1 (en) | 2023-06-30 | 2023-12-15 | ヴィアゲート株式会社 | Video viewing analysis system, video viewing analysis method, and video viewing analysis program |
Also Published As
Publication number | Publication date |
---|---|
US7930199B1 (en) | 2011-04-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7930199B1 (en) | Method and report assessing consumer reaction to a stimulus by matching eye position with facial coding | |
US8235725B1 (en) | Computerized method of assessing consumer reaction to a business stimulus employing facial coding | |
Husić-Mehmedović et al. | Seeing is not necessarily liking: Advancing research on package design with eye-tracking | |
US7246081B2 (en) | Method of facial coding monitoring for the purpose of gauging the impact and appeal of commercially-related stimuli | |
US6292688B1 (en) | Method and apparatus for analyzing neurological response to emotion-inducing stimuli | |
Yoshida et al. | Predicting behavioral loyalty through community: Why other fans are more important than our own intentions, our satisfaction, and the team itself | |
Gill et al. | A study of neuromarketing techniques for proposing cost effective information driven framework for decision making | |
JP5249223B2 (en) | Methods for measuring emotional responses and preference trends | |
US20100010317A1 (en) | Self-contained data collection system for emotional response testing | |
Anderson | Decision making in the graduate selection interview: An experimental investigation | |
US20100004977A1 (en) | Method and System For Measuring User Experience For Interactive Activities | |
WO2012136599A1 (en) | Method and system for assessing and measuring emotional intensity to a stimulus | |
Boscolo et al. | Gender differences: Visual attention and attitude toward advertisements | |
US20190043069A1 (en) | System and method for conducting online market research | |
Williams et al. | Diversity issues in consumer psychology | |
CN108921829A (en) | A kind of advertisement design method for objectively evaluating of view-based access control model attention mechanism | |
Şik et al. | EYES DO NOT LIE. INVESTIGATION OF THE EFFECTIVENESS OF OUTDOOR ADVERTISING INSTRUMENTS: AN APPLIED NEUROMARKETING RESEARCH WITH EYE-TRACKING TECHNIQUE. | |
US11367083B1 (en) | Method and system for evaluating content for digital displays by measuring viewer responses by demographic segments | |
Pereira et al. | Some experiences in Neuromarketing: moving from White papers to Scientific inquiries | |
Bae | Attention-Grabbing Power of Branded vs. Unbranded Packaging. | |
Gonchigjav | Results of neuromarketing study of visual attention and emotions of buyers in retail store environment | |
Girma | Political Marketing: Exploring the Nexus between Theory and Practice in Ethiopia (Comparative Study between Ethiopian People’s Revolutionary Democratic Front and Coalition for Unity and Democratic Party) | |
Dewi et al. | Applying eye tracker technology for analyzing user interface design of online transportation applications (case study: grab application) | |
Zahmati et al. | Effects of Endorsers Popularity and Gender on the Audience’s Attention to the Advertisement from a Neuromarketing Perspective: An Eye-Tracking Study | |
Šola et al. | How neuroscience-based research methodologies can deliver new insights to marketers |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |