EP4042348A1 - Systèmes et procédés destinés à un moteur de recherche intelligente de participants à une étude - Google Patents

Systèmes et procédés destinés à un moteur de recherche intelligente de participants à une étude

Info

Publication number
EP4042348A1
EP4042348A1 EP20875145.3A EP20875145A EP4042348A1 EP 4042348 A1 EP4042348 A1 EP 4042348A1 EP 20875145 A EP20875145 A EP 20875145A EP 4042348 A1 EP4042348 A1 EP 4042348A1
Authority
EP
European Patent Office
Prior art keywords
participants
study
participant
panel
sources
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP20875145.3A
Other languages
German (de)
English (en)
Other versions
EP4042348A4 (fr
Inventor
Xavier Mestres
Eduard Ponte
Xavier Canchal
Marc Anell
David Matile
Jorge Aboytes
Roc Alayo
Jordi IBANEZ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
UserZoom Technologies Inc
Original Assignee
UserZoom Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/063,368 external-priority patent/US11348148B2/en
Application filed by UserZoom Technologies Inc filed Critical UserZoom Technologies Inc
Publication of EP4042348A1 publication Critical patent/EP4042348A1/fr
Publication of EP4042348A4 publication Critical patent/EP4042348A4/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising

Definitions

  • the term ‘usability’ refers to a metric scoring value forjudging the ease of use of a target web site.
  • a ‘client’ refers to a sponsor who initiates and/or finances the usability study. The client may be, for example, a marketing manager who seeks to test the usability of a commercial web site for marketing (selling or advertising) certain products or services.
  • Participants may be a selected group of people who participate in the usability study and may be screened based on a predetermined set of questions.
  • ‘UX researcher’ or ‘UX designer’ refers to an individual generating or collecting information on usability via a study.
  • communication link 135' may be a distributed computer network and share the same physical connection as communication link 135. This is, for example, the case where data collecting module 260 locates physically close to virtual moderator module 230, or if they share the usability testing system’s processing hardware.
  • client 171 and user experience researcher 181 may provide one or more sets of questions associated with a target web site to research server 210 via respective communication link 175 and 185.
  • Research server 210 stores the provided sets of questions in a study content database 220 that may include a mass storage device, a hard disk storage or a disk array being in communication with research server 210 through a two-way interconnection link 212.
  • the study content database may interface with virtual moderator server 230 through a communication link 234 and provides one or more sets of questions to participants via virtual moderator server 230.
  • the feedback questionnaire may include one or more survey questions such as a subjective rating of target web site attractiveness, how easy the product can be used, features that participants like or dislike, whether participants would recommend the products to others, and the like.
  • the results of the card sorting exercises will be analyzed against a set of quality control rules, and the qualified results will be stored in the behavioral database 270.
  • the analyze of the result of the card sorting exercise is performed by a dedicated analytics server 280 that provides much higher performance than general-purpose servers to provide higher satisfaction to clients. If participants complete all tasks successfully, then the process proceeds to step 368, where all participants will be thanked for their time and/or any reward may be paid out. Else, if participants do not comply or cannot complete the tasks successfully, the process proceeds to step 366 that eliminates the non-compliant participants.
  • the selection server 525 performs the task of procuring the participants from the panel sources 510a-n.
  • the selection server 525 utilizes information secured directly from the panel sources, as well as discovered and imputed data regarding the participants, which are all stored in the source and panelist database 524.
  • the system generally begins a small scale sampling of the various populations, and subjecting these sampled individuals to questions to determine the frequency of the non-targetable attribute. Once statistically sufficient (e.g., seventy-fifth, eighty-fifty, ninetieth or ninety-fifth percentile confidence) data has been collected, then the estimate for the prevalence of the non-targetable attribute may be determined for the given supply.
  • the statistical methodologies for sampling, and determining frequency within a larger population to a given confidence level are known in the field of statistical analysis, and as such will not be discussed in any exhaustive detail for the sake of brevity.
  • Supplier B also was determined to have 25 available participants, however supplier B costs $7 per test participant. For a study requiring 40 participants, supplier A would be extended 25 invitations, and supplier B only 15 invitations.
  • These rules may have a default set of configurations, may be configured by the client directly, may be automatically generated leveraging machine learning, or in some embodiments, may be extrapolated from a service level agreement between the client and the participant sourcing entity.
  • the participant sources are then filtered (at 1030) to remove duplicate participant records, and to remove participants that have been found by the system to be fraudulent and/or below a basic quality threshold.
  • quality and fraudulency metrics for a participant may be gained through temporal tracking of prior participant activity, unusual answer patters by the participant, or by specifically ‘testing’ the participants by red-herring style questions or questions that look for consistency in the participants answers.
  • an initial query is made (at 920).
  • the initial query is when the intelligent sourcing engine 520 initially connects with the panel sources 510a-n to determine sample availability, pricing and estimated time in the field from the sources. While the intelligent sourcing engine 520 communicates regularly with the panel sources 510a-n, and thus has an indication of the participants available at each source, due to other commitments, membership changes, or contractual restrictions, the available number of participants, and pricing may vary from one study to the next. As such prior to any panel selection activity, these items are ideally confirmed via the initial query with the various suppliers.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Strategic Management (AREA)
  • Human Resources & Organizations (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Physics & Mathematics (AREA)
  • Game Theory and Decision Science (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Theoretical Computer Science (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention concerne des systèmes et des procédés de recherche de participants pour une étude de facilité d'utilisation. Dans certains modes de réalisation, les systèmes et les procédés reçoivent des paramètres d'étude comprenant le type d'étude, le temps de mise en œuvre de l'étude, le nombre requis de participants et les attributs de participant requis. De plus, un ensemble de règles commerciales sont reçues pour l'étude. Ces règles commerciales peuvent être reçues d'un client, extrapolées à partir d'un contrat de service avec un client pour lequel l'étude est réalisée, ou générées sur la base des résultats surveillés de la recherche des études précédentes. Ensuite, des sources de panel de participants potentiels et des données de tarification sont interrogées, et un ensemble des sources sont sélectionnées sur la base des données de tarification. Les participants sont ensuite reçus de ces sources, qui sont ensuite mises en œuvre dans l'étude et surveillées en vue des résultats.
EP20875145.3A 2019-10-09 2020-10-06 Systèmes et procédés destinés à un moteur de recherche intelligente de participants à une étude Withdrawn EP4042348A4 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962913142P 2019-10-09 2019-10-09
US17/063,368 US11348148B2 (en) 2010-05-26 2020-10-05 Systems and methods for an intelligent sourcing engine for study participants
PCT/US2020/054439 WO2021071860A1 (fr) 2019-10-09 2020-10-06 Systèmes et procédés destinés à un moteur de recherche intelligente de participants à une étude

Publications (2)

Publication Number Publication Date
EP4042348A1 true EP4042348A1 (fr) 2022-08-17
EP4042348A4 EP4042348A4 (fr) 2023-08-16

Family

ID=75437431

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20875145.3A Withdrawn EP4042348A4 (fr) 2019-10-09 2020-10-06 Systèmes et procédés destinés à un moteur de recherche intelligente de participants à une étude

Country Status (2)

Country Link
EP (1) EP4042348A4 (fr)
WO (1) WO2021071860A1 (fr)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050182663A1 (en) * 2004-02-18 2005-08-18 Klaus Abraham-Fuchs Method of examining a plurality of sites for a clinical trial
JP2007531940A (ja) * 2004-04-01 2007-11-08 テックスミス コーポレイション ユーザビリティテストを実施する自動化システムおよび方法
US8000983B2 (en) * 2008-07-01 2011-08-16 Numoda Technologies, Inc. Method and apparatus for accounting and contracting for clinical trial studies
US10691583B2 (en) * 2010-05-26 2020-06-23 Userzoom Technologies, Inc. System and method for unmoderated remote user testing and card sorting
US20140052853A1 (en) * 2010-05-26 2014-02-20 Xavier Mestres Unmoderated Remote User Testing and Card Sorting
US20110307340A1 (en) * 2010-06-09 2011-12-15 Akram Benmbarek Systems and methods for sharing user or member experience on brands
US20160217481A1 (en) * 2015-01-27 2016-07-28 Jacqueline Stetson PASTORE Communication system and server for conducting user experience study

Also Published As

Publication number Publication date
EP4042348A4 (fr) 2023-08-16
WO2021071860A1 (fr) 2021-04-15

Similar Documents

Publication Publication Date Title
US11526428B2 (en) System and method for unmoderated remote user testing and card sorting
US11704705B2 (en) Systems and methods for an intelligent sourcing engine for study participants
US8566142B2 (en) Computer implemented methods and systems of determining matches between searchers and providers
Ho et al. Timing of adaptive web personalization and its effects on online consumer behavior
US7885849B2 (en) System and method for predicting demand for items
US8103540B2 (en) System and method for influencing recommender system
US7966342B2 (en) Method for monitoring link & content changes in web pages
US10902443B2 (en) Detecting differing categorical features when comparing segments
US20090222304A1 (en) Method and Apparatus for Social Network Marketing with Advocate Referral
US20090222302A1 (en) Method and Apparatus for Social Network Marketing with Consumer Referral
US20130138507A1 (en) Predictive modeling for e-commerce advertising systems and methods
US20090222303A1 (en) Method and Apparatus for Social Network Marketing with Brand Referral
US8250012B1 (en) Evaluating recommendations by determining user actions, and performance values pertaining to lists of recommendations
US20160034468A1 (en) Testing of and adapting to user responses to web applications
US20130325623A1 (en) Method and apparatus for real estate correlation and marketing
US20120143718A1 (en) Optimization of a web-based recommendation system
US20210035163A1 (en) Predictive platform for determining incremental lift
US20160026640A1 (en) Systems and methods of testing-based online ranking
KR102477687B1 (ko) 광고 관리 장치 및 이의 동작 방법
US20230368226A1 (en) Systems and methods for improved user experience participant selection
Ursu et al. Online advertising as passive search
US20160342699A1 (en) Systems, methods, and devices for profiling audience populations of websites
US20240177204A1 (en) Systems and methods for attribute characterization of usability testing participants
WO2021071860A1 (fr) Systèmes et procédés destinés à un moteur de recherche intelligente de participants à une étude
Vassiliou et al. The process of personalizing web content: techniques, workflow and evaluation

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220414

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20230717

RIC1 Information provided on ipc code assigned before grant

Ipc: G16H 10/00 20180101ALI20230711BHEP

Ipc: G06Q 50/00 20120101ALI20230711BHEP

Ipc: G06Q 30/02 20120101ALI20230711BHEP

Ipc: G06Q 10/06 20120101AFI20230711BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20240214