WO2021097832A1 - Method and apparatus for determining target information, computer device and storage medium - Google Patents

Method and apparatus for determining target information, computer device and storage medium Download PDF

Info

Publication number
WO2021097832A1
WO2021097832A1 PCT/CN2019/120367 CN2019120367W WO2021097832A1 WO 2021097832 A1 WO2021097832 A1 WO 2021097832A1 CN 2019120367 W CN2019120367 W CN 2019120367W WO 2021097832 A1 WO2021097832 A1 WO 2021097832A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
behavior
determining
target
characteristic information
Prior art date
Application number
PCT/CN2019/120367
Other languages
French (fr)
Chinese (zh)
Inventor
吴晓
胡龙耀
耿路
吴靖
范育宸
刘怀国
刘润声
Original Assignee
连云港伍江数码科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 连云港伍江数码科技有限公司 filed Critical 连云港伍江数码科技有限公司
Priority to PCT/CN2019/120367 priority Critical patent/WO2021097832A1/en
Publication of WO2021097832A1 publication Critical patent/WO2021097832A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising

Definitions

  • the present invention relates to the field of information processing technology, in particular to a method, device, computer equipment and storage medium for determining target information.
  • the present invention provides a method, a device, a computer device and a storage medium for determining target information, which can automatically determine the target information that the object is interested in based on the action of the object, and improve the efficiency of determining the target information.
  • a method for determining target information includes the following steps: acquiring the behavior characteristic information of the object within a preset time period; determining the behavior change information of the object according to the behavior characteristic information; according to a preset algorithm and the The behavior change information determines the target area that the object is interested in; and the target information corresponding to the target area is determined according to a preset mapping table.
  • the step of determining the behavior change information of the object according to the behavior characteristic information includes: determining the head height change value of the object in a preset time period according to the behavior characteristic information .
  • the behavior change information further includes: arm change value, eye focus change value; the step of determining the target area of interest of the object according to a preset algorithm and the behavior change information includes : Determine the area corresponding to the head height change value, the arm change value and/or the eyeball focus change value from a pre-established database according to a preset algorithm, as the target area of interest for the object.
  • the step of acquiring behavior characteristic information of the object within a preset period of time includes: acquiring biological characteristic information of the object; when it is determined that the object is in a registered state according to the biological characteristic information When the time, the behavior characteristic information of the object in the preset time period is acquired.
  • the method further includes: when it is determined that the object is in an unregistered state according to the biometric information, obtaining the motion feature information of the object; Display information, determine new display information according to the action characteristic information, and adjust current display information according to the new display information.
  • the method further includes: setting a timer; and when the timer expires, restoring the current display information.
  • the method further includes: obtaining a registered QR code and prompting the object to scan the registered QR code; After receiving the scan completion instruction, bind the registered two-dimensional code with the biometric information, and determine the object as a registered state.
  • an embodiment of the present invention provides an apparatus for determining target information, including: a characteristic information acquisition module, configured to acquire behavior characteristic information of the object within a preset time period; and an area determination module, configured based on the behavior
  • the characteristic information determines the behavior change information of the object; determines the target area of interest of the object according to the preset algorithm and the behavior change information; the target information determination module is used to determine the target area according to the preset mapping table. Target information corresponding to the area.
  • the method and device for determining the target information described above determine the behavior change information of the object according to the behavior characteristic information of the object, determine the target area of interest of the object according to the behavior change information, and then determine the corresponding target information.
  • the target information of interest can be determined according to the behavior of the object, and the efficiency of determining target information can be effectively improved.
  • a computer device includes a memory, a processor, and a computer program stored on the memory and running on the processor.
  • the processor implements the following steps when the processor executes the computer program: acquiring the object within a preset time period The behavior characteristic information of the object; the behavior change information of the object is determined according to the behavior characteristic information; the target area of interest of the object is determined according to the preset algorithm and the behavior change information; and the target area is determined according to the preset mapping table.
  • the target information corresponding to the target area.
  • the above-mentioned computer equipment can determine the target information of interest according to the behavior of the object, effectively improving the efficiency of determining the target information.
  • a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the following steps are implemented: acquiring behavior characteristic information of the object within a preset time period; determining according to the behavior characteristic information The behavior change information of the object; the target area of interest of the object is determined according to a preset algorithm and the behavior change information; the target information corresponding to the target area is determined according to a preset mapping table.
  • the above-mentioned computer-readable storage medium can determine the target information of interest according to the behavior of the object, effectively improving the efficiency of determining target information.
  • FIG. 1 is an application environment diagram of a method for determining target information in an embodiment
  • Figure 2 is a schematic structural diagram of a system for determining target information in an embodiment
  • FIG. 3 is a schematic flowchart of a method for determining target information in an embodiment
  • Fig. 4 is a schematic diagram of the height change of the head of the subject in an embodiment
  • FIG. 5 is a schematic diagram of candidate target areas in the freezer in an embodiment
  • Figure 6 is a top view of an object taking objects in an embodiment
  • Figure 7 is a front view of an object taking objects in an embodiment
  • Fig. 8 is a structural block diagram of an apparatus for determining target information in an embodiment.
  • the method for determining target information provided in this application can be applied to the computer device as shown in FIG. 1.
  • the computer device may be a server, and its internal structure diagram may be as shown in Figure 1.
  • the computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system, a computer program, and a database.
  • the internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium.
  • the database of the computer equipment is used to store data such as behavior characteristic information, behavior change information, and target area.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for determining target information is realized.
  • FIG. 1 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied.
  • the specific computer device may Including more or fewer parts than shown in the figure, or combining some parts, or having a different arrangement of parts.
  • the method for determining target information provided in this application can be applied to the target information determining system shown in FIG. 2, which includes a processor, a detector, a display, and a target area.
  • the detector is used for video detection of objects within the coverage area, and uses a series of information collection techniques to transmit the collected object information to the processor for analysis and processing.
  • the processor is composed of a processing unit and a storage unit.
  • the method for determining target information is realized when the processor is running; the processor is used to analyze the identified video detection information and item information, determine the target area of interest and the corresponding target information, and Send target information to the display; the main function of the processing unit is to process, forward, and dump data; the main function of the storage unit is to store item information and video detection information; A series of information such as video and sound are fed back to the subject.
  • the target area is used to place items.
  • the processor may include an audit module, an association module, a storage module, a binding module, and a two-dimensional code generation module.
  • these modules can also be implemented by devices other than the processor.
  • the review module is used to review the subject's facial information and other biometric information (biometric information refers to fingerprints, facial features, iris, body shape and other information that can represent the physical characteristics of the subject) and place the data in the storage module.
  • the binding module is used to bind the biometrics to the registered QR code. After binding, the object is a registered object, and the registration information is displayed on the display in real time.
  • the association module is used for associating the object of interest with the characteristic information of the object.
  • the two-dimensional code generation module is used to generate two-dimensional codes such as product two-dimensional codes, registered two-dimensional codes, and object two-dimensional codes corresponding to biometric information.
  • the content stored in the storage module mainly includes item information (which can be stored fixedly or based on a cloud platform), facial feature information, behavior feature information, item information, information push records, and the binding relationship between feature information and target information, etc.
  • the embodiment of the present invention provides a method, a device, a computer device, and a storage medium for determining target information. Detailed descriptions are given below.
  • a method for determining target information includes the following steps:
  • S301 Acquire behavior characteristic information of the object within a preset time period.
  • the object can refer to a natural person, a robot, or an animal, etc., and can be one, two, or even multiple (when there are multiple objects, the target information of these objects can be determined respectively).
  • objects can refer to consumers who enter a specific area (a specific area can refer to areas such as unmanned vending equipment, unmanned supermarkets, and unmanned freezers, and all objects in the specific area can be detected through video detection technology).
  • the preset time period may be 1 s, 5 s, 1 min, etc., and the embodiment of the present invention does not limit the duration of the preset time period.
  • the behavior characteristic information refers to information such as the posture of the action, the amplitude of the action, etc., and can also include the biological characteristic information of the object when the subject performs a specific action.
  • the behavior characteristic information of the object can be obtained through video recognition technology.
  • Video recognition technology is a relatively mature and stable recognition technology so far, which can realize the recognition of human body, biological body, etc.
  • Video recognition technology uses certain optical modules to obtain environmental images, video information, etc., and uses image analysis and other technologies to extract the required information in environmental images and video information and make corresponding judgments to make up for the incomprehensibility of conventional recognition technology .
  • the current video recognition technology includes face recognition, video recognition, image recognition, text recognition, behavior recognition, iris recognition, eyeball focus positioning and other recognition technologies.
  • the video detection technology can be realized by a detector, etc.
  • the detector can be a camera installed in a specific area (for example, installed on the top of a freezer), etc., or a mobile terminal of the subject.
  • the video recognition technology can be applied to various embodiments of the present invention, that is, the behavior characteristic information, head height change value, arm change value, eye focus change value, biometric information, etc. of the object can be obtained through the video recognition
  • the behavior change information refers to the change information caused by the behavior of the object, and may be the change of the position, height, angle, etc. of a certain part of the body (for example, the head, etc.).
  • the target area of interest may refer to the area that the object pays attention to and views.
  • the preset algorithm refers to an algorithm that can determine the target area of interest of the object according to the behavior change information.
  • the algorithm can be a query mapping table, a specific operation on the behavior change information, or other implementation methods.
  • the accuracy of the target area of multiple target objects can be summarized, and the algorithm can be adjusted according to the accuracy.
  • the target area can refer to the area where unmanned vending equipment, unmanned supermarket, unmanned freezer, etc. are located.
  • An unmanned freezer can be a storage device such as a refrigerated freezer, a freezer freezer, etc. that can store related physical products.
  • the display part can be divided into different commodity layout areas and compartments.
  • the freezer can have a glass door or a doorless structure.
  • the target area can also refer to the internal area of unmanned vending equipment, unmanned supermarket, unmanned freezer, etc.
  • the freezer includes multiple compartments, and the target area can refer to a specific compartment of the freezer.
  • S303 Determine target information corresponding to the target area according to a preset mapping table.
  • the preset mapping table may include the corresponding relationship between the target area and the target information.
  • the target information may refer to information related to the target area, it may be the item information of the items displayed in the target area, or it may be promotion information.
  • the target information can be pre-stored in the memory, or it can be obtained in real time based on the displayed items.
  • the target object After determining the target information, you can also bind the target object's characteristic information (behavior characteristic information, biological characteristic information, etc.) with the target information. When the target object appears again, the corresponding target information can be directly read.
  • target object's characteristic information behavior characteristic information, biological characteristic information, etc.
  • the target information of interest can be determined according to the behavior of the object, which effectively improves the efficiency of determining target information and reduces labor costs.
  • the target information after obtaining the target information, it may also include a process of feeding back the target information through audio, video, pictures, text, and the like. This information can be fed back through a display set in a specific area or a mobile terminal of the object. If the behavior change information of the object is constantly changing, the corresponding target information can be determined in real time. When the target information changes, the latest target information can be fed back.
  • the pre-stored item information can be obtained from the memory, and the item information can be displayed regularly.
  • the step of determining the behavior change information of the object according to the behavior characteristic information includes: determining the head height change value of the object in a preset time period according to the behavior characteristic information.
  • the head height change value may refer to the height difference when the head moves from a certain position to another position.
  • Determining the change value of the head height of the object can determine the head height of the object by means of dual cameras, infrared detection, etc., real-time detection of the head height, and then determine the change value of the head height.
  • the embodiment of the present invention does not limit the angle of the head, the movement frequency, and the state of other parts of the subject during the change of the head height.
  • the corresponding relationship between the head height change value and the target area can be: if the head height change value is 5cm, the target area is the closest first target area; if the head height change value is 10cm, the target area is in The second target area in the middle position; if the head height change value is 15cm, the target area is the farthest second target area.
  • the target area to be selected is called the candidate target area.
  • the candidate target area as the compartment of the freezer as an example, as shown in Fig. 4, it includes three candidate target areas 1, 2, and 3.
  • the initial head of the subject when he was standing near the freezer was at position 1. If the subject looks down into the compartment in the freezer and the head height is reduced to position 2, then the subject can be considered interested in candidate target area 1; if the subject’s head height is reduced to position 3, then the subject can be considered Interested in the candidate target area 2; if the height of the head of the object is reduced to the position 4, the object can be considered to be interested in the candidate target area 3.
  • the target area of interest of the object is determined according to the change of the height of the avatar of the object, which can effectively determine the area of interest of the object according to the action of the object.
  • the target area of interest can be determined by other methods than the head height change value.
  • the target area can be determined directly by the height of the head of the object. Prior to this, the corresponding relationship between the head height and the target area can be established. After a certain head height of an object is determined by a detector installed near the target area, the target area of interest of the object can be determined according to the corresponding relationship.
  • the behavior change information further includes: arm change value and eyeball focus change value; the step of determining the target area of interest of the object according to a preset algorithm and the behavior change information includes: According to a preset algorithm, an area corresponding to the head height change value, the arm change value and/or the eye focus change value is determined from a pre-established database as the target area of interest for the object.
  • the arm change value refers to the change value of the arm relative to the original state after the subject's arm performs a certain action (for example, reaching out, etc.). It can be the position change of the arm, the palm height change, etc., according to the arm change value. Analyze whether the subject has taken the object.
  • the eyeball focus change value refers to the focus change value caused by the change of the eyeball in the process of viewing the object. The eyeball focus change value can analyze the gaze change of the object, and then determine the target area for viewing.
  • the process of determining the target area by the head height change value, the arm change value, and the eyeball focus change value can be determined in conjunction with the object's height, arm length, and distance between the eyes. That is, although two objects with different heights have the same head height change value, the determined target area may be different.
  • Figure 5 is a schematic diagram of candidate target areas in a freezer.
  • the freezer contains nine candidate target areas 4/5/6/7/8/9/10/11/12.
  • Figure 6 is a top view of the object taking the object, as shown in Figure 6,
  • an object stands on area 2 but the head and arms do not move, it can be considered that the object is not interested in any area in the freezer;
  • an object stands on area 2 with its head protruding forward (the head height becomes lower) and the arms extend a short distance forward, it can be considered that the object is against the candidate target area 5 (for the location of the candidate target area, please refer to Figure 5) Interest;
  • an object stands on the area 2 with its head protruding forward and its arms extended for a long distance it can be considered that the object is interested in the candidate target area 8.
  • Figure 7 is the front view of the object taking the object, in Figure 7 Corresponds to Figure 6. According to Figure 7, the changes of the subject's head and arms in different states can be clearly seen: Indicates the state of observation, Indicates the state of wanting to take, Indicates the state of taking, Indicates that the subject has received the item.
  • the head height change is combined with the arm change value and the eyeball focus change value to determine the target area of interest according to the state changes of multiple parts of the object, which can effectively improve the accuracy of the determined target information.
  • the step of acquiring behavior characteristic information of the object within a preset time period includes: acquiring biological characteristic information of the object; when it is determined that the object is in a registered state according to the biological characteristic information To obtain the behavior characteristic information of the object in a preset time period.
  • This embodiment determines whether the corresponding object is registered according to the biological characteristic information of the object. If it is a registered object that has been registered, obtain its behavior characteristic information and determine the target area of interest; if it is an unregistered object, it may not be obtained. Information about its behavior characteristics. Therefore, this embodiment can perform targeted processing according to different registration states of objects, without determining the target information of unregistered objects, and can effectively save resources.
  • the method further includes: when it is determined that the object is in an unregistered state according to the biometric information, obtaining the action feature information of the object; and obtaining the current display Information, new display information is determined according to the action characteristic information, and current display information is adjusted according to the new display information.
  • the movement characteristic information refers to the movement amplitude, frequency, and biological characteristic information when the object performs a certain movement.
  • the motion characteristic information may be motion information of left and right hand waving.
  • the registration information can be displayed so that the unregistered object completes the registration process according to the prompt.
  • Information about multiple specific actions of the object can be prompted in the vicinity of the object.
  • the object can be prompted to perform actions such as waving hands, nodding heads, shaking heads, etc., and prompting the impact of each action on the currently displayed information.
  • the method further includes: setting a timer; and when the timer expires, restoring the current display information.
  • the timing time can be 10s, 20s, etc., or other time.
  • the display information is adjusted according to the action characteristic information of the unregistered object, so that the unregistered object can also view the information of interest.
  • the display information is adjusted according to the action characteristic information of the unregistered object, so that the unregistered object can also view the information of interest.
  • target information When displaying target information, you can distinguish between registered objects and unregistered objects. For example, for registered objects, the target information is continuously displayed until it leaves a specific area, and for unregistered objects, it is displayed for a limited time. It is also possible not to distinguish between registered objects and unregistered objects, or even registered and unregistered objects.
  • the method further includes: obtaining a registered QR code, prompting the object to scan the registered QR code; After the instruction is scanned, the registered two-dimensional code is bound to the biometric information, and the object is determined to be in a registered state.
  • the registration QR code refers to the QR code information that needs to be used when the object is registered.
  • the registration QR code of different objects in the registration process can be the same or different.
  • the registered two-dimensional codes of different objects may be pre-generated and stored in the storage, or randomly generated.
  • Object scanning registration QR code can be scanned through the mobile device it carries, or through scanning terminals provided by unmanned supermarkets and unmanned freezers.
  • the process of object registration is implemented. After the object scans the registered QR code, the registered QR code is bound to the biological characteristic information of the object. When the object reaches a specific area again, it can be determined as a registered object based on its biometric information.
  • the detector obtains the biometric information of consumers A and B. According to the biometric information, it is judged whether consumers A and B are registered objects.
  • the candidate target area corresponding to the head height change value is determined from the pre-established database as the target area of interest to consumer A.
  • the target information of interest is determined according to the change of the head height, which can effectively improve the efficiency of determining the target information.
  • the process of not determining target information for unregistered objects can effectively save existing resources and can also prompt unregistered objects to complete the registration process. It can be ensured that consumers can obtain consumer consultation in time during consumption, without having to seek assistance from a clerk, thereby effectively improving the consumer's shopping experience. Makes the user's self-service shopping process has many advantages such as intelligence, humanization, and easy implementation.
  • the present invention also provides a device for determining target information, which can be used to execute the method for determining target information described above.
  • a device for determining target information which can be used to execute the method for determining target information described above.
  • the illustrated structure does not constitute a limitation on the device, and may include comparisons. More or fewer parts are shown, or some parts are combined, or different parts are arranged.
  • the device for determining target information includes a feature information acquiring module 801, an area determining module 802, and a target information determining module 803.
  • the detailed description is as follows:
  • the characteristic information acquiring module 801 is configured to acquire behavior characteristic information of the object within a preset time period.
  • the area determining module 802 is configured to determine the behavior change information of the object according to the behavior characteristic information; determine the target area of interest of the object according to a preset algorithm and the behavior change information.
  • the target information determining module 803 is configured to determine target information corresponding to the target area according to a preset mapping table.
  • the target information of interest can be determined according to the behavior of the object, which effectively improves the efficiency of determining target information.
  • the area determination module 802 is further configured to determine the head height change value of the object in a preset time period according to the behavior characteristic information.
  • the behavior change information further includes: arm change value, eyeball focus change value; the area determination module 802 is also used to determine the height of the head from a pre-established database according to a preset algorithm. The area corresponding to the change value, the arm change value and/or the eyeball focus change value is used as the target area of interest for the subject.
  • the characteristic information acquisition module 801 includes: a biological characteristic information acquisition sub-module for acquiring biological characteristic information of an object; and a registration judgment sub-module for determining that the object is already based on the biological characteristic information. In the registration state, the behavior characteristic information of the object within a preset time period is acquired.
  • it further includes: an action feature information acquisition submodule, configured to acquire action feature information of the object when it is determined that the object is in an unregistered state according to the biometric information; a display information adjustment submodule, It is used to obtain current display information, determine new display information according to the action characteristic information, and adjust the current display information according to the new display information.
  • an action feature information acquisition submodule configured to acquire action feature information of the object when it is determined that the object is in an unregistered state according to the biometric information
  • a display information adjustment submodule It is used to obtain current display information, determine new display information according to the action characteristic information, and adjust the current display information according to the new display information.
  • it further includes: a display recovery module, configured to set a timer; when the timer expires, recover the current display information.
  • a display recovery module configured to set a timer; when the timer expires, recover the current display information.
  • it further includes: a two-dimensional code scanning module for obtaining a registered two-dimensional code and prompting the object to scan the registered two-dimensional code; an information binding module for when receiving a scanning completion instruction, Bind the registered two-dimensional code with the biometric information, and determine the object as a registered state.
  • the device for determining target information of the present invention corresponds to the method for determining target information of the present invention one-to-one, and the technical features and beneficial effects described in the embodiment of the method for determining target information are applicable to target information.
  • the specific content can be referred to the description in the method embodiment of the present invention, which will not be repeated here, and it is hereby declared.
  • the logical division of each program module is only an example. In actual applications, it can be used as required, for example, due to the configuration requirements of the corresponding hardware or the convenience of software implementation.
  • the above-mentioned function allocation is completed by different program modules, that is, the internal structure of the device for determining the target information is divided into different program modules to complete all or part of the functions described above.
  • a computer device including a memory, a processor, and a computer program stored in the memory and capable of running on the processor.
  • the processor executes the computer program, the following steps are implemented: Set the behavior characteristic information within a time period; determine the behavior change information of the object according to the behavior characteristic information; determine the target area of interest of the object according to the preset algorithm and the behavior change information; according to the preset mapping
  • the table determines the target information corresponding to the target area.
  • the processor further implements the following step when executing the computer program: determining the head height change value of the object within a preset time period according to the behavior characteristic information.
  • the processor further implements the following steps when executing the computer program: according to a preset algorithm, determine from a pre-established database the value corresponding to the head height change value, the arm change value and/or the eye focus change value. The corresponding area is used as the target area of interest for the object.
  • the processor further implements the following steps when executing the computer program: acquiring the biological characteristic information of the object; when it is determined that the object is in the registered state according to the biological characteristic information, acquiring the object in the preset time period Behavior characteristics information within.
  • the processor further implements the following steps when executing the computer program: when the object is determined to be in an unregistered state according to the biometric information, acquiring the action characteristic information of the object; acquiring the current display information, according to all The action characteristic information determines new display information, and adjusts the current display information according to the new display information.
  • the processor further implements the following steps when executing the computer program: setting a timer; when the timer expires, restoring the current display information.
  • the processor further implements the following steps when executing the computer program: acquiring the registration QR code, prompting the object to scan the registration QR code; when receiving the scanning completion instruction, the registration QR code Binding with the biometric information, and determining the object as a registered state.
  • a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the following steps are implemented: acquiring behavior characteristic information of the object within a preset time period; The behavior characteristic information determines the behavior change information of the object; the target area of interest of the object is determined according to a preset algorithm and the behavior change information; the target corresponding to the target area is determined according to a preset mapping table information.
  • the following step is further implemented: determining the head height change value of the object in a preset time period according to the behavior characteristic information.
  • the following steps are further implemented: according to a preset algorithm, determine the head height change value, the arm change value and/or the eye focus change value from a pre-established database. The corresponding area is used as the target area of interest for the object.
  • the following steps are further implemented: acquiring the biological characteristic information of the object; when it is determined that the object is in the registered state according to the biological characteristic information, acquiring the object at a preset time Behavior characteristic information within the segment.
  • the following steps are further implemented: when it is determined that the object is in an unregistered state according to the biometric information, the action characteristic information of the object is obtained; the current display information is obtained according to The action characteristic information determines new display information, and adjusts the current display information according to the new display information.
  • the following steps are further implemented: setting a timer; and when the timer expires, restoring the current display information.
  • the following steps are also implemented: acquiring the registration QR code, prompting the object to scan the registration QR code; after receiving the scanning completion instruction, registering the QR code The code is bound with the biometric information, and the object is determined to be in a registered state.
  • the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because it can be used, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable media if necessary.
  • the program is processed in a way to obtain the program electronically and then stored in the computer memory.
  • each part of the present invention can be implemented by hardware, software, firmware or a combination thereof.
  • multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if it is implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: Discrete logic circuits, application-specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Accounting & Taxation (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Human Computer Interaction (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A method and apparatus for determining target information, a computer device and a storage medium, which relate to the technical field of information processing. The method comprises: acquiring behavior feature information of a subject within a preset time period (S301); determining behavior change information of the subject according to the behavior feature information; determining a target region of interest to the subject according to a preset algorithm and the behavior change information (S302); and determining target information corresponding to the target region according to a preset mapping table (S303). The method, apparatus, computer device and storage medium solve the problem of low process efficiency when determining information of interest to the subject. The target information of interest to a subject may be determined according to the behavior of the subject, and the efficiency of determining the target information may be effectively improved.

Description

目标信息的确定方法、装置、计算机设备和存储介质Method, device, computer equipment and storage medium for determining target information 技术领域Technical field
本发明涉及信息处理技术领域,特别是涉及目标信息的确定方法、装置、计算机设备和存储介质。The present invention relates to the field of information processing technology, in particular to a method, device, computer equipment and storage medium for determining target information.
背景技术Background technique
随着社会的发展进步,在许多场景中人们可以通过广告、书籍等方式获取到许多信息。但是在某些情况下,人们需要获取的是所关注的某个目标的信息。例如,在超市中,消费者需要获知某个感兴趣商品的商品信息、优惠信息等。在实现本发明过程中,发明人发现现有技术中至少存在如下问题:目前,消费者需要找店员咨询或者通过查找终端设备等才能获知到某个感兴趣对象的信息,这就使得信息的获取过程效率低下。With the development and progress of society, people can obtain a lot of information through advertisements, books, etc. in many scenarios. But in some cases, what people need to obtain is information about a certain target they are concerned about. For example, in a supermarket, consumers need to know the product information and discount information of a certain product of interest. In the process of implementing the present invention, the inventor found that there are at least the following problems in the prior art: At present, consumers need to consult with shop assistants or search for terminal equipment to obtain information about a certain object of interest, which makes the acquisition of information The process is inefficient.
发明内容Summary of the invention
基于此,本发明提供了目标信息的确定方法、装置、计算机设备和存储介质,能根据对象的动作自动确定出对象所感兴趣的目标信息,提高目标信息的确定效率。Based on this, the present invention provides a method, a device, a computer device and a storage medium for determining target information, which can automatically determine the target information that the object is interested in based on the action of the object, and improve the efficiency of determining the target information.
本发明实施例的内容如下:The content of the embodiment of the present invention is as follows:
一种目标信息的确定方法,包括以下步骤:获取所述对象在预设时间段内的行为特征信息;根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域;根据预设的映射表确定与所述目标区域对应的目标信息。A method for determining target information includes the following steps: acquiring the behavior characteristic information of the object within a preset time period; determining the behavior change information of the object according to the behavior characteristic information; according to a preset algorithm and the The behavior change information determines the target area that the object is interested in; and the target information corresponding to the target area is determined according to a preset mapping table.
在其中一个实施例中,所述根据所述行为特征信息确定所述对象的行为变化信息的步骤,包括:根据所述行为特征信息确定所述对象在预设时间段内的头部高度变化值。In one of the embodiments, the step of determining the behavior change information of the object according to the behavior characteristic information includes: determining the head height change value of the object in a preset time period according to the behavior characteristic information .
在其中一个实施例中,所述行为变化信息还包括:手臂变化值、眼球焦点变化值;所述根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域的步骤,包括:根据预设的算法,从预先建立的数据库中确定与所述头部高度变化值、手臂变化值和/或眼球焦点变化值相对应的区域,作为所述对象感兴趣的目标区域。In one of the embodiments, the behavior change information further includes: arm change value, eye focus change value; the step of determining the target area of interest of the object according to a preset algorithm and the behavior change information includes : Determine the area corresponding to the head height change value, the arm change value and/or the eyeball focus change value from a pre-established database according to a preset algorithm, as the target area of interest for the object.
在其中一个实施例中,所述获取所述对象在预设时间段内的行为特征信息的步骤,包括:获取对象的生物特征信息;当根据所述生物特征信息确定所述对象为已注册状态时,获取所 述对象在预设时间段内的行为特征信息。In one of the embodiments, the step of acquiring behavior characteristic information of the object within a preset period of time includes: acquiring biological characteristic information of the object; when it is determined that the object is in a registered state according to the biological characteristic information When the time, the behavior characteristic information of the object in the preset time period is acquired.
在其中一个实施例中,所述获取对象的生物特征信息的步骤之后,还包括:当根据所述生物特征信息确定所述对象为未注册状态时,获取所述对象的动作特征信息;获取当前显示信息,根据所述动作特征信息确定新的显示信息,根据所述新的显示信息调整当前显示信息。In one of the embodiments, after the step of obtaining biometric information of the object, the method further includes: when it is determined that the object is in an unregistered state according to the biometric information, obtaining the motion feature information of the object; Display information, determine new display information according to the action characteristic information, and adjust current display information according to the new display information.
在其中一个实施例中,所述根据所述新的显示信息调整当前显示信息的步骤之后,还包括:设置计时器;当所述计时器计时时间到达时,恢复所述当前显示信息。In one of the embodiments, after the step of adjusting the current display information according to the new display information, the method further includes: setting a timer; and when the timer expires, restoring the current display information.
在其中一个实施例中,所述当根据所述生物特征信息确定所述对象为未注册状态的步骤之后,还包括:获取注册二维码,提示所述对象扫描所述注册二维码;当接收到扫描完成指令后,将所述注册二维码与所述生物特征信息进行绑定,将所述对象确定为已注册状态。In one of the embodiments, after the step of determining that the object is in an unregistered state according to the biometric information, the method further includes: obtaining a registered QR code and prompting the object to scan the registered QR code; After receiving the scan completion instruction, bind the registered two-dimensional code with the biometric information, and determine the object as a registered state.
相应的,本发明实施例提供一种目标信息的确定装置,包括:特征信息获取模块,用于获取所述对象在预设时间段内的行为特征信息;区域确定模块,用于根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域;目标信息确定模块,用于根据预设的映射表确定与所述目标区域对应的目标信息。Correspondingly, an embodiment of the present invention provides an apparatus for determining target information, including: a characteristic information acquisition module, configured to acquire behavior characteristic information of the object within a preset time period; and an area determination module, configured based on the behavior The characteristic information determines the behavior change information of the object; determines the target area of interest of the object according to the preset algorithm and the behavior change information; the target information determination module is used to determine the target area according to the preset mapping table. Target information corresponding to the area.
上述目标信息的确定方法及装置,根据对象的行为特征信息确定其行为变化信息,根据行为变化信息确定对象感兴趣的目标区域进而确定对应的目标信息。能够根据对象的行为确定其感兴趣的目标信息,有效提高目标信息的确定效率。The method and device for determining the target information described above determine the behavior change information of the object according to the behavior characteristic information of the object, determine the target area of interest of the object according to the behavior change information, and then determine the corresponding target information. The target information of interest can be determined according to the behavior of the object, and the efficiency of determining target information can be effectively improved.
一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现以下步骤:获取所述对象在预设时间段内的行为特征信息;根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域;根据预设的映射表确定与所述目标区域对应的目标信息。A computer device includes a memory, a processor, and a computer program stored on the memory and running on the processor. The processor implements the following steps when the processor executes the computer program: acquiring the object within a preset time period The behavior characteristic information of the object; the behavior change information of the object is determined according to the behavior characteristic information; the target area of interest of the object is determined according to the preset algorithm and the behavior change information; and the target area is determined according to the preset mapping table. The target information corresponding to the target area.
上述计算机设备,能够根据对象的行为确定其感兴趣的目标信息,有效提高目标信息的确定效率。The above-mentioned computer equipment can determine the target information of interest according to the behavior of the object, effectively improving the efficiency of determining the target information.
一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现以下步骤:获取所述对象在预设时间段内的行为特征信息;根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域;根据预设的映射表确定与所述目标区域对应的目标信息。A computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the following steps are implemented: acquiring behavior characteristic information of the object within a preset time period; determining according to the behavior characteristic information The behavior change information of the object; the target area of interest of the object is determined according to a preset algorithm and the behavior change information; the target information corresponding to the target area is determined according to a preset mapping table.
上述计算机可读存储介质,能够根据对象的行为确定其感兴趣的目标信息,有效提高目 标信息的确定效率。The above-mentioned computer-readable storage medium can determine the target information of interest according to the behavior of the object, effectively improving the efficiency of determining target information.
附图说明Description of the drawings
图1为一个实施例中目标信息的确定方法的应用环境图;FIG. 1 is an application environment diagram of a method for determining target information in an embodiment;
图2为一个实施例中目标信息的确定***的结构示意图;Figure 2 is a schematic structural diagram of a system for determining target information in an embodiment;
图3为一个实施例中目标信息的确定方法的流程示意图;FIG. 3 is a schematic flowchart of a method for determining target information in an embodiment;
图4为一个实施例中对象头部高度变化的示意图;Fig. 4 is a schematic diagram of the height change of the head of the subject in an embodiment;
图5为一个实施例中冰柜中的候选目标区域示意图;FIG. 5 is a schematic diagram of candidate target areas in the freezer in an embodiment;
图6为一个实施例中对象拿取物品的俯视图;Figure 6 is a top view of an object taking objects in an embodiment;
图7为一个实施例中对象拿取物品的正面图;Figure 7 is a front view of an object taking objects in an embodiment;
图8为一个实施例中目标信息的确定装置的结构框图。Fig. 8 is a structural block diagram of an apparatus for determining target information in an embodiment.
具体实施方式Detailed ways
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following further describes the present invention in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.
本申请提供的目标信息的确定方法可以应用于如图1所示的计算机设备中。该计算机设备可以是服务器,其内部结构图可以如图1所示。该计算机设备包括通过***总线连接的处理器、存储器、网络接口和数据库。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作***、计算机程序和数据库。该内存储器为非易失性存储介质中的操作***和计算机程序的运行提供环境。该计算机设备的数据库用于存储行为特征信息、行为变化信息、目标区域等数据。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机程序被处理器执行时实现一种目标信息的确定方法。The method for determining target information provided in this application can be applied to the computer device as shown in FIG. 1. The computer device may be a server, and its internal structure diagram may be as shown in Figure 1. The computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database of the computer equipment is used to store data such as behavior characteristic information, behavior change information, and target area. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for determining target information is realized.
本领域技术人员可以理解,图1中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。Those skilled in the art can understand that the structure shown in FIG. 1 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may Including more or fewer parts than shown in the figure, or combining some parts, or having a different arrangement of parts.
本申请提供的目标信息的确定方法可以应用于如图2所示的目标信息的确定***中,该***包括处理器、侦测器、显示器以及目标区域。侦测器用于对所覆盖范围内的对象进行视 讯侦测,利用一系列信息采集技术将所采集的对象信息传送至处理器分析处理。处理器由处理单元与存储单元组成,处理器运行时实现目标信息的确定方法;处理器用于分析所识别的视讯侦测信息、物品信息,确定对象感兴趣的目标区域以及对应的目标信息,并将目标信息发送给显示器;处理单元的主要作用为处理、转发、转存数据;存储单元的主要作用为存储物品信息、视讯侦测信息;显示器通过有线、无线等各种途径将物品的图像、视频、声音等一系列信息反馈给对象。目标区域用于放置物品。The method for determining target information provided in this application can be applied to the target information determining system shown in FIG. 2, which includes a processor, a detector, a display, and a target area. The detector is used for video detection of objects within the coverage area, and uses a series of information collection techniques to transmit the collected object information to the processor for analysis and processing. The processor is composed of a processing unit and a storage unit. The method for determining target information is realized when the processor is running; the processor is used to analyze the identified video detection information and item information, determine the target area of interest and the corresponding target information, and Send target information to the display; the main function of the processing unit is to process, forward, and dump data; the main function of the storage unit is to store item information and video detection information; A series of information such as video and sound are fed back to the subject. The target area is used to place items.
处理器可以包括审核模块、关联模块、存储模块、绑定模块以及二维码生成模块。当然,这些模块也可以通过处理器以外的其他器件来实现。其中,审核模块用于审核对象人脸信息等生物特征信息(生物特征信息指的是指纹、脸象、虹膜、体型等能代表对象生理特征的信息)并将数据放置于存储模块中。绑定模块用于将生物特征与注册二维码进行绑定,绑定后该对象则为已注册对象,并通过显示器实时显示注册信息。关联模块用于将对象感兴趣的物品与该对象的特征信息进行关联。二维码生成模块用于生成产品二维码、注册二维码、与生物特征信息相对应的对象二维码等二维码。存储模块中存储的内容主要有物品信息(可固定存储也可基于云平台)、人脸特征信息、行为特征信息、物品信息、信息推送记录、特征信息与目标信息的绑定关系等。The processor may include an audit module, an association module, a storage module, a binding module, and a two-dimensional code generation module. Of course, these modules can also be implemented by devices other than the processor. Among them, the review module is used to review the subject's facial information and other biometric information (biometric information refers to fingerprints, facial features, iris, body shape and other information that can represent the physical characteristics of the subject) and place the data in the storage module. The binding module is used to bind the biometrics to the registered QR code. After binding, the object is a registered object, and the registration information is displayed on the display in real time. The association module is used for associating the object of interest with the characteristic information of the object. The two-dimensional code generation module is used to generate two-dimensional codes such as product two-dimensional codes, registered two-dimensional codes, and object two-dimensional codes corresponding to biometric information. The content stored in the storage module mainly includes item information (which can be stored fixedly or based on a cloud platform), facial feature information, behavior feature information, item information, information push records, and the binding relationship between feature information and target information, etc.
本发明实施例提供一种目标信息的确定方法、装置、计算机设备和存储介质。以下分别进行详细说明。The embodiment of the present invention provides a method, a device, a computer device, and a storage medium for determining target information. Detailed descriptions are given below.
在一个实施例中,如图3所示,提供了一种目标信息的确定方法。包括以下步骤:In one embodiment, as shown in FIG. 3, a method for determining target information is provided. It includes the following steps:
S301、获取所述对象在预设时间段内的行为特征信息。S301: Acquire behavior characteristic information of the object within a preset time period.
其中,对象可以指自然人,也可以是机器人,还可以是动物等,可以为一个、两个甚至多个(当对象为多个时,可以分别确定这些对象的目标信息)。同时,对象可以指进入特定区域(特定区域可以指无人售货设备、无人超市、无人冰柜等区域,通过视讯侦测技术能够检测到该特定区域中的所有对象)的消费者。Among them, the object can refer to a natural person, a robot, or an animal, etc., and can be one, two, or even multiple (when there are multiple objects, the target information of these objects can be determined respectively). At the same time, objects can refer to consumers who enter a specific area (a specific area can refer to areas such as unmanned vending equipment, unmanned supermarkets, and unmanned freezers, and all objects in the specific area can be detected through video detection technology).
预设时间段可以为1s、5s、1min等时间,本发明实施例对该预设时间段的时长不做限制。The preset time period may be 1 s, 5 s, 1 min, etc., and the embodiment of the present invention does not limit the duration of the preset time period.
行为特征信息指的是动作姿态、动作幅度等信息,还可以包括对象做特定动作时的生物特征信息。The behavior characteristic information refers to information such as the posture of the action, the amplitude of the action, etc., and can also include the biological characteristic information of the object when the subject performs a specific action.
可以通过视讯识别技术获取对象的行为特征信息。视讯识别技术是迄今为止较为成熟、稳定的识别技术,可以实现对人体、生物体等的识别。视讯识别技术是通过一定的光学模块获取环境图像、视频信息等,并通过图像分析等技术提取环境图像、视频信息中所需的信息 并做出相应的判断,以弥补常规识别技术的不全面性。目前视讯识别技术包含人脸识别、视频识别、图像识别、文字识别、行为识别、虹膜识别、眼球焦点定位等多种识别技术。可以通过侦测器等来实现视讯侦测技术,侦测器可以是安装于特定区域的摄像头(例如:安装在冰柜的顶部)等,也可以是对象的移动终端等。另外,视讯识别技术可以应用于本发明的各个实施例中,即可以通过视讯识别技术获取对象的行为特征信息、头部高度变化值、手臂变化值、眼球焦点变化值、生物特征信息等。The behavior characteristic information of the object can be obtained through video recognition technology. Video recognition technology is a relatively mature and stable recognition technology so far, which can realize the recognition of human body, biological body, etc. Video recognition technology uses certain optical modules to obtain environmental images, video information, etc., and uses image analysis and other technologies to extract the required information in environmental images and video information and make corresponding judgments to make up for the incomprehensibility of conventional recognition technology . The current video recognition technology includes face recognition, video recognition, image recognition, text recognition, behavior recognition, iris recognition, eyeball focus positioning and other recognition technologies. The video detection technology can be realized by a detector, etc. The detector can be a camera installed in a specific area (for example, installed on the top of a freezer), etc., or a mobile terminal of the subject. In addition, the video recognition technology can be applied to various embodiments of the present invention, that is, the behavior characteristic information, head height change value, arm change value, eye focus change value, biometric information, etc. of the object can be obtained through the video recognition technology.
S302、根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域。S302. Determine behavior change information of the object according to the behavior characteristic information; determine a target area of interest of the object according to a preset algorithm and the behavior change information.
其中,行为变化信息指的是由于对象的行为导致的变化信息,可以是身体某个部位(例如:头部等)的位置、高度、角度等的变化。感兴趣的目标区域可以指对象关注、查看的区域。Among them, the behavior change information refers to the change information caused by the behavior of the object, and may be the change of the position, height, angle, etc. of a certain part of the body (for example, the head, etc.). The target area of interest may refer to the area that the object pays attention to and views.
预设的算法指的是能根据行为变化信息确定对象感兴趣的目标区域的算法。该算法可以是查询映射表,也可以是对行为变化信息进行特定的运算,还可以为其他的实现方式。另外,可以总结多个目标对象的目标区域准确率,根据所该准确率来调整该算法。The preset algorithm refers to an algorithm that can determine the target area of interest of the object according to the behavior change information. The algorithm can be a query mapping table, a specific operation on the behavior change information, or other implementation methods. In addition, the accuracy of the target area of multiple target objects can be summarized, and the algorithm can be adjusted according to the accuracy.
目标区域可以指无人售货设备、无人超市、无人冰柜等所在的区域。无人冰柜可以为制冷冰柜、冷冻冰柜等可存储相关实质产品的储物装置,其展示部分可划分为不同商品布置区域、格间,同时该冰柜可以为玻璃门或无门式结构。同时,目标区域还可以指无人售货设备、无人超市、无人冰柜等的内部区域,例如,冰柜包括多个格间,目标区域可以指冰柜的某个具体格间。The target area can refer to the area where unmanned vending equipment, unmanned supermarket, unmanned freezer, etc. are located. An unmanned freezer can be a storage device such as a refrigerated freezer, a freezer freezer, etc. that can store related physical products. The display part can be divided into different commodity layout areas and compartments. At the same time, the freezer can have a glass door or a doorless structure. At the same time, the target area can also refer to the internal area of unmanned vending equipment, unmanned supermarket, unmanned freezer, etc. For example, the freezer includes multiple compartments, and the target area can refer to a specific compartment of the freezer.
S303、根据预设的映射表确定与所述目标区域对应的目标信息。S303: Determine target information corresponding to the target area according to a preset mapping table.
其中,预设的映射表中可以包含目标区域和目标信息的对应关系。目标信息可以指与目标区域相关的信息,可以是目标区域中陈列物品的物品信息,也可以是促销信息等。同时,目标信息可以预先存储在存储器中,也可以是根据所陈列的物品等实时获取的。Wherein, the preset mapping table may include the corresponding relationship between the target area and the target information. The target information may refer to information related to the target area, it may be the item information of the items displayed in the target area, or it may be promotion information. At the same time, the target information can be pre-stored in the memory, or it can be obtained in real time based on the displayed items.
确定目标信息以后,还可以将目标对象的特征信息(行为特征信息、生物特征信息等)与目标信息进行绑定。当该目标对象再次出现时,可以直接读取对应的目标信息。After determining the target information, you can also bind the target object's characteristic information (behavior characteristic information, biological characteristic information, etc.) with the target information. When the target object appears again, the corresponding target information can be directly read.
本实施例,能够根据对象的行为确定其感兴趣的目标信息,有效提高目标信息的确定效率,降低人力成本。In this embodiment, the target information of interest can be determined according to the behavior of the object, which effectively improves the efficiency of determining target information and reduces labor costs.
在一个实施例中,获取目标信息之后,还可以包括通过音视讯、图片、文字等方式反馈目标信息的过程。可以通过设置在特定区域的显示器或者对象的移动终端来反馈这些信息。 若对象的行为变化信息在不断变化,则可以实时确定对应的目标信息,当目标信息发生变化时,可以反馈最新的目标信息。In an embodiment, after obtaining the target information, it may also include a process of feeding back the target information through audio, video, pictures, text, and the like. This information can be fed back through a display set in a specific area or a mobile terminal of the object. If the behavior change information of the object is constantly changing, the corresponding target information can be determined in real time. When the target information changes, the latest target information can be fed back.
另外,若没有对象处于特定区域,则可以从存储器中获取预先存储的物品信息,定期显示这些物品信息。In addition, if no object is in a specific area, the pre-stored item information can be obtained from the memory, and the item information can be displayed regularly.
在一个实施例中,所述根据所述行为特征信息确定所述对象的行为变化信息的步骤,包括:根据所述行为特征信息确定所述对象在预设时间段内的头部高度变化值。In one embodiment, the step of determining the behavior change information of the object according to the behavior characteristic information includes: determining the head height change value of the object in a preset time period according to the behavior characteristic information.
其中,头部高度变化值可以指头部从某个位置移动到另一个位置时的高度差。Among them, the head height change value may refer to the height difference when the head moves from a certain position to another position.
确定对象的头部高度变化值可以通过双摄像头、红外侦测等方式来确定对象的头部高度,实时侦测器头部的高度,进而确定其头部高度的变化值。Determining the change value of the head height of the object can determine the head height of the object by means of dual cameras, infrared detection, etc., real-time detection of the head height, and then determine the change value of the head height.
本发明实施例对对象在头部高度变化过程中头部的角度、移动频率以及其他部位的状态不做限制。The embodiment of the present invention does not limit the angle of the head, the movement frequency, and the state of other parts of the subject during the change of the head height.
另外,头部高度变化值与目标区域的对应关系可以为:若头部高度变化值为5cm,则目标区域为最近的第一目标区域;若头部高度变化值为10cm,则目标区域为处于中间位置的第二目标区域;若头部高度变化值为15cm,则目标区域为最远的第二目标区域。In addition, the corresponding relationship between the head height change value and the target area can be: if the head height change value is 5cm, the target area is the closest first target area; if the head height change value is 10cm, the target area is in The second target area in the middle position; if the head height change value is 15cm, the target area is the farthest second target area.
待选的目标区域称为候选目标区域,以候选目标区域为冰柜的格间为例,如图4所示,包括1、2、3三个候选目标区域。对象刚站在冰柜附近时的初始头像位于位置①。若该对象低头看向冰柜中的格间,且头部高度降低到位置②,则可以认为该对象对候选目标区域1感兴趣;若该对象头部高度降低到位置③,则可以认为该对象对候选目标区域2感兴趣;若该对象头部高度降低到位置④,则可以认为该对象对候选目标区域3感兴趣。The target area to be selected is called the candidate target area. Taking the candidate target area as the compartment of the freezer as an example, as shown in Fig. 4, it includes three candidate target areas 1, 2, and 3. The initial head of the subject when he was standing near the freezer was at position ①. If the subject looks down into the compartment in the freezer and the head height is reduced to position ②, then the subject can be considered interested in candidate target area 1; if the subject’s head height is reduced to position ③, then the subject can be considered Interested in the candidate target area 2; if the height of the head of the object is reduced to the position ④, the object can be considered to be interested in the candidate target area 3.
本实施例,根据对象的头像高度变化来确定对象感兴趣的目标区域,能有效根据对象的动作确定其感兴趣的区域。In this embodiment, the target area of interest of the object is determined according to the change of the height of the avatar of the object, which can effectively determine the area of interest of the object according to the action of the object.
另外,也可以通过头部高度变化值以外的其他方式来确定对象感兴趣的目标区域,例如:可以直接通过对象的头部高度确定目标区域。在这之前,可以建立头部高度与目标区域的对应关系。当通过安装在目标区域附近的侦测器确定对象的某一头部高度以后,根据该对应关系就能确定该对象感兴趣的目标区域。In addition, it is also possible to determine the target area of interest by other methods than the head height change value. For example, the target area can be determined directly by the height of the head of the object. Prior to this, the corresponding relationship between the head height and the target area can be established. After a certain head height of an object is determined by a detector installed near the target area, the target area of interest of the object can be determined according to the corresponding relationship.
在一个实施例中,所述行为变化信息还包括:手臂变化值、眼球焦点变化值;所述根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域的步骤,包括:根据预设的算法,从预先建立的数据库中确定与所述头部高度变化值、手臂变化值和/或眼球焦点变化值相对应的区域,作为所述对象感兴趣的目标区域。In an embodiment, the behavior change information further includes: arm change value and eyeball focus change value; the step of determining the target area of interest of the object according to a preset algorithm and the behavior change information includes: According to a preset algorithm, an area corresponding to the head height change value, the arm change value and/or the eye focus change value is determined from a pre-established database as the target area of interest for the object.
其中,手臂变化值指的是对象的手臂执行某个动作(例如:伸手等)以后,其手臂相对于原来状态的变化值,可以是手臂的位置变化、手掌高度变化等,根据手臂变化值能够分析出对象是否有拿取物品的动作。眼球焦点变化值指的是眼球在观看物品的过程中发生变化,导致的焦点变化值,通过眼球焦点变化值能分析出对象的目光变化情况,进而确定其观看的目标区域。Among them, the arm change value refers to the change value of the arm relative to the original state after the subject's arm performs a certain action (for example, reaching out, etc.). It can be the position change of the arm, the palm height change, etc., according to the arm change value. Analyze whether the subject has taken the object. The eyeball focus change value refers to the focus change value caused by the change of the eyeball in the process of viewing the object. The eyeball focus change value can analyze the gaze change of the object, and then determine the target area for viewing.
另外,头部高度变化值、手臂变化值、眼球焦点变化值确定目标区域的过程可以结合对象的身高、手臂长度、两眼距离等来确定。即,两个身高不同的对象虽然头部高度变化值一致,但所确定的目标区域可以不一样。In addition, the process of determining the target area by the head height change value, the arm change value, and the eyeball focus change value can be determined in conjunction with the object's height, arm length, and distance between the eyes. That is, although two objects with different heights have the same head height change value, the determined target area may be different.
图5为一个冰柜中候选目标区域的示意图,如图5所示,该冰柜包含4/5/6/7/8/9/10/11/12这九个候选目标区域,同时,在冰柜外有1/2/3三个供对象站立的区域。图6为对象拿取物品的俯视图,如图6所示,
Figure PCTCN2019120367-appb-000001
当某一对象站立在区域2上但头部和手臂没有动作时,可以认为该对象对冰柜中的各个区域都不感兴趣;
Figure PCTCN2019120367-appb-000002
当某一对象站立在区域2上,头部往前探(头部高度变低)且手臂往前伸出一小段距离时,可以认为该对象对候选目标区域5(候选目标区域的位置请参见图5)感兴趣;
Figure PCTCN2019120367-appb-000003
当某一对象站立在区域2上,头部往前探且手臂往前伸出一大段距离时,可以认为该对象对候选目标区域8感兴趣。图7为对象拿取物品的正面图,图7中
Figure PCTCN2019120367-appb-000004
与图6相对应。根据图7可以明显地看出不同状态下对象的头部和手臂的变化:
Figure PCTCN2019120367-appb-000005
表示观察状态,
Figure PCTCN2019120367-appb-000006
表示欲拿取状态,
Figure PCTCN2019120367-appb-000007
表示拿取状态,
Figure PCTCN2019120367-appb-000008
表示对象拿到了物品。
Figure 5 is a schematic diagram of candidate target areas in a freezer. As shown in Figure 5, the freezer contains nine candidate target areas 4/5/6/7/8/9/10/11/12. At the same time, outside the freezer There are 1/2/3 three areas for the subject to stand. Figure 6 is a top view of the object taking the object, as shown in Figure 6,
Figure PCTCN2019120367-appb-000001
When an object stands on area 2 but the head and arms do not move, it can be considered that the object is not interested in any area in the freezer;
Figure PCTCN2019120367-appb-000002
When an object stands on area 2 with its head protruding forward (the head height becomes lower) and the arms extend a short distance forward, it can be considered that the object is against the candidate target area 5 (for the location of the candidate target area, please refer to Figure 5) Interest;
Figure PCTCN2019120367-appb-000003
When an object stands on the area 2 with its head protruding forward and its arms extended for a long distance, it can be considered that the object is interested in the candidate target area 8. Figure 7 is the front view of the object taking the object, in Figure 7
Figure PCTCN2019120367-appb-000004
Corresponds to Figure 6. According to Figure 7, the changes of the subject's head and arms in different states can be clearly seen:
Figure PCTCN2019120367-appb-000005
Indicates the state of observation,
Figure PCTCN2019120367-appb-000006
Indicates the state of wanting to take,
Figure PCTCN2019120367-appb-000007
Indicates the state of taking,
Figure PCTCN2019120367-appb-000008
Indicates that the subject has received the item.
本实施例,将头部高度变化与手臂变化值、眼球焦点变化值进行结合,根据对象多个部位的状态变化来确定对象感兴趣的目标区域,能有效提高所确定的目标信息的准确率。In this embodiment, the head height change is combined with the arm change value and the eyeball focus change value to determine the target area of interest according to the state changes of multiple parts of the object, which can effectively improve the accuracy of the determined target information.
在一个实施例中,所述获取所述对象在预设时间段内的行为特征信息的步骤,包括:获取对象的生物特征信息;当根据所述生物特征信息确定所述对象为已注册状态时,获取所述对象在预设时间段内的行为特征信息。In one embodiment, the step of acquiring behavior characteristic information of the object within a preset time period includes: acquiring biological characteristic information of the object; when it is determined that the object is in a registered state according to the biological characteristic information To obtain the behavior characteristic information of the object in a preset time period.
本实施例根据对象的生物特征信息来确定对应的对象是否经过注册,若是注册过的已注册对象,则获取其行为特征信息并确定其感兴趣的目标区域;若是未注册对象,则可以不获取其行为特征信息。因此,本实施例能够根据对象的不同注册状态,进行针对性的处理,不需要确定未注册对象的目标信息,能有效节约资源。This embodiment determines whether the corresponding object is registered according to the biological characteristic information of the object. If it is a registered object that has been registered, obtain its behavior characteristic information and determine the target area of interest; if it is an unregistered object, it may not be obtained. Information about its behavior characteristics. Therefore, this embodiment can perform targeted processing according to different registration states of objects, without determining the target information of unregistered objects, and can effectively save resources.
在一个实施例中,所述获取对象的生物特征信息的步骤之后,还包括:当根据所述生物特征信息确定所述对象为未注册状态时,获取所述对象的动作特征信息;获取当前显示信息,根据所述动作特征信息确定新的显示信息,根据所述新的显示信息调整当前显示信息。In one embodiment, after the step of obtaining the biometric information of the object, the method further includes: when it is determined that the object is in an unregistered state according to the biometric information, obtaining the action feature information of the object; and obtaining the current display Information, new display information is determined according to the action characteristic information, and current display information is adjusted according to the new display information.
其中,动作特征信息指的是对象执行某个动作时的动作幅度、频率以及生物特征信息等。例如,动作特征信息可以是左右摆手的动作信息。当某一未注册对象向左摆手,则认为该未注册对象想查看下一页的显示信息,因此将下一页的显示信息确定为新的显示信息,覆盖当前显示信息。Among them, the movement characteristic information refers to the movement amplitude, frequency, and biological characteristic information when the object performs a certain movement. For example, the motion characteristic information may be motion information of left and right hand waving. When an unregistered object waves his hand to the left, it is considered that the unregistered object wants to view the display information of the next page, so the display information of the next page is determined as the new display information, overwriting the current display information.
当然,若确定某一对象是未注册对象,则可以显示注册信息,以便未注册对象根据提示完成注册过程。Of course, if it is determined that an object is an unregistered object, the registration information can be displayed so that the unregistered object completes the registration process according to the prompt.
可以在对象的附近提示对象多个特定动作的信息,例如,提示对象可以执行摆手、点头、摇头等动作,并提示各个动作对当前显示信息的影响。Information about multiple specific actions of the object can be prompted in the vicinity of the object. For example, the object can be prompted to perform actions such as waving hands, nodding heads, shaking heads, etc., and prompting the impact of each action on the currently displayed information.
此外,所述根据所述新的显示信息调整当前显示信息的步骤之后,还包括:设置计时器;当所述计时器计时时间到达时,恢复所述当前显示信息。In addition, after the step of adjusting the current display information according to the new display information, the method further includes: setting a timer; and when the timer expires, restoring the current display information.
其中,计时时间可以是10s、20s等时间,也可以为其他时间。Among them, the timing time can be 10s, 20s, etc., or other time.
本实施例根据未注册对象的动作特征信息进行显示信息的调整,能使得未注册对象也能查看到感兴趣的信息。同时允许未注册对象限时体验信息显示的服务,可以引导未注册对象转化为已注册对象。In this embodiment, the display information is adjusted according to the action characteristic information of the unregistered object, so that the unregistered object can also view the information of interest. At the same time, allowing unregistered objects to experience information display services for a limited time, which can guide unregistered objects to be transformed into registered objects.
当然,对于未注册对象,也可以跟已注册对象一样,根据其行为变化信息确定其感兴趣的目标区域,进而确定目标信息。Of course, for unregistered objects, it is also possible to determine the target area of interest according to the behavior change information of the registered object, and then determine the target information.
显示目标信息时,可以对已注册对象和未注册对象进行区别,例如:对于已注册对象,持续显示目标信息直到其离开特定区域,对于未注册对象则限时显示。也可以不区别已注册对象和未注册对象,甚至可以不区分已注册和未注册对象。When displaying target information, you can distinguish between registered objects and unregistered objects. For example, for registered objects, the target information is continuously displayed until it leaves a specific area, and for unregistered objects, it is displayed for a limited time. It is also possible not to distinguish between registered objects and unregistered objects, or even registered and unregistered objects.
在一个实施例中,所述当根据所述生物特征信息确定所述对象为未注册状态的步骤之后,还包括:获取注册二维码,提示所述对象扫描所述注册二维码;当接收到扫描完成指令后,将所述注册二维码与所述生物特征信息进行绑定,将所述对象确定为已注册状态。In one embodiment, after the step of determining that the object is in an unregistered state according to the biometric information, the method further includes: obtaining a registered QR code, prompting the object to scan the registered QR code; After the instruction is scanned, the registered two-dimensional code is bound to the biometric information, and the object is determined to be in a registered state.
其中,注册二维码指的是对象注册时需要使用的二维码信息。不同对象在注册过程中的注册二维码可以相同,也可以不同。另外,若不同对象的注册二维码不同时,该注册二维码可以是预先生成并存储在存储中的,也可以是随机生成的。Among them, the registration QR code refers to the QR code information that needs to be used when the object is registered. The registration QR code of different objects in the registration process can be the same or different. In addition, if the registered two-dimensional codes of different objects are different, the registered two-dimensional codes may be pre-generated and stored in the storage, or randomly generated.
对象扫描注册二维码可以通过其携带的移动设备,也可以通过无人超市、无人冰柜等提供的扫描终端来进行扫描。Object scanning registration QR code can be scanned through the mobile device it carries, or through scanning terminals provided by unmanned supermarkets and unmanned freezers.
本实施例,实现的是对象注册的过程,当对象扫描注册二维码以后,将该注册二维码与对象的生物特征信息进行绑定。在该对象再次到达特定区域时,根据其生物特征信息就能确 定该对象为已注册对象。In this embodiment, the process of object registration is implemented. After the object scans the registered QR code, the registered QR code is bound to the biological characteristic information of the object. When the object reaches a specific area again, it can be determined as a registered object based on its biometric information.
为了更好地理解上述方法,以候选目标区域为冰柜的格间对象为消费者为例,以下详细阐述一个本发明目标信息的确定方法的应用实例。In order to better understand the above method, taking the candidate target area as the freezer compartment object as the consumer as an example, an application example of the method for determining target information of the present invention will be described in detail below.
一、注册判断阶段1. Registration Judgment Stage
1、消费者A、B进入冰柜所在的区域时,侦测器获取消费者A、B的生物特征信息。根据该生物特征信息判断消费者A、B是否为已注册对象。1. When consumers A and B enter the area where the freezer is located, the detector obtains the biometric information of consumers A and B. According to the biometric information, it is judged whether consumers A and B are registered objects.
二、目标信息确定阶段2. Target information determination stage
2、当根据生物特征信息确定消费者A为已注册状态时,获取消费者A在1min内的头部高度。2. When it is determined that consumer A is in the registered state according to the biometric information, obtain the head height of consumer A within 1 min.
3、根据该头部高度确定消费者A的头部高度变化值。3. Determine the head height change value of consumer A according to the head height.
4、根据预设的算法,从预先建立的数据库中确定与该头部高度变化值相对应的候选目标区域,作为消费者A感兴趣的目标区域。4. According to a preset algorithm, the candidate target area corresponding to the head height change value is determined from the pre-established database as the target area of interest to consumer A.
5、根据预设的映射表确定目标区域中所存放的物品,将该物品信息确定为目标信息。5. Determine the items stored in the target area according to the preset mapping table, and determine the item information as the target information.
6、通过显示器显示该目标信息。6. Display the target information on the display.
本实施例对于已注册对象,根据其头部高度变化确定其感兴趣的目标信息,能有效提高目标信息的确定效率。同时对未注册对象不进行目标信息确定的过程,能有效节约现有资源,也能促使未注册对象完成注册过程。可以保证消费者在消费时能及时获取到消费咨询,而无需寻找店员协助,进而可以有效提高消费者的购物体验。使得用户的自助购物过程具有智能、人性化、易实现等诸多优点。In this embodiment, for the registered object, the target information of interest is determined according to the change of the head height, which can effectively improve the efficiency of determining the target information. At the same time, the process of not determining target information for unregistered objects can effectively save existing resources and can also prompt unregistered objects to complete the registration process. It can be ensured that consumers can obtain consumer consultation in time during consumption, without having to seek assistance from a clerk, thereby effectively improving the consumer's shopping experience. Makes the user's self-service shopping process has many advantages such as intelligence, humanization, and easy implementation.
需要说明的是,对于前述的各方法实施例,为了简便描述,将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述的动作顺序的限制,因为依据本发明,某些步骤可以采用其它顺序或者同时进行。It should be noted that for the foregoing method embodiments, for simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described sequence of actions, because According to the present invention, certain steps can be performed in other order or simultaneously.
基于与上述实施例中的目标信息的确定方法相同的思想,本发明还提供目标信息的确定装置,该装置可用于执行上述目标信息的确定方法。为了便于说明,目标信息的确定装置实施例的结构示意图中,仅仅示出了与本发明实施例相关的部分,本领域技术人员可以理解,图示结构并不构成对装置的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Based on the same idea as the method for determining target information in the foregoing embodiment, the present invention also provides a device for determining target information, which can be used to execute the method for determining target information described above. For ease of description, in the schematic structural diagram of the embodiment of the device for determining target information, only the parts related to the embodiment of the present invention are shown. Those skilled in the art can understand that the illustrated structure does not constitute a limitation on the device, and may include comparisons. More or fewer parts are shown, or some parts are combined, or different parts are arranged.
如图8所述,目标信息的确定装置包括特征信息获取模块801、区域确定模块802和目标信息确定模块803,详细说明如下:As shown in FIG. 8, the device for determining target information includes a feature information acquiring module 801, an area determining module 802, and a target information determining module 803. The detailed description is as follows:
特征信息获取模块801,用于获取所述对象在预设时间段内的行为特征信息。The characteristic information acquiring module 801 is configured to acquire behavior characteristic information of the object within a preset time period.
区域确定模块802,用于根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域。The area determining module 802 is configured to determine the behavior change information of the object according to the behavior characteristic information; determine the target area of interest of the object according to a preset algorithm and the behavior change information.
目标信息确定模块803,用于根据预设的映射表确定与所述目标区域对应的目标信息。The target information determining module 803 is configured to determine target information corresponding to the target area according to a preset mapping table.
本实施例,能够根据对象的行为确定其感兴趣的目标信息,有效提高目标信息的确定效率。In this embodiment, the target information of interest can be determined according to the behavior of the object, which effectively improves the efficiency of determining target information.
在一个实施例中,区域确定模块802,还用于根据所述行为特征信息确定所述对象在预设时间段内的头部高度变化值。In one embodiment, the area determination module 802 is further configured to determine the head height change value of the object in a preset time period according to the behavior characteristic information.
在一个实施例中,所述行为变化信息还包括:手臂变化值、眼球焦点变化值;区域确定模块802,还用于根据预设的算法,从预先建立的数据库中确定与所述头部高度变化值、手臂变化值和/或眼球焦点变化值相对应的区域,作为所述对象感兴趣的目标区域。In one embodiment, the behavior change information further includes: arm change value, eyeball focus change value; the area determination module 802 is also used to determine the height of the head from a pre-established database according to a preset algorithm. The area corresponding to the change value, the arm change value and/or the eyeball focus change value is used as the target area of interest for the subject.
在一个实施例中,特征信息获取模块801,包括:生物特征信息获取子模块,用于获取对象的生物特征信息;注册判断子模块,用于当根据所述生物特征信息确定所述对象为已注册状态时,获取所述对象在预设时间段内的行为特征信息。In one embodiment, the characteristic information acquisition module 801 includes: a biological characteristic information acquisition sub-module for acquiring biological characteristic information of an object; and a registration judgment sub-module for determining that the object is already based on the biological characteristic information. In the registration state, the behavior characteristic information of the object within a preset time period is acquired.
在一个实施例中,还包括:动作特征信息获取子模块,用于当根据所述生物特征信息确定所述对象为未注册状态时,获取所述对象的动作特征信息;显示信息调整子模块,用于获取当前显示信息,根据所述动作特征信息确定新的显示信息,根据所述新的显示信息调整当前显示信息。In one embodiment, it further includes: an action feature information acquisition submodule, configured to acquire action feature information of the object when it is determined that the object is in an unregistered state according to the biometric information; a display information adjustment submodule, It is used to obtain current display information, determine new display information according to the action characteristic information, and adjust the current display information according to the new display information.
在一个实施例中,还包括:显示恢复模块,用于设置计时器;当所述计时器计时时间到达时,恢复所述当前显示信息。In one embodiment, it further includes: a display recovery module, configured to set a timer; when the timer expires, recover the current display information.
在一个实施例中,还包括:二维码扫描模块,用于获取注册二维码,提示所述对象扫描所述注册二维码;信息绑定模块,用于当接收到扫描完成指令后,将所述注册二维码与所述生物特征信息进行绑定,将所述对象确定为已注册状态。In one embodiment, it further includes: a two-dimensional code scanning module for obtaining a registered two-dimensional code and prompting the object to scan the registered two-dimensional code; an information binding module for when receiving a scanning completion instruction, Bind the registered two-dimensional code with the biometric information, and determine the object as a registered state.
需要说明的是,本发明的目标信息的确定装置与本发明的目标信息的确定方法一一对应,在上述目标信息的确定方法的实施例阐述的技术特征及其有益效果均适用于目标信息的确定装置的实施例中,具体内容可参见本发明方法实施例中的叙述,此处不再赘述,特此声明。It should be noted that the device for determining target information of the present invention corresponds to the method for determining target information of the present invention one-to-one, and the technical features and beneficial effects described in the embodiment of the method for determining target information are applicable to target information. In the embodiment of the determining device, the specific content can be referred to the description in the method embodiment of the present invention, which will not be repeated here, and it is hereby declared.
此外,上述示例的目标信息的确定装置的实施方式中,各程序模块的逻辑划分仅是举例说明,实际应用中可以根据需要,例如出于相应硬件的配置要求或者软件的实现的便利考虑,将上述功能分配由不同的程序模块完成,即将所述目标信息的确定装置的内部结构划分成不 同的程序模块,以完成以上描述的全部或者部分功能。In addition, in the implementation of the device for determining target information in the foregoing example, the logical division of each program module is only an example. In actual applications, it can be used as required, for example, due to the configuration requirements of the corresponding hardware or the convenience of software implementation. The above-mentioned function allocation is completed by different program modules, that is, the internal structure of the device for determining the target information is divided into different program modules to complete all or part of the functions described above.
在一个实施例中,提供了一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,处理器执行计算机程序时实现以下步骤:获取所述对象在预设时间段内的行为特征信息;根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域;根据预设的映射表确定与所述目标区域对应的目标信息。In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor. When the processor executes the computer program, the following steps are implemented: Set the behavior characteristic information within a time period; determine the behavior change information of the object according to the behavior characteristic information; determine the target area of interest of the object according to the preset algorithm and the behavior change information; according to the preset mapping The table determines the target information corresponding to the target area.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:根据所述行为特征信息确定所述对象在预设时间段内的头部高度变化值。In an embodiment, the processor further implements the following step when executing the computer program: determining the head height change value of the object within a preset time period according to the behavior characteristic information.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:根据预设的算法,从预先建立的数据库中确定与所述头部高度变化值、手臂变化值和/或眼球焦点变化值相对应的区域,作为所述对象感兴趣的目标区域。In one embodiment, the processor further implements the following steps when executing the computer program: according to a preset algorithm, determine from a pre-established database the value corresponding to the head height change value, the arm change value and/or the eye focus change value. The corresponding area is used as the target area of interest for the object.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:获取对象的生物特征信息;当根据所述生物特征信息确定所述对象为已注册状态时,获取所述对象在预设时间段内的行为特征信息。In one embodiment, the processor further implements the following steps when executing the computer program: acquiring the biological characteristic information of the object; when it is determined that the object is in the registered state according to the biological characteristic information, acquiring the object in the preset time period Behavior characteristics information within.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:当根据所述生物特征信息确定所述对象为未注册状态时,获取所述对象的动作特征信息;获取当前显示信息,根据所述动作特征信息确定新的显示信息,根据所述新的显示信息调整当前显示信息。In one embodiment, the processor further implements the following steps when executing the computer program: when the object is determined to be in an unregistered state according to the biometric information, acquiring the action characteristic information of the object; acquiring the current display information, according to all The action characteristic information determines new display information, and adjusts the current display information according to the new display information.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:设置计时器;当所述计时器计时时间到达时,恢复所述当前显示信息。In an embodiment, the processor further implements the following steps when executing the computer program: setting a timer; when the timer expires, restoring the current display information.
在一个实施例中,处理器执行计算机程序时还实现以下步骤:获取注册二维码,提示所述对象扫描所述注册二维码;当接收到扫描完成指令后,将所述注册二维码与所述生物特征信息进行绑定,将所述对象确定为已注册状态。In one embodiment, the processor further implements the following steps when executing the computer program: acquiring the registration QR code, prompting the object to scan the registration QR code; when receiving the scanning completion instruction, the registration QR code Binding with the biometric information, and determining the object as a registered state.
在一个实施例中,提供了一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现以下步骤:获取所述对象在预设时间段内的行为特征信息;根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域;根据预设的映射表确定与所述目标区域对应的目标信息。In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented: acquiring behavior characteristic information of the object within a preset time period; The behavior characteristic information determines the behavior change information of the object; the target area of interest of the object is determined according to a preset algorithm and the behavior change information; the target corresponding to the target area is determined according to a preset mapping table information.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:根据所述行为特征信息确定所述对象在预设时间段内的头部高度变化值。In one embodiment, when the computer program is executed by the processor, the following step is further implemented: determining the head height change value of the object in a preset time period according to the behavior characteristic information.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:根据预设的算法,从预 先建立的数据库中确定与所述头部高度变化值、手臂变化值和/或眼球焦点变化值相对应的区域,作为所述对象感兴趣的目标区域。In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: according to a preset algorithm, determine the head height change value, the arm change value and/or the eye focus change value from a pre-established database. The corresponding area is used as the target area of interest for the object.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:获取对象的生物特征信息;当根据所述生物特征信息确定所述对象为已注册状态时,获取所述对象在预设时间段内的行为特征信息。In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: acquiring the biological characteristic information of the object; when it is determined that the object is in the registered state according to the biological characteristic information, acquiring the object at a preset time Behavior characteristic information within the segment.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:当根据所述生物特征信息确定所述对象为未注册状态时,获取所述对象的动作特征信息;获取当前显示信息,根据所述动作特征信息确定新的显示信息,根据所述新的显示信息调整当前显示信息。In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: when it is determined that the object is in an unregistered state according to the biometric information, the action characteristic information of the object is obtained; the current display information is obtained according to The action characteristic information determines new display information, and adjusts the current display information according to the new display information.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:设置计时器;当所述计时器计时时间到达时,恢复所述当前显示信息。In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: setting a timer; and when the timer expires, restoring the current display information.
在一个实施例中,计算机程序被处理器执行时还实现以下步骤:获取注册二维码,提示所述对象扫描所述注册二维码;当接收到扫描完成指令后,将所述注册二维码与所述生物特征信息进行绑定,将所述对象确定为已注册状态。In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: acquiring the registration QR code, prompting the object to scan the registration QR code; after receiving the scanning completion instruction, registering the QR code The code is bound with the biometric information, and the object is determined to be in a registered state.
本领域普通技术人员可以理解,实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,作为独立的产品销售或使用。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program, and the program can be stored in a computer readable storage medium, as Independent product sales or use. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connections (electronic devices) with one or more wiring, portable computer disk cases (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable and editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because it can be used, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable media if necessary. The program is processed in a way to obtain the program electronically and then stored in the computer memory.
应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行***执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that each part of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if it is implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: Discrete logic circuits, application-specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.
本发明实施例的术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包 含。例如包含了一系列步骤或(模块)单元的过程、方法、***、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。The terms "including" and "having" and any variations thereof in the embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or (module) units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optional The ground also includes other steps or units inherent to these processes, methods, products, or equipment.
以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the various technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, All should be considered as the scope of this specification.
以上所述实施例仅表达了本发明的几种实施方式,不能理解为对本发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进,这些都属于本发明的保护范围。因此,本发明专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several embodiments of the present invention, and cannot be understood as a limitation of the patent scope of the present invention. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can be made, and these all fall within the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention should be subject to the appended claims.

Claims (10)

  1. 一种目标信息的确定方法,其特征在于,包括以下步骤:A method for determining target information is characterized in that it comprises the following steps:
    获取所述对象在预设时间段内的行为特征信息;Acquiring behavior characteristic information of the object in a preset time period;
    根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域;Determine the behavior change information of the object according to the behavior characteristic information; determine the target area of interest of the object according to a preset algorithm and the behavior change information;
    根据预设的映射表确定与所述目标区域对应的目标信息。The target information corresponding to the target area is determined according to a preset mapping table.
  2. 根据权利要求1所述的目标信息的确定方法,其特征在于,所述根据所述行为特征信息确定所述对象的行为变化信息的步骤,包括:The method for determining target information according to claim 1, wherein the step of determining the behavior change information of the object according to the behavior characteristic information comprises:
    根据所述行为特征信息确定所述对象在预设时间段内的头部高度变化值。The head height change value of the object in a preset time period is determined according to the behavior characteristic information.
  3. 根据权利要求2所述的目标信息的确定方法,其特征在于,所述行为变化信息还包括:手臂变化值、眼球焦点变化值;The method for determining target information according to claim 2, wherein the behavior change information further comprises: arm change value and eyeball focus change value;
    所述根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域的步骤,包括:The step of determining the target area of interest of the object according to the preset algorithm and the behavior change information includes:
    根据预设的算法,从预先建立的数据库中确定与所述头部高度变化值、手臂变化值和/或眼球焦点变化值相对应的区域,作为所述对象感兴趣的目标区域。According to a preset algorithm, an area corresponding to the head height change value, the arm change value and/or the eye focus change value is determined from a pre-established database as the target area of interest for the object.
  4. 根据权利要求1所述的目标信息的确定方法,其特征在于,所述获取所述对象在预设时间段内的行为特征信息的步骤,包括:The method for determining target information according to claim 1, wherein the step of obtaining behavior characteristic information of the object within a preset time period comprises:
    获取对象的生物特征信息;Obtain the biometric information of the object;
    当根据所述生物特征信息确定所述对象为已注册状态时,获取所述对象在预设时间段内的行为特征信息。When it is determined that the object is in a registered state according to the biological characteristic information, the behavior characteristic information of the object within a preset time period is acquired.
  5. 根据权利要求4所述的目标信息的确定方法,其特征在于,所述获取对象的生物特征信息的步骤之后,还包括:The method for determining target information according to claim 4, characterized in that, after the step of obtaining the biological characteristic information of the object, the method further comprises:
    当根据所述生物特征信息确定所述对象为未注册状态时,获取所述对象的动作特征信息;When it is determined that the object is in an unregistered state according to the biometric information, acquiring action characteristic information of the object;
    获取当前显示信息,根据所述动作特征信息确定新的显示信息,根据所述新的显示信息调整当前显示信息。Obtain current display information, determine new display information according to the action characteristic information, and adjust the current display information according to the new display information.
  6. 根据权利要求5所述的目标信息的确定方法,其特征在于,所述根据所述新的显示信息调整当前显示信息的步骤之后,还包括:The method for determining target information according to claim 5, wherein after the step of adjusting the current display information according to the new display information, the method further comprises:
    设置计时器;Set a timer;
    当所述计时器计时时间到达时,恢复所述当前显示信息。When the timer expires, restore the current display information.
  7. 根据权利要求5所述的目标信息的确定方法,其特征在于,所述当根据所述生物特征信息确定所述对象为未注册状态的步骤之后,还包括:The method for determining target information according to claim 5, wherein after the step of determining that the object is in an unregistered state according to the biometric information, the method further comprises:
    获取注册二维码,提示所述对象扫描所述注册二维码;Obtain a registration QR code, and prompt the object to scan the registration QR code;
    当接收到扫描完成指令后,将所述注册二维码与所述生物特征信息进行绑定,将所述对象确定为已注册状态。After receiving the scan completion instruction, bind the registered two-dimensional code with the biometric information, and determine the object as a registered state.
  8. 一种目标信息的确定装置,其特征在于,包括:A device for determining target information is characterized in that it comprises:
    特征信息获取模块,用于获取所述对象在预设时间段内的行为特征信息;The characteristic information acquisition module is used to acquire the behavior characteristic information of the object in a preset time period;
    区域确定模块,用于根据所述行为特征信息确定所述对象的行为变化信息;根据预设的算法以及所述行为变化信息确定所述对象感兴趣的目标区域;An area determination module, configured to determine behavior change information of the object according to the behavior characteristic information; determine a target area of interest of the object according to a preset algorithm and the behavior change information;
    目标信息确定模块,用于根据预设的映射表确定与所述目标区域对应的目标信息。The target information determining module is configured to determine the target information corresponding to the target area according to a preset mapping table.
  9. 一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1至7任一项所述的方法的步骤。A computer device, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor implements the computer program described in any one of claims 1 to 7 when the processor executes the computer program. The steps of the method described.
  10. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至7任一项所述的方法的步骤。A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the method according to any one of claims 1 to 7 when the computer program is executed by a processor.
PCT/CN2019/120367 2019-11-22 2019-11-22 Method and apparatus for determining target information, computer device and storage medium WO2021097832A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/120367 WO2021097832A1 (en) 2019-11-22 2019-11-22 Method and apparatus for determining target information, computer device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/120367 WO2021097832A1 (en) 2019-11-22 2019-11-22 Method and apparatus for determining target information, computer device and storage medium

Publications (1)

Publication Number Publication Date
WO2021097832A1 true WO2021097832A1 (en) 2021-05-27

Family

ID=75980090

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/120367 WO2021097832A1 (en) 2019-11-22 2019-11-22 Method and apparatus for determining target information, computer device and storage medium

Country Status (1)

Country Link
WO (1) WO2021097832A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110153431A1 (en) * 2009-12-21 2011-06-23 Electronics And Telecommunications Research Institute Apparatus and method for targeted advertising based on image of passerby
CN104462530A (en) * 2014-12-23 2015-03-25 小米科技有限责任公司 Method and device for analyzing user preferences and electronic equipment
CN108197971A (en) * 2017-12-08 2018-06-22 北京天正聚合科技有限公司 Information collecting method, information processing method, apparatus and system
CN108711086A (en) * 2018-05-09 2018-10-26 连云港伍江数码科技有限公司 Man-machine interaction method, device, article-storage device and storage medium in article-storage device
CN109191188A (en) * 2018-08-17 2019-01-11 连云港伍江数码科技有限公司 Determination method, apparatus, computer equipment and the storage medium of target information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110153431A1 (en) * 2009-12-21 2011-06-23 Electronics And Telecommunications Research Institute Apparatus and method for targeted advertising based on image of passerby
CN104462530A (en) * 2014-12-23 2015-03-25 小米科技有限责任公司 Method and device for analyzing user preferences and electronic equipment
CN108197971A (en) * 2017-12-08 2018-06-22 北京天正聚合科技有限公司 Information collecting method, information processing method, apparatus and system
CN108711086A (en) * 2018-05-09 2018-10-26 连云港伍江数码科技有限公司 Man-machine interaction method, device, article-storage device and storage medium in article-storage device
CN109191188A (en) * 2018-08-17 2019-01-11 连云港伍江数码科技有限公司 Determination method, apparatus, computer equipment and the storage medium of target information

Similar Documents

Publication Publication Date Title
CN111989537B (en) System and method for detecting human gaze and gestures in an unconstrained environment
CN106462242B (en) Use the user interface control of eye tracking
CN110175514B (en) Face brushing payment prompting method, device and equipment
US9224037B2 (en) Apparatus and method for controlling presentation of information toward human object
US8724910B1 (en) Selection of representative images
CN109242765B (en) Face image processing method and device and storage medium
JP6950912B2 (en) Video search information provision method, equipment and computer program
US20200364752A1 (en) Storefront device, storefront system, storefront management method, and program
TWI775134B (en) Interaction method, apparatus, device and storage medium
WO2019214673A1 (en) Method and device for human-computer interaction with a storage apparatus, storage apparatus and storage medium
CN104254817A (en) Rapid gesture re-engagement
CN104598869A (en) Intelligent advertisement pushing method based on human face recognition device
CN102542566A (en) Orienting the position of a sensor
TWI775135B (en) Interaction method, apparatus, device and storage medium
CN109191188A (en) Determination method, apparatus, computer equipment and the storage medium of target information
CN110582781A (en) Sight tracking system and method
Yu et al. Vision-based hand recognition based on tof depth camera
CN113781058A (en) Payment method and device for unmanned vehicle, electronic equipment and storage medium
US9501710B2 (en) Systems, methods, and media for identifying object characteristics based on fixation points
WO2021097832A1 (en) Method and apparatus for determining target information, computer device and storage medium
CN112655021A (en) Image processing method, image processing device, electronic equipment and storage medium
WO2019192455A1 (en) Store system, article matching method and apparatus, and electronic device
TW201351308A (en) Non-contact medical navigation system and control method therefof
CN109241942A (en) Image processing method, device, face recognition device and storage medium
CN109255674B (en) Trial makeup data processing system and method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19953669

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19953669

Country of ref document: EP

Kind code of ref document: A1