WO2021135196A1

WO2021135196A1 - Status recognition method and device for display region, electronic apparatus, and storage medium

Info

Publication number: WO2021135196A1
Application number: PCT/CN2020/105284
Authority: WO
Inventors: 孙贺然; 李佳宁; 程玉文; 任小兵; 贾存迪
Original assignee: 北京市商汤科技开发有限公司
Priority date: 2019-12-31
Filing date: 2020-07-28
Publication date: 2021-07-08
Also published as: KR20210088600A; JP2022519149A; TW202127348A; CN110942055A

Abstract

Provided are a status recognition method and device for a display region, an electronic apparatus, and a storage medium. In an embodiment, the method comprises: acquiring a video image captured in a display region; determining, on the basis of the captured video image, customer flow data of the display region within a first time period, the customer flow data comprising at least two of the following: a dwell time of each customer in the display region, an attention duration of each customer, attribute information of each customer, a customer footfall count, and a customer repeat-visit count; using the customer flow data to determine crowd status data of the display region within the first time period; and using the crowd status data to control a corresponding display status of the display region on a display interface.

Description

展示区域的状态识别方法、装置、电子设备及存储介质State recognition method, device, electronic equipment and storage medium of display area

相关申请的交叉引用Cross-references to related applications

本专利申请要求于2019年12月31日提交的、申请号为2019114163365的中国专利申请的优先权，该申请的全文以引用的方式并入本文中。This patent application claims the priority of the Chinese patent application with application number 2019114163365 filed on December 31, 2019, the full text of which is incorporated herein by reference.

技术领域Technical field

本公开涉及计算机技术领域，具体而言，涉及一种展示区域的状态识别方法、装置、电子设备及存储介质。The present disclosure relates to the field of computer technology, and in particular, to a state recognition method, device, electronic device, and storage medium of a display area.

背景技术Background technique

在诸如超市等购物门店、展览馆等展会场所中，通常会在各个展示区域展示各式各样的物品，以供用户购买或者参观。用户对各展示区域中物品的感兴趣程度，是很多门店或展会所关注的问题之一。然而，由于门店或展会的人流特点多体现在人群密集且用户活动轨迹处于无规律状态，这使得对用户对各展示区域中物品的感兴趣程度的分析更加困难。In exhibition venues such as supermarkets and other shopping stores, exhibition halls, etc., various items are usually displayed in various display areas for users to purchase or visit. The degree of user interest in the items in each display area is one of the concerns of many stores or exhibitions. However, because the characteristics of the flow of people in stores or exhibitions are mostly reflected in the dense crowds and the trajectories of users in an irregular state, this makes it more difficult to analyze the degree of user interest in the items in each display area.

发明内容Summary of the invention

有鉴于此，本公开至少提供一种展示区域的状态识别方案。In view of this, the present disclosure provides at least a state recognition solution for the display area.

第一方面，本公开提供了一种展示区域的状态识别方法，包括：In the first aspect, the present disclosure provides a method for identifying the status of a display area, including:

获取在展示区域采集的视频画面；Obtain the video images collected in the display area;

基于所述采集的视频画面，确定在第一时间段内所述展示区域的客流数据，所述客流数据包括出现在所述展示区域的各用户的停留时长、各用户的关注时长、各用户的属性信息、客流人数、客流人次中的至少两种；Based on the collected video images, determine the passenger flow data of the display area in the first time period. The passenger flow data includes the stay time of each user appearing in the display area, the attention time of each user, and the user's At least two of attribute information, number of passengers, and number of passengers;

利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据；Using the passenger flow data to determine crowd state data in the display area in the first time period;

利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态。Using the crowd state data, the display state corresponding to the display area in the display interface is controlled.

上述方法中，可以基于采集的视频画面确定客流数据，利用客流数据，确定第一时间段内展示区域的人群状态数据，并利用人群状态数据，控制显示界面中展示区域的显示状态。展示区域的显示状态，可以用于提示该展示区域中的人群状态数据，由此可以实现对于展示区域的人群状态的动态监控，进而可以分析展示区域的关注人群。In the above method, the passenger flow data may be determined based on the collected video images, the passenger flow data may be used to determine the crowd state data of the display area in the first time period, and the crowd state data may be used to control the display state of the display area in the display interface. The display status of the display area can be used to prompt the crowd status data in the display area, so that dynamic monitoring of the crowd status in the display area can be realized, and the people of interest in the display area can be analyzed.

一种可能的实施方式中，所述人群状态数据包括人群热度等级；所述利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态，包括：控制所述显示界面中所述展示区域对应的显示区域的图层呈现与所述人群热度等级匹配的颜色等级。In a possible implementation manner, the crowd state data includes crowd popularity levels; the using the crowd state data to control the display state corresponding to the display area in the display interface includes: controlling the display state in the display interface The layer of the display area corresponding to the display area presents a color level that matches the popularity level of the crowd.

通过不同颜色等级，展示不同的人群热度等级，丰富了展示区域的显示状态的呈现方式，且可以更加直观的展示不同展示区域的人群热度信息。Through different color levels, different people's popularity levels are displayed, which enriches the way of presenting the display status of the display area, and can more intuitively display the crowd's popularity information in different display areas.

一种可能的实施方式中，根据以下方式确定所述人群热度等级：基于所述客流数据中至少两种客流数据分别对应的权重系数、以及所述至少两种客流数据的数值，确定人群热度值，并确定所述人群热度值所在范围对应的人群热度等级。In a possible implementation manner, the crowd popularity level is determined according to the following manner: determining the crowd popularity value based on the respective weight coefficients of at least two types of passenger flow data in the passenger flow data and the values of the at least two types of passenger flow data , And determine the crowd's popularity level corresponding to the range of the crowd's popularity value.

通过这种方式确定出的人群热度值，结合了至少两种客流数据的特征，因此确定的人群热度值更能体现出该展示区域的客流特征，进而确定出的人群热度等级更加精确。The crowd popularity value determined in this way combines the characteristics of at least two kinds of passenger flow data, so the determined crowd popularity value can better reflect the passenger flow characteristics of the display area, and the determined crowd popularity level is more accurate.

一种可能的实施方式中，在所述客流数据包括所述客流人数和所述客流人次的情况下，所述利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据，包括：利用所述客流人数和所述客流人次，获取所述第一时间段的多个时间节点处的客流人数和客流人次；所述利用所述人群状态数据，控制显示界面中所述对应的显示状态，包括：基于所述第一时间段的多个时间节点处的客流人数和客流人次，在所述显示界面中展示所述第一时间段内所述展示区域的客流人数的变化趋势和客流次数的变化趋势。In a possible implementation manner, in a case where the passenger flow data includes the number of passenger flow and the number of passenger flow, the use of the passenger flow data to determine the state of the crowd in the display area in the first time period The data includes: using the number of passengers and the number of passengers to obtain the number of passengers and the number of passengers at multiple time nodes in the first time period; and using the crowd status data to control the number of passengers in the display interface The corresponding display state includes: based on the number of passengers and the number of passengers at multiple time nodes in the first time period, displaying the change in the number of passengers in the display area in the first time period on the display interface Trends and trends in the number of passenger flows.

上述实施方式中，可以更加直观的展示展示区域的客流人数和客流次数的变化情况。In the foregoing embodiment, the number of passenger flows and the change of the number of passenger flows in the display area can be displayed more intuitively.

一种可能的实施方式中，所述利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据，包括：基于各用户的属性信息，确定具有不同属性的人群分布数据，所述人群分布数据包括具有年龄、性别、魅力值、情绪中至少一种属性的分布数据；In a possible implementation manner, the using the passenger flow data to determine the crowd status data of the display area in the first time period includes: determining crowd distribution data with different attributes based on the attribute information of each user , The population distribution data includes distribution data having at least one attribute of age, gender, charm value, and emotion;

所述利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态，包括：利用具有所述不同属性的人群分布数据，控制所述显示界面中分别展示带有每种属性的人群分布图。The using the crowd state data to control the display state corresponding to the display area in the display interface includes: using the crowd distribution data with the different attributes to control the display interface to separately display the crowd with each attribute Distribution.

上述实施方式中，可以根据不同属性的人群分布数据，展示每种属性的人群分布图，以便针对各展示区域展示更为细致化的人群分布情况。In the foregoing embodiment, the population distribution map of each attribute may be displayed according to the population distribution data of different attributes, so as to display a more detailed population distribution situation for each display area.

一种可能的实施方式中，在所述客流数据包括各用户的关注时长和各用户的属性信息的情况下，所述利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据，包括：基于出现在所述展示区域的各用户的属性信息，将各用户划分在不同类属性的人群集合中；获取每类属性的人群集合中每个用户在所述展示区域的关注时长；基于每类属性的人群集合中每个用户对应的所述关注时长，确定每类属性的人群集合的关注总时长；In a possible implementation manner, in the case that the passenger flow data includes the attention duration of each user and the attribute information of each user, the passenger flow data is used to determine the display area of the display area in the first time period. The crowd status data includes: dividing each user into a crowd set of different attributes based on the attribute information of each user appearing in the display area; obtaining the status of each user in the display area in the crowd set of each type of attribute Attention duration; based on the attention duration corresponding to each user in the crowd set of each type of attribute, determine the total attention duration of the crowd set of each type of attribute;

所述利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态，包括：基于每类属性的人群集合的关注总时长，控制所述显示界面中呈现所述每类属性的人群集合的关注状态效果图。The use of the crowd state data to control the display state corresponding to the display area in the display interface includes: controlling the crowd who presents each type of attribute in the display interface based on the total attention time of the crowd set of each type of attribute A collection of state-of-interest renderings.

基于上述实施方式，在显示界面中呈现的每类属性的人群集合的关注状态效果图，可以用于指示不同类属性的人群对展示区域的关注程度。Based on the foregoing implementation manner, the attention state effect diagram of the crowd set of each type of attribute presented on the display interface can be used to indicate the degree of attention of the crowd of different types of attributes to the display area.

一种可能的实施方式中，所述每类属性的人群集合中的用户符合年龄、性别、魅力值、情绪中的至少两种属性。In a possible implementation manner, the users in the population set of each type of attribute meet at least two attributes of age, gender, charm value, and emotion.

一种可能的实施方式中，所述关注状态效果图通过特定图形来显示；每类属性的人群集合的关注总时长不同，对应的特定图像的显示效果也不同。In a possible implementation manner, the attention state effect diagram is displayed by a specific graphic; the total attention time of the group of people of each type of attribute is different, and the display effect of the corresponding specific image is also different.

一种可能的实施方式中，根据以下方式确定所述关注时长：针对每一用户，识别所述采集的视频画面中所述用户的人脸朝向数据；在检测到所述人脸朝向数据指示所述用户关注所述展示区域的展示物体的情况下，记录所述用户首次关注所述展示物体的时间；基于记录的多个所述用户首次关注所述展示物体的时间，确定在所述第一时间段内所述用户关注所述展示物体的关注时长，所述关注时长不超过所述第一时间段。In a possible implementation manner, the length of attention is determined according to the following manner: for each user, identify the user’s face orientation data in the collected video frame; In the case where the user pays attention to the display object in the display area, record the time when the user first paid attention to the display object; based on the recorded times when the user first paid attention to the display object, it is determined that the display object is in the first The length of time the user pays attention to the display object within the time period, and the time period of attention does not exceed the first time period.

一种可能的实施方式中，所述人脸朝向数据包括人脸的俯仰角和偏航角；在所述俯仰角处于第一角度范围内、且所述偏航角处于第二角度范围内的情况下，确定所述人脸朝向数据指示所述用户关注所述展示区域的展示物体。In a possible implementation manner, the face orientation data includes a pitch angle and a yaw angle of the face; when the pitch angle is within a first angle range and the yaw angle is within a second angle range In this case, it is determined that the face orientation data indicates that the user pays attention to the display object in the display area.

上述实施方式中，可以仅仅根据记录的用户首次关注展示物体的时间，确定在第一时间段内用户关注展示物体的关注时长，因此，可以避免用户首次关注展示物体的时间之间的间隔过短，造成的关注时长的频繁统计，也使得计算关注时长的方式更为合理。In the above-mentioned embodiment, the user's attention time of the displayed object in the first time period can be determined only based on the recorded time when the user first paid attention to the displayed object. Therefore, it is possible to prevent the user from paying attention to the displayed object for the first time. , Resulting in frequent statistics of the attention time, also makes the way of calculating the attention time more reasonable.

一种可能的实施方式中，根据以下方式确定在第一时间段内所述展示区域的客流人次：确定在所述第一时间段内所述展示区域中各用户的出现总次数；其中，针对每一用户，记录所述用户每次进入所述展示区域的开始时间；若记录的两次所述开始时间之间的间隔超过第一时长，确定所述用户出现一次；所述第一时长不超出所述第一时间段。In a possible implementation manner, the number of visitors in the display area in the first time period is determined according to the following manner: the total number of appearances of each user in the display area in the first time period is determined; For each user, record the start time each time the user enters the display area; if the interval between the two recorded start times exceeds the first duration, it is determined that the user appears once; the first duration is not Beyond the first time period.

上述实施方式中，可以避免在较短时间内用户出现次数的重复统计，提高了客流人次统计的精度。In the foregoing implementation manner, repeated statistics of the number of user appearances in a relatively short period of time can be avoided, and the accuracy of passenger flow statistics is improved.

一种可能的实施方式中，根据以下方式确定在第一时间段内所述展示区域的用户停留时长：确定在所述第一时间段内各用户每次出现时停留的总时长；其中，针对每一用户，在确定所述用户两次进入所述展示区域的开始时间之间的间隔超过第一时长的情况下，将所述间隔作为所述用户出现一次停留的时长。In a possible implementation manner, the length of stay of users in the display area in the first time period is determined according to the following method: the total length of stay of each user during each appearance in the first time period is determined; For each user, when it is determined that the interval between the start time when the user enters the display area twice exceeds the first duration, the interval is used as the duration of the user's one stay.

上述实施方式中，可以避免较短时间内用户多次出现时，对于停留时长的多次计算，降低了停留时长的计算量，也使得计算停留时长的方式更为合理。In the foregoing embodiment, it is possible to avoid multiple calculations of the stay time when the user appears multiple times in a short period of time, which reduces the calculation amount of the stay time and also makes the method of calculating the stay time more reasonable.

一种可能的实施方式中，还包括：在利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态之前，获取所述显示界面中针对所述展示区域的触发操作。In a possible implementation manner, the method further includes: before using the crowd state data to control the display state corresponding to the display area in the display interface, acquiring a trigger operation on the display area in the display interface.

一种可能的实施方式中，所述获取所述显示界面中针对所述展示区域的触发操作，包括：控制所述显示界面显示姿态提示框，所述手势提示框中包括姿态描述内容；检测所述采集的视频画面中的用户姿态；在所述用户姿态与所述姿态描述内容所记录的姿态一致的情况下，确认获取到所述显示界面中针对所述展示区域的触发操作。In a possible implementation manner, the acquiring the trigger operation for the display area in the display interface includes: controlling the display interface to display a gesture prompt box, the gesture prompt box including gesture description content; The user posture in the collected video frame; in the case that the user posture is consistent with the posture recorded in the posture description content, confirm that the trigger operation for the display area in the display interface is acquired.

上述实施方式中，在获取显示界面中针对显示区域的触发操作时，还可以通过采集视频画面中的用户姿态的方式，丰富了触发操作的触发方式，增加了用户与设备之间的交互。In the above embodiment, when acquiring the trigger operation for the display area in the display interface, the user gesture in the video screen may also be collected to enrich the trigger mode of the trigger operation and increase the interaction between the user and the device.

第二方面，本公开实施例提供了一种展示区域的状态识别装置，包括：In a second aspect, embodiments of the present disclosure provide a state recognition device for a display area, including:

获取模块，用于获取在展示区域采集的视频画面；The acquisition module is used to acquire the video images collected in the display area;

第一确定模块，用于基于所述采集的视频画面，确定在第一时间段内所述展示区域的客流数据，所述客流数据包括出现在所述展示区域的各用户的停留时长、各用户的关注时长、各用户的属性信息、客流人数、客流人次中的至少两种；The first determining module is configured to determine the passenger flow data of the display area in the first time period based on the collected video images, where the passenger flow data includes the stay time of each user appearing in the display area, and each user At least two of the following time, the attribute information of each user, the number of visitors, and the number of visitors;

第二确定模块，用于利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据；A second determining module, configured to use the passenger flow data to determine crowd status data in the display area in the first time period;

控制模块，用于利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态。The control module is configured to use the crowd state data to control the display state corresponding to the display area in the display interface.

第三方面，本公开提供一种电子设备，包括：处理器和存储器，所述存储器存储有所述处理器可执行的机器可读指令，所述机器可读指令被所述处理器执行时，使所述处理器执行如上述第一方面或任一实施方式所述的展示区域的状态识别方法。In a third aspect, the present disclosure provides an electronic device including: a processor and a memory, the memory stores machine-readable instructions executable by the processor, and when the machine-readable instructions are executed by the processor, The processor is caused to execute the method for recognizing the state of the display area as described in the first aspect or any one of the implementation manners.

第四方面，本公开提供一种计算机可读存储介质，该计算机可读存储介质上存储有计算机程序，该计算机程序被处理器运行时，使所述处理器执行如上述第一方面或任一实施方式所述的展示区域的状态识别方法。In a fourth aspect, the present disclosure provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when the computer program is run by a processor, the processor executes the above-mentioned first aspect or any one of The state recognition method of the display area described in the implementation mode.

为使本公开的上述目的、特征和优点能更明显易懂，下文特举较佳实施例，并配合所附附图，作详细说明如下。In order to make the above objectives, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with accompanying drawings are described in detail as follows.

附图说明Description of the drawings

为了更清楚地说明本公开实施例的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，此处的附图被并入说明书中并构成本说明书中的一部分，这些附图示出了符合本公开的实施例，并与说明书一起用于说明本公开的技术方案。应当理解，以下附图仅示出了本公开的某些实施例，因此不应被看作是对范围的限定，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他相关的附图。In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following will briefly introduce the drawings that need to be used in the embodiments. The drawings here are incorporated into the specification and constitute a part of the specification. The figure shows an embodiment conforming to the present disclosure, and is used together with the description to explain the technical solution of the present disclosure. It should be understood that the following drawings only show certain embodiments of the present disclosure, and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, they can also Obtain other related drawings based on these drawings.

图1示出了本公开实施例所提供的一种展示区域的状态识别方法的流程示意图；FIG. 1 shows a schematic flowchart of a method for recognizing the status of a display area provided by an embodiment of the present disclosure;

图2示出了本公开实施例所提供的一种显示界面中不同颜色等级的展示区域的展示示意图；FIG. 2 shows a schematic diagram showing display areas of different color levels in a display interface provided by an embodiment of the present disclosure;

图3示出了本公开实施例所提供的一种显示界面中每种属性下的人群分布图；FIG. 3 shows a distribution diagram of people under each attribute in a display interface provided by an embodiment of the present disclosure;

图4示出了本公开实施例所提供的一种客流人数的变化趋势和客流次数的变化趋势之间的比对结果示意图；FIG. 4 shows a schematic diagram of a comparison result between the change trend of the number of passenger flow and the change trend of the number of passenger flow provided by an embodiment of the present disclosure;

图5示出了本公开实施例所提供的用户的关注时长确定方法的流程示意图；FIG. 5 shows a schematic flowchart of a method for determining a user's attention duration provided by an embodiment of the present disclosure;

图6示出了本公开实施例所提供的一种关注状态效果图；FIG. 6 shows an effect diagram of a state of attention provided by an embodiment of the present disclosure;

图7示出了本公开实施例所提供的一种姿态提示框的示意图；FIG. 7 shows a schematic diagram of a gesture prompt box provided by an embodiment of the present disclosure;

图8A示出了本公开实施例所提供的另一种显示界面示意图；FIG. 8A shows a schematic diagram of another display interface provided by an embodiment of the present disclosure;

图8B示出了本公开实施例所提供的另一种显示界面示意图；FIG. 8B shows a schematic diagram of another display interface provided by an embodiment of the present disclosure;

图9示出了本公开实施例所提供的一种展示区域的状态识别装置的架构示意图；FIG. 9 shows a schematic structural diagram of a state recognition device for a display area provided by an embodiment of the present disclosure;

图10示出了本公开实施例所提供的电子设备的结构示意图。FIG. 10 shows a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.

具体实施方式Detailed ways

为使本公开实施例的目的、技术方案和优点更加清楚，下面将结合本公开实施例中的附图，对本公开实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本公开一部分实施例，而不是全部的实施例。通常在此处附图中描述和示出的本公开实施例的组件可以以各种不同的配置来布置和设计。因此，以下对在附图中提供的本公开的实施例的详细描述并非旨在限制要求保护的本公开的范围，而是仅仅表示本公开的选定实施例。基于本公开的实施例，本领域技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例，都属于本公开保护的范围。In order to make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments It is only a part of the embodiments of the present disclosure, but not all the embodiments. The components of the embodiments of the present disclosure generally described and illustrated in the drawings herein may be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed present disclosure, but merely represents selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative work shall fall within the protection scope of the present disclosure.

相关技术中，在对各个展示区域进行监控时，一般采用监控当前展示区域中的人群密度的方式，然而由于仅仅根据统计出的人群密度，无法实现对于展示区域的客流人群的具体分析，例如无法实现对于展示区域的客流人群的关注时长、客流人群中用户的属性信息等的分析，进而无法实现用户对展示区域的感兴趣程度的分析。In related technologies, when monitoring each display area, the method of monitoring the crowd density in the current display area is generally adopted. However, because only the statistical crowd density is used, a specific analysis of the crowd in the display area cannot be realized, for example, it is impossible to analyze the crowd density in the display area. Realize the analysis of the attention time of the crowds in the display area, the attribute information of the users in the crowds, and so on, and then it is impossible to realize the analysis of the user's interest in the display area.

基于此，本公开提供的展示区域的状态识别方法中，可以基于采集的视频画面，确定在第一时间段内展示区域的客流数据，确定出的客流数据包括出现在所述展示区域的各用户的停留时长、各用户的关注时长、各用户的属性信息、客流人数、客流人次中的至少两种，由此可以结合客流数据中的至少两种特征确定人群状态数据，因此，在基于人群状态数据，控制显示界面中展示区域的显示状态时，可以更加精确和直观地展示展示区域中的人群特征。Based on this, in the method for identifying the status of the display area provided by the present disclosure, the passenger flow data of the display area in the first time period can be determined based on the collected video images, and the determined passenger flow data includes each user appearing in the display area At least two of the length of stay of the user, the length of attention of each user, the attribute information of each user, the number of passengers, and the number of passengers, which can be combined with at least two characteristics in the passenger flow data to determine the crowd state data. Therefore, the crowd state data is determined based on the crowd state Data, when controlling the display status of the display area in the display interface, the characteristics of the crowd in the display area can be displayed more accurately and intuitively.

本公开实施例所提供的展示区域的状态识别方法可应用于服务器，或者应用于支持显示功能的终端设备。服务器可以是本地服务器也可以是云端服务器等，终端设备可以是智能手机、平板电脑、个人数字处理(Personal Digital Assistant，PDA)、智能电视等，本申请对此并不限定。The method for identifying the state of the display area provided by the embodiments of the present disclosure can be applied to a server or to a terminal device that supports a display function. The server may be a local server or a cloud server, etc. The terminal device may be a smart phone, a tablet computer, a personal digital assistant (PDA), a smart TV, etc., which is not limited in this application.

在本公开实施例应用于服务器时，本公开中的数据可以是从终端设备和/或摄像设备中获取的，控制显示界面中展示区域对应的显示状态，可以是通过向终端设备下发控制指令，来实现对终端设备的显示界面中展示区域对应的显示状态的控制。When the embodiments of the present disclosure are applied to a server, the data in the present disclosure can be obtained from a terminal device and/or a camera device, and the display state corresponding to the display area in the display interface can be controlled by issuing a control command to the terminal device. , To realize the control of the display state corresponding to the display area in the display interface of the terminal device.

为便于理解本公开实施例，首先对一种展示区域的状态识别方法进行详细介绍。To facilitate the understanding of the embodiments of the present disclosure, a method for identifying the state of the display area is first introduced in detail.

图1为本公开实施例所提供的一种展示区域的状态识别方法的流程示意图，该方法包括步骤S101～S104。FIG. 1 is a schematic flowchart of a method for recognizing the status of a display area provided by an embodiment of the present disclosure. The method includes steps S101 to S104.

S101、获取在展示区域采集的视频画面。S101. Obtain a video image collected in the display area.

S102、基于采集的视频画面，确定在第一时间段内展示区域的客流数据，客流数据包括出现在展示区域的各用户的停留时长、各用户的关注时长、各用户的属性信息、客流人数、客流人次中的至少两种。S102. Based on the collected video images, determine the passenger flow data of the display area in the first time period. The passenger flow data includes the stay time of each user appearing in the display area, the attention time of each user, the attribute information of each user, the number of visitors, At least two of the passenger flow.

S103、利用客流数据，确定第一时间段内展示区域的人群状态数据。S103. Using the passenger flow data, determine the crowd state data of the display area in the first time period.

S104、利用人群状态数据，控制显示界面中展示区域对应的显示状态。S104. Using the crowd state data, control the display state corresponding to the display area in the display interface.

本实施例所提供的方法，可以基于采集的视频画面确定客流数据，利用客流数据，确定第一时间段内展示区域的人群状态数据，并利用人群状态数据，控制显示界面中展示区域对应的显示状态。展示区域对应的显示状态，可以用于表明该展示区域中的人群状态，由此可以实现对展示区域内的人群状态的动态监控，进而可以分析对该展示区域的关注人群。The method provided in this embodiment can determine the passenger flow data based on the collected video images, use the passenger flow data to determine the crowd state data in the display area within the first time period, and use the crowd state data to control the display corresponding to the display area in the display interface status. The display state corresponding to the display area can be used to indicate the state of the crowd in the display area, thereby realizing dynamic monitoring of the state of the crowd in the display area, and then analyzing the people of interest in the display area.

当视频画面中包括多个展示区域时，根据不同展示区域的人群状态数据，可以控制显示界面中呈现不同展示区域对应不同的显示状态，进而可以对不同展示区域的人群状态进行对比分析。When the video screen includes multiple display areas, according to the crowd status data of different display areas, different display areas corresponding to different display states can be controlled to be presented in the display interface, and then the crowd status of different display areas can be compared and analyzed.

本公开的一实施例中，人群状态数据包括人群热度等级。可根据以下方式确定人群热度等级：基于客流数据中至少两种客流数据分别对应的权重系数、以及至少两种客流数据的数值，确定人群热度值，然后确定人群热度值所在范围对应的人群热度等级。In an embodiment of the present disclosure, the crowd status data includes crowd popularity levels. The crowd popularity level can be determined according to the following methods: based on the weight coefficients corresponding to at least two types of passenger flow data in the passenger flow data, and the values of at least two types of passenger flow data, determine the crowd popularity value, and then determine the crowd popularity rating corresponding to the range of the crowd popularity value. .

具体的，可以预先设置不同的人群热度等级所对应的人群热度值范围，例如，第一级人群热度对应的人群热度值范围为0～10，对应地，第一级人群热度内的人群热度值可取值为0、5、10；第二级人群热度对应的人群热度值范围为11～20，对应地，第二级人群热度内的人群热度值可取值为11、15、20；第三级人群热度对应的人群热度值范围为21～30，对应地，第三级人群热度内的人群热度值可取值为21、25、30。在根据客流数据的数值、以及每种客流数据的权重系数确定人群热度值之后，可以确定人群热度值所属的范围，然后确定对应的人群热度等级；例如若确定的人群热度值为25，则可以确定对应的人群热度等级为第三级人群热度。Specifically, the crowd popularity value range corresponding to different crowd popularity levels can be preset. For example, the crowd popularity value range corresponding to the first-level crowd popularity is 0-10, and correspondingly, the crowd popularity value within the first-level crowd popularity Possible values are 0, 5, and 10; the range of crowd popularity values corresponding to the second-level crowd popularity is 11-20. Correspondingly, the crowd popularity values within the second-level crowd popularity may take the values 11, 15, and 20; The crowd fever value range corresponding to the third-level crowd fever is 21-30. Correspondingly, the crowd fever value within the third-level crowd fever can take values of 21, 25, and 30. After the crowd popularity value is determined according to the value of the passenger flow data and the weight coefficient of each type of passenger flow data, the range to which the crowd popularity value belongs can be determined, and then the corresponding crowd popularity level; for example, if the determined crowd popularity value is 25, you can Determine the corresponding crowd popularity level as the third-level crowd popularity.

示例性的，基于客流人次以及客流人数计算人群热度值可以如下所示：Exemplarily, the crowd popularity value calculated based on the number of passengers and the number of passengers can be as follows:

p＝ax ₁+bx ₂ 公式(1) p=ax ₁ +bx ₂ formula (1)

其中，p表示人群热度值，x ₁表示客流人次的取值，x ₂表示客流人数的取值，a表示客流人次的权重，b表示客流人数的权重。 Among them, p represents the popularity value of the crowd, x ₁ represents the value of passenger flow, x ₂ represents the value of passenger flow, a represents the weight of passenger flow, and b represents the weight of passenger flow.

示例性的，还可以基于客流人数和停留时长相结合来计算人群热度值，或者，基于客流人数和关注时长相结合来计算人群热度值等，本申请对此并不做限定。Exemplarily, the crowd popularity value may also be calculated based on the combination of the number of passengers and the length of stay, or the crowd popularity value may be calculated based on the combination of the number of passengers and the length of attention, etc., which is not limited in this application.

在利用人群状态数据，控制显示界面中展示区域的显示状态时，可以是控制显示界面中展示区域对应的显示区域的图层呈现与人群热度等级匹配的颜色等级。When using the crowd state data to control the display state of the display area in the display interface, it can be used to control the display area of the display area corresponding to the display area in the display interface to present a color level that matches the crowd popularity level.

不同人群热度等级匹配不同的颜色等级。例如，与第一级人群热度匹配的颜色等级可以为绿色，与第二级人群热度匹配的颜色可以为黄色，与第三级人群热度匹配的颜色可以为红色。或者，不同颜色等级可以呈现不同的灰度值。其中，不同人群热度等级匹配的颜色等级可以为预先设置好的。The heat level of different people matches different color levels. For example, the color level matching the popularity of the first-level crowd may be green, the color matching the popularity of the second-level crowd may be yellow, and the color matching the popularity of the third-level crowd may be red. Or, different color levels can present different gray values. Among them, the color levels matched by the heat levels of different groups of people may be preset.

在确定人群热度等级之后，可以确定与该人群热度等级匹配的颜色等级，然后控制显示界面中展示区域对应的显示区域的图层呈现该颜色等级的颜色。示例性的，显示界面中不同颜色等级的展示区域的展示示意图可以如图2所示，图2中不同的灰色区域表示不同的展示区域，灰度值表示该展示区域的人群热度，灰度值越高，人群热度值越高。After determining the popularity level of the crowd, the color level matching the popularity level of the crowd can be determined, and then the layer of the display area corresponding to the display area in the display interface is controlled to present the color of the color level. Exemplarily, the display schematic diagram of the display area of different color levels in the display interface may be as shown in FIG. 2. In FIG. 2, different gray areas represent different display areas, and the gray value represents the popularity of the crowd in the display area, and the gray value The higher, the higher the popularity of the crowd.

在显示界面中包括各展示区域对应的显示区域时，可以根据各显示区域的图层的颜色，展示不同展示区域的人群热度信息，展示方式更加直观。When the display interface includes the display area corresponding to each display area, according to the color of the layer of each display area, the crowd popularity information of different display areas can be displayed, and the display mode is more intuitive.

本公开的另一实施例中，还可以控制显示界面中展示区域显示与客流数据相关的显示状态，例如可以根据客流数据的种类的不同，控制显示界面中呈现与不同种类的客流数据相关的显示状态。In another embodiment of the present disclosure, the display area in the display interface can also be controlled to display display states related to passenger flow data. For example, according to different types of passenger flow data, the display interface can be controlled to present displays related to different types of passenger flow data. status.

一种可能的实施方式中，利用客流数据，确定第一时间段内展示区域的人群状态数据，包括：基于各用户的属性信息，确定具有不同属性的人群分布数据，所述人群分布数据包括具有年龄、性别、魅力值、情绪中至少一种属性的分布数据。示例性的，人群分布数据的人数统计可以是基于客流人数来计算，这种情况下，客流数据中至少包括出现在展示区域的各用户的属性信息和客流人数。In a possible implementation manner, using passenger flow data to determine the crowd status data of the display area in the first time period includes: determining crowd distribution data with different attributes based on the attribute information of each user, and the crowd distribution data includes Distribution data of at least one attribute of age, gender, charm value, and emotion. Exemplarily, the population statistics of the population distribution data may be calculated based on the number of passenger flow. In this case, the passenger flow data includes at least the attribute information of each user appearing in the display area and the number of passenger flow.

相应地，所述利用人群状态数据，控制显示界面中展示区域的显示状态，包括：利用具有不同属性的人群分布数据，控制显示界面中分别展示每种属性下的人群分布图。Correspondingly, the use of crowd state data to control the display state of the display area in the display interface includes: using crowd distribution data with different attributes to control the display interface to separately display the crowd distribution map under each attribute.

其中，显示界面中展示的每种属性下的人群分布图可以是饼状图、环形图、柱状图等。示例性的，显示界面中每种属性下的人群分布图可以如图3所示，图3中展示的属性分别为性别、年龄、魅力值、情绪，以及每种属性分布旁边的图例用于表示不同区间内的数量所占比例。例如，客流年龄分布旁边的“XXXX”可以表示不同的年龄区间，“XXX”可以表示对应的年龄区间的人数占总人数的比例(或者可以表示对应的年龄区间的人数值)；客流性别分布旁边的“XXX”可以表示不同性别的用户所占比例(或者可以表示对应性别的人数值)；魅力值分布旁边的“XXXX”可以表示不同的魅力值区间，“XXX”可以表示对应的魅力值区间的人数占总人数的比例(或者可以表示对应的魅力值区间的人数值)；情绪分布旁边的“XXXX”可以表示不同类型的情绪，“XXX”可以表示对应类型的情绪的人数占总人数的比例(或者可以表示对应类型的情绪的人数值)。Among them, the population distribution graph under each attribute displayed in the display interface can be a pie graph, a ring graph, a bar graph, etc. Exemplarily, the population distribution diagram under each attribute in the display interface can be shown in Figure 3. The attributes shown in Figure 3 are gender, age, charm value, emotion, and the legend next to the distribution of each attribute is used to indicate The proportion of the quantity in different intervals. For example, "XXXX" next to the age distribution of passenger flow can indicate different age ranges, and "XXX" can indicate the proportion of the number of people in the corresponding age range to the total number of people (or it can indicate the number of people in the corresponding age range); next to the gender distribution of passenger flow The "XXX" can indicate the proportion of users of different genders (or the number of people corresponding to the gender); the "XXXX" next to the charm value distribution can indicate different charm value intervals, and "XXX" can indicate the corresponding charm value interval The proportion of the number of people in the total number of people (or the number of people in the corresponding charm value interval); "XXXX" next to the emotional distribution can indicate different types of emotions, and "XXX" can indicate the number of people with corresponding types of emotions in the total number of people Proportion (or the number of people that can represent the corresponding type of emotion).

本公开的另外一实施例中，人群状态数据包括第一时间段的多个时间节点处的客流人数和客流人次。在确定第一时间段的多个时间节点处的客流人数和客流人次时，可以从客流数据中的客流人数和客流人次获取。In another embodiment of the present disclosure, the crowd state data includes the number of passengers and the number of passengers at multiple time nodes in the first time period. When determining the number of passenger flow and passenger flow at multiple time nodes in the first time period, the passenger flow number and passenger flow may be obtained from the passenger flow data.

为降低计算量，在确定第一时间段内展示区域的客流人数和客流人次时，可以每隔预设时间段确定一次，例如可以每隔1分钟确定一次客流人数和客流人次。In order to reduce the amount of calculation, when determining the number of passenger flow and the number of passenger flow in the display area in the first time period, the number of passenger flow and the number of passenger flow may be determined every preset time period, for example, the number of passenger flow and the number of passenger flow may be determined every 1 minute.

具体在确定客流人次时，可以确定在第一时间段内展示区域中各用户的出现总次数。其中，针对每一用户，可以记录该用户每次进入展示区域的开始时间，若记录的两次开始时间之间的间隔超过第一时长，则确定用户出现一次，第一时长不超过第一时间段。Specifically, when determining the number of passenger flow, the total number of appearances of each user in the display area in the first time period can be determined. Among them, for each user, the start time of each user entering the display area can be recorded. If the interval between the two recorded start times exceeds the first duration, it is determined that the user appears once, and the first duration does not exceed the first duration. segment.

示例性的，若分别记录用户进入展示区域A的开始时间分别为10:00，10:08，10:11，第一时长为10分钟，10:00～10:08之间的间隔的时长小于第一时长，则确定用户出现零次，10:00～10:11之间的间隔的时长大于第一时长，则确定用户出现一次。Exemplarily, if the starting time of recording the user entering the display area A is 10:00, 10:08, 10:11, the first time length is 10 minutes, and the time length of the interval between 10:00-10:08 is less than The first time length, it is determined that the user appears zero times, and the time length of the interval between 10:00-10:11 is greater than the first time length, it is determined that the user appears once.

上述方式中，在记录的两次开始时间之间的间隔超过第一时长时，确定用户出现一次，通过这种方式，可以避免在较短时间内用户出现次数的重复统计，提高了客流人次统计的精度。In the above method, when the interval between the two start times of the recording exceeds the first time length, it is determined that the user appears once. In this way, the repeated statistics of the number of user appearances in a relatively short period of time can be avoided, and the passenger flow statistics can be improved. Accuracy.

在确定客流人数时，可以获取在第一预设时间段内的采集的视频画面中所包含的人脸图像的个数，然后将获取的人脸图像进行去重处理，即统一用户人脸在不同时间的视频画面中出现，确定该用户对应的客流人数为1，将去重处理之后的人脸图像的个数确定为客流人数。When determining the number of passengers, the number of face images contained in the captured video images within the first preset time period can be acquired, and then the acquired face images can be de-duplicated, that is, the unified user face It appears in the video images at different times, it is determined that the number of visitors corresponding to the user is 1, and the number of facial images after deduplication is determined as the number of visitors.

考虑到客流人数和客流人数都是实时变化的，为降低计算量，可以获取第一时间段的多个时间节点处的客流人数和客流人次，其中，任意相邻两个时间节点之间的时间间隔可以相同。Considering that both the number of passenger flow and the number of passenger flow change in real time, in order to reduce the amount of calculation, the number of passenger flow and the number of passenger flow at multiple time nodes in the first time period can be obtained. Among them, the time between any two adjacent time nodes The interval can be the same.

在一种可能的实施方式中，可以在同一坐标系中展示第一时间段内多个时间节点处的客流人数和客流人次，示例性的，可以以时间节点为横坐标，以每个时间节点对应的客流人数为纵坐标，绘制折线图，然后在同一坐标系下，以相同的时间节点为横坐标，以每个时间节点对应的客流人次为纵坐标，绘制折线图，通过折线图展示第一时间段内展示区域的客流人数的变化趋势和客流次数的变化趋势；本公开另外一示例中还可以通过绘制柱状图、饼状图等的方式，来展示第一时间段内展示区域的客流人数的变化趋势和客流次数的变化趋势。In a possible implementation, the number of passengers and the number of passengers at multiple time nodes in the first time period can be displayed in the same coordinate system. For example, the time node can be used as the abscissa, and each time node can be used as the abscissa. The corresponding number of passengers is the ordinate, and a line graph is drawn. Then, in the same coordinate system, the same time node is the abscissa, and the number of passengers corresponding to each time node is the ordinate. The line graph is drawn, and the line graph is displayed. The changing trend of the number of passenger flow and the changing trend of the number of passenger flow in the display area within a period of time; in another example of the present disclosure, the passenger flow of the display area in the first period of time can also be displayed by drawing a bar graph, a pie chart, etc. The changing trend of the number of people and the changing trend of the number of passenger flows.

示例性的，显示界面中展示的客流人数的变化趋势和客流次数的变化趋势及其二者之间的比对结果可以如图4所示。Exemplarily, the change trend of the number of passenger flow and the change trend of the number of passenger flow displayed on the display interface and the comparison result between the two may be shown in FIG. 4.

上述实施方式中，通过显示界面显示展示区域的客流人数的变化趋势和客流次数的变化趋势，可以更加直观的展示展示区域的客流人数和客流次数的变化情况。In the foregoing embodiment, the change trend of the number of passenger flow and the change trend of the number of passenger flow in the display area is displayed through the display interface, so that the change of the number of passenger flow and the number of passenger flow in the display area can be displayed more intuitively.

本公开的另外一实施例中，人群状态数据包括每类属性的人群集合的关注总时长，示例性的，客流数据包括用户的关注时长和各用户的属性信息。其中，用户的属性信息包括年龄、性别、魅力值、情绪中的至少两种属性。In another embodiment of the present disclosure, the crowd status data includes the total attention duration of the crowd collection of each type of attribute. For example, the customer flow data includes the attention duration of the user and the attribute information of each user. Among them, the attribute information of the user includes at least two attributes of age, gender, charm value, and emotion.

在确定用户的关注时长时，可以通过如图5所示的方法，包括以下几个步骤。When determining the user's attention time, the method shown in FIG. 5 can be used, including the following steps.

S501、针对每一用户，识别采集的视频画面中所述用户的人脸朝向数据。S501: For each user, identify the face orientation data of the user in the collected video frame.

其中，人脸朝向数据包括人脸的俯仰角和偏航角。通过判断俯仰角是否处于第一角度范围内、以及偏航角是否处于第二角度范围内，可以确定用户是否关注展示区域的展示物体。Among them, the face orientation data includes the pitch angle and the yaw angle of the face. By judging whether the pitch angle is within the first angle range and the yaw angle is within the second angle range, it can be determined whether the user pays attention to the displayed object in the display area.

S502、在检测到所述人脸朝向数据指示所述用户关注所述展示区域的展示物体的情况下，记录所述用户首次关注所述展示物体的时间。S502: In a case where it is detected that the face orientation data indicates that the user pays attention to the display object in the display area, record the time when the user pays attention to the display object for the first time.

在人脸朝向数据中的俯仰角处于第一角度范围内、且人脸朝向数据中的偏航角处于第二角度范围内的情况下，可以确定该人脸朝向数据指示用户关注展示区域的展示物体。In the case where the pitch angle in the face orientation data is within the first angle range and the yaw angle in the face orientation data is within the second angle range, it can be determined that the face orientation data indicates that the user pays attention to the display of the display area object.

S503、基于记录的多个所述用户首次关注所述展示物体的时间，确定在所述第一时间段内所述用户关注所述展示物体的关注时长，所述关注时长不超过所述第一时间段。S503: Based on the recorded times when the user first paid attention to the display object, determine the time period during which the user paid attention to the display object in the first time period, and the attention time period does not exceed the first time period. period.

具体在确定第一时间段内用户关注展示物体的关注时长时，可以先确定用户第一时间段内用户开始关注展示物体的开始时间，然后在确定用户两次关注展示物体的开始时间之间的间隔超过设定时长的情况下，将该间隔作为用户一次关注展示物体的关注时长。Specifically, when determining the length of time the user pays attention to the displayed object in the first time period, you can first determine the start time when the user starts to pay attention to the displayed object in the first time period, and then determine the time between the start time when the user pays attention to the displayed object twice. If the interval exceeds the set duration, the interval is taken as the time duration for the user to pay attention to the displayed object at one time.

示例性的，若第一时间段为10:00～10:30，用户关注展示物体的开始时间分别为10:02，10:05，10:13，10:15，10:25，第一时长为10分钟，则第一次关注时长为10:13-10:02＝11分钟，第二次关注时长为10:25-10:13＝12分钟。Exemplarily, if the first time period is from 10:00 to 10:30, the start time when the user pays attention to the displayed object is 10:02, 10:05, 10:13, 10:15, 10:25, and the first time period is 10:02, 10:05, 10:13, 10:15, and 10:25 respectively. If it is 10 minutes, the first time of attention is 10:13-10:02=11 minutes, and the second time of attention is 10:25-10:13=12 minutes.

上述方法中，可以仅仅根据记录的用户首次关注展示物体的时间，确定在第一时间段内用户关注展示物体的关注时长，因此，可以避免用户首次关注展示物体的时间之间的间隔过短，造成的关注时长的频繁统计，降低了计算关注时长时的计算量，也使计算出的关注时长更为合理。In the above method, it is possible to determine the length of time that the user pays attention to the displayed object in the first time period only according to the recorded time when the user pays attention to the displayed object for the first time. Therefore, the interval between the time when the user first pays attention to the displayed object can be prevented from being too short. The resulting frequent statistics of the attention time reduces the amount of calculation when calculating the attention time, and also makes the calculated attention time more reasonable.

具体的，在利用各用户的关注时长和各用户的属性信息，确定第一时间段内每类属性的人群集合的关注总时长时，可以基于出现在展示区域的各用户的属性信息，将各用户划分在不同类属性的人群集合中；然后获取每类属性的人群集合中每个用户在展示区域的关注时长，并基于每类属性的人群集合中每个用户对应的关注时长，确定每类属性的人群集合的关注总时长。Specifically, when using the attention time of each user and the attribute information of each user to determine the total attention time of the group of people of each type of attribute in the first time period, the attribute information of each user appearing in the display area can be used to determine the total attention time of each user. Users are divided into groups of different types of attributes; then, the attention time of each user in the display area of each type of attribute is obtained, and each type of attention is determined based on the corresponding length of attention of each user in the group of each attribute. The total attention time of the attribute's crowd collection.

在一种可能的实施方式中，可以利用第一时间段内每类属性的人群集合的关注总时长，在显示界面中展示每类属性的人群集合的关注状态效果图。In a possible implementation manner, the total attention time of the crowd collection of each type of attribute in the first time period may be used to display the attention state effect diagram of the crowd collection of each type of attribute on the display interface.

其中，关注效果图可以通过特定图形来显示；每类属性的人群集合的关注总时长不同，对应的特定图像的显示效果也不同。示例性的，关注状态效果图可以如图6所示，图6中展示了关注总时长在同一区间范围内的不同类属性的用户的分布情况，以属性为性别和年龄为例，可以先分别确定人群集合中性别为男的人群子集，以及性别为女的人群子集，然后分别确定性别为男的人群子集中各个年龄段的年龄子集，以及确定性别为女的人群子集中各个年龄段的年龄子集，再分别根据确定的年龄子集确定对应的圆的直径，圆中的“XXXX”表示不同的年龄区间。其中，划分出的不同性别不同年龄段的子集，可视为不同类属性的人群集合。Among them, the attention effect map can be displayed by specific graphics; the total attention time of the group of people of each type of attribute is different, and the display effect of the corresponding specific image is also different. Exemplarily, the following state effect diagram can be shown in Figure 6. Figure 6 shows the distribution of users with different types of attributes whose total time is in the same interval. Taking the attributes as gender and age as an example, you can first Determine the subset of the population with male gender and the subset of population with female gender in the population set, and then determine the age subsets of each age group in the gender subset of the male population, and determine the age subsets of the gender subset of the female population. According to the age subsets of the segments, the diameters of the corresponding circles are determined according to the determined age subsets. The "XXXX" in the circles indicate different age ranges. Among them, the divided subsets of different genders and different age groups can be regarded as a collection of people with different types of attributes.

进一步地，可以按照上述关注时长的计算方式，统计不同类属性的人群集合中各用户的关注时长，然后基于不同类属性的人群集合下各用户的关注总时长，来显示各类属性的人群集合的关注状态效果图。比如图6所示，关注总时长越长的人群集合，对应的关注状态效果图的尺寸越大。Further, according to the calculation method of the above-mentioned attention time length, the attention time of each user in the crowd set of different types of attributes can be counted, and then based on the total attention time of each user under the crowd set of different types of attributes, the crowd set of various attributes can be displayed. The rendering of the state of attention. For example, as shown in Figure 6, the longer the total time of attention is for the group of people, the larger the size of the corresponding attention state effect map.

上述实施方式中，可以根据不同属性下的人群分布数据，展示每种属性下的人群分布图，进而可以实现对于不同关注总时长的不同属性人群的分析。In the foregoing embodiment, the population distribution map under each attribute can be displayed according to the population distribution data under different attributes, so as to realize the analysis of people with different attributes with different total time of attention.

本公开的另外一实施例中，人群状态数据包括每类属性的人群集合的停留总时长，此时，客流数据包括在第一时间段内出现在所述展示区域的各用户的停留时长和各用户的属性信息。In another embodiment of the present disclosure, the crowd status data includes the total stay duration of the crowd set of each type of attribute. At this time, the passenger flow data includes the stay duration and the stay duration of each user appearing in the display area within the first time period. User attribute information.

其中，在确定出现在展示区域的各用户的停留时长时，可以是确定在第一时间段内各用户每次出现时停留的总时长；其中，针对每一用户，在确定用户两次进入展示区域的开始时间之间的间隔超过第一时长的情况下，将所述间隔作为用户出现一次停留的时长。Among them, when determining the stay time of each user appearing in the display area, it may be determining the total stay time of each user each time they appear in the first time period; among them, for each user, when it is determined that the user enters the display twice In the case where the interval between the start times of the regions exceeds the first duration, the interval is taken as the duration of one stay of the user.

示例性的，若第一时间段为10:00～10:30，用户进入展示区域的开始时间分别为10:02，10:05，10:13，10:15，10:25，第一时长为10分钟，则第一次停留时长为10:13-10:02＝11分钟，第二次停留时长为10:25-10:13＝12分钟。Exemplarily, if the first time period is from 10:00 to 10:30, the start time of the user entering the display area is 10:02, 10:05, 10:13, 10:15, 10:25, the first time period If it is 10 minutes, the length of the first stay is 10:13-10:02=11 minutes, and the length of the second stay is 10:25-10:13=12 minutes.

在一种可能的实施方式中，可以利用在第一时间段内出现在所述展示区域的各用户的停留时长和各用户的属性信息，确定每类属性的人群集合的停留总时长，然后利用每类属性的人群集合的停留总时长，在显示界面中展示每类属性的人群集合的停留状态效果图。In a possible implementation manner, the staying time of each user appearing in the display area during the first time period and the attribute information of each user may be used to determine the total staying time of each type of attribute crowd set, and then use The total stay time of the crowd collection of each type of attribute, and the effect diagram of the stay state of the crowd collection of each type of attribute is displayed on the display interface.

具体的，可以先基于出现在展示区域的各用户的属性信息，将各用户划分在不同属性的人群集合中；然后获取每类属性的人群集合中每个用户在展示区域的停留时长；基于每类属性的人群集合中每个用户对应的停留时长，确定每类属性的人群集合的停留总时长。Specifically, based on the attribute information of each user appearing in the display area, each user can be divided into a crowd set of different attributes; then the stay time of each user in the display area in the crowd set of each type of attribute can be obtained; The stay time corresponding to each user in the crowd set of the category attribute determines the total stay time of the crowd set of each category attribute.

停留状态效果图通过特定图像来显示，每类属性的人群集合的停留总时长不同，对应的特定图像的展示效果也不同。示例性的，停留状态效果图也可以如图3所示，但此时图3中展示的为在同一区间范围内不同属性的用户的停留时长的分布情况。The staying state renderings are displayed by specific images. The total stay time of the crowd set of each type of attribute is different, and the corresponding specific image display effects are also different. Exemplarily, the staying state effect diagram may also be as shown in FIG. 3, but at this time, what is shown in FIG. 3 is the distribution of staying time of users with different attributes within the same interval.

上述实施方式中，可以根据不同属性下的人群分布数据，展示每种属性下的人群分布图，进而可以实现对于不同停留总时长的不同属性人群的分析。In the foregoing embodiment, the population distribution map under each attribute can be displayed according to the population distribution data under different attributes, so as to realize the analysis of the population of different attributes with different total length of stay.

本公开一示例中，还可以在获取到显示界面中针对展示区域的触发操作之后，再利用人群状态数据，控制显示界面中展示区域的显示状态。In an example of the present disclosure, after the trigger operation for the display area in the display interface is obtained, the crowd state data can be used to control the display state of the display area in the display interface.

其中，所述获取到显示界面中针对展示区域的触发操作可以是控制显示界面显示姿态提示框，姿态提示框中包括姿态描述内容，然后检测摄像设备采集的视频画面中的用户姿态，在检测到用户姿态与姿态描述内容所记录的姿态一致的情况下，确认获取到显示界面中针对展示区域的触发操作。Wherein, the acquired trigger operation for the display area in the display interface may be to control the display interface to display a gesture prompt box, which includes gesture description content, and then detects the user gesture in the video screen captured by the camera device, and then detects the user gesture If the user's posture is consistent with the posture recorded in the posture description content, it is confirmed that the trigger operation for the display area in the display interface is obtained.

示例性的，姿态提示框可以如图7所示，姿态提示框中包括“请您正面位于取景框内，举手确认”的姿态描述信息，线条部分展示的人体姿态用于提示用户在对应位置做出该动作姿态。当检测到用户取景框的线条部分做出举手动作时，则确定获取到显示界面中针对展示区域的触发操作。Exemplarily, the posture prompt box can be as shown in Figure 7. The posture prompt box includes posture description information of "please be in the viewfinder frame, raise your hand to confirm", and the human posture shown in the line part is used to prompt the user to be in the corresponding position Make this gesture. When it is detected that the line part of the user's framing frame makes a hand-raising action, it is determined that the trigger operation for the display area in the display interface is obtained.

本公开另外一种示例中，获取到显示界面中针对展示区域的触发操作，还可以是检测到屏幕中展示区域对应的位置被点击，点击方式包括但不仅限于单击、双击、长按、重按等；或者，获取到显示界面中针对展示区域的触发操作，还可以是接收到用户输入的语音指令，然后对语音指令进行解析，进而确定获取到显示界面中针对展示区域的触发操作。In another example of the present disclosure, the trigger operation for the display area in the display interface is obtained, and it can also be detected that the position corresponding to the display area on the screen is clicked. The click methods include but are not limited to single click, double click, long press, and double click. Press etc.; or, to obtain the trigger operation for the display area in the display interface, it can also be the voice command input by the user is received, and then the voice instruction is parsed to determine the trigger operation for the display area in the display interface.

结合上述各实施方式，给出以下具体示例：In combination with the foregoing implementation manners, the following specific examples are given:

在客流数据出现在所述展示区域的各用户的停留时长、各用户的关注时长、各用户的属性信息、客流人数、客流人次时，初始展示的显示界面可以如图8A所示，在图8A的左侧展示区域中不同热度等级的区域的灰度值不同，右侧展示区域中展示有第一时间段内所述展示区域的客流人数的变化趋势和客流次数的变化趋势之间的比对结果、每种属性下的人群分布图、以及客流数据统计结果，其中，客流数据统计结果包括今日客流人数、今日客流人次、今日停留总时长、历史客流人数、历史客流人次、人均停留时常等；当检测到左侧展示区域中的任意一个展示区域被触发时，显示界面可以展示如图8B所示，图8B中，将图8A中右侧展示区域中展示的关注状态效果图，替换为被触发的展示区域对应的界面图，界面图中可展示被触发的展示区域的客流数据统计信息(包括客流人数、客流人次、停留时长等)，客流人数/人次变化趋势、关注度人群分析(比如关注状态效果图)等。其中，图8A和图8B中展示的客流数据统计结果中，各项数值可以是实时变化的，可以统计今日、7天内、30天内等一段时间内的客流数据统计结果。所述“今日”指的是从今日开始统计到当前时刻。When the passenger flow data appears in the display area for the stay time of each user, the attention time of each user, the attribute information of each user, the number of visitors, and the number of visitors, the initial display interface may be as shown in Figure 8A, in Figure 8A The gray values of different heat levels in the left display area of the display area are different, and the right display area displays the comparison between the change trend of the number of visitors and the change trend of the number of visitors in the display area during the first time period Results, the population distribution diagram under each attribute, and the statistical results of passenger flow data. Among them, the statistical results of passenger flow data include the number of today's passenger flow, today's passenger flow, total stay time today, the number of historical passenger flow, historical passenger flow, and per capita stay time, etc.; When it is detected that any one of the display areas in the left display area is triggered, the display interface can display as shown in Figure 8B. In Figure 8B, the effect of the state of interest displayed in the right display area in Figure 8A is replaced by The interface diagram corresponding to the triggered display area. The interface diagram can display the passenger flow data statistics of the triggered display area (including the number of passengers, the number of passengers, the length of stay, etc.), the number of passengers/the changing trend of the visitors, and the analysis of the people of interest (such as Pay attention to the status renderings) and so on. Among them, in the passenger flow data statistics results shown in FIG. 8A and FIG. 8B, various values can be changed in real time, and the passenger flow data statistics results in a period of time, such as today, 7 days, and 30 days, can be counted. The "today" refers to counting from today to the current time.

本领域技术人员可以理解，在具体实施方式的上述方法中，各步骤的撰写顺序并不意味着严格的执行顺序而对实施过程构成任何限定，各步骤的具体执行顺序应当以其功能和可能的内在逻辑确定。Those skilled in the art can understand that in the above-mentioned methods of the specific implementation, the writing order of the steps does not mean a strict execution order but constitutes any limitation on the implementation process. The specific execution order of each step should be based on its function and possibility. The inner logic is determined.

基于相同的构思，本公开实施例还提供了一种展示区域的状态识别装置。图9为本公开实施例所提供的一种展示区域的状态识别装置的架构示意图。该装置包括获取模块901、第一确定模块902、第二确定模块903、以及控制模块904。Based on the same concept, the embodiment of the present disclosure also provides a state recognition device for the display area. FIG. 9 is a schematic structural diagram of a state recognition device for a display area provided by an embodiment of the disclosure. The device includes an acquisition module 901, a first determination module 902, a second determination module 903, and a control module 904.

获取模块901用于获取在展示区域采集的视频画面。The obtaining module 901 is used for obtaining the video images collected in the display area.

第一确定模块902用于基于所述采集的视频画面，确定在第一时间段内所述展示区域的客流数据，所述客流数据包括出现在所述展示区域的各用户的停留时长、各用户的关注时长、各用户的属性信息、客流人数、客流人次中的至少两种。The first determining module 902 is configured to determine the passenger flow data of the display area in the first time period based on the collected video images. The passenger flow data includes the stay time of each user appearing in the display area, and each user At least two of the following time, the attribute information of each user, the number of visitors, and the number of visitors.

第二确定模块903用于利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据。The second determining module 903 is configured to use the passenger flow data to determine the crowd state data of the display area in the first time period.

控制模块904用于利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态。The control module 904 is configured to use the crowd state data to control the display state corresponding to the display area in the display interface.

一种可能的实施方式中，所述人群状态数据包括人群热度等级；所述控制模块904，在利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态时，用于：控制所述显示界面中所述展示区域对应的显示区域的图层呈现与所述人群热度等级匹配的颜色等级。In a possible implementation manner, the crowd state data includes crowd popularity levels; the control module 904, when using the crowd state data to control the display state corresponding to the display area in the display interface, is used to: control The layer of the display area corresponding to the display area in the display interface presents a color level matching the popularity level of the crowd.

一种可能的实施方式中，所述第二确定模块903，还用于根据以下方式确定所述人群热度等级：基于所述客流数据中至少两种客流数据分别对应的权重系数、以及所述至少两种客流数据的数值，确定人群热度值，并确定所述人群热度值所在范围对应的人群热度等级。In a possible implementation manner, the second determining module 903 is further configured to determine the popularity level of the crowd according to the following method: based on the weight coefficients corresponding to at least two kinds of passenger flow data in the passenger flow data, and the at least The two kinds of passenger flow data values determine the crowd popularity value, and determine the crowd popularity level corresponding to the range of the crowd popularity value.

一种可能的实施方式中，在所述客流数据包括所述客流人数和所述客流人次的情况下，所述第二确定模块903，在利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据时，用于：利用所述客流人数和所述客流人次，获取所述第一时间段的多个时间节点处的客流人数和客流人次；In a possible implementation manner, in a case where the passenger flow data includes the number of passenger flow and the number of passenger flow, the second determining module 903 uses the passenger flow data to determine that within the first time period When the crowd status data in the display area is used, it is used to: use the number of passengers and the number of passengers to obtain the number of passengers and the number of passengers at multiple time nodes in the first time period;

所述控制模块904，在利用所述人群状态数据，，控制显示界面中所述展示区域对应的显示状态，用于：基于所述第一时间段的多个时间节点处的客流人数和客流人次，在所述显示界面中展示所述第一时间段内所述展示区域的客流人数的变化趋势和客流次数的变化趋势。The control module 904 uses the crowd state data to control the display state corresponding to the display area in the display interface for: based on the number of passengers and the number of passengers at multiple time nodes in the first time period , Displaying the changing trend of the number of passenger flows and the changing trend of the number of passenger flows in the display area in the first time period on the display interface.

一种可能的实施方式中，所述第二确定模块903，在利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据时，用于：基于各用户的属性信息，确定具有不同属性的人群分布数据，所述人群分布数据包括具有年龄、性别、魅力值、情绪中至少一种属性的分布数据；In a possible implementation manner, the second determining module 903, when using the passenger flow data to determine the crowd status data of the display area in the first time period, is configured to: based on the attribute information of each user , Determining population distribution data with different attributes, where the population distribution data includes distribution data having at least one attribute of age, gender, charm value, and emotion;

所述控制模块904，在利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态时，用于：利用具有所述不同属性的人群分布数据，控制所述显示界面中分别展示带有每种属性的人群分布图。The control module 904, when using the crowd state data to control the display state corresponding to the display area in the display interface, is used to: use the crowd distribution data with the different attributes to control the respective display in the display interface Distribution map of the population with each attribute.

一种可能的实施方式中，在所述客流数据包括各用户的关注时长和各用户的属性信息的情况下，所述第二确定模块903，在利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据时，用于：基于出现在所述展示区域的各用户的属性信息，将各用户划分在不同类属性的人群集合中；获取每类属性的人群集合中每个用户在所述展示区域的关注时长；基于每类属性的人群集合中每个用户对应的所述关注时长，确定每类属性的人群集合的关注总时长；In a possible implementation manner, in a case where the passenger flow data includes the attention duration of each user and the attribute information of each user, the second determining module 903 determines the first time by using the passenger flow data. When the crowd status data of the display area in the paragraph is used: based on the attribute information of each user appearing in the display area, divide each user into a crowd set of different types of attributes; obtain the crowd set of each type of attribute The attention time of each user in the display area; based on the attention time corresponding to each user in the crowd set of each type of attribute, determine the total attention time of the crowd set of each type of attribute;

所述控制模块904，在利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态时，用于：基于每类属性的人群集合的关注总时长，控制所述显示界面中呈现所述每类属性的人群集合的关注状态效果图。The control module 904, when using the crowd state data to control the display state corresponding to the display area in the display interface, is used to: control the display on the display interface based on the total attention time of the crowd set of each type of attribute The effect diagram of the attention state of the crowd collection of each type of attribute.

一种可能的实施方式中，所述第一确定模块902，还用于根据以下方式确定所述关注时长：针对每一用户，识别所述采集的视频画面中所述用户的人脸朝向数据；In a possible implementation manner, the first determining module 902 is further configured to determine the attention duration according to the following manner: for each user, identifying the face orientation data of the user in the collected video frame;

在检测到所述人脸朝向数据指示所述用户关注所述展示区域的展示物体的情况下，记录所述用户首次关注所述展示物体的时间；基于记录的多个所述用户首次关注所述展示物体的时间，确定在所述第一时间段内所述用户关注所述展示物体的关注时长，所述关注时长不超过所述第一时间段。In the case where it is detected that the face orientation data indicates that the user pays attention to the display object in the display area, record the time when the user pays attention to the display object for the first time; The time for displaying the object, and determining the attention time period during which the user pays attention to the displayed object in the first time period, and the attention time period does not exceed the first time period.

一种可能的实施方式中，所述人脸朝向数据包括人脸的俯仰角和偏航角；所述第一确定模块902用于：在所述俯仰角处于第一角度范围内、且所述偏航角处于第二角度范围内的情况下，确定所述人脸朝向数据指示所述用户关注所述展示区域的展示物体。In a possible implementation manner, the face orientation data includes the pitch angle and the yaw angle of the face; the first determining module 902 is configured to: when the pitch angle is within a first angle range, and the pitch angle When the yaw angle is within the second angle range, it is determined that the face orientation data indicates that the user pays attention to the display object in the display area.

一种可能的实施方式中，所述第一确定模块902，还用于根据以下方式确定在第一时间段内所述展示区域的客流人次：确定在所述第一时间段内所述展示区域中各用户的出现总次数；其中，针对每一用户，记录所述用户每次进入所述展示区域的开始时间；若记录的两次所述开始时间之间的间隔超过第一时长，确定所述用户出现一次；所述第一时长不超出所述第一时间段。In a possible implementation manner, the first determining module 902 is further configured to determine the number of visitors in the display area in the first time period according to the following method: determining the display area in the first time period The total number of appearances of each user in each user; among them, for each user, record the start time of each user entering the display area; if the interval between the two recorded start times exceeds the first length of time, determine all The user appears once; the first time period does not exceed the first time period.

一种可能的实施方式中，所述第一确定模块902，还用于根据以下方式确定在第一时间段内所述展示区域的用户停留时长：确定在所述第一时间段内各用户每次出现时停留的总时长；其中，针对每一用户，在确定所述用户两次进入所述展示区域的开始时间之间的间隔超过第一时长的情况下，将所述间隔作为所述用户出现一次停留的时长。In a possible implementation manner, the first determining module 902 is further configured to determine the length of stay of the user in the display area in the first time period according to the following method: determining that each user stays in the display area during the first time period. The total length of stay at the second occurrence; wherein, for each user, if the interval between the start time when the user enters the display area is determined to exceed the first duration, the interval is taken as the user The duration of a stay.

一种可能的实施方式中，所述获取模块901，还用于在利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态之前，获取所述显示界面中针对所述展示区域的触发操作。In a possible implementation manner, the obtaining module 901 is further configured to obtain information about the display area in the display interface before using the crowd state data to control the display state corresponding to the display area in the display interface. Trigger action.

一种可能的实施方式中，所述获取模块901，在获取所述显示界面中针对所述展示区域的触发操作时，用于：控制所述显示界面显示姿态提示框，所述姿态提示框中包括姿态描述内容；检测所述采集的视频画面中的用户姿态；在所述用户姿态与所述姿态描述内容所记录的姿态一致的情况下，确认获取到所述显示界面中针对所述展示区域的触发操作。In a possible implementation manner, the acquiring module 901, when acquiring a trigger operation on the display area in the display interface, is used to: control the display interface to display a gesture prompt box, the gesture prompt box Include posture description content; detect the user posture in the collected video screen; in the case that the user posture is consistent with the posture recorded by the posture description content, confirm that the display interface is acquired for the display area Trigger action.

在一些实施例中，本公开实施例提供的装置具有的功能或包含的模板可以用于执行上文方法实施例描述的方法，其具体实现可以参照上文方法实施例的描述。In some embodiments, the functions or templates contained in the device provided in the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments, and the specific implementation can refer to the description of the above method embodiments.

基于同一技术构思，本公开实施例还提供了一种电子设备。图10为本公开实施例提供的电子设备的结构示意图。该电子设备包括处理器1001、存储器1002和总线1003。其中，存储器1002用于存储执行指令，包括内存10021和外部存储器10022；这里的内存10021也称内存储器，用于暂时存放处理器1001中的运算数据，以及与硬盘等外部存储器10022交换的数据，处理器1001通过内存10021与外部存储器10022进行数据交换，当电子设备1000运行时，处理器1001与存储器1002之间通过总线1003通信，使得处理器1001在执行以下指令：Based on the same technical concept, the embodiments of the present disclosure also provide an electronic device. FIG. 10 is a schematic structural diagram of an electronic device provided by an embodiment of the disclosure. The electronic device includes a processor 1001, a memory 1002, and a bus 1003. Among them, the memory 1002 is used to store execution instructions, including a memory 10021 and an external memory 10022; the memory 10021 here is also called an internal memory, which is used to temporarily store the calculation data in the processor 1001 and the data exchanged with the external memory 10022 such as a hard disk. The processor 1001 exchanges data with the external memory 10022 through the memory 10021. When the electronic device 1000 is running, the processor 1001 and the memory 1002 communicate through the bus 1003, so that the processor 1001 executes the following instructions:

此外，本公开实施例还提供一种计算机可读存储介质，该计算机可读存储介质上存储有计算机程序，该计算机程序被处理器运行时执行上述方法实施例中所述的展示区域的状态识别方法的步骤。In addition, the embodiments of the present disclosure also provide a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when the computer program is run by a processor, the state of the display area described in the above method embodiment is recognized. Method steps.

本公开实施例所提供的展示区域的状态识别方法的计算机程序产品，包括存储了程序代码的计算机可读存储介质，所述程序代码包括的指令可用于执行上述方法实施例中所述的展示区域的状态识别方法的步骤。The computer program product of the method for identifying the status of the display area provided by the embodiment of the present disclosure includes a computer-readable storage medium storing program code, and the instructions included in the program code can be used to execute the display area described in the above method embodiment The steps of the state recognition method.

所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的***和装置的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。在本公开所提供的几个实施例中，应该理解到，所揭露的***、装置和方法，可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，又例如，多个单元或组件可以结合或者可以集成到另一个***，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些通信接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。Those skilled in the art can clearly understand that, for the convenience and conciseness of the description, the specific working process of the system and device described above can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device, and method may be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation. For example, multiple units or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

另外，在本公开各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。In addition, the functional units in the various embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个处理器可执行的非易失的计算机可读取存储介质中。基于这样的理解，本公开的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本公开各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a non-volatile computer readable storage medium executable by a processor. Based on this understanding, the technical solution of the present disclosure essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present disclosure. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks or optical disks and other media that can store program codes. .

以上仅为本公开的具体实施方式，但本公开的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本公开揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本公开的保护范围之内。因此，本公开的保护范围应以权利要求的保护范围为准。The above are only specific implementations of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present disclosure, and they shall be covered Within the protection scope of this disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

一种展示区域的状态识别方法，其特征在于，包括：A method for identifying the status of a display area, which is characterized in that it includes:

获取在所述展示区域采集的视频画面；Acquiring a video screen collected in the display area;

基于所述采集的视频画面，确定在第一时间段内所述展示区域的客流数据，所述客流数据包括出现在所述展示区域的各用户的停留时长、各用户的关注时长、各用户的属性信息、客流人数、客流人次中的至少两种；Based on the collected video images, determine the passenger flow data of the display area in the first time period. The passenger flow data includes the stay time of each user appearing in the display area, the attention time of each user, and the user's At least two of attribute information, number of passengers, and number of passengers;

利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据；Using the passenger flow data to determine crowd state data in the display area in the first time period;

利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态。Using the crowd state data, the display state corresponding to the display area in the display interface is controlled.
根据权利要求1所述的方法，其特征在于，所述人群状态数据包括人群热度等级；所述利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态，包括：The method according to claim 1, wherein the crowd state data includes crowd popularity levels; and the using the crowd state data to control the display state corresponding to the display area in the display interface includes:

控制所述显示界面中所述展示区域对应的显示区域的图层呈现与所述人群热度等级匹配的颜色等级。Controlling the layer of the display area corresponding to the display area in the display interface to present a color level that matches the popularity level of the crowd.
根据权利要求2所述的方法，其特征在于，根据以下方式确定所述人群热度等级：The method according to claim 2, wherein the popularity level of the crowd is determined according to the following method:

基于所述客流数据中至少两种客流数据分别对应的权重系数、以及所述至少两种客流数据的数值，确定人群热度值；Determining the crowd popularity value based on the respective weight coefficients corresponding to the at least two types of passenger flow data in the passenger flow data and the values of the at least two types of passenger flow data;

确定所述人群热度值所在范围对应的人群热度等级。Determine the crowd's popularity level corresponding to the range of the crowd's popularity value.
根据权利要求1所述的方法，其特征在于，在所述客流数据包括所述客流人数和所述客流人次的情况下，所述利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据，包括：The method according to claim 1, wherein in the case that the passenger flow data includes the number of passenger flow and the number of passenger flow, the passenger flow data is used to determine the passenger flow data in the first time period. Crowd status data in the display area, including:

利用所述客流人数和所述客流人次，获取所述第一时间段的多个时间节点处的客流人数和客流人次；Using the number of passenger flow and the number of passenger flow to obtain the number of passenger flow and the number of passenger flow at multiple time nodes in the first time period;

所述利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态，包括：The using the crowd state data to control the display state corresponding to the display area in the display interface includes:

基于所述第一时间段的多个时间节点处的客流人数和客流人次，在所述显示界面中展示所述第一时间段内所述展示区域的客流人数的变化趋势和客流次数的变化趋势。Based on the number of passenger flow and the number of passenger flow at multiple time nodes in the first time period, the change trend of the number of passenger flow and the change trend of the number of passenger flow in the display area in the first time period are displayed on the display interface .
根据权利要求1所述的方法，其特征在于，所述利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据，包括：The method according to claim 1, wherein the using the passenger flow data to determine the crowd status data of the display area in the first time period comprises:

基于各用户的属性信息，确定具有不同属性的人群分布数据，所述人群分布数据包括具有年龄、性别、魅力值、情绪中至少一种属性的分布数据；Determine population distribution data with different attributes based on the attribute information of each user, where the population distribution data includes distribution data with at least one attribute of age, gender, charm value, and emotion;

所述利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态，包括：The using the crowd state data to control the display state corresponding to the display area in the display interface includes:

利用具有所述不同属性的人群分布数据，控制所述显示界面中分别展示带有每种属性的人群分布图。Using the crowd distribution data with the different attributes, control the display interface to separately display the crowd distribution map with each attribute.
根据权利要求1所述的方法，其特征在于，在所述客流数据包括各用户的关注时长和各用户的属性信息的情况下，所述利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据，包括：The method according to claim 1, characterized in that, in the case that the passenger flow data includes the attention duration of each user and the attribute information of each user, the passenger flow data is used to determine that the time period is within the first time period. The crowd status data in the display area includes:

基于出现在所述展示区域的各用户的属性信息，将各用户划分在不同类属性的人群集合中；Based on the attribute information of each user appearing in the display area, classify each user into a group of people with different attributes;

获取每类属性的人群集合中每个用户在所述展示区域的关注时长；Acquiring the attention time of each user in the display area in the crowd set of each type of attribute;

基于每类属性的人群集合中每个用户对应的所述关注时长，确定每类属性的人群集合的关注总时长；Determine the total attention time of the crowd set of each type of attribute based on the attention time corresponding to each user in the crowd set of each type of attribute;

所述利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态，包括：The using the crowd state data to control the display state corresponding to the display area in the display interface includes:

基于每类属性的人群集合的关注总时长，控制所述显示界面中呈现所述每类属性的人群集合的关注状态效果图。Based on the total attention time length of the crowd collection of each type of attribute, the display interface is controlled to present the attention state effect diagram of the crowd collection of each type of attribute.
根据权利要求6所述的方法，其特征在于，所述每类属性的人群集合中的用户符合年龄、性别、魅力值、情绪中的至少两种属性。The method according to claim 6, wherein the users in the population set of each type of attribute meet at least two attributes of age, gender, charm value, and emotion.
根据权利要求6所述的方法，其特征在于，所述关注状态效果图通过特定图形来显示；每类属性的人群集合的关注总时长不同，对应的特定图像的显示效果也不同。The method according to claim 6, wherein the attention state effect diagram is displayed by a specific graphic; the total attention time of the crowd set of each type of attribute is different, and the display effect of the corresponding specific image is also different.
根据权利要求1、6至8任一所述的方法，其特征在于，根据以下方式确定所述关注时长：The method according to any one of claims 1, 6 to 8, wherein the attention duration is determined according to the following manner:

针对每一用户，识别所述采集的视频画面中所述用户的人脸朝向数据；For each user, identifying the face orientation data of the user in the collected video frame;

在检测到所述人脸朝向数据指示所述用户关注所述展示区域的展示物体的情况下，记录所述用户首次关注所述展示物体的时间；In a case where it is detected that the face orientation data indicates that the user pays attention to the display object in the display area, record the time when the user first pays attention to the display object;

基于记录的多个所述用户首次关注所述展示物体的时间，确定在所述第一时间段内所述用户关注所述展示物体的关注时长，所述关注时长不超过所述第一时间段。Based on the recorded times when the users first paid attention to the display object, determine the time period during which the user paid attention to the display object in the first time period, and the attention time period does not exceed the first time period .
根据权利要求9所述的方法，其特征在于，所述人脸朝向数据包括人脸的俯仰角和偏航角；The method according to claim 9, wherein the face orientation data includes a pitch angle and a yaw angle of the face;

在所述俯仰角处于第一角度范围内、且所述偏航角处于第二角度范围内的情况下，确定所述人脸朝向数据指示所述用户关注所述展示区域的展示物体。When the pitch angle is within a first angle range and the yaw angle is within a second angle range, it is determined that the face orientation data indicates that the user pays attention to the display object in the display area.
根据权利要求1或4所述的方法，其特征在于，根据以下方式确定在所述第一时间段内所述展示区域的客流人次：The method according to claim 1 or 4, wherein the number of passengers in the display area in the first time period is determined according to the following method:

确定在所述第一时间段内所述展示区域中各用户的出现总次数；Determining the total number of appearances of each user in the display area in the first time period;

其中，针对每一用户，记录所述用户每次进入所述展示区域的开始时间；若记录的两次所述开始时间之间的间隔超过第一时长，确定所述用户出现一次；所述第一时长不超出所述第一时间段。Wherein, for each user, record the start time each time the user enters the display area; if the interval between the two recorded start times exceeds the first time length, it is determined that the user appears once; The duration of one time does not exceed the first time period.
根据权利要求1所述的方法，其特征在于，根据以下方式确定在所述第一时间段内所述展示区域的用户停留时长：The method according to claim 1, characterized in that the length of time the user stays in the display area in the first time period is determined according to the following manner:

确定在所述第一时间段内各用户每次出现时停留的总时长；Determine the total length of stay of each user each time they appear in the first time period;

其中，针对每一用户，在确定所述用户两次进入所述展示区域的开始时间之间的间隔超过第一时长的情况下，将所述间隔作为所述用户出现一次停留的时长。Wherein, for each user, in a case where it is determined that the interval between the start time when the user enters the display area twice exceeds the first duration, the interval is taken as the duration of one stay of the user.
根据权利要求1至12任一项所述的方法，其特征在于，还包括：在利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态之前，The method according to any one of claims 1 to 12, further comprising: before using the crowd state data to control the display state corresponding to the display area in the display interface,

获取所述显示界面中针对所述展示区域的触发操作。Acquire the trigger operation for the display area in the display interface.
根据权利要求13所述的方法，其特征在于，所述获取所述显示界面中针对所述展示区域的触发操作，包括：The method according to claim 13, wherein said acquiring a trigger operation for said display area in said display interface comprises:

控制所述显示界面显示姿态提示框，所述姿态提示框中包括姿态描述内容；Controlling the display interface to display a gesture prompt box, the gesture prompt box including gesture description content;

检测所述采集的视频画面中的用户姿态；Detecting the user gesture in the collected video frame;

在所述用户姿态与所述姿态描述内容所记录的姿态一致的情况下，确认获取到所述显示界面中针对所述展示区域的触发操作。In the case that the user posture is consistent with the posture recorded in the posture description content, it is confirmed that the trigger operation for the display area in the display interface is acquired.
一种展示区域的状态识别装置，其特征在于，包括：A state recognition device for a display area, which is characterized in that it comprises:

获取模块，用于获取在展示区域采集的视频画面；The acquisition module is used to acquire the video images collected in the display area;

第一确定模块，用于基于所述采集的视频画面，确定在第一时间段内所述展示区域的客流数据，所述客流数据包括出现在所述展示区域的各用户的停留时长、各用户的关注时长、各用户的属性信息、客流人数、客流人次中的至少两种；The first determining module is configured to determine the passenger flow data of the display area in the first time period based on the collected video images, where the passenger flow data includes the stay time of each user appearing in the display area, and each user At least two of the following time, the attribute information of each user, the number of visitors, and the number of visitors;

第二确定模块，用于利用所述客流数据，确定所述第一时间段内所述展示区域的人群状态数据；A second determining module, configured to use the passenger flow data to determine crowd status data in the display area in the first time period;

控制模块，用于利用所述人群状态数据，控制显示界面中所述展示区域对应的显示状态。The control module is configured to use the crowd state data to control the display state corresponding to the display area in the display interface.
一种电子设备，其特征在于，包括：处理器和存储器，所述存储器存储有所述处理器可执行的机器可读指令，所述机器可读指令被所述处理器执行时，使所述处理器执行如权利要求1至14任一所述的展示区域的状态识别方法。An electronic device, characterized by comprising: a processor and a memory, the memory storing machine-readable instructions executable by the processor, and when the machine-readable instructions are executed by the processor, the The processor executes the method for identifying the status of the display area according to any one of claims 1 to 14.
一种计算机可读存储介质，其特征在于，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器运行时，使所述处理器执行如权利要求1至14任一所述的展示区域的状态识别方法。A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is run by a processor, the processor executes any one of claims 1 to 14 The state recognition method of the display area described above.