一种信息处理方法、装置、电子设备及存储介质An information processing method, device, electronic device and storage medium
相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS
本专利申请要求2021年01月27提交的中国专利申请号为202110110576.3,申请人为北京市商汤科技开发有限公司,申请名称为“一种信息处理方法、装置、电子设备及存储介质”的优先权,该申请的全文以引用的方式并入本申请中。This patent application requires the priority of the Chinese patent application number 202110110576.3 submitted on January 27, 2021, the applicant is Beijing Shangtang Technology Development Co., Ltd., and the application name is "an information processing method, device, electronic device and storage medium" , the entirety of which is incorporated by reference into this application.
技术领域technical field
本申请涉及计算机视觉技术领域,尤其涉及一种信息处理方法、装置、电子设备及存储介质。The present application relates to the field of computer vision technology, and in particular, to an information processing method, apparatus, electronic device, and storage medium.
背景技术Background technique
针对一些目标场所,比如大型商场而言,包含多个不同的物品陈列区域,比如包含多个不同的店铺,各店铺通常采用一些传统的物品陈列方式来招揽顾客,比如将新品或者销量较高的商品摆放至店铺门口。相关技术中主要是通过人为干预的方式来对物品陈列区域进行调整,费时费力,处理方式繁琐,且数据来源的准确度较低。For some target places, such as large shopping malls, there are multiple different item display areas, such as multiple different stores. Each store usually adopts some traditional item display methods to attract customers, such as new products or high-selling items. Products are placed at the door of the store. In the related art, the adjustment of the item display area is mainly performed by means of human intervention, which is time-consuming and labor-intensive, the processing method is cumbersome, and the accuracy of the data source is low.
发明内容SUMMARY OF THE INVENTION
本申请实施例至少提供一种信息处理方案。The embodiments of the present application provide at least one information processing solution.
本申请实施例提供了一种信息处理方法,由电子设备执行,包括:The embodiment of the present application provides an information processing method, which is executed by an electronic device, including:
基于对目标场所采集的视频流,确定所述视频流中的行人在所述目标场所中的轨迹数据;determining the trajectory data of pedestrians in the target place in the video stream based on the video stream collected from the target place;
基于所述视频流中的行人在所述目标场所中的轨迹数据,以及所述目标场所内不同物品陈列区域的位置范围,确定所述不同物品陈列区域分别对应的行人统计数据;Based on the trajectory data of the pedestrians in the video stream in the target place, and the position ranges of different item display areas in the target place, determine the pedestrian statistics corresponding to the different item display areas respectively;
基于行人统计数据,确定针对所述目标场所内至少部分物品陈列区域的部署。Based on the pedestrian statistics, a deployment is determined for at least a portion of the item display area within the target venue.
本申请实施例中,采用上述技术手段可以结合采集到的目标场所的视频流确定出不同物品陈列区域的行人统计数据,进一步可以基于行人统计数据确定针对所述目标场所内至少部分物品陈列区域的部署。In the embodiment of the present application, the above-mentioned technical means can be used to determine the pedestrian statistical data of different item display areas in combination with the collected video streams of the target place, and further, based on the pedestrian statistical data, the pedestrian statistics for at least part of the item display areas in the target place can be determined. deploy.
由此可以通过线上对目标场所采集的视频流,来分析目标场所中各个物品陈列区域的人流量,从而可以及时地针对造成阻碍人员流通的物品陈列区域进行调整,以提高目标场所中各个物品陈列区域的部署合理性。In this way, the flow of people in each item display area in the target site can be analyzed through the video stream collected online at the target site, so that the item display area that hinders the circulation of people can be adjusted in time to improve the quality of each item in the target site. The rationality of the deployment of the display area.
在一种可能的实施方式中,所述基于所述行人统计数据,确定针对所述目标场所内至少部分物品陈列区域的部署,至少包括以下之一:In a possible implementation manner, the determining, based on the pedestrian statistics, the deployment for at least part of the item display area in the target place includes at least one of the following:
基于所述行人统计数据,生成针对所述目标场所内至少部分物品陈列区域的部署建议;generating, based on the pedestrian statistical data, deployment recommendations for at least part of the item display area in the target site;
基于所述行人统计数据,调整所述目标场所内至少部分物品陈列区域的部署。Based on the pedestrian statistics, the deployment of at least a portion of the item display area within the target site is adjusted.
考虑到对于目标场所而言,无论目标场所属于公共场合或是非公共场合,出于安全考虑,通常会部署诸如摄像头等视频采集部件。也就意味着,实现上述技术方案的数据来源通常属于现有资源,无需额外采集视频流。这样一来,本申请实施例提供的技术方案能够通过对现有资源的合理运用,以得到适用于目标场所的部署建议,实现了现有资源的充分利用。且得到的物品陈列区域的调整方案,可以更加适应于目标场所的实际需求。Considering that for the target place, whether the target place is a public place or a non-public place, for safety reasons, video capture components such as cameras are usually deployed. That is to say, the data sources for realizing the above technical solutions usually belong to existing resources, and there is no need to collect additional video streams. In this way, the technical solutions provided by the embodiments of the present application can obtain deployment suggestions suitable for the target site by rationally utilizing the existing resources, thereby realizing the full utilization of the existing resources. In addition, the obtained adjustment scheme of the item display area can be more adapted to the actual needs of the target place.
在一种可能的实施方式中,所述基于所述行人统计数据,确定针对所述目标场所内至少部分物品陈列区域的部署,包括:In a possible implementation manner, the determining, based on the pedestrian statistical data, the deployment for at least part of the item display area in the target site includes:
基于所述不同物品陈列区域分别对应的行人统计数据和所述目标场所中的轨迹数据,确定是否存在第一目标物品陈列区域发生人流拥堵;Based on the pedestrian statistical data corresponding to the different item display areas and the trajectory data in the target place respectively, determining whether there is a crowd congestion in the first target item display area;
在确定存在第一目标物品陈列区域发生人流拥堵的情况下,至少执行以下之一:生成针对所述第一目标物品陈列区域的部署建议、调整所述第一目标物品陈列区域的部署。When it is determined that there is a crowd congestion in the first target item display area, at least one of the following is performed: generating a deployment suggestion for the first target item display area, and adjusting the deployment of the first target item display area.
本申请实施例中,可以通过不同物品陈列区域的行人统计数据和目标场所中的轨迹数据,分析出是否存在人流拥堵的情况,比如存在一个第一物品陈列区域的行人数量较多,且基于视频流检测到行人的轨迹到达第一物品陈列区域后轨迹发生返回的情况,可以确定出第一物品陈列区域发生人流拥堵,此时可以至少执行以下之一:生成针对该第一物品陈列区域的部署建议、调整第一目标物品陈列区域的部署,降低第一目标物品陈列区域的拥堵情况。In the embodiment of the present application, it is possible to analyze whether there is a crowd congestion situation through the pedestrian statistics data in different item display areas and the trajectory data in the target place. When the flow detects that the pedestrian's trajectory returns to the first item display area, it can be determined that the first item display area is crowded with people. At this time, at least one of the following can be performed: generate a deployment for the first item display area. Suggest and adjust the deployment of the first target item display area to reduce the congestion in the first target item display area.
在一种可能的实施方式中,所述在确定存在第一目标物品陈列区域发生人流拥堵的情况下,至少执行以下之一:生成针对所述第一目标物品陈列区域的部署建议、调整所述第一目标物品陈列区域的部署,包括:In a possible implementation manner, when it is determined that there is a congestion of people in the first target item display area, at least one of the following is performed: generating a deployment suggestion for the first target item display area, adjusting the The deployment of the first target item display area, including:
从所述视频流中提取与所述第一目标物品陈列区域关联的视频帧;extracting video frames associated with the first target item display area from the video stream;
确定提取的所述视频帧中的行人在所述第一目标物品陈列区域的姿态数据;determining the posture data of the pedestrian in the extracted video frame in the display area of the first target item;
基于所述姿态数据,至少执行以下之一:生成针对所述第一目标物品陈列区域的部署建议、调整所述第一目标物品陈列区域的部署。Based on the gesture data, at least one of the following is performed: generating a deployment suggestion for the first target item display area, and adjusting the deployment of the first target item display area.
本申请实施例中,提出可以根据第一目标物品陈列区域关联的视频帧,确定视频帧中的行人在该区域的姿态数据,通过该姿态数据可以检测出第一目标物品陈列区域发生拥堵的部分原因,基于此,至少执行以下之一:可以提供出针对第一目标物品陈列区域的合理部署建议、可以合理对第一目标物品陈列区域进行合理部署,以改善第一目标物品陈列区域造成的人流拥堵。In the embodiment of the present application, it is proposed that the posture data of pedestrians in the video frame in the area can be determined according to the video frame associated with the display area of the first target item, and the congested part of the display area of the first target item can be detected through the gesture data. Reason, based on this, at least one of the following is performed: a reasonable deployment suggestion for the first target item display area can be provided, and a reasonable deployment of the first target item display area can be made to improve the flow of people caused by the first target item display area. congestion.
在一种可能的实施方式中,所述第一目标物品陈列区域包含至少一个物品陈列货架,每个物品陈列货架包含多层,所述基于所述姿态数据,至少执行以下之一:生成针对所述第一目标物品陈列区域的部署建议、调整所述第一目标物品陈列区域的部署,包括:In a possible implementation manner, the first target article display area includes at least one article display shelf, and each article display shelf includes multiple layers, and based on the gesture data, at least one of the following is performed: Describe the deployment suggestion of the first target item display area, and adjust the deployment of the first target item display area, including:
基于所述姿态数据,在确定所述视频帧中存在超过设定个数的行人的姿态符合第一预设姿态的情况下,获取与所述超过设定个数的行人的注视方向匹配的第一目标物品陈列货架的第一目标层;Based on the gesture data, when it is determined that there are more than a set number of pedestrians in the video frame whose gestures conform to the first preset attitude, obtain a first position matching the gaze direction of the more than set number of pedestrians a first target layer of a target item display shelf;
基于所述第一目标层,至少执行以下之一:生成指示将所述第一目标层陈列的物品调整至所述第一目标物品陈列货架的第二目标层进行陈列的部署建议、将所述第一目标层陈列的物品调整至所述第二目标层,所述第二目标层距离地面的高度高于所述第一目标层距离地面的高度。Based on the first target layer, at least one of the following is performed: generating a deployment proposal instructing to adjust the items displayed on the first target layer to a second target layer of the first target item display shelf for display; The items displayed on the first target layer are adjusted to the second target layer, and the height of the second target layer from the ground is higher than the height of the first target layer from the ground.
本申请实施例中,可以通过姿态数据检测出造成第一目标物品陈列区域发生人流拥堵的原因是因为该第一目标物品陈列区域中的物品陈列货架中的物品摆放不合理,比如大量顾客关注的物品被摆放至货架的底层,造成大量顾客需要俯身挑选商品,因此引发人流拥堵,这样可以提出针对第一目标物品陈列区域的合理化的部署,比如可以将顾客关注的底层货架的物品调整至高层,方便顾客站立挑选商品,从而可以改善拥堵情况。In this embodiment of the present application, it can be detected through gesture data that the reason for the congestion of people in the first target item display area is that the items in the item display shelves in the first target item display area are placed unreasonably, for example, a large number of customers are concerned about Items are placed on the bottom of the shelf, causing a large number of customers to lean over to select products, thus causing traffic congestion. In this way, a rational deployment for the display area of the first target item can be proposed, such as adjusting the items on the bottom shelf that customers pay attention to. To the upper floors, it is convenient for customers to stand and choose products, which can improve the congestion situation.
在一种可能的实施方式中,所述物品陈列货架包含多个,所述信息处理方法还包括:In a possible implementation manner, the item display racks include multiple ones, and the information processing method further includes:
基于提取的所述视频帧中的行人在所述第一目标物品陈列区域中的轨迹数据,确定经过的行人数量小于第一设定数量的第二目标物品陈列货架;Based on the extracted trajectory data of the pedestrians in the video frame in the first target item display area, determine that the number of passing pedestrians is less than the first set number of second target item display shelves;
基于所述第二目标物品陈列货架,至少执行以下之一:生成指示将所述第一目标层陈列的部分物品调整至所述第二目标物品陈列货架的部署建议、将所述第一目标层陈列的部分物品调整至第二目标物品陈列货架。Based on the second target item display rack, at least one of the following is performed: generating a deployment suggestion instructing to adjust part of the items displayed on the first target layer to the second target item display rack; Some of the displayed items are adjusted to the second target item display shelf.
本申请实施例中,提出可以将第一目标物品陈列区域中造成人流拥堵的第一目标物品陈列货架的物品调整到人流数量较少的第二目标物品陈列货架,以有效改善行人因必须在第一目标物品陈列货架处挑选物品造成的拥堵情况。In the embodiment of the present application, it is proposed that the items on the first target item display shelf, which causes congestion of people in the first target item display area, can be adjusted to the second target item display shelf with fewer people, so as to effectively improve pedestrians because they must Congestion caused by picking items at a target item display shelf.
在一种可能的实施方式中,所述第一目标物品陈列货架为可移动货架,所述基于所述 姿态数据,至少执行以下之一:生成针对所述第一目标物品陈列区域的部署建议、调整所述第一目标物品陈列区域的部署,还包括:In a possible implementation manner, the first target item display rack is a movable rack, and based on the gesture data, at least one of the following is performed: generating a deployment suggestion for the first target item display area, Adjusting the deployment of the first target item display area further includes:
基于所述姿态数据,在确定所述视频帧中存在超过设定个数的行人的姿态符合第二预设姿态的情况下,获取与所述超过设定个数的行人的注视方向匹配的第一目标物品陈列货架的当前位置和所述人流拥堵发生的位置区域;Based on the gesture data, when it is determined that there are more than a set number of pedestrians in the video frame whose gestures conform to the second preset attitude, obtain a first position matching the gaze direction of the more than set number of pedestrians The current position of a target item display shelf and the location area where the crowd congestion occurs;
基于所述当前位置和所述人流拥堵发生的位置区域,至少执行以下之一:生成针对所述第一目标物品陈列货架进行移动的部署建议、按照所述当前位置和所述人流拥堵发生的位置区域调整所述第一目标物品陈列货架。Based on the current location and the location area where the crowd congestion occurs, at least one of the following is performed: generating a deployment suggestion for moving the first target item display shelf, and according to the current location and the location where the crowd congestion occurs The area adjusts the display shelf of the first target item.
本申请实施例中,在第一目标物品陈列货架为可移动货架,且根据姿态数据检测到超过设定个数的行人为站立姿态的情况下,可以对该第一目标物品陈列货架的位置进行调整,可以有效改善因第一目标物品陈列货架处行人较多造成的对其它顾客的阻塞情况。In the embodiment of the present application, in the case where the first target item display rack is a movable rack, and more than a set number of pedestrians are detected to be standing according to the posture data, the position of the first target item display rack can be checked. The adjustment can effectively improve the blocking situation for other customers caused by more pedestrians at the display shelf of the first target item.
在一种可能的实施方式中,所述在确定存在目标物品陈列区域发生人流拥堵的情况下,所述基于所述行人统计数据,确定针对所述目标场所内至少部分物品陈列区域的部署,包括:In a possible implementation manner, in the case where it is determined that there is a congestion of people in the target item display area, the determining, based on the pedestrian statistical data, is directed to at least part of the item display area in the target place, including: :
基于所述不同物品陈列区域分别对应的行人统计数据,确定行人数量小于第二设定数量的第二目标物品陈列区域;Based on the pedestrian statistical data corresponding to the different item display areas respectively, determining a second target item display area where the number of pedestrians is less than the second set number;
基于所述第二目标物品陈列区域,至少执行以下之一:生成指示将所述第一目标物品陈列区域陈列的部分物品调整至第二目标物品陈列区域的部署建议、将所述第一目标物品陈列区域的部分物品调整至所述第二目标物品陈列区域。Based on the second target item display area, at least one of the following is performed: generating a deployment suggestion instructing to adjust some items displayed in the first target item display area to the second target item display area; Some items in the display area are adjusted to the second target item display area.
本申请实施例中,提出可以将发生人流拥堵的第一目标物品陈列区域陈列的部分物品调整至行人数量较少的第二目标物品陈列区域进行陈列,以有效改善第一目标物品陈列区域的拥堵情况。In the embodiment of the present application, it is proposed that some items displayed in the first target item display area with crowded traffic can be adjusted to be displayed in the second target item display area with fewer pedestrians, so as to effectively improve the congestion in the first target item display area. Happening.
在一种可能的实施方式中,所述基于对目标场所采集的视频流,确定所述视频流中的行人在所述目标场所中的轨迹数据,包括:In a possible implementation manner, the determining, based on the video stream collected from the target place, determines the trajectory data of the pedestrians in the video stream in the target place, including:
对所述视频流中的视频帧进行行人检测,得到同一行人在关联的视频帧中的位置指示信息;Perform pedestrian detection on the video frames in the video stream to obtain the position indication information of the same pedestrian in the associated video frames;
基于所述同一行人在关联视频帧中的位置指示信息,确定所述同一行人在所述目标场所中的轨迹数据。Based on the position indication information of the same pedestrian in the associated video frame, the trajectory data of the same pedestrian in the target place is determined.
本申请实施例中,通过使用行人检测技术,可以快速确定出视频帧中用于指示行人位置的位置指示信息,基于此可以快速确定出同一行人在目标场所中的轨迹数据。In the embodiment of the present application, by using the pedestrian detection technology, the position indication information used to indicate the position of the pedestrian in the video frame can be quickly determined, and based on this, the trajectory data of the same pedestrian in the target place can be quickly determined.
在一种可能的实施方式中,所述同一行人在关联的视频帧中的位置指示信息包括所述同一行人在关联的视频帧中与预设特征点的相对位置信息;所述基于所述同一行人在关联视频帧中的位置指示信息,确定所述同一行人所述目标场所中的轨迹数据,包括:In a possible implementation manner, the position indication information of the same pedestrian in the associated video frame includes relative position information of the same pedestrian and the preset feature point in the associated video frame; The position indication information of the pedestrian in the associated video frame, to determine the trajectory data of the same pedestrian in the target place, including:
提取所述同一行人关联的视频帧中的预设特征点;extracting preset feature points in the video frames associated with the same pedestrian;
基于所述预设特征点在所述目标场所中的预设位置信息,以及所述同一行人与所述预设特征点的相对位置信息,确定所述同一行人在所述目标场所中的轨迹数据。Based on the preset position information of the preset feature point in the target place and the relative position information of the same pedestrian and the preset feature point, determine the trajectory data of the same pedestrian in the target place .
本申请实施例中,通过提前确定视频帧中预设特征点在目标场所中的预设位置信息,这样可以基于预设特征点和行人在视频帧中的相对位置信息,快速确定出行人在目标场所中的轨迹数据。In the embodiment of the present application, the preset position information of the preset feature points in the video frame in the target place is determined in advance, so that the pedestrian can be quickly determined based on the preset feature points and the relative position information of the pedestrian in the video frame. Trajectory data in the venue.
在一种可能的实施方式中,按照以下方式确定所述同一行人关联的视频帧:In a possible implementation manner, the video frames associated with the same pedestrian are determined in the following manner:
对所述视频流中的视频帧进行头肩检测,获取所述视频帧中包含的行人头肩特征信息;Perform head and shoulder detection on the video frame in the video stream, and obtain the pedestrian head and shoulder feature information contained in the video frame;
基于不同视频帧分别包含的行人头肩特征信息,确定所述不同视频帧包含的行人之间的特征相似度;Determine the feature similarity between pedestrians included in the different video frames based on the pedestrian head and shoulders feature information included in the different video frames;
将所述特征相似度高于预设相似度阈值的视频帧,作为所述同一行人关联的视频帧。The video frames with the feature similarity higher than the preset similarity threshold are regarded as the video frames associated with the same pedestrian.
本申请实施例中,提出可以通过头肩检测技术获取视频帧中包含的行人头肩特征信息, 通过头肩检测技术可以较为准确全面的提取到标识行人特征的信息,从而可以快速确定多帧视频帧中的同一行人以及同一行人关联的视频帧,为后续对行人的追踪,以确定行人的轨迹数据提供便利。In the embodiments of the present application, it is proposed that the head and shoulders feature information of pedestrians contained in video frames can be obtained through the head and shoulders detection technology, and the information identifying the pedestrian features can be extracted more accurately and comprehensively through the head and shoulders detection technology, so that multiple frames of video can be quickly determined. The same pedestrian in the frame and the video frames associated with the same pedestrian provide convenience for the subsequent tracking of the pedestrian to determine the trajectory data of the pedestrian.
在一种可能的实施方式中,所述信息处理方法还包括:In a possible implementation, the information processing method further includes:
基于所述不同物品陈列区域在至少一个时段分别对应的行人统计数据,以及预先设定的不同行人统计数据对应的渲染方式,生成并输出所述目标场所在预设时长内的行人热力图。Based on the pedestrian statistical data corresponding to the different item display areas in at least one time period, and the preset rendering methods corresponding to the different pedestrian statistical data, a pedestrian heat map of the target place within a preset time period is generated and output.
本申请实施例中,可以基于不同物品陈列区域在至少一个时段分别对应的行人统计数据,生成可以直观形象反应目标场所内各个物品陈列区域的人流数量变化的人流热量图,以便为目标场所内的物品陈列区域提供部署建议。In the embodiment of the present application, based on the pedestrian statistical data corresponding to different item display areas in at least one time period, a pedestrian flow heat map that can intuitively reflect the changes in the number of people in each item display area in the target place can be generated, so as to be the number of people in the target place. The item display area provides deployment suggestions.
在一种可能的实施方式中,所述信息处理方法还包括:In a possible implementation, the information processing method further includes:
基于所述不同物品陈列区域分别对应的行人统计数据,确定是否存在至少一个物品陈列区域达到预警条件;Determine whether there is at least one item display area that meets the warning condition based on the pedestrian statistical data corresponding to the different item display areas;
在确定存在至少一个物品陈列区域达到预警条件的情况下,生成第一预警提示信息。When it is determined that there is at least one item display area that meets the warning condition, first warning prompt information is generated.
本申请实施例中,提出可以基于不同物品陈列区域分别对应的行人统计数据,检测是否存在潜在危险,并在确定存在潜在危险的情况下,生成预警提示,从而可以有效提高目标场所内的安全性。In the embodiment of the present application, it is proposed to detect whether there is a potential danger based on the pedestrian statistical data corresponding to different item display areas, and generate a warning prompt when it is determined that there is a potential danger, so as to effectively improve the safety in the target place .
在一种可能的实施方式中,所述预警条件包括物品陈列区域的行人数量大于或等于第一预设阈值。In a possible implementation manner, the warning condition includes that the number of pedestrians in the item display area is greater than or equal to a first preset threshold.
在一种可能的实施方式中,所述预警条件还包括如下至少一项:In a possible implementation, the warning condition further includes at least one of the following:
物品陈列区域的行人数量与其它任一物品陈列区域的行人数量之间的差异大于第二预设阈值;The difference between the number of pedestrians in the item display area and the number of pedestrians in any other item display area is greater than the second preset threshold;
物品陈列区域与相邻的物品陈列区域之间的距离小于预设距离阈值;The distance between the item display area and the adjacent item display area is less than the preset distance threshold;
物品陈列区域位于所述目标场所中的预设交通枢纽区域。The item display area is located in a preset transportation hub area in the target site.
本申请实施例中,通过设立不同的预警条件,以全面对目标场所的潜在危险进行预判,提高目标场所的安全性。In the embodiment of the present application, by setting up different early warning conditions, the potential danger of the target place is comprehensively predicted, and the safety of the target place is improved.
在一种可能的实施方式中,所述信息处理方法还包括:In a possible implementation, the information processing method further includes:
在确定存在第一目标物品陈列区域发生人流拥堵的情况下,获取第一目标物品陈列区域发生人流拥堵的持续时长;When it is determined that there is a crowd congestion in the display area of the first target item, obtaining the duration of the crowd congestion in the display area of the first target item;
在所述持续时长达到预设时长阈值的情况下,生成第二预警提示信息。When the duration reaches a preset duration threshold, second warning prompt information is generated.
本申请实施例中,提出可以对拥堵事件的持续时长进行检测,并在检测到拥堵事件的持续时长较长时,可以进行预警提示,以提高目标场所的安全性。In the embodiment of the present application, it is proposed that the duration of the congestion event can be detected, and when it is detected that the duration of the congestion event is long, an early warning prompt can be provided to improve the safety of the target place.
在一种可能的实施方式中,所述信息处理方法还包括:In a possible implementation, the information processing method further includes:
针对未发生人流拥堵的第三目标物品陈列区域,获取所述第三目标物品陈列区域在多个时段分别对应的行人数量;For the third target item display area where there is no crowd congestion, obtain the number of pedestrians corresponding to the third target item display area in multiple time periods;
在确定所述第三目标物品陈列区域在所述多个时段分别对应的行人数量均小于第三预设阈值的情况下,生成针对所述第三目标物品陈列区域的部署建议。In the case where it is determined that the number of pedestrians corresponding to the third target item display area in the plurality of time periods is less than a third preset threshold, a deployment suggestion for the third target item display area is generated.
本申请实施例中,在第三目标物品陈列区域不存在拥堵事件的情况下,若检测到该第三目标物品陈列区域的行人数量仍然较少,可以生成对该第三目标物品陈列区域的合理化部署建议,以便可以提高第三目标物品陈列区域的行人数量。In the embodiment of the present application, in the case where there is no congestion event in the third target item display area, if it is detected that the number of pedestrians in the third target item display area is still small, a rationalization of the third target item display area can be generated. Deploy recommendations so that the number of pedestrians in the display area of the third target item can be increased.
在一种可能的实施方式中,所述信息处理方法还包括:In a possible implementation, the information processing method further includes:
在确定所述第三目标物品陈列区域在至少一个时段对应的行人数量大于所述第三预设阈值的情况下,基于所述第三目标物品陈列区域中各子区域对应的轨迹数据,确定所述第三目标物品陈列区域中是否存在至少一个子区域在所述多个时段对应的行人数量均小于第四预设阈值;In the case where it is determined that the number of pedestrians corresponding to the third target item display area in at least one time period is greater than the third preset threshold, based on the trajectory data corresponding to each sub-area in the third target item display area, determine Whether there is at least one sub-area in the third target item display area and the number of pedestrians corresponding to the plurality of time periods is smaller than the fourth preset threshold;
在确定至少一个子区域在所述多个时段对应的行人数量均小于第四预设阈值的情况下,生成针对所述第三目标物品陈列区域的部署建议。When it is determined that the number of pedestrians corresponding to at least one sub-area in the plurality of time periods is less than a fourth preset threshold, a deployment suggestion for the third target item display area is generated.
本申请实施例中,提出第三目标物品陈列区域存在一个时段的行人数量较多,但是存在至少一个子区域的行人数量始终较少,此时同样可以生成对该第三目标物品陈列区域的合理化部署建议,以便可以均衡第三目标物品陈列区域中各个子区域的行人数量。In the embodiment of the present application, it is proposed that the third target item display area has a large number of pedestrians in one period, but the number of pedestrians in at least one sub-area is always small. At this time, a rationalization of the third target item display area can also be generated. Recommendations are deployed so that the number of pedestrians in each sub-area in the third target item display area can be balanced.
本申请实施例提供了一种信息处理装置,包括:The embodiment of the present application provides an information processing device, including:
第一确定模块,配置为基于对目标场所采集的视频流,确定所述视频流中的行人在所述目标场所中的轨迹数据;a first determining module, configured to determine the trajectory data of pedestrians in the target place in the video stream based on the video stream collected from the target place;
第二确定模块,配置为基于所述视频流中的行人在所述目标场所中的轨迹数据,以及所述目标场所内不同物品陈列区域的位置范围,确定所述不同物品陈列区域分别对应的行人统计数据;The second determining module is configured to determine the pedestrians corresponding to the different item display areas respectively based on the trajectory data of the pedestrians in the video stream in the target place and the position ranges of the different item display areas in the target place Statistical data;
处理模块,配置为基于所述行人统计数据,确定针对所述目标场所内至少部分物品陈列区域的部署。A processing module configured to determine deployment for at least a portion of the item display area in the target venue based on the pedestrian statistics.
在一种可能的实施方式中,所述处理器模块,还配置为基于所述行人统计数据,生成针对所述目标场所内至少部分物品陈列区域的部署建议;In a possible implementation manner, the processor module is further configured to generate deployment suggestions for at least part of the item display areas in the target place based on the pedestrian statistics;
配置为基于所述行人统计数据,调整所述目标场所内至少部分物品陈列区域的部署。is configured to adjust the deployment of at least a portion of the item display area within the target venue based on the pedestrian statistics.
本申请实施例提供了一种电子设备,包括:处理器、存储器和总线,所述存储器存储有所述处理器可执行的机器可读指令,当电子设备运行时,所述处理器与所述存储器之间通过总线通信,所述机器可读指令被所述处理器执行时执行如第一方面所述的信息处理方法的步骤。An embodiment of the present application provides an electronic device, including: a processor, a memory, and a bus, where the memory stores machine-readable instructions executable by the processor, and when the electronic device runs, the processor and the The memories communicate with each other through a bus, and when the machine-readable instructions are executed by the processor, the steps of the information processing method according to the first aspect are executed.
本申请实施例提供了一种计算机可读存储介质,该计算机可读存储介质上存储有计算机程序,该计算机程序被处理器运行时执行如第一方面所述的信息处理方法的步骤。An embodiment of the present application provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is run by a processor, the steps of the information processing method described in the first aspect are executed.
本公开实施例提供一种计算机程序,包括计算机可读代码,在所述计算机可读代码在电子设备中运行,被所述电子设备中的处理器执行的情况下,实现如上所述的活体检测方法。An embodiment of the present disclosure provides a computer program, including computer-readable codes, and when the computer-readable codes are executed in an electronic device and executed by a processor in the electronic device, the above-mentioned living body detection is realized method.
为使本申请实施例的上述目的、特征和优点能更明显易懂,下文特举较佳实施例,并配合所附附图,作详细说明如下。In order to make the above-mentioned objects, features and advantages of the embodiments of the present application more obvious and easy to understand, the preferred embodiments are exemplified below, and are described in detail as follows in conjunction with the accompanying drawings.
附图说明Description of drawings
为了更清楚地说明本公开实施例的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,此处的附图被并入说明书中并构成本说明书中的一部分,这些附图示出了符合本公开的实施例,并与说明书一起用于说明本公开的技术方案。应当理解,以下附图仅示出了本公开的某些实施例,因此不应被看作是对范围的限定,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他相关的附图。In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following briefly introduces the accompanying drawings required in the embodiments, which are incorporated into the specification and constitute a part of the specification. The drawings illustrate embodiments consistent with the present disclosure, and together with the description serve to explain the technical solutions of the present disclosure. It should be understood that the following drawings only show some embodiments of the present disclosure, and therefore should not be regarded as limiting the scope. Other related figures are obtained from these figures.
图1A示出了本申请实施例所提供的一种信息处理方法的流程图;FIG. 1A shows a flowchart of an information processing method provided by an embodiment of the present application;
图1B示出了本申请实施例所提供的一种信息处理方法的一种***架构示意图;FIG. 1B shows a schematic diagram of a system architecture of an information processing method provided by an embodiment of the present application;
图2示出了本申请实施例所提供的一种确定行人的轨迹数据的方法流程图;FIG. 2 shows a flowchart of a method for determining pedestrian trajectory data provided by an embodiment of the present application;
图3示出了本申请实施例所提供的一种确定同一行人关联的视频帧的方法流程图;3 shows a flowchart of a method for determining video frames associated with the same pedestrian provided by an embodiment of the present application;
图4示出了本申请实施例所提供的第一种调整目标场所内至少部分物品陈列区域的方法流程图;FIG. 4 shows a flowchart of the first method for adjusting at least part of the display area of items in the target site provided by the embodiment of the present application;
图5示出了本申请实施例所提供的第二种调整目标场所内至少部分物品陈列区域的方法流程图;FIG. 5 shows a flowchart of a second method for adjusting at least a part of the display area of items in a target site provided by an embodiment of the present application;
图6示出了本申请实施例所提供的第三种调整目标场所内至少部分物品陈列区域的方法流程图;FIG. 6 shows a flowchart of a third method for adjusting at least a part of the display area of items in a target site provided by an embodiment of the present application;
图7示出了本申请实施例所提供的一种行人热力图的示意图;FIG. 7 shows a schematic diagram of a pedestrian heat map provided by an embodiment of the present application;
图8示出了本申请实施例所提供的一种预警提示方法流程图;FIG. 8 shows a flowchart of an early warning prompting method provided by an embodiment of the present application;
图9示出了本申请实施例所提供的第四种调整目标场所内至少部分物品陈列区域的方法流程图;FIG. 9 shows a flowchart of a fourth method for adjusting at least a part of the item display area in a target site provided by an embodiment of the present application;
图10示出了本申请实施例所提供的第五种调整目标场所内至少部分物品陈列区域的方法流程图FIG. 10 shows a flowchart of the fifth method for adjusting at least part of the item display area in the target place provided by the embodiment of the present application
图11示出了本申请实施例所提供的一种信息处理装置的结构示意图;FIG. 11 shows a schematic structural diagram of an information processing apparatus provided by an embodiment of the present application;
图12示出了本申请实施例所提供的一种电子设备的示意图。FIG. 12 shows a schematic diagram of an electronic device provided by an embodiment of the present application.
具体实施方式Detailed ways
为使本公开实施例的目的、技术方案和优点更加清楚,下面将结合本公开实施例中附图,对本公开实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本公开一部分实施例,而不是全部的实施例。通常在此处附图中描述和示出的本公开实施例的组件可以以各种不同的配置来布置和设计。因此,以下对在附图中提供的本公开的实施例的详细描述并非旨在限制要求保护的本公开的范围,而是仅仅表示本公开的选定实施例。基于本公开的实施例,本领域技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例,都属于本公开保护的范围。In order to make the purposes, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only These are some, but not all, embodiments of the present disclosure. The components of the disclosed embodiments generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations. Therefore, the following detailed description of the embodiments of the disclosure provided in the accompanying drawings is not intended to limit the scope of the disclosure as claimed, but is merely representative of selected embodiments of the disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present disclosure.
应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步定义和解释。It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.
本文中术语“和/或”,仅仅是描述一种关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本文中术语“至少一种”表示多种中的任意一种或多种中的至少两种的任意组合,例如,包括A、B、C中的至少一种,可以表示包括从A、B和C构成的集合中选择的任意一个或多个元素。The term "and/or" in this paper only describes an association relationship, which means that there can be three kinds of relationships, for example, A and/or B, which can mean: the existence of A alone, the existence of A and B at the same time, the existence of B alone. a situation. In addition, the term "at least one" herein refers to any combination of any one of the plurality or at least two of the plurality, for example, including at least one of A, B, and C, and may mean including from A, B, and C. Any one or more elements selected from the set of B and C.
本公开实施例中的多个或者多种可以分别指的是至少两个或者至少两种。Multiple or multiple in the embodiments of the present disclosure may refer to at least two or at least two, respectively.
传统的物品陈列方式可能会引发人流分布不均匀,比如人流大概率分布在销量较高的区域,造成交通拥堵,不利于商场的人员流通,从而影响销售额。因此,亟需一种针对商场内不同物品陈列区域的调整信息生成方案,以改善传统陈列物品陈列方式造成的人流分布不均匀带来的问题。The traditional way of displaying items may cause uneven distribution of people. For example, people are likely to be distributed in areas with high sales, causing traffic congestion, which is not conducive to the circulation of people in shopping malls, thus affecting sales. Therefore, an adjustment information generation scheme for different item display areas in a shopping mall is urgently needed, so as to improve the problem caused by the uneven distribution of people flow caused by the traditional display item display method.
基于上述研究,本申请实施例提供了一种信息处理方法,可以结合采集到的目标场所的视频流确定出不同物品陈列区域的行人统计数据,进一步可以基于行人统计数据确定针对所述目标场所内至少部分物品陈列区域的部署。Based on the above research, the embodiment of the present application provides an information processing method, which can determine the pedestrian statistical data of different item display areas in combination with the collected video streams of the target place, and further can determine the pedestrian statistics based on the pedestrian statistical data. Deployment of at least part of the item display area.
由此可以通过线上对目标场所采集的视频流,来分析目标场所中各个物品陈列区域的人流量,从而可以及时地针对造成阻碍人员流通的物品陈列区域进行调整,以提高目标场所中各个物品陈列区域的部署合理性。In this way, the flow of people in each item display area in the target site can be analyzed through the video stream collected online at the target site, so that the item display area that hinders the circulation of people can be adjusted in time to improve the quality of each item in the target site. The rationality of the deployment of the display area.
此外,考虑到对于目标场所而言,无论目标场所属于公共场合或是非公共场合,出于安全考虑,通常会部署诸如摄像头等视频采集部件。也就意味着,实现上述技术方案的数据来源通常属于现有资源,无需额外采集视频流。这样一来,本申请实施例提供的技术方案能够通过对现有资源的合理运用,以得到适用于目标场所的部署建议,实现了现有资源的充分利用。且得到的物品陈列区域的调整方案,可以更加适应于目标场所的实际需求。In addition, considering that for a target place, whether the target place is a public place or a non-public place, for safety reasons, video capture components such as cameras are usually deployed. That is to say, the data sources for realizing the above technical solutions usually belong to existing resources, and there is no need to collect additional video streams. In this way, the technical solutions provided by the embodiments of the present application can obtain deployment suggestions suitable for the target site by rationally utilizing the existing resources, thereby realizing the full utilization of the existing resources. In addition, the obtained adjustment scheme of the item display area can be more adapted to the actual needs of the target place.
为便于对本实施例进行理解,首先对本申请实施例所公开的一种信息处理方法进行详细介绍,本申请实施例所提供的信息处理方法的执行主体一般为具有一定计算能力的计算机设备,该计算机设备例如包括:终端设备或服务器或其它处理设备。在一些可能的实现方式中,该信息处理方法可以通过处理器调用存储器中存储的计算机可读指令的方式来实现。In order to facilitate the understanding of this embodiment, an information processing method disclosed in the embodiment of this application is first introduced in detail. The execution subject of the information processing method provided by the embodiment of this application is generally a computer device with a certain computing capability. Devices include, for example, terminal devices or servers or other processing devices. In some possible implementations, the information processing method may be implemented by a processor invoking computer-readable instructions stored in a memory.
参见图1A所示,为本申请实施例提供的信息处理方法的流程图,该信息处理方法包括以下S101至S103:Referring to FIG. 1A , which is a flowchart of an information processing method provided by an embodiment of the present application, the information processing method includes the following S101 to S103:
S101,基于对目标场所采集的视频流,确定视频流中的行人在目标场所中的轨迹数据。S101: Determine, based on the video stream collected from the target place, track data of pedestrians in the video stream in the target place.
示例性地,目标场所可以为包含需要进行行人分布统计的场所,比如可以为包含多个展览馆的展览厅,可以基于统计得到的不同展览厅在预设时长内的人流量,对各个展览厅陈列的物品类型进行调整,还可以为包含多个店铺的商场,可以基于统计得到的不同店铺在设定时段内的行人数量,对各个店铺陈列的部署进行调整。Exemplarily, the target place may be a place containing pedestrian distribution statistics, such as an exhibition hall including multiple exhibition halls. The types of displayed items can be adjusted, and it can also be a shopping mall containing multiple stores. Based on the statistics of the number of pedestrians in different stores within a set period, the deployment of each store display can be adjusted.
示例性地,可以在目标场所包含的多个区域布置用于采集视频流的视频采集部件,视频采集部件包含摄像头,可以是三原色(Red Green Blue,RGB)摄像头,或者三原色深度(Red Green Blue Depth,RGBD)摄像头,在此不进行限定,比如可以在目标场所的多个物品陈列区域分别设置用于对相应的物品陈列区域进行视频采集的摄像头,这样在对多个物理陈列区域设置的摄像头采集的视频流进行拼接后,可以得到整个目标场所的视频流。Exemplarily, a video capture component for capturing video streams may be arranged in multiple areas included in the target site, and the video capture component includes a camera, which may be a three-primary color (Red Green Blue, RGB) camera, or a three-primary color depth (Red Green Blue Depth). , RGBD) cameras, which are not limited here, for example, cameras for video capture of the corresponding article display areas can be set up in multiple item display areas of the target site, so that the cameras set in multiple physical display areas can capture After the video streams are spliced, the video streams of the entire target site can be obtained.
示例性地,在得到针对目标场所的视频流后,可以对视频流进行分帧处理,以便对视频流中的视频帧进行行人检测,从而可以确定视频流中行人在视频帧中的位置变化,进一步可以得到视频流中的行人在目标场所中的轨迹数据,比如针对同一个行人A为例,该行人A的轨迹数据可以包括该行人A在多个时间点或在多个时间段所处的位置。Exemplarily, after obtaining the video stream for the target place, the video stream can be framed, so as to perform pedestrian detection on the video frame in the video stream, so that the position change of the pedestrian in the video stream in the video frame can be determined, Further, the trajectory data of pedestrians in the video stream in the target place can be obtained. For example, for the same pedestrian A as an example, the trajectory data of the pedestrian A can include the pedestrian A at multiple time points or at multiple time periods. Location.
S102,基于视频流中的行人在目标场所中的轨迹数据,以及目标场所内不同物品陈列区域的位置范围,确定不同物品陈列区域分别对应的行人统计数据。S102 , based on the trajectory data of pedestrians in the video stream in the target place and the position ranges of different item display areas in the target place, determine pedestrian statistical data corresponding to different item display areas respectively.
示例性地,目标场所内包含的不同物品陈列区域的位置范围可以预先进行确定,比如可以针对目标场所建立世界坐标系,从而可以提前确定并保存目标场所内不同物品陈列区域在世界坐标系下的位置范围。Exemplarily, the location ranges of different item display areas included in the target site may be determined in advance, for example, a world coordinate system may be established for the target site, so that the world coordinate system of different item display areas in the target site may be determined and saved in advance. Location range.
示例性地,物品陈列区域对应的行人统计数据可以指物品陈列区域在预设时刻包含的行人数量,比如确定不同物品陈列区域在9:00时各自包含的行人数量,例如可以基于视频流确定的行人在该预设时刻的轨迹数据(即行人在预设时刻所处的位置)以及不同物品陈列区域的位置范围来确定;或者物品陈列区域对应的行人统计数据可以指物品陈列区域在设定时段内的人流数量,可以基于视频流确定的行人在该设定时段内的轨迹点以及不同物品陈列区域的位置范围来确定,实现方式将在后文进行详细说明。Exemplarily, the pedestrian statistical data corresponding to the item display area may refer to the number of pedestrians contained in the item display area at a preset time, such as determining the number of pedestrians contained in different item display areas at 9:00, for example, it may be determined based on the video stream. The trajectory data of the pedestrian at the preset time (that is, the position of the pedestrian at the preset time) and the position range of different item display areas are determined; or the pedestrian statistics corresponding to the item display area can refer to the item display area at the set time period. The number of pedestrians in the video stream can be determined based on the trajectory points of the pedestrians in the set period determined by the video stream and the position range of different item display areas. The implementation method will be described in detail later.
S103,基于行人统计数据,确定针对目标场所内至少部分物品陈列区域的部署。S103 , based on the pedestrian statistical data, determine the deployment for at least part of the item display area in the target place.
示例性地,基于行人统计数据,确定针对目标场所内至少部分物品陈列区域的部署至少包括以下之一:针对目标场所内至少部分物品陈列区域的部署建议、调整目标场所内至少部分物品陈列区域的部署;其中,部署建议可以包括以下至少之一:对陈列物品的放置位置的调整建议、对用于陈列物品的陈列货架的调整建议;对应地,调整目标场所内至少部分物品陈列区域的部署可以包含以下至少之一:对陈列物品的调整、对用于陈列物品的陈列货架的调整。Exemplarily, based on the pedestrian statistical data, determining the deployment for at least part of the item display area in the target site includes at least one of the following: a deployment suggestion for at least a part of the item display area in the target site; deployment; wherein, the deployment suggestion may include at least one of the following: an adjustment suggestion for the placement position of the displayed items, and an adjustment suggestion for the display shelves used for displaying the items; correspondingly, adjusting the deployment of at least part of the item display area in the target site may It includes at least one of the following: adjustment of the displayed items, and adjustment of the display shelves used for displaying the items.
可以结合采集到的目标场所的视频流确定出不同物品陈列区域的行人统计数据,进一步可以基于行人统计数据确定针对所述目标场所内至少部分物品陈列区域的部署。Pedestrian statistics of different item display areas can be determined in combination with the collected video streams of the target site, and further, based on the pedestrian statistics data, deployment for at least part of the item display areas in the target site can be determined.
由此可以通过线上对目标场所采集的视频流,来分析目标场所中各个物品陈列区域的人流量,从而可以及时地针对造成阻碍人员流通的物品陈列区域进行调整,以提高目标场所中各个物品陈列区域的部署合理性。In this way, the flow of people in each item display area in the target site can be analyzed through the video stream collected online at the target site, so that the item display area that hinders the circulation of people can be adjusted in time to improve the quality of each item in the target site. The rationality of the deployment of the display area.
此外,考虑到对于目标场所而言,无论目标场所属于公共场合或是非公共场合,出于安全考虑,通常会部署诸如摄像头等视频采集部件。也就意味着,实现上述技术方案的数据来源通常属于现有资源,无需额外采集视频流。这样一来,本申请实施例提供的技术方案能够通过对现有资源的合理运用,以得到适用于目标场所的部署建议,实现了现有资源的充分利用。且得到的物品陈列区域的调整方案,可以更加适应于目标场所的实际需求。In addition, considering that for a target place, whether the target place is a public place or a non-public place, for safety reasons, video capture components such as cameras are usually deployed. That is to say, the data sources for realizing the above technical solutions usually belong to existing resources, and there is no need to collect additional video streams. In this way, the technical solutions provided by the embodiments of the present application can obtain deployment suggestions suitable for the target site by rationally utilizing the existing resources, thereby realizing the full utilization of the existing resources. In addition, the obtained adjustment scheme of the item display area can be more adapted to the actual needs of the target place.
图1B可以应用本申请实施例一种信息处理方法的一种***架构示意图;如图1B所示,该***架构中包括:视频采集设备2001、网络2002和图像获取终端2003。为实现支撑一个示例性应用,视频采集设备2001和图像获取终端2003可以通过网络2002建立通信连 接,视频采集设备2001通过网络2002向图像获取终端2003传输采集的视频流,图像获取终端2003接收视频流,并对视频流进行分析,进而确定针对视频流中目标场所内部分物品陈列区域的部署。FIG. 1B is a schematic diagram of a system architecture to which an information processing method according to an embodiment of the present application can be applied; as shown in FIG. In order to support an exemplary application, the video capture device 2001 and the image capture terminal 2003 can establish a communication connection through the network 2002, the video capture device 2001 transmits the captured video stream to the image capture terminal 2003 through the network 2002, and the image capture terminal 2003 receives the video stream. , and analyze the video stream, and then determine the deployment for the display area of some items in the target place in the video stream.
作为示例,当前场景视频采集设备2001可以包括摄像头等图像采集设备,摄像头例如可以是RGB摄像头,或者RGBD摄像头。图像获取终端2003可以包括具有一定计算能力的计算机设备,该计算机设备例如包括:终端设备或服务器或其它处理设备。网络2002可以采用有线连接或无线连接方式。其中,当视频采集设备2001为图像采集设备,图像获取终端2003为服务器时,视频采集设备可以通过有线连接的方式与图像获取终端通信连接,例如通过总线进行数据通信;当视频采集设备2001为图像采集设备,图像获取终端2003为终端设备时,视频采集设备可以通过无线连接的方式与图像获取终端通信连接,进而进行数据通信。As an example, the current scene video capture device 2001 may include an image capture device such as a camera, and the camera may be, for example, an RGB camera or an RGBD camera. The image acquisition terminal 2003 may include a computer device with a certain computing capability, for example, the computer device includes a terminal device or a server or other processing devices. The network 2002 can be wired or wireless. Wherein, when the video capture device 2001 is an image capture device and the image capture terminal 2003 is a server, the video capture device can be connected to the image capture terminal through a wired connection, such as data communication through a bus; when the video capture device 2001 is an image capture device Acquisition device, when the image acquisition terminal 2003 is a terminal device, the video acquisition device can communicate with the image acquisition terminal through a wireless connection, thereby performing data communication.
或者,在一些场景中,图像获取终端2003可以是带有视频采集模组的视觉处理设备,可以是带有摄像头的主机。这时,本申请实施例的信息处理方法可以由图像获取终端2003执行,上述***架构可以不包含网络2002和视频采集设备2001。Or, in some scenarios, the image acquisition terminal 2003 may be a vision processing device with a video acquisition module, or a host with a camera. At this time, the information processing method of the embodiment of the present application may be executed by the image acquisition terminal 2003 , and the above-mentioned system architecture may not include the network 2002 and the video acquisition device 2001 .
下面将结合一些实施例对上述S101至S103进行详细阐述。The above S101 to S103 will be described in detail below with reference to some embodiments.
针对上述S101,在基于对目标场所采集的视频流,确定视频流中的行人在目标场所中的轨迹数据时,如图2所示,可以包括以下S201和S202:For the above S101, when determining the trajectory data of pedestrians in the video stream in the target place based on the video stream collected from the target place, as shown in FIG. 2, the following S201 and S202 may be included:
S201,对视频流中的视频帧进行行人检测,得到同一行人在关联的视频帧中的位置指示信息。S201: Perform pedestrian detection on a video frame in a video stream to obtain position indication information of the same pedestrian in an associated video frame.
示例性地,考虑到视频帧中的行人可能存在遮挡情况,从视频帧中可能无法拍摄到整个人的身体,因此,在对视频流中的视频帧进行行人检测时,可以考虑采用头肩检测算法,完成对视频帧中行人的检测。Exemplarily, considering that the pedestrians in the video frame may be occluded, the whole body of the person may not be photographed from the video frame. Therefore, when pedestrian detection is performed on the video frame in the video stream, head and shoulders detection can be considered. algorithm to complete the detection of pedestrians in video frames.
示例性地,位置指示信息可以包括用于指示行人在视频帧中的位置的信息,比如可以包括基于行人检测技术确定的用于表示行人在视频帧中位置信息的检测框,还可以包含行人在视频帧中与预设特征点之间的相对位置信息,在预设特征点在目标场所中的位置信息为已知的情况下,可以结合预设特征点和行人之间的相对位置信息确定行人在目标场所中的轨迹数据。Exemplarily, the position indication information may include information used to indicate the position of the pedestrian in the video frame, for example, may include a detection frame determined based on the pedestrian detection technology and used to represent the position information of the pedestrian in the video frame, and may also include the pedestrian in the video frame. The relative position information between the video frame and the preset feature points. When the position information of the preset feature points in the target site is known, the pedestrian can be determined by combining the relative position information between the preset feature points and the pedestrian. Trajectory data in the target location.
考虑到视频流中可以包含多个行人,在对行人进行追踪确定行人的轨迹数据时,需要识别出不同帧中包含的同一行人,确定出同一行人在关联的视频帧中的位置指示信息,比如连续n帧视频帧都包含同一行人,则可以将这n帧视频帧作为同一行人关联的视频帧,并确定出这n帧视频帧中该同一行人的位置指示信息。Considering that a video stream can contain multiple pedestrians, when tracking pedestrians to determine the trajectory data of pedestrians, it is necessary to identify the same pedestrian contained in different frames, and determine the position indication information of the same pedestrian in the associated video frame, such as If consecutive n video frames contain the same pedestrian, the n video frames can be regarded as video frames associated with the same pedestrian, and the position indication information of the same pedestrian in the n video frames can be determined.
S202,基于同一行人在关联视频帧中的位置指示信息,确定同一行人在目标场所中的轨迹数据。S202: Determine the trajectory data of the same pedestrian in the target place based on the position indication information of the same pedestrian in the associated video frame.
示例性地,位置指示信息可以包括用于指示行人在视频帧中的位置的检测框,比如可以将检测框底边的中心点在视频帧中的位置信息作为行人在视频帧中的位置信息,然后基于图像坐标系与相机坐标系之间的转换关系,以及相机坐标系与世界坐标系之间的转换关系,确定出行人在目标场所中的位置。Exemplarily, the position indication information may include a detection frame for indicating the position of the pedestrian in the video frame, for example, the position information of the center point of the bottom edge of the detection frame in the video frame may be used as the position information of the pedestrian in the video frame, Then, based on the transformation relationship between the image coordinate system and the camera coordinate system, and the transformation relationship between the camera coordinate system and the world coordinate system, the position of the pedestrian in the target place is determined.
示例性地,位置指示信息还可以包含行人在视频帧中与预设特征点之间的相对位置信息,可以先确定出预设特征点在目标场所中的位置信息,然后根据预设特征点与行人之间的相对位置信息,确定出行人在目标场所中的位置,比如预设特征点与行人的脚部在视频帧中重合,可以将预设特征点在目标场所中的位置作为行人脚部在目标场所中的位置。Exemplarily, the position indication information can also include the relative position information of the pedestrian in the video frame and the preset feature point, the position information of the preset feature point in the target place can be determined first, and then according to the preset feature point and the preset feature point. The relative position information between pedestrians is used to determine the pedestrian's position in the target place. For example, the preset feature point and the pedestrian's foot are coincident in the video frame, and the position of the preset feature point in the target place can be used as the pedestrian's foot. position in the target site.
示例性地,在对同一行人进行追踪时,可以得到同一行人在目标场所中的多个位置,比如同一行人在目标场所中的位置包括位置A、位置B和位置C,这些位置按照时序依次相连后可以表示该同一行人在目标场所中的轨迹数据。Exemplarily, when tracking the same pedestrian, multiple positions of the same pedestrian in the target site can be obtained. For example, the positions of the same pedestrian in the target site include position A, position B, and position C, and these positions are sequentially connected in sequence. Then, the trajectory data of the same pedestrian in the target place can be represented.
本申请实施例中,通过使用行人检测技术,可以快速确定出视频帧中用于指示行人位 置的位置指示信息,基于此可以快速确定出同一行人的轨迹数据。In the embodiment of the present application, by using the pedestrian detection technology, the position indication information used to indicate the position of the pedestrian in the video frame can be quickly determined, and based on this, the trajectory data of the same pedestrian can be quickly determined.
针对上述提到的同一行人在关联的视频帧中的位置指示信息包括同一行人在关联的视频帧中与预设特征点的相对位置信息;针对上述S202,在基于同一行人在关联视频帧中的位置指示信息,确定同一行人目标场所中的轨迹数据时,可以包括以下S2021和S2022:The position indication information of the same pedestrian in the associated video frame mentioned above includes the relative position information of the same pedestrian in the associated video frame and the preset feature point; for the above S202, based on the same pedestrian in the associated video frame The location indication information, when determining the trajectory data in the same pedestrian target place, may include the following S2021 and S2022:
S2021,提取同一行人关联的视频帧中的预设特征点;S2021, extracting preset feature points in video frames associated with the same pedestrian;
S2022,基于预设特征点在目标场所中的预设位置信息,以及同一行人与预设特征点的相对位置信息,确定同一行人在目标场所中的轨迹数据。S2022 , based on the preset position information of the preset feature point in the target place and the relative position information of the same pedestrian and the preset feature point, determine the trajectory data of the same pedestrian in the target place.
示例性地,可以预先绘制目标场所对应的计算机辅助设计(Computer Aided Design,CAD)图,在CAD图中可以标记目标场所中包含的多个预设特征点在目标场所中的预设位置信息,多个预设特征点可以为预先选择的在一定时长内处于静止的物体包含的特征点,比如地面、桌子、灯、墙壁等,预设特征点在目标场所中的预设位置信息可以根据预先建立的目标场所对应的世界坐标系确定。Exemplarily, a computer-aided design (Computer Aided Design, CAD) diagram corresponding to the target site can be drawn in advance, and the preset position information in the target site of a plurality of preset feature points contained in the target site can be marked in the CAD diagram, The plurality of preset feature points can be pre-selected feature points contained in objects that are stationary for a certain period of time, such as the ground, table, lamp, wall, etc. The preset position information of the preset feature points in the target place can be determined according to the preset position information. The world coordinate system corresponding to the established target location is determined.
示例性地,以行人关联的一帧视频帧为例进行说明,可以根据行人在视频帧中的位置信息,提取与行人的位置信息关联的预设特征点,比如可以提取视频帧中与行人脚部位置重合的预设特征点,这样可以直接基于预设特征点在目标场所中的预设位置信息,确定行人在目标场所中的位置,按照这样的方式,在同一行人关联的视频帧包含多帧时,可以确定出该同一行人在目标场所中的多个位置,由此可以确定出该同一行人在目标场所中的位置变化,对该同一行人进行追踪。Exemplarily, taking a video frame associated with a pedestrian as an example, the preset feature points associated with the position information of the pedestrian can be extracted according to the position information of the pedestrian in the video frame. In this way, the position of the pedestrian in the target place can be determined directly based on the preset position information of the preset feature point in the target place. In this way, the video frames associated with the same pedestrian contain multiple During the frame, multiple positions of the same pedestrian in the target place can be determined, and thus the position change of the same pedestrian in the target place can be determined, and the same pedestrian can be tracked.
本申请实施例中,通过提前确定视频帧中预设特征点在目标场所中的预设位置信息,这样可以基于预设特征点和行人在视频帧中的相对位置信息,快速确定出行人在目标场所中的轨迹数据。In the embodiment of the present application, the preset position information of the preset feature points in the video frame in the target place is determined in advance, so that the pedestrian can be quickly determined based on the preset feature points and the relative position information of the pedestrian in the video frame. Trajectory data in the venue.
针对上述提到的确定同一行人在关联的视频帧中的位置指示信息的过程,例如可以按照以下方式确定同一行人关联的视频帧,如图3所示,包括S301至S303:For the above-mentioned process of determining the position indication information of the same pedestrian in the associated video frame, for example, the video frame associated with the same pedestrian can be determined in the following manner, as shown in FIG. 3 , including S301 to S303:
S301,对视频流中的视频帧进行头肩检测,获取视频帧中包含的行人头肩特征信息。S301 , performing head and shoulder detection on a video frame in a video stream, and acquiring the pedestrian head and shoulder feature information contained in the video frame.
示例性地,在对视频流进行分帧处理后,针对每帧视频帧,可以在确定该帧视频帧中包含行人的头肩信息后,提取用于描述行人头肩的特征信息,比如可以提取行人头肩的轮廓特征、形状特征、颜色特征、纹理特征以及运动特征等,还可以包含行人脸部特征,通过多种特征结合判断,可以为后续判断不同视频帧中的行人是否为同一行人提供技术支持。Exemplarily, after the video stream is divided into frames, for each frame of video frame, after it is determined that the video frame contains the head and shoulders information of the pedestrian, feature information for describing the head and shoulders of the pedestrian can be extracted. The outline features, shape features, color features, texture features, and motion features of pedestrians’ heads and shoulders can also include pedestrian facial features. Through the combination of multiple features, it can be used to determine whether pedestrians in different video frames are the same pedestrian. Technical Support.
S302,基于不同视频帧分别包含的行人头肩特征信息,确定不同视频帧包含的行人之间的特征相似度。S302 , based on the pedestrian head and shoulder feature information contained in different video frames respectively, determine the feature similarity between pedestrians contained in different video frames.
示例性地,可以根据不同视频帧中包含的行人头肩特征信息生成不同视频帧包含的行人分别对应的特征向量,然后通过余弦公式,确定不同视频帧中包含的行人之间的特征相似度。Exemplarily, feature vectors corresponding to pedestrians contained in different video frames can be generated according to the pedestrian head and shoulder feature information contained in different video frames, and then the feature similarity between pedestrians contained in different video frames can be determined by the cosine formula.
S303,将特征相似度高于预设相似度阈值的视频帧,作为同一行人关联的视频帧。S303, taking the video frames with the feature similarity higher than the preset similarity threshold as the video frames associated with the same pedestrian.
示例性地,考虑到同一行人在视频流的不同视频帧中对应的行人特征信息之间的相似度较高,因此,可以基于预先设置的预设相似度阈值,来筛选与同一行人关联的视频帧,比如第一帧、第二帧和第三帧包含的一个行人之间的特征相似度高于预设相似度阈值,可以将第一帧、第二帧和第三帧作为该行人关联的视频帧。Exemplarily, considering that the similarity between the pedestrian feature information corresponding to the same pedestrian in different video frames of the video stream is relatively high, therefore, the videos associated with the same pedestrian can be screened based on a preset similarity threshold value set in advance. For example, if the feature similarity between a pedestrian contained in the first frame, the second frame and the third frame is higher than the preset similarity threshold, the first frame, the second frame and the third frame can be used as the pedestrian associated with the pedestrian. video frame.
示例性地,在对视频帧进行头肩检测过程中,还可以对检测到的行人进行ID编码,比如可以通过相同的ID对不同视频帧中同一行人进行编码,这样在对行人进行追踪过程中,可以通过相同的ID追踪同一行人的轨迹点信息。Exemplarily, in the process of performing head and shoulders detection on the video frame, ID encoding can also be performed on the detected pedestrian, for example, the same pedestrian in different video frames can be encoded by the same ID, so that in the process of tracking the pedestrian. , the track point information of the same pedestrian can be tracked through the same ID.
本申请实施例中,提出可以通过头肩检测技术获取视频帧中包含的行人头肩特征信息,通过头肩检测技术可以较为准确全面的提取到标识行人特征的信息,从而可以快速确定多帧视频帧中的同一行人以及同一行人关联的视频帧,为后续对行人的追踪,以确定行人的轨迹数据提供便利。In the embodiments of the present application, it is proposed that the head and shoulders feature information of pedestrians contained in video frames can be obtained through the head and shoulders detection technology, and the information identifying the pedestrian features can be extracted more accurately and comprehensively through the head and shoulders detection technology, so that multiple frames of video can be quickly determined. The same pedestrian in the frame and the video frames associated with the same pedestrian provide convenience for the subsequent tracking of the pedestrian to determine the trajectory data of the pedestrian.
在一种可能的实施方式中,针对上述S103,在基于行人统计数据,确定针对所述目标场所内至少部分物品陈列区域的部署时,如图4所示,可以包括以下S401和S402:In a possible implementation manner, for the above S103, when determining the deployment for at least part of the item display area in the target place based on pedestrian statistics, as shown in FIG. 4, the following S401 and S402 may be included:
S401,基于不同物品陈列区域分别对应的行人统计数据和目标场所中的轨迹数据,确定是否存在第一目标物品陈列区域发生人流拥堵。S401 , based on pedestrian statistical data corresponding to different item display areas and trajectory data in the target place, determine whether there is a crowd congestion in the first target item display area.
示例性地,可以根据不同物品陈列区域在预设时段内分别对应的行人统计数据,确定出每个物品陈列区域在该预设时段内的行人数量是否超过达到拥挤对应的行人数量,比如预先在设定面积为n平米的物品陈列区域对应的行人数量超过m的情况下,该物品陈列区域可能发生人流拥堵,进一步可以结合目标场所的轨迹数据,检测是否存在行人到达一个行人数量较多的物品陈列区域后原路折回,或者绕道而行,如果存在,可以确定该第一目标物品陈列区域大概率发生人流拥堵。Exemplarily, it can be determined whether the number of pedestrians in each item display area in the preset time period exceeds the number of pedestrians corresponding to the congestion, according to the pedestrian statistical data corresponding to different item display areas within a preset period of time, such as in advance. When the number of pedestrians corresponding to the item display area with an area of n square meters exceeds m, the item display area may be crowded with people. Further, it can be combined with the trajectory data of the target site to detect whether there are pedestrians arriving at an item with a large number of pedestrians. After the display area, turn back to the original road, or take a detour. If there is, it can be determined that there is a high probability of crowd congestion in the display area of the first target item.
S402,在确定存在第一目标物品陈列区域发生人流拥堵的情况下,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署。S402, when it is determined that the first target item display area is crowded with people, at least one of the following is performed: generating a deployment suggestion for the first target item display area, and adjusting the deployment of the first target item display area.
示例性地,针对确定出存在人流拥堵的第一目标物品陈列区域,进一步可以判断造成该第一目标物品陈列区域人流拥堵的原因,然后至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署。Exemplarily, for the first target item display area where it is determined that there is a crowd congestion, it is possible to further determine the cause of the crowd congestion in the first target item display area, and then at least one of the following is performed: Deploy suggestions and adjust the deployment of the first target item display area.
本申请实施例中,可以通过不同物品陈列区域的行人统计数据和目标场所中的轨迹数据,分析出是否存在人流拥堵的情况,比如存在一个第一物品陈列区域的行人数量较多,且基于视频流检测到行人的轨迹到达第一物品陈列区域后轨迹发生返回的情况,可以确定出第一物品陈列区域发生人流拥堵,此时可以至少执行以下之一:生成针对该第一物品陈列区域的部署建议、调整第一目标物品陈列区域的部署,降低第一目标物品陈列区域的拥堵情况。In the embodiment of the present application, it is possible to analyze whether there is a crowd congestion situation through the pedestrian statistics data in different item display areas and the trajectory data in the target place. When the flow detects that the pedestrian's trajectory returns to the first item display area, it can be determined that the first item display area is crowded with people. At this time, at least one of the following can be performed: generate a deployment for the first item display area. Suggest and adjust the deployment of the first target item display area to reduce the congestion in the first target item display area.
在一种可能的实施方式中,针对上述S402,在确定存在第一目标物品陈列区域发生人流拥堵的情况下,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署时,如图5所示,可以包括以下S501至S503:In a possible implementation manner, for the above S402, when it is determined that there is a crowd congestion in the first target item display area, at least one of the following is performed: generating a deployment suggestion for the first target item display area, adjusting the first target item display area During the deployment of the target item display area, as shown in FIG. 5 , the following S501 to S503 may be included:
S501,从视频流中提取与第一目标物品陈列区域关联的视频帧。S501. Extract video frames associated with the display area of the first target item from the video stream.
示例性地,目标场所中可以设置多个摄像头,每个摄像头可以采集不同区域对应的视频流,为了快速确定出造成第一目标物品陈列区域发生人流拥堵的原因,这里可以提取与第一目标物品陈列区域关联的摄像头采集的视频流,然后进一步对该视频流进行分帧处理,得到与第一目标物品陈列区域关联的视频帧。Exemplarily, multiple cameras can be set in the target place, and each camera can collect video streams corresponding to different areas. The video stream collected by the camera associated with the display area is further processed into frames to obtain the video frame associated with the display area of the first target item.
S502,确定提取的视频帧中的行人在第一目标物品陈列区域的姿态数据。S502: Determine the posture data of the pedestrian in the first target item display area in the extracted video frame.
示例性地,可以基于预先训练的姿态识别网络识别视频帧中的行人在第一目标物品陈列区域中的姿态数据,例如,姿态数据可以包含俯身姿态和站立姿态。Exemplarily, the gesture data of the pedestrian in the video frame in the display area of the first target item may be recognized based on the pre-trained gesture recognition network. For example, the gesture data may include a leaning posture and a standing posture.
S503,基于姿态数据,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署。S503: Based on the gesture data, at least one of the following is performed: generating a deployment suggestion for the first target item display area, and adjusting the deployment of the first target item display area.
示例性地,针对购物场景,比如超市购物场景,在大多顾客关注的商品被布置在购物架的底层的情况下,顾客在挑选这类商品时需要俯身挑选,这样容易对购物架前方的过道造成拥挤,针对此,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署。Exemplarily, for a shopping scene, such as a supermarket shopping scene, when most of the commodities that customers pay attention to are arranged on the bottom of the shopping rack, the customer needs to lean over to select such commodities, so that the aisle in front of the shopping rack is easy to see. To cause congestion, for this, at least one of the following is performed: generating a deployment suggestion for the first target item display area, and adjusting the deployment of the first target item display area.
本申请实施例中,提出可以根据第一目标物品陈列区域关联的视频帧,确定视频帧中的行人在该区域的姿态数据,通过该姿态数据可以检测出第一目标物品陈列区域发生拥堵的部分原因,基于此,至少执行以下之一:可以提供出针对第一目标物品陈列区域的合理部署建议、可以合理对第一目标物品陈列区域进行合理部署,以改善第一目标物品陈列区域造成的人流拥堵。In the embodiment of the present application, it is proposed that the posture data of pedestrians in the video frame in the area can be determined according to the video frame associated with the display area of the first target item, and the congested part of the display area of the first target item can be detected through the gesture data. Reason, based on this, at least one of the following is performed: a reasonable deployment suggestion for the first target item display area can be provided, and a reasonable deployment of the first target item display area can be made to improve the flow of people caused by the first target item display area. congestion.
在一种可能的实施方式中,第一目标物品陈列区域包含至少一个物品陈列货架,每个物品陈列货架包含多层,针对上述S503,在基于姿态数据,至少执行以下之一:生成针对 第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署时,可以包括以下S5031和S5032:In a possible implementation, the first target article display area includes at least one article display shelf, and each article display shelf includes multiple layers. For the above S503, based on the gesture data, at least one of the following is performed: The deployment suggestion of the target item display area and the adjustment of the deployment of the first target item display area may include the following S5031 and S5032:
S5031,基于姿态数据,在确定视频帧中存在超过设定个数的行人的姿态符合第一预设姿态的情况下,获取与超过设定个数的行人的注视方向匹配的第一目标物品陈列货架的第一目标层。S5031, based on the attitude data, in the case where it is determined that there are more than a set number of pedestrians in the video frame whose attitudes conform to the first preset attitude, obtain a first target item display that matches the gaze direction of the more than set number of pedestrians The first target layer of the shelf.
示例性地,以第一目标物品陈列区域为目标场所中的店铺为例,该店铺可以包含多个物品陈列货架,相邻的两个物品陈列货架之间构成供顾客通行的通道,每个物品陈列货架可以自下而上包含多层。Exemplarily, taking the store in the first target item display area as the target site as an example, the store may include multiple item display shelves, and a passage for customers to pass between two adjacent item display shelves is formed. Display shelves can contain multiple layers from the bottom up.
示例性地,第一预设姿态可以为俯身姿态,在检测到超过设定个数的顾客的姿态为俯身姿态的情况下,通过检测这些顾客的注视方向确定出超过设定个数的顾客关注的第一目标物品陈列货架的第一目标层,可以确定出引发人流拥堵的原因是超过设定个数的顾客俯身挑选第一目标物品陈列货架低层的货物。Exemplarily, the first preset posture may be a leaning-over posture, and when it is detected that the posture of the customers exceeding the set number is the leaning-over posture, it is determined by detecting the gaze direction of these customers that the posture exceeds the set number. On the first target layer of the display shelf for the first target item that the customer pays attention to, it can be determined that the cause of the crowd congestion is that more than the set number of customers lean over to select the goods on the lower layer of the first target article display shelf.
S5032,基于第一目标层,至少执行以下之一:生成指示将第一目标层陈列的物品调整至第一目标物品陈列货架的第二目标层进行陈列的部署建议、将第一目标层陈列的物品调整至第二目标层,第二目标层距离地面的高度高于第一目标层距离地面的高度。S5032, based on the first target layer, at least one of the following is performed: generating a deployment suggestion instructing to adjust the items displayed on the first target layer to the second target layer of the first target item display shelf for display; The item is adjusted to the second target layer, and the height of the second target layer from the ground is higher than the height of the first target layer from the ground.
示例性地,考虑到由于超过设定个数的顾客俯身挑选第一目标物品陈列货架低层的货物导致第一目标物品陈列区域在第一目标物品陈列货架处发生人流拥堵,因此可以至少执行以下之一:生成指示将低层陈列的物品调整至高层进行陈列的部署建议、将低层陈列的物品调整至高层,这样顾客在挑选感兴趣的货物时可以站立挑选,从而缓解因大部分顾客俯身挑选货物而导致的人流拥堵情况。Exemplarily, considering that the first target item display area is crowded with people at the first target item display shelf due to the over-set number of customers leaning over to pick the goods on the lower layer of the first target item display shelf, at least the following can be performed: One: generate a deployment proposal that instructs to adjust the items displayed on the lower level to the upper level for display, and adjust the items displayed on the lower level to the upper level, so that customers can stand and select the goods they are interested in, so as to alleviate the problem of most customers leaning over to choose. Traffic congestion caused by goods.
本申请实施例中,可以通过姿态数据检测出造成第一目标物品陈列区域发生人流拥堵的原因是因为该第一目标物品陈列区域中的物品陈列货架中的物品摆放不合理,比如大量顾客关注的物品被摆放至货架的底层,造成大量顾客需要俯身挑选商品,因此引发人流拥堵,这样可以提出针对第一目标物品陈列区域的合理化的部署,比如可以将顾客关注的底层货架的物品调整至高层,方便顾客站立挑选商品,从而可以改善拥堵情况。In this embodiment of the present application, it can be detected through gesture data that the reason for the congestion of people in the first target item display area is that the items in the item display shelves in the first target item display area are placed unreasonably, for example, a large number of customers are concerned about Items are placed on the bottom of the shelf, causing a large number of customers to lean over to select products, thus causing traffic congestion. In this way, a rational deployment for the display area of the first target item can be proposed, such as adjusting the items on the bottom shelf that customers pay attention to. To the upper floors, it is convenient for customers to stand and choose products, which can improve the congestion situation.
在一种可能的实施方式中,物品陈列货架包含多个,本申请实施例提供的信息处理方法还包括以下S5033和S5034:In a possible implementation manner, the item display shelves include a plurality of shelves, and the information processing method provided in this embodiment of the present application further includes the following S5033 and S5034:
S5033,基于提取的视频帧中的行人在第一目标物品陈列区域中的轨迹数据,确定经过的行人数量小于第一设定数量的第二目标物品陈列货架;S5033, based on the trajectory data of the pedestrians in the extracted video frame in the first target item display area, determine that the number of passing pedestrians is less than the first set number of second target item display shelves;
S5034,基于所述第二目标物品陈列货架,至少执行以下之一:生成指示将第一目标层陈列的部分物品调整至第二目标物品陈列货架的部署建议、将第一目标层陈列的部分物品调整至第二目标物品陈列货架。S5034: Based on the second target item display rack, at least one of the following is performed: generating a deployment suggestion instructing to adjust some items displayed on the first target layer to the second target item display rack, displaying some items on the first target layer Adjusted to the second target item display shelf.
示例性地,第一设定数量可以根据物品陈列区域中包含的不同物品陈列货架之间能够容纳的最多行人数量来确定,比如不同物品陈列货架之间能够容纳的最多行人数量为N,则该第一设定数量可以设置为N的k倍,其中k大于0且小于1,该第一设定数量表示行人数量较少,远远小于最多行人数量。Exemplarily, the first set number may be determined according to the maximum number of pedestrians that can be accommodated between different item display shelves included in the item display area. For example, the maximum number of pedestrians that can be accommodated between different item display shelves is N, then the The first set number may be set to be k times N, where k is greater than 0 and less than 1, and the first set number indicates that the number of pedestrians is small, far less than the maximum number of pedestrians.
示例性地,同样以第一目标物品陈列区域为目标场所中的店铺为例,针对上述提到的引发人流拥堵的原因是超过设定个数的顾客俯身挑选第一目标物品陈列货架低层的货物造成的情况下,可以在该第一目标物品陈列区域中选择顾客较少的第二目标物品陈列货架,这样可以生成将第一目标物品货架中第一目标层陈列的货物调整至第二目标物品陈列货架中,以将热门的货物放置不同的物品陈列货架中,降低人流拥堵概率。Exemplarily, also taking the first target item display area as an example of a store in the target location, for the above-mentioned cause of traffic congestion, more than the set number of customers leaned over to select the first target item on the lower level of the display shelf. In the case of goods caused, a second target item display shelf with fewer customers can be selected in the first target item display area, so that the goods displayed on the first target layer in the first target item shelf can be adjusted to the second target item. Items are placed on display shelves, so that popular goods can be placed in different item display shelves to reduce the probability of crowd congestion.
本申请实施例中,提出可以将第一目标物品陈列区域中造成人流拥堵的第一目标物品陈列货架的物品调整到人流数量较少的第二目标物品陈列货架,以有效改善行人因必须在第一目标物品陈列货架处挑选物品造成的拥堵情况。In the embodiment of the present application, it is proposed that the items on the first target item display shelf, which causes congestion of people in the first target item display area, can be adjusted to the second target item display shelf with fewer people, so as to effectively improve pedestrians because they must Congestion caused by picking items at a target item display shelf.
在另一种实施方式中,第一目标物品陈列货架为可移动货架,针对上述S503,在基于 姿态数据,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署时,还包括以下S5035和S5036:In another embodiment, the first target item display shelf is a movable shelf, and for the above S503, based on the gesture data, at least one of the following is performed: generating a deployment suggestion for the first target item display area, adjusting the first target During the deployment of the item display area, the following S5035 and S5036 are also included:
S5035,基于姿态数据,在确定视频帧中存在超过设定个数的行人的姿态符合第二预设姿态的情况下,获取与超过设定个数的行人的注视方向匹配的第一目标物品陈列货架的当前位置和人流拥堵发生的位置区域;S5035, based on the attitude data, in the case where it is determined that there are more than a set number of pedestrians in the video frame whose attitudes conform to the second preset attitude, obtain a first target item display that matches the gaze direction of the more than set number of pedestrians The current position of the shelf and the location area where the traffic congestion occurs;
S5036,基于当前位置和人流拥堵发生的位置区域,至少执行以下之一:生成针对第一目标物品陈列货架进行移动的部署建议、按照当前位置和人流拥堵发生的位置区域调整第一目标物品陈列货架。S5036, based on the current location and the location area where the crowd congestion occurs, at least one of the following is performed: generating a deployment suggestion for moving the first target item display shelf, adjusting the first target item display shelf according to the current location and the location area where the crowd congestion occurs .
示例性地,同样以第一目标物品陈列区域为目标场所中的店铺为例,该店铺中包含的多个物品陈列货架为可移动货架,在第一目标物品陈列货架所在区域发生人流拥堵的情况下,可以通过调整第一目标物品陈列货架的位置,改善拥堵情况。Exemplarily, also take the store in the target location as the first target item display area as an example, the plurality of item display shelves included in the store are movable shelves, and the crowded situation occurs in the area where the first target item display shelf is located. In this case, the congestion situation can be improved by adjusting the position of the display shelf of the first target item.
示例性地,第二预设姿态可以为站立姿态,在检测到超过设定个数的顾客的姿态为站立姿态的情况下,通过检测这些顾客的注视方向确定出超过设定个数的顾客关注的第一目标物品陈列货架,可以确定出引发人流拥堵的原因是超过设定个数的顾客站立在第一目标物品陈列货架附近挑选货物造成的,此时可以根据视频帧识别出第一目标物品陈列货架的当前位置和人流拥堵发生的位置区域,进一步可以至少执行以下之一:生成对第一目标物品陈列货架进行移动的部署建议、按照当前位置和人流拥堵发生的位置区域调整第一目标物品陈列货架。Exemplarily, the second preset posture may be a standing posture, and in the case that the postures of the customers exceeding the set number are detected as standing postures, the attention of the customers exceeding the set number is determined by detecting the gaze directions of these customers. The first target item display shelf, it can be determined that the cause of the crowd congestion is caused by more than the set number of customers standing near the first target item display shelf and picking the goods. At this time, the first target item can be identified according to the video frame. The current position of the display shelf and the location area where the crowd congestion occurs may further perform at least one of the following: generating a deployment suggestion for moving the display shelf of the first target item, adjusting the first target item according to the current position and the location area where the crowd congestion occurs Display shelves.
示例性地,在按照当前位置和人流拥堵发生的位置区域调整第一目标物品陈列货架时,可以至少执行以下之一:对第一目标物品陈列货架进行平移、对第一目标物品陈列货架进行旋转,其中,平移的距离以从第一目标物品陈列货架从当前位置开始向远离人流拥堵的方向进行移动,根据人流拥堵所在位置区域的范围确定平移的距离,旋转可以对第一目标物品陈列货架的角度进行旋转,可以通过陈列货架的旋转来调整顾客挑选商品时所处的位置,并且,由于人流通常会沿着货架的方向移动,这样调整还可以有效调整人流的移动方向,因此,在对第一目标物品陈列货架进行旋转时,可以向远离人流拥堵的方向进行旋转,根据人流拥堵所在位置区域的范围确定旋转的角度。Exemplarily, when adjusting the first target item display rack according to the current position and the location area where the crowd congestion occurs, at least one of the following may be performed: translating the first target item display rack, and rotating the first target item display rack , wherein the translation distance is to move from the current position of the first target item display shelf to the direction away from the crowd congestion, the translation distance is determined according to the range of the location area where the crowd congestion is located, and the rotation can affect the first target item display shelf. The angle of rotation can be used to adjust the position of the customer when selecting the product through the rotation of the display shelf, and since the flow of people usually moves along the direction of the shelf, this adjustment can also effectively adjust the movement direction of the flow of people. When a target item display shelf is rotated, it can be rotated in a direction away from the crowd congestion, and the rotation angle is determined according to the range of the location area where the crowd congestion is located.
本申请实施例中,在第一目标物品陈列货架为可移动货架,且根据姿态数据检测到超过设定个数的行人为站立姿态的情况下,可以对该第一目标物品陈列货架的位置进行调整,可以有效改善因第一目标物品陈列货架处行人较多造成的对其它顾客的阻塞情况。In the embodiment of the present application, in the case where the first target item display rack is a movable rack, and more than a set number of pedestrians are detected to be standing according to the posture data, the position of the first target item display rack can be checked. The adjustment can effectively improve the blocking situation for other customers caused by more pedestrians at the display shelf of the first target item.
在另一种可能的实施方式中,针对上述S402,在确定存在第一目标物品陈列区域发生人流拥堵的情况下,基于行人统计数据,确定针对目标场所内至少部分物品陈列区域的部署时,如图6所示,可以包括以下S601和S602:In another possible implementation, for the above S402, when it is determined that there is a crowd congestion in the first target item display area, based on pedestrian statistics, when determining the deployment for at least part of the item display area in the target place, such as As shown in FIG. 6, the following S601 and S602 may be included:
S601,基于不同物品陈列区域分别对应的行人统计数据,确定行人数量小于第二设定数量的第二目标物品陈列区域;S601, based on pedestrian statistical data corresponding to different item display areas, determine a second target item display area where the number of pedestrians is less than a second set number;
S602,基于第二目标物品陈列区域,至少执行以下之一:生成指示将第一目标物品陈列区域陈列的部分物品调整至第二目标物品陈列区域的部署建议、将第一目标物品陈列区域的部分物品调整至第二目标物品陈列区域。S602, based on the second target item display area, at least one of the following is performed: generating a deployment suggestion instructing to adjust part of the items displayed in the first target item display area to the second target item display area; The item is adjusted to the second target item display area.
示例性地,第二设定数量可以根据物品陈列区域能够容纳的最多行人数量来确定,比如不同物品陈列区域能够容纳的最多行人数量为P,则该第二设定数量可以设置为P的f倍,其中f大于0且小于1,该第二设定数量表示行人数量较少,远远小于物品陈列区域能够容纳的最多行人数量。Exemplarily, the second set number can be determined according to the maximum number of pedestrians that can be accommodated in the item display area. For example, the maximum number of pedestrians that can be accommodated in different item display areas is P, then the second set quantity can be set as f of P. times, where f is greater than 0 and less than 1, the second set number indicates that the number of pedestrians is small, which is far less than the maximum number of pedestrians that can be accommodated in the item display area.
本申请实施例中,提出可以将发生人流拥堵的第一目标物品陈列区域陈列的部分物品调整至行人数量较少的第二目标物品陈列区域进行陈列,以有效改善第一目标物品陈列区域的拥堵情况。In the embodiment of the present application, it is proposed that some items displayed in the first target item display area with crowded traffic can be adjusted to be displayed in the second target item display area with fewer pedestrians, so as to effectively improve the congestion in the first target item display area. Happening.
在一种实施方式中,本申请实施例提供的信息处理方法还包括:In an implementation manner, the information processing method provided by the embodiment of the present application further includes:
基于不同物品陈列区域在至少一个时段分别对应的行人统计数据,以及预先设定的不同行人统计数据对应的渲染方式,生成并输出目标场所在预设时长内的行人热力图。Based on the pedestrian statistical data corresponding to different item display areas in at least one time period, and the preset rendering methods corresponding to different pedestrian statistical data, a pedestrian heat map of the target place within the preset time period is generated and output.
示例性地,预设时长包含多个时段,比如一个时段为1小时,可以生成并输出目标场所在12小时内的行人热力图。Exemplarily, the preset duration includes multiple time periods, for example, one time period is 1 hour, and a pedestrian heat map of the target place within 12 hours can be generated and output.
示例性地,为了更形象地掌握不同物品陈列区域在预设时长内对应的行人数量变化,可以按照预先设置的不同行人统计数据对应的渲染方式,生成行人热力图,比如可以将在一个时段内对应的行人统计数据大于M的区域标记为红色,将在该时段内对应的行人统计数据大于N,且小于或等于M的物品陈列区域标记为黄色,将在该时段内对应的行人统计数据大于0,且小于或等于N的物品陈列区域标记为绿色,将在该时段内的行人统计数据为0的物品陈列区域标记为白色,这样可以得到目标场所在预设时长内不同时段对应的行人热力图的变化情况。Exemplarily, in order to more vividly grasp the changes in the number of pedestrians corresponding to different item display areas within a preset time period, a pedestrian heat map can be generated according to the preset rendering methods corresponding to different pedestrian statistical data. The area with the corresponding pedestrian statistical data greater than M is marked in red, and the item display area with the corresponding pedestrian statistical data greater than N and less than or equal to M in this period is marked in yellow, and the corresponding pedestrian statistical data in this period is greater than or equal to M. 0, and the item display area less than or equal to N is marked as green, and the item display area with the pedestrian statistical data of 0 in this period is marked as white, so that the pedestrian heat corresponding to the target place at different time periods within the preset time period can be obtained. Changes in the graph.
如图7所示,为目标场所在一个时段内对应的行人热量图,可见,物品陈列区域A在该时段内包含的行人数量最多,物品陈列区域C在该时段内包含的行人数量最少。As shown in FIG. 7 , which is the pedestrian heat map corresponding to the target site in a period, it can be seen that the item display area A contains the largest number of pedestrians in this period, and the item display area C contains the least number of pedestrians in this period.
本申请实施例中,可以基于不同物品陈列区域在至少一个时段分别对应的行人统计数据,生成可以直观形象反应目标场所内各个物品陈列区域的人流数量变化的人流热量图,以便为目标场所内的物品陈列区域提供部署建议。In the embodiment of the present application, based on the pedestrian statistical data corresponding to different item display areas in at least one time period, a people flow heat map that can intuitively reflect the changes in the number of people in each item display area in the target place can be generated, so as to be the number of people in the target place. The item display area provides deployment suggestions.
在一种实施方式中,如图8所示,本申请实施例提供的信息处理方法还包括以下S701和S702:In an implementation manner, as shown in FIG. 8 , the information processing method provided by this embodiment of the present application further includes the following S701 and S702:
S701,基于不同物品陈列区域分别对应的行人统计数据,确定是否存在至少一个物品陈列区域达到预警条件;S701, based on the pedestrian statistical data corresponding to different item display areas, determine whether there is at least one item display area that meets the warning condition;
S702,在确定存在至少一个物品陈列区域达到预警条件的情况下,生成第一预警提示信息。S702, when it is determined that there is at least one article display area that meets the warning condition, generate first warning prompt information.
在一种可能的实施方式中,预警条件包括物品陈列区域的行人数量大于或等于第一预设阈值。In a possible implementation, the warning condition includes that the number of pedestrians in the item display area is greater than or equal to a first preset threshold.
示例性地,第一预设阈值可以根据实际需要进行设置,比如可以根据目标场所的类型,物品陈列区域在目标场所中的位置、统计时间段等来进行设置。Exemplarily, the first preset threshold may be set according to actual needs, for example, it may be set according to the type of the target place, the position of the item display area in the target place, the statistical time period, and the like.
在另一种可能的实施方式中,预警条件还包括如下至少一项:In another possible implementation, the warning condition further includes at least one of the following:
(1)物品陈列区域的行人数量与其它任一物品陈列区域的行人数量之间的差异大于第二预设阈值。(1) The difference between the number of pedestrians in the item display area and the number of pedestrians in any other item display area is greater than the second preset threshold.
(2)物品陈列区域与相邻的物品陈列区域之间的距离小于预设距离阈值;(2) The distance between the item display area and the adjacent item display area is less than the preset distance threshold;
(3)物品陈列区域位于目标场所中的预设交通枢纽区域。(3) The item display area is located in the preset transportation hub area in the target site.
针对第(1)项,第二预设阈值用于衡量目标场所中任意两个物品陈列区域包含的行人数量之间的最大差异,比如针对目标场所为同一店铺的情况,该店铺包含多个物品陈列区域,若存在一个物品陈列区域和其它任一物品陈列区域之间的行人数量差异过大,可以生成第一预警提示信息,便于及时查验该物品陈列区域存在的问题。For item (1), the second preset threshold is used to measure the maximum difference between the number of pedestrians contained in any two item display areas in the target site. For example, for the case where the target site is the same store, the store contains multiple items In the display area, if there is a large difference in the number of pedestrians between an item display area and any other item display area, a first warning prompt message can be generated to facilitate timely inspection of problems in the item display area.
针对第(2)项,考虑到客流量较大的时间段容易引发引流拥堵,因此需要相邻的物品陈列区域之间的距离满足一定条件,比如不能小于预设距离阈值,因此在检测到物品陈列区域与相邻的物品陈列区域之间的距离小于预设距离阈值的情况下,可以生成第一预警提示信息,便于及时进行调整。For item (2), considering that the time period with large passenger flow is easy to cause drainage congestion, the distance between adjacent item display areas needs to meet certain conditions, such as not less than the preset distance threshold, so when the item is detected When the distance between the display area and the adjacent item display area is smaller than the preset distance threshold, first warning prompt information may be generated, which facilitates timely adjustment.
针对第(3)项,可以预先规划目标场所的多条交通道路,存在一些区域为多条交通道路的交汇区域,即预设交通枢纽区域,在物品陈列区域位于预设交通枢纽区域的情况下,可以生成第一预警提示信息,便于及时对该物品陈列区域的位置进行调整,减少发生交通堵塞。For item (3), multiple traffic roads of the target site can be pre-planned, and there are some areas that are intersection areas of multiple traffic roads, that is, the preset traffic hub area. In the case where the item display area is located in the preset traffic hub area , the first warning prompt information can be generated, so that the position of the item display area can be adjusted in time, and the occurrence of traffic jams can be reduced.
在一种可能的实施方式中,可以对拥堵事件的持续时长进行检测,以及时输出第二告警信息,即首先,在确定存在第一目标物品陈列区域发生人流拥堵的情况下,获取第一目 标物品陈列区域发生人流拥堵的持续时长;然后,在持续时长达到预设时长阈值的情况下,生成第二预警提示信息。如此,对拥堵事件的持续时长进行检测,并在检测到拥堵事件的持续时长较长时,进行预警提示,能够提高目标场所的安全性。In a possible implementation, the duration of the congestion event can be detected, and the second alarm information can be output in time. That is, first, when it is determined that there is a crowd congestion in the display area of the first target item, the first target object is obtained. The duration of the crowd congestion in the item display area; then, when the duration reaches a preset duration threshold, a second warning prompt message is generated. In this way, the duration of the congestion event is detected, and when it is detected that the duration of the congestion event is long, an early warning prompt is provided, which can improve the safety of the target site.
本申请实施例中,通过设立不同的预警条件,以全面对目标场所的潜在危险进行预判,提高目标场所的安全性。In the embodiment of the present application, by setting up different early warning conditions, the potential danger of the target place is comprehensively predicted, and the safety of the target place is improved.
示例性地,上述生成的第一预警提示信息可以为文字、语音、视频等格式的信息,比如,生成的第一预警提示信息可以用于对行人进行提示,例如可以为“注意,您当前所在区域行人数量较多,请注意安全”。Exemplarily, the generated first warning prompt information may be information in the format of text, voice, video, etc. For example, the generated first early warning prompt information may be used to prompt pedestrians, for example, it may be "Attention, where are you currently? There are a lot of pedestrians in the area, please pay attention to safety.”
本申请实施例中,提出可以基于不同物品陈列区域分别对应的行人统计数据,检测是否存在潜在危险,并在确定存在潜在危险的情况下,生成预警提示,从而可以有效提高目标场所内的安全性。In the embodiment of the present application, it is proposed to detect whether there is a potential danger based on the pedestrian statistical data corresponding to different item display areas, and generate a warning prompt when it is determined that there is a potential danger, so as to effectively improve the safety in the target place .
在一种实施方式中,如图9所示,本申请实施例提供的信息处理方法还包括以下S801和S802:In an implementation manner, as shown in FIG. 9 , the information processing method provided by this embodiment of the present application further includes the following S801 and S802:
S801,针对未发生人流拥堵的第三目标物品陈列区域,获取第三目标物品陈列区域在多个时段分别对应的行人数量;S801, for a third target item display area where there is no crowd congestion, obtain the number of pedestrians corresponding to the third target item display area in multiple time periods;
S802,在确定第三目标物品陈列区域在多个时段分别对应的行人数量均小于第三预设阈值的情况下,生成针对第三目标物品陈列区域的部署建议。S802 , when it is determined that the number of pedestrians corresponding to the third target item display area in multiple time periods is less than a third preset threshold, generate a deployment suggestion for the third target item display area.
示例性地,第三预设阈值可以用于表示物品陈列区域包含的行人数量较少的情况,在确定第三目标物品陈列区域在未发生人流拥堵的情况下,若该第三目标物品陈列区域在长时间内包含的行人数量较少,说明该第三目标物品陈列区域可能在目标场所中的位置偏僻,或者陈列的物品的吸引力较低,可以考虑生成针对第三目标物品陈列区域的部署建议,比如将热门的货物摆放至店头区域以吸引顾客进店。Exemplarily, the third preset threshold may be used to indicate that the number of pedestrians contained in the item display area is small. When it is determined that the third target item display area is not crowded with people, if the third target item display area is The number of pedestrians contained in a long period of time is small, indicating that the third target item display area may be remote in the target site, or the displayed items are less attractive, and you can consider generating a deployment for the third target item display area Recommendations, such as placing popular items in the store front area to attract customers into the store.
本申请实施例中,在第三目标物品陈列区域不存在拥堵事件的情况下,若检测到该第三目标物品陈列区域的行人数量仍然较少,可以生成对该第三目标物品陈列区域的合理化部署建议,以便可以提高第三目标物品陈列区域的行人数量。In the embodiment of the present application, in the case where there is no congestion event in the third target item display area, if it is detected that the number of pedestrians in the third target item display area is still small, a rationalization of the third target item display area can be generated. Deploy recommendations so that the number of pedestrians in the display area of the third target item can be increased.
在一种实施方式中,如图10所示,本申请实施例提供的信息处理方法还包括以下S803和S804:In an implementation manner, as shown in FIG. 10 , the information processing method provided by this embodiment of the present application further includes the following S803 and S804:
S803,在确定第三目标物品陈列区域在至少一个时段对应的行人数量大于第三预设阈值的情况下,基于第三目标物品陈列区域中各子区域对应的轨迹数据,确定第三目标物品陈列区域中是否存在至少一个子区域在多个时段对应的行人数量均小于第四预设阈值;S803, when it is determined that the number of pedestrians corresponding to the third target item display area in at least one time period is greater than the third preset threshold, based on the trajectory data corresponding to each sub-area in the third target item display area, determine the third target item display area Whether there is at least one sub-area in the area where the number of pedestrians corresponding to multiple time periods is less than the fourth preset threshold;
S804,在确定至少一个子区域在多个时段对应的行人数量均小于第四预设阈值的情况下,生成针对第三目标物品陈列区域的部署建议。S804, when it is determined that the number of pedestrians corresponding to at least one sub-area in multiple time periods is less than a fourth preset threshold, generate a deployment suggestion for the third target item display area.
示例性地,第四预设阈值小于第三预设阈值,第三目标物品陈列区域可以包括多个子区域,如果该第三目标物品陈列区域存在包含的行人数量大于第三预设阈值的情况,说明该第三目标物品陈列区域可以吸引到顾客,但是存在至少一个子区域在长时间段包含的行人数量较少,说明该子区域可能在第三目标物品陈列区域中的位置偏僻,或者该子区域陈列的物品的吸引力较低,可以考虑生成针对该子区域陈列的物品进行调整的部署建议。Exemplarily, the fourth preset threshold is smaller than the third preset threshold, and the third target item display area may include multiple sub-areas. If the third target item display area contains a number of pedestrians that is greater than the third preset threshold, It shows that the third target item display area can attract customers, but there is at least one sub-area that contains a small number of pedestrians for a long period of time, indicating that the sub-area may be remote in the third target item display area, or the sub-area The items displayed in the area are less attractive, and you can consider generating deployment suggestions that are adjusted for the items displayed in the sub-area.
本申请实施例中,提出第三目标物品陈列区域存在一个时段的行人数量较多,但是存在至少一个子区域的行人数量始终较少,此时同样可以生成对该第三目标物品陈列区域的合理化部署建议,以便可以均衡第三目标物品陈列区域中各个子区域的行人数量。In the embodiment of the present application, it is proposed that the third target item display area has a large number of pedestrians in one period, but the number of pedestrians in at least one sub-area is always small. At this time, a rationalization of the third target item display area can also be generated. Recommendations are deployed so that the number of pedestrians in each sub-area in the third target item display area can be balanced.
本领域技术人员可以理解,在具体实施方式的上述方法中,各步骤的撰写顺序并不意味着严格的执行顺序而对实施过程构成任何限定,各步骤的执行顺序应当以其功能和可能的内在逻辑确定。Those skilled in the art can understand that, in the above-mentioned method of the specific embodiment, the writing order of each step does not mean a strict execution order but constitutes any limitation on the implementation process, and the execution order of each step should be based on its function and possible intrinsic Logical OK.
基于同一技术构思,本申请实施例中还提供了与信息处理方法对应的信息处理装置,由于本申请实施例中的装置解决问题的原理与本申请实施例上述信息处理方法相似,因此 装置的实施可以参见方法的实施,重复之处不再赘述。Based on the same technical concept, the embodiment of the present application also provides an information processing device corresponding to the information processing method. Reference may be made to the implementation of the method, and repeated descriptions will not be repeated.
参照图11所示,为本申请实施例提供的一种信息处理装置900的示意图,该信息处理装置包括:Referring to FIG. 11, which is a schematic diagram of an information processing apparatus 900 provided by an embodiment of the present application, the information processing apparatus includes:
第一确定模块901,配置为基于对目标场所采集的视频流,确定视频流中的行人在目标场所中的轨迹数据;The first determining module 901 is configured to determine the trajectory data of pedestrians in the target place in the video stream based on the video stream collected from the target place;
第二确定模块902,配置为基于视频流中的行人在目标场所中的轨迹数据,以及目标场所内不同物品陈列区域的位置范围,确定不同物品陈列区域分别对应的行人统计数据;The second determination module 902 is configured to determine pedestrian statistics corresponding to different item display areas respectively based on the trajectory data of pedestrians in the video stream in the target site and the position ranges of different item display areas in the target site;
处理模块903,配置为基于行人统计数据,确定针对所述目标场所内至少部分物品陈列区域的部署。The processing module 903 is configured to determine, based on the statistical data of pedestrians, the deployment for at least part of the item display area in the target place.
在一种可能的实施方式中,处理模块903,还配置为基于行人统计数据,生成针对目标场所内至少部分物品陈列区域的部署建议;In a possible implementation manner, the processing module 903 is further configured to generate deployment suggestions for at least part of the item display areas in the target place based on the pedestrian statistical data;
配置为基于行人统计数据,调整目标场所内至少部分物品陈列区域的部署。is configured to adjust the deployment of at least a portion of the item display area within the target venue based on pedestrian statistics.
在一种可能的实施方式中,处理模块903在配置为基于行人统计数据,确定针对所述目标场所内至少部分物品陈列区域的部署时,包括:In a possible implementation manner, when the processing module 903 is configured to determine the deployment for at least part of the item display area in the target place based on pedestrian statistics, the process includes:
基于不同物品陈列区域分别对应的行人统计数据和目标场所中的轨迹数据,确定是否存在第一目标物品陈列区域发生人流拥堵;Based on the pedestrian statistics data corresponding to different item display areas and the trajectory data in the target place, determine whether there is a crowd congestion in the first target item display area;
在确定存在第一目标物品陈列区域发生人流拥堵的情况下,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署。When it is determined that the first target item display area is crowded with people, at least one of the following is performed: generating a deployment suggestion for the first target item display area, and adjusting the deployment of the first target item display area.
在一种可能的实施方式中,处理模块903在配置为在确定存在第一目标物品陈列区域发生人流拥堵的情况下,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署时,包括:In a possible implementation manner, the processing module 903 is configured to perform at least one of the following when it is determined that there is a congestion of people in the display area of the first target item: generating a deployment suggestion for the display area of the first target item, adjusting The deployment of the first target item display area includes:
从视频流中提取与第一目标物品陈列区域关联的视频帧;extracting video frames associated with the display area of the first target item from the video stream;
确定提取的视频帧中的行人在第一目标物品陈列区域的姿态数据;Determine the posture data of the pedestrian in the extracted video frame in the display area of the first target item;
基于姿态数据,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署。Based on the gesture data, at least one of the following is performed: generating a deployment suggestion for the first target item display area, and adjusting the deployment of the first target item display area.
在一种可能的实施方式中,第一目标物品陈列区域包含至少一个物品陈列货架,每个物品陈列货架包含多层,处理模块903在配置为基于姿态数据,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署时,包括:In a possible implementation, the first target article display area includes at least one article display shelf, and each article display shelf includes multiple layers, and the processing module 903 is configured to perform at least one of the following based on the gesture data: The deployment suggestion of a target item display area, and when adjusting the deployment of the first target item display area, include:
基于姿态数据,在确定视频帧中存在超过设定个数的行人的姿态符合第一预设姿态的情况下,获取与超过设定个数的行人的注视方向匹配的第一目标物品陈列货架的第一目标层;Based on the gesture data, in the case where it is determined that there are more than a set number of pedestrians in the video frame whose gestures conform to the first preset attitude, obtain the first target item display shelf that matches the gaze direction of the more than set number of pedestrians the first target layer;
基于第一目标层,至少执行以下之一:生成指示将第一目标层陈列的物品调整至第一目标物品陈列货架的第二目标层进行陈列的部署建议、将第一目标层陈列的物品调整至第二目标层,第二目标层距离地面的高度高于第一目标层距离地面的高度。Based on the first target layer, at least one of the following is performed: generating a deployment suggestion instructing to adjust the items displayed on the first target layer to the second target layer of the first target item display shelf for display, adjusting the items displayed on the first target layer To the second target layer, the height of the second target layer from the ground is higher than the height of the first target layer from the ground.
在一种可能的实施方式中,物品陈列货架包含多个,处理模块903还配置为:In a possible implementation manner, the item display shelves include a plurality of shelves, and the processing module 903 is further configured to:
基于提取的视频帧中的行人在第一目标物品陈列区域中的轨迹数据,确定经过的行人数量小于第一设定数量的第二目标物品陈列货架;Based on the trajectory data of the pedestrians in the extracted video frame in the display area of the first target item, determine that the number of passing pedestrians is less than the first set quantity of the second target item display shelf;
基于第二目标物品陈列货架,至少执行以下之一:生成指示将第一目标层陈列的部分物品调整至第二目标物品陈列货架的部署建议、将第一目标层陈列的部分物品调整至第二目标物品陈列货架。Based on the second target item display rack, at least one of the following is performed: generating a deployment proposal instructing to adjust some items displayed on the first target layer to the second target item display rack, adjusting some items displayed on the first target layer to the second target item display rack Target item display shelf.
在一种可能的实施方式中,第一目标物品陈列货架为可移动货架,处理模块903在配置为基于姿态数据,至少执行以下之一:生成针对第一目标物品陈列区域的部署建议、调整第一目标物品陈列区域的部署时,还包括:In a possible implementation manner, the first target item display shelf is a movable shelf, and the processing module 903 is configured to perform at least one of the following based on the gesture data: generate a deployment suggestion for the first target item display area, adjust the first target item display area When deploying a target item display area, it also includes:
基于姿态数据,在确定视频帧中存在超过设定个数的行人的姿态符合第二预设姿态的情况下,获取与超过设定个数的行人的注视方向匹配的第一目标物品陈列货架的当前位置 和人流拥堵发生的位置区域;Based on the gesture data, in the case where it is determined that there are more than a set number of pedestrians in the video frame whose gestures conform to the second preset attitude, obtain the first target item display shelf that matches the gaze direction of the more than set number of pedestrians The current location and the location area where crowd congestion occurs;
基于当前位置和人流拥堵发生的位置区域,至少执行以下之一:生成针对第一目标物品陈列货架进行移动的部署建议、按照当前位置和人流拥堵发生的位置区域调整第一目标物品陈列货架。Based on the current location and the location area where crowd congestion occurs, at least one of the following is performed: generating a deployment suggestion for moving the first target item display rack, and adjusting the first target item display rack according to the current location and the location area where crowd congestion occurs.
在一种可能的实施方式中,处理模块903在配置为在确定存在第一目标物品陈列区域发生人流拥堵的情况下,基于行人统计数据,确定针对目标场所内至少部分物品陈列区域的部署时,包括:In a possible implementation manner, when the processing module 903 is configured to, when it is determined that there is a crowd congestion in the first target item display area, based on pedestrian statistics, when determining the deployment for at least part of the item display area in the target place, include:
基于不同物品陈列区域分别对应的行人统计数据,确定行人数量小于第二设定数量的第二目标物品陈列区域;Based on the pedestrian statistical data corresponding to different item display areas, determine a second target item display area where the number of pedestrians is less than the second set number;
基于第二目标物品陈列区域,至少执行以下之一:生成指示将第一目标物品陈列区域陈列的部分物品调整至第二目标物品陈列区域的部署建议、将第一目标物品陈列区域的部分物品调整至第二目标物品陈列区域。Based on the second target item display area, at least one of the following is performed: generating a deployment suggestion instructing to adjust some items displayed in the first target item display area to the second target item display area, adjusting some items in the first target item display area to the second target item display area.
在一种可能的实施方式中,第一确定模块901在配置为基于对目标场所采集的视频流,确定视频流中的行人在目标场所中的轨迹数据时,包括:In a possible implementation manner, when the first determining module 901 is configured to determine the trajectory data of pedestrians in the video stream in the target place based on the video stream collected from the target place, the method includes:
对视频流中的视频帧进行行人检测,得到同一行人在关联的视频帧中的位置指示信息;Perform pedestrian detection on the video frames in the video stream to obtain the position indication information of the same pedestrian in the associated video frame;
基于同一行人在关联视频帧中的位置指示信息,确定同一行人在目标场所中的轨迹数据。Based on the position indication information of the same pedestrian in the associated video frame, the trajectory data of the same pedestrian in the target place is determined.
在一种可能的实施方式中,同一行人在关联的视频帧中的位置指示信息包括同一行人在关联的视频帧中与预设特征点的相对位置信息;第一确定模块901在配置为基于同一行人在关联视频帧中的位置指示信息,确定同一行人目标场所中的轨迹数据时,包括:In a possible implementation manner, the position indication information of the same pedestrian in the associated video frame includes the relative position information of the same pedestrian in the associated video frame and the preset feature point; the first determining module 901 is configured to be based on the same Pedestrian position indication information in the associated video frame, when determining the trajectory data in the same pedestrian target location, including:
提取同一行人关联的视频帧中的预设特征点;Extract preset feature points in video frames associated with the same pedestrian;
基于预设特征点在目标场所中的预设位置信息,以及同一行人与预设特征点的相对位置信息,确定同一行人在目标场所中的轨迹数据。Based on the preset position information of the preset feature point in the target place and the relative position information of the same pedestrian and the preset feature point, the trajectory data of the same pedestrian in the target place is determined.
在一种可能的实施方式中,第一确定模块901配置为按照以下方式确定同一行人关联的视频帧:In a possible implementation manner, the first determining module 901 is configured to determine video frames associated with the same pedestrian in the following manner:
对视频流中的视频帧进行头肩检测,获取视频帧中包含的行人头肩特征信息;Perform head and shoulder detection on the video frame in the video stream to obtain the pedestrian head and shoulder feature information contained in the video frame;
基于不同视频帧分别包含的行人头肩特征信息,确定不同视频帧中包含的行人之间的特征相似度;Determine the feature similarity between pedestrians contained in different video frames based on the pedestrian head and shoulder feature information contained in different video frames;
将特征相似度高于预设相似度阈值的视频帧,作为同一行人关联的视频帧。The video frames whose feature similarity is higher than the preset similarity threshold are regarded as the video frames associated with the same pedestrian.
在一种可能的实施方式中,处理模块903还配置为:In a possible implementation manner, the processing module 903 is further configured to:
基于不同物品陈列区域在至少一个时段分别对应的行人统计数据,以及预先设定的不同行人统计数据对应的渲染方式,生成并输出目标场所在预设时长内的行人热力图。Based on the pedestrian statistical data corresponding to different item display areas in at least one time period, and the preset rendering methods corresponding to different pedestrian statistical data, a pedestrian heat map of the target place within the preset time period is generated and output.
在一种可能的实施方式中,处理模块903还配置为:In a possible implementation manner, the processing module 903 is further configured to:
基于不同物品陈列区域分别对应的行人统计数据,确定是否存在至少一个物品陈列区域达到预警条件;Based on the pedestrian statistics corresponding to different item display areas, determine whether there is at least one item display area that meets the warning condition;
在确定存在至少一个物品陈列区域达到预警条件的情况下,生成第一预警提示信息。When it is determined that there is at least one item display area that meets the warning condition, first warning prompt information is generated.
在一种可能的实施方式中,预警条件包括物品陈列区域的行人数量大于或等于第一预设阈值。In a possible implementation, the warning condition includes that the number of pedestrians in the item display area is greater than or equal to a first preset threshold.
在一种可能的实施方式中,预警条件还包括如下至少一项:In a possible implementation, the warning condition further includes at least one of the following:
物品陈列区域的行人数量与其它任一物品陈列区域的行人数量之间的差异大于第二预设阈值;The difference between the number of pedestrians in the item display area and the number of pedestrians in any other item display area is greater than the second preset threshold;
物品陈列区域与相邻的物品陈列区域之间的距离小于预设距离阈值;The distance between the item display area and the adjacent item display area is less than the preset distance threshold;
物品陈列区域位于目标场所中的预设交通枢纽区域。The item display area is located in a preset traffic hub area in the target site.
在一种可能的实施方式中,处理模块903还配置为:In a possible implementation manner, the processing module 903 is further configured to:
在确定存在第一目标物品陈列区域发生人流拥堵的情况下,获取第一目标物品陈列区 域发生人流拥堵的持续时长;When it is determined that there is a crowd congestion in the display area of the first target item, obtain the duration of the crowd congestion in the display area of the first target item;
在持续时长达到预设时长阈值的情况下,生成第二预警提示信息。When the duration reaches the preset duration threshold, second warning prompt information is generated.
在一种可能的实施方式中,处理模块903还配置为:In a possible implementation manner, the processing module 903 is further configured to:
针对未发生人流拥堵的第三目标物品陈列区域,获取第三目标物品陈列区域在多个时段分别对应的行人数量;For the third target item display area where there is no crowd congestion, obtain the number of pedestrians corresponding to the third target item display area in multiple time periods;
在确定第三目标物品陈列区域在多个时段分别对应的行人数量均小于第三预设阈值的情况下,生成针对第三目标物品陈列区域的部署建议。When it is determined that the number of pedestrians corresponding to the third target item display area in multiple time periods is all smaller than the third preset threshold, a deployment suggestion for the third target item display area is generated.
在一种可能的实施方式中,处理模块903还配置为:In a possible implementation manner, the processing module 903 is further configured to:
在确定第三目标物品陈列区域在至少一个时段对应的行人数量大于第三预设阈值的情况下,基于第三目标物品陈列区域中各子区域对应的轨迹数据,确定第三目标物品陈列区域中是否存在至少一个子区域在多个时段对应的行人数量均小于第四预设阈值;In the case where it is determined that the number of pedestrians corresponding to the third target item display area in at least one time period is greater than the third preset threshold, determine the number of pedestrians in the third target item display area based on the trajectory data corresponding to each sub-area in the third target item display area Whether there is at least one sub-area in which the number of pedestrians corresponding to multiple time periods is less than the fourth preset threshold;
在确定至少一个子区域在多个时段对应的行人数量均小于第四预设阈值的情况下,生成针对第三目标物品陈列区域的部署建议。When it is determined that the number of pedestrians corresponding to at least one sub-area in multiple time periods is less than the fourth preset threshold, a deployment suggestion for the third target item display area is generated.
关于装置中的各模块的处理流程、以及各模块之间的交互流程的描述可以参照上述方法实施例中的相关说明,这里不再详述。For the description of the processing flow of each module in the apparatus and the interaction flow between the modules, reference may be made to the relevant descriptions in the foregoing method embodiments, which will not be described in detail here.
对应于图1中的信息处理方法,本申请实施例还提供了一种电子设备1000,如图12所示,为本申请实施例提供的电子设备1000结构示意图,包括:Corresponding to the information processing method in FIG. 1 , the embodiment of the present application further provides an electronic device 1000 . As shown in FIG. 12 , the schematic structural diagram of the electronic device 1000 provided by the embodiment of the present application includes:
处理器101、存储器102、和总线103;存储器102配置为存储执行指令,包括内存1021和外部存储器1022;这里的内存1021也称内存储器,配置为暂时存放处理器101中的运算数据,以及与硬盘等外部存储器1022交换的数据,处理器101通过内存1021与外部存储器1022进行数据交换,当电子设备1000运行时,处理器101与存储器102之间通过总线103通信,使得处理器101执行以下指令:基于对目标场所采集的视频流,确定视频流中的行人在目标场所中的轨迹数据;基于视频流中的行人在目标场所中的轨迹数据,以及目标场所内不同物品陈列区域的位置范围,确定不同物品陈列区域分别对应的行人统计数据;基于行人统计数据,至少执行以下之一:生成针对目标场所内至少部分物品陈列区域的部署建议、调整目标场所内至少部分物品陈列区域的部署。The processor 101, the memory 102, and the bus 103; the memory 102 is configured to store execution instructions, including the memory 1021 and the external memory 1022; the memory 1021 here is also called internal memory, and is configured to temporarily store the operation data in the processor 101, and For the data exchanged by the external memory 1022 such as the hard disk, the processor 101 exchanges data with the external memory 1022 through the memory 1021. When the electronic device 1000 is running, the processor 101 and the memory 102 communicate through the bus 103, so that the processor 101 executes the following instructions : Based on the video stream collected from the target place, determine the trajectory data of pedestrians in the video stream in the target place; Determine the pedestrian statistics corresponding to different item display areas; based on the pedestrian statistics, perform at least one of the following: generate deployment suggestions for at least part of the item display areas in the target site, and adjust the deployment of at least some item display areas in the target site.
本申请实施例还提供一种计算机可读存储介质,该计算机可读存储介质上存储有计算机程序,该计算机程序被处理器运行时执行上述方法实施例中的信息处理方法的步骤。其中,该存储介质可以是易失性或非易失的计算机可读取存储介质。Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is run by a processor, the steps of the information processing method in the foregoing method embodiments are executed. Wherein, the storage medium may be a volatile or non-volatile computer-readable storage medium.
本申请实施例还提供一种计算机程序产品,该计算机程序产品承载有程序代码,所述程序代码包括的指令可配置为执行上述方法实施例中所述的信息处理方法的步骤,可参见上述方法实施例。Embodiments of the present application further provide a computer program product, where the computer program product carries program codes, and the instructions included in the program codes can be configured to execute the steps of the information processing methods described in the foregoing method embodiments, and reference may be made to the foregoing methods. Example.
其中,上述计算机程序产品例如可以通过硬件、软件或其结合的方式实现。在一个可选实施例中,所述计算机程序产品例如体现为计算机存储介质,在另一个可选实施例中,计算机程序产品例如体现为软件产品,例如软件开发包(Software Development Kit,SDK)等等。Wherein, the above-mentioned computer program product can be realized by means of hardware, software or a combination thereof, for example. In an optional embodiment, the computer program product is embodied as a computer storage medium, for example, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的***和装置的工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。在本申请所提供的几个实施例中,应该理解到,所揭露的***、装置和方法,可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,又例如,多个单元或组件可以结合或者可以集成到另一个***,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些通信接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the working process of the system and device described above, reference may be made to the corresponding process in the foregoing method embodiments, and details are not repeated here. In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. The apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces, indirect coupling or communication connection of devices or units, which may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的 部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个处理器可执行的非易失的计算机可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The functions, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a processor-executable non-volatile computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that make contributions to the prior art or the parts of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes .
最后应说明的是:以上所述实施例,仅为本申请实施例的实施方式,用以说明本申请实施例的技术方案,而非对其限制,本申请实施例的保护范围并不局限于此,尽管参照前述实施例对本申请实施例进行了详细的说明,本领域的普通技术人员应当理解:任何熟悉本技术领域的技术人员在本申请实施例揭露的技术范围内,其依然可以对前述实施例所记载的技术方案进行修改或可轻易想到变化,或者对其中部分技术特征进行等同替换;而这些修改、变化或者替换,并不使相应技术方案的本质脱离本申请实施例技术方案的精神和范围,都应涵盖在本申请实施例的保护范围之内。因此,本申请实施例的保护范围应所述以权利要求的保护范围为准。Lastly, it should be noted that the above-mentioned embodiments are only implementations of the embodiments of the present application, and are used to illustrate the technical solutions of the embodiments of the present application, but not to limit them, and the protection scope of the embodiments of the present application is not limited to Therefore, although the embodiments of the present application have been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that any person skilled in the art who is familiar with the technical field within the technical scope disclosed in the embodiments of the present application can still The technical solutions recorded in the embodiments are modified or easily thought of to change, or equivalent replacements are made to some of the technical features; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit of the technical solutions in the embodiments of the present application and scope, all should be covered within the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application should be based on the protection scope of the claims.
工业实用性Industrial Applicability
本申请实施例公开了一种信息处理方法、装置、电子设备及存储介质,其中,信息处理方法包括:基于对目标场所采集的视频流,确定视频流中的行人在所述目标场所中的轨迹数据;基于视频流中的行人在所述目标场所中的轨迹数据,以及目标场所内不同物品陈列区域的位置范围,确定不同物品陈列区域分别对应的行人统计数据;基于行人统计数据,确定针对所述目标场所内至少部分物品陈列区域的部署。The embodiments of the present application disclose an information processing method, device, electronic device, and storage medium, wherein the information processing method includes: determining the trajectory of pedestrians in the video stream in the target place based on a video stream collected from a target place data; based on the trajectory data of pedestrians in the video stream in the target site, and the location ranges of different item display areas in the target site, determine the pedestrian statistics corresponding to different item display areas; Describe the deployment of at least part of the item display area in the target site.