CN112070623A - Thermal analysis method, device and system - Google Patents
Thermal analysis method, device and system Download PDFInfo
- Publication number
- CN112070623A CN112070623A CN201910427547.2A CN201910427547A CN112070623A CN 112070623 A CN112070623 A CN 112070623A CN 201910427547 A CN201910427547 A CN 201910427547A CN 112070623 A CN112070623 A CN 112070623A
- Authority
- CN
- China
- Prior art keywords
- area
- thermal
- layout
- thermal distribution
- map
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000002076 thermal analysis method Methods 0.000 title claims abstract description 44
- 238000009826 distribution Methods 0.000 claims abstract description 210
- 238000010586 diagram Methods 0.000 claims abstract description 70
- 238000000034 method Methods 0.000 claims abstract description 45
- 238000012545 processing Methods 0.000 claims abstract description 9
- 238000012360 testing method Methods 0.000 claims description 26
- 238000012544 monitoring process Methods 0.000 claims description 14
- 230000002159 abnormal effect Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 10
- 238000003860 storage Methods 0.000 claims description 10
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 8
- 238000013507 mapping Methods 0.000 claims description 8
- 238000010276 construction Methods 0.000 claims description 3
- 238000005260 corrosion Methods 0.000 claims description 3
- 230000007797 corrosion Effects 0.000 claims description 3
- 238000013461 design Methods 0.000 claims description 3
- 238000009432 framing Methods 0.000 claims 2
- 238000012932 thermodynamic analysis Methods 0.000 abstract description 19
- 230000006870 function Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000011960 computer-aided design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
- G06F30/18—Network design, e.g. design based on topological or interconnect aspects of utility systems, piping, heating ventilation air conditioning [HVAC] or cabling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Engineering & Computer Science (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- Tourism & Hospitality (AREA)
- Evolutionary Computation (AREA)
- Multimedia (AREA)
- Human Resources & Organizations (AREA)
- Water Supply & Treatment (AREA)
- General Business, Economics & Management (AREA)
- Public Health (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Image Analysis (AREA)
Abstract
The disclosure provides a thermal analysis method, a thermal analysis device and a thermal analysis system, and relates to the technical field of image processing. The disclosed thermodynamic analysis method includes: determining a thermal distribution legal area and a thermal distribution illegal area in a layout diagram of a target area; acquiring an initial thermal distribution map of a target area; and according to the initial thermal distribution diagram, moving the thermal value of the illegal region of thermal distribution in the layout diagram to the corresponding position of the legal region of thermal distribution in the layout diagram, and acquiring an updated thermal distribution diagram. By the method, a thermal distribution legal area and a thermal distribution illegal area can be obtained on the basis of the target area layout diagram, and the acquired initial thermal distribution diagram is corrected, so that the thermal distribution diagram is rationalized, and the accuracy and the reliability of thermal analysis are improved.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to a method, an apparatus, and a system for thermal analysis.
Background
In the internet era, data is the basis of all applications, and online users can make intelligent decision optimization according to data of browsing history paths, page dwell time, searching behaviors, clicking times, shopping cart adding behaviors, attention, collection, transaction and the like of the users.
Aiming at the offline scene, thermodynamic diagram data can be collected to be used as an important basis for analyzing the popularity of a browsing area of a customer and hot shelf screening, and shelf adjustment and commodity display optimization can be carried out according to the thermodynamic data, so that the intelligent decision of stores is facilitated.
Disclosure of Invention
It is an object of the present disclosure to improve the accuracy of a thermodynamic analysis.
According to an aspect of the present disclosure, there is provided a method of thermal analysis, comprising: determining a thermal distribution legal area and a thermal distribution illegal area in a layout diagram of a target area; acquiring an initial thermal distribution map of a target area; and according to the initial thermal distribution diagram, moving the thermal value of the illegal region of thermal distribution in the layout diagram to the corresponding position of the legal region of thermal distribution in the layout diagram, and acquiring an updated thermal distribution diagram.
In some embodiments, the thermodynamic analysis method further comprises one or more of: adjusting the distribution of the articles in the target area according to the updated thermodynamic distribution map; or, adjusting the inventory of the target area according to the updated thermal distribution map.
In some embodiments, the method of thermodynamic analysis further comprises: testing and adjusting the distribution of the articles in the target area according to the updated thermal distribution diagram, and acquiring the adjusted updated thermal distribution diagram; under the condition that the change proportion of the updated thermal distribution map before and after the test exceeds a preset threshold, adjusting the stock quantity of the articles in the target area according to the updated thermal distribution map; and under the condition that the change proportion of the updated thermodynamic distribution map before and after the test does not exceed a preset threshold, adjusting the distribution of the articles in the target area according to the requirement.
In some embodiments, determining the thermal distribution legal area and the thermal distribution illegal area in the layout of the target area includes: obtaining a layout of a target area; determining regions allowing a person to pass through and regions not allowing a person to pass through in the layout; the area allowing the person to pass through is set as a legal heat distribution area, and the area not allowing the person to pass through is set as an illegal heat distribution area.
In some embodiments, determining regions in the layout that allow passage of a person and regions that do not allow passage of a person includes: filling the binary layout map with overflowing water and reversing to obtain an overflowing water reversal map; acquiring an article frame selection layout according to the flood reversal map and the binary layout; and determining the areas allowing the people to pass through and the areas not allowing the people to pass through according to the article frame selection layout.
In some embodiments, determining in the map the regions that allow passage of the person and the regions that do not allow passage of the person further comprises: performing expansion operation on the object frame selection layout; performing corrosion operation on the expanded article frame selection layout to obtain an updated article frame selection layout; determining the areas allowing the person to pass through and the areas not allowing the person to pass through according to the item frame selection layout comprises the following steps: and according to the updated article frame layout, determining that the area surrounded by the area where the articles are placed and the area where the articles are placed is an area where people are not allowed to pass, and determining that the area not where the articles are placed and surrounded by the area where the articles are not placed is an area where people are allowed to pass.
In some embodiments, determining in the map the regions that allow passage of the person and the regions that do not allow passage of the person further comprises: performing binarization processing on the layout, wherein the background color of the binarized layout is a first preset color, and the non-background color part is a second preset color; filling and inverting for flood includes: filling the water with a second preset color; modifying the first predetermined color portion to a second predetermined color, the second predetermined color portion to the first predetermined color; the step of obtaining the article frame selection layout according to the flooding reversal map and the binary layout comprises the following steps: at least one of the flooding reversal diagram and the binary layout diagram is a position with a second preset color, the article frame selection layout diagram is a second preset color, and at the position with the first preset color, the article frame selection layout diagram is a first preset color; determining the areas allowing the person to pass through and the areas not allowing the person to pass through according to the item frame selection layout comprises the following steps: the second predetermined color region is a region that does not allow a person to pass through, and the first predetermined color region is a region that allows a person to pass through.
In some embodiments, moving the thermal value of the illegal region of thermal distribution in the layout to the corresponding position of the legal region of thermal distribution in the layout comprises: determining the position, which is not 0, of the thermal value of the illegal area of the thermal distribution in the initial thermal distribution map as an abnormal position; determining the nearest legal position corresponding to each abnormal position, wherein the nearest legal position is located in a thermal distribution legal area; and accumulating the thermal value of each abnormal position at the corresponding nearest legal position.
In some embodiments, obtaining an initial thermodynamic profile of the target region comprises: acquiring a monitoring video of a target area through image acquisition equipment; detecting the positions of pedestrians in each frame of image of the monitoring video through a pedestrian detection and identification algorithm; an initial thermodynamic profile of the target zone is determined based on the number of people remaining at each location for more than a predetermined period of time and the length of time of the stay.
In some embodiments, obtaining the initial thermodynamic profile of the target region further comprises: and mapping each detection area to the plane of the same target area according to the position relation of the detection areas of the plurality of image acquisition devices.
In some embodiments, the layout of the target area includes a plan view, a construction view, or a scene view of the target area recovered based on the scanning.
By the method, a thermal distribution legal area and a thermal distribution illegal area can be obtained on the basis of the target area layout diagram, and the acquired initial thermal distribution diagram is corrected, so that the thermal distribution diagram is rationalized, and the accuracy of thermal analysis is improved.
According to an aspect of other embodiments of the present disclosure, there is provided a thermal analysis apparatus including: an area determination unit configured to determine a thermal distribution legal area and a thermal distribution illegal area in a layout diagram of a target area; an initial thermal distribution acquisition unit configured to acquire an initial thermal distribution map of a target area; and the thermal distribution acquisition unit is configured to move the thermal value of the illegal region of the thermal distribution in the layout to the corresponding position of the legal region of the thermal distribution in the layout according to the initial thermal distribution map to acquire an updated thermal distribution map.
In some embodiments, the thermodynamic analysis device further comprises a thermodynamic distribution application unit configured to perform one or more of: adjusting the distribution of the articles in the target area according to the updated thermodynamic distribution map; or, adjusting the inventory of the target area according to the updated thermal distribution map.
In some embodiments, the thermal analysis device further comprises: the testing unit is configured to test and adjust the distribution of the articles in the target area according to the updated thermal distribution diagram and obtain the adjusted updated thermal distribution diagram; a thermal distribution application unit configured to adjust the stock quantity of the articles in the target area according to the updated thermal distribution map in a case where a change ratio of the updated thermal distribution map before and after the test exceeds a predetermined threshold; and under the condition that the change proportion of the updated thermodynamic distribution map before and after the test does not exceed a preset threshold, adjusting the distribution of the articles in the target area according to the requirement.
According to an aspect of still further embodiments of the present disclosure, there is provided a thermal analysis apparatus including: a memory; and a processor coupled to the memory, the processor configured to perform any of the above thermal analysis methods based on instructions stored in the memory.
The thermal analysis device can obtain a thermal distribution legal area and a thermal distribution illegal area on the basis of the target area layout diagram, and further corrects the acquired initial thermal distribution diagram, so that the thermal distribution diagram is rationalized, and the accuracy of thermal analysis is improved.
According to an aspect of still further embodiments of the present disclosure, a computer-readable storage medium is provided, having stored thereon computer program instructions, which when executed by a processor, implement the steps of any of the above methods of thermal analysis.
By executing the instructions on the computer-readable storage medium, a thermal distribution legal area and a thermal distribution illegal area can be obtained on the basis of the target area layout, and the acquired initial thermal distribution map is corrected, so that the thermal distribution map is rationalized, and the accuracy of thermal analysis is improved.
Further, according to an aspect of some embodiments of the present disclosure, there is provided a thermal analysis system including: any one of the above thermal analysis devices; and the image acquisition equipment is configured to monitor the target area and acquire the monitoring video.
The thermal analysis system can acquire the monitoring video and obtain an initial thermal distribution map, obtain a thermal distribution legal area and a thermal distribution illegal area on the basis of a target area layout map, and further correct the acquired initial thermal distribution map, so that the thermal distribution map is rationalized, and the accuracy of thermal analysis is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this disclosure, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure and not to limit the disclosure. In the drawings:
fig. 1 is a flow chart of some embodiments of a thermodynamic analysis method of the present disclosure.
Fig. 2 is a flow chart of further embodiments of the thermodynamic analysis method of the present disclosure.
Fig. 3 is a flow chart of some embodiments of determining a legal area of thermal distribution and an illegal area of thermal distribution in the thermal analysis method of the present disclosure.
Fig. 4A-4E are schematic diagrams of some embodiments of determining a legal area of thermal distribution and an illegal area of thermal distribution in the thermal analysis method of the present disclosure.
Fig. 4F is an effect graph of some embodiments of the thermodynamic analysis method of the present disclosure.
Fig. 5 is a flow chart of further embodiments of the thermodynamic analysis method of the present disclosure.
Fig. 6 is a schematic diagram of some embodiments of a thermal analysis device of the present disclosure.
Fig. 7 is a schematic view of further embodiments of a thermal analysis device of the present disclosure.
Fig. 8 is a schematic diagram of further embodiments of a thermal analysis device of the present disclosure.
Fig. 9 is a schematic diagram of some embodiments of a thermodynamic analysis system of the present disclosure.
Detailed Description
The technical solution of the present disclosure is further described in detail by the accompanying drawings and examples.
Under the online retail scene, people group portrayal of store entering and people moving of the offline store is drawn through an AI (Artificial Intelligence) algorithm, the track of the customers is tracked, and data of the distribution of the people heating power area are collected and analyzed. The basic data support is carried out on decisions such as product selection, address selection, pricing, sales promotion and the like of the shop through the data acquired by the algorithm. The quality of these collected data is critical to store systems that make intelligent decisions based on the data.
When the coordinate mapping is carried out on the global thermodynamic diagram of the shop of the online off-store during the thermodynamic diagram coordinate mapping, the coordinate points reported by the computer vision algorithm can be directly mapped to the global diagram of the shop for drawing. However, due to the influence caused by visual errors or operation errors in the pedestrian detection algorithm, reported coordinate points cannot be correctly mapped in a reasonable area at some time, and many thermodynamic coordinates are mapped to containers, shelves and exhibition stands, so that the presentation effect and the reliability of the thermodynamic diagram are greatly reduced.
A flow chart of some embodiments of the thermodynamic analysis method of the present disclosure is shown in fig. 1.
In step 101, a thermal distribution legal area and a thermal distribution illegal area are determined in a layout of a target area. In some embodiments, the heat distribution legal area refers to an area that can be reached by a person, and the heat distribution illegal area refers to an area that cannot be reached by a person, for example, a place where a shelf is placed, or a place where a customer cannot enter in an enclosed state, that is, an illegal heat distribution area.
In step 102, an initial thermodynamic profile of the target region is acquired. In some embodiments, the initial thermal profile may be a thermal profile acquired by an image acquisition device such as a camera and analyzed by a computer vision algorithm.
In some embodiments, the order of execution of steps 101 and 102 is not sequential.
In step 103, according to the initial thermal distribution map, the thermal value of the illegal region of thermal distribution in the layout map is moved to the corresponding position of the legal region of thermal distribution in the layout map, and an updated thermal distribution map is obtained. In some embodiments, the thermal value of the illegal region of thermal distribution may be moved to the position of the legal region of thermal distribution closest to the current position in the map.
By the method, a thermal distribution legal area and a thermal distribution illegal area can be obtained on the basis of the target area layout diagram, and the acquired initial thermal distribution diagram is corrected, so that the thermal distribution diagram is rationalized, and the accuracy and the reliability of thermal analysis are improved.
In some embodiments, after obtaining the updated thermal profile, inventory of the commodity may be adjusted according to the updated thermal profile, e.g., to determine items placed on shelves nearest to locations with the highest or higher thermal value, to increase inventory of such items; the goods placed on the shelf closest to the position with the lowest or lower thermal value are determined, and the stock of the goods is reduced, so that the goods shelf is fully utilized by utilizing the popularity of the goods, and the utilization rate and the yield of space are improved.
In some embodiments, after obtaining the updated thermodynamic profile, the distribution of items may be adjusted according to the updated thermodynamic profile, for example, by placing more profitable items on the shelves closest to the location with the highest or higher thermodynamic value and less profitable items on the shelves closest to the location with the lowest or lower thermodynamic value, thereby increasing the rationality of the arrangement and increasing the profitability with the popularity of the zones.
A flow chart of further embodiments of the thermodynamic analysis method of the present disclosure is shown in fig. 2.
In step 201, a thermal distribution legal area and a thermal distribution illegal area are determined in the layout of the target area.
In step 202, an initial thermodynamic profile of the target region is acquired.
In step 203, according to the initial thermal distribution map, the thermal value of the illegal region of thermal distribution in the layout map is moved to the corresponding position of the legal region of thermal distribution in the layout map, and an updated thermal distribution map is obtained.
In step 204, the distribution of the articles in the adjusted target area is tested according to the updated thermal distribution map, and the adjusted updated thermal distribution map is obtained. In some embodiments, the adjustment to the distribution of the items may include: the items on the shelf closest to the position with the highest or higher thermal value are exchanged with the items on the shelf closest to the position with the lowest or lower thermal value, or the arrangement of the items may be randomly disturbed.
In step 205, it is determined whether the variation ratio of the updated thermodynamic distribution map before and after the test exceeds a predetermined threshold. In some embodiments, the thermal values of the points of the updated thermal profile before and after the test may be compared to determine a ratio of the number of points that have changed, and compared to a predetermined threshold. If the change ratio of the updated thermodynamic distribution map before and after the test is greater than the predetermined threshold, executing step 206; if the change ratio of the updated thermodynamic distribution map before and after the test is not greater than the predetermined threshold, step 207 is executed.
In step 206, since the updated thermodynamic profile has a large variation, which indicates that the deviation of the thermodynamic profile is more caused by the articles themselves, the inventory of articles in the target area is adjusted according to the updated thermodynamic profile.
In step 207, since the updated thermodynamic profile does not change much, it is shown that the deviation of the thermodynamic profile is more location-dependent, and the distribution of the articles in the target area is adjusted according to the demand.
By the method, the influence factors of the thermal distribution can be analyzed in a test mode, so that a corresponding strategy is specified, the accuracy of the application of the thermal distribution is improved, and the effective utilization of the limited target area space is improved.
In some embodiments, since there may be fixed-position objects in the target area, such as shelf areas, and areas where no articles are placed, but where customers cannot enter due to Design blocking, the areas where people are allowed to pass and the areas where people are not allowed to pass are determined by analysis in a Design drawing (such as a CAD (Computer Aided Design) drawing), a construction drawing, or a target area scene drawing restored based on scanning. A flow chart of some embodiments of the disclosed thermodynamic analysis method to determine legal and illegal regions of thermodynamic distribution is shown in fig. 3.
In step 301, the binarized layout is filled with flood water and inverted to obtain a flood water inverted map. In some embodiments, for a non-binarized layout, a binarization process may be performed first, where the background color is a first predetermined color, and the non-background color portion is a second predetermined color, as shown in fig. 4A, where the first predetermined color is black and the second predetermined color is white. After obtaining the binarized layout, flood filling is performed with a second predetermined color, as shown in fig. 4B, and further, as shown in fig. 4C, inversion processing is performed, including modifying the first predetermined color portion into the second predetermined color, and modifying the second predetermined color portion into the first predetermined color.
In step 302, an article frame selection layout is obtained according to the flood inversion map and the binary layout. In some embodiments, the position where at least one of the flood reversal map and the binarized layout map is the second predetermined color may be set, the article frame selection layout map is the second predetermined color, and the position where the article frame selection layout map is the first predetermined color in both the flood reversal map and the binarized layout map is the first predetermined color. In some embodiments, the positions of the second predetermined color and the first predetermined color in the flood reversal map and the binary layout map may be set to be 1, the position of the first predetermined color may be 0, the two maps are subjected to an or operation, the position with the operation result of 1 is the second predetermined color, and the position with the operation result of 0 is the first predetermined color.
In some embodiments, the area of the second predetermined color may be set to an area where a person is not allowed to pass, i.e., an illegal heat distribution area, and the area of the first predetermined color may be set to an area where a person is allowed to pass, i.e., a legal heat distribution area.
In some embodiments, to improve accuracy and avoid noise and small area effects, steps 303 and 304 may also be performed.
In step 303, the item frame layout is expanded, as shown in FIG. 4D. In some embodiments, the expansion coefficient may be preset.
In step 304, the expanded layout of the item box is eroded to reduce the size of the item before expansion, and an updated layout of the item box is obtained, as shown in fig. 4F.
Illegal discrete points formed by characters, irregular areas and other factors in the graph are removed through expansion and corrosion operations, and accuracy is improved.
In step 305, it is determined that the area surrounded by the area where the article is placed and the area where the article is placed is an area where people are not allowed to pass, and the area surrounded by the area where the article is not placed and the area where the article is not placed is an area where people are allowed to pass, based on the updated article frame layout.
By the method, the illegal thermal distribution region and the legal thermal distribution region can be obtained through the operation on the layout diagram, so that the initial thermal distribution diagram is corrected, the updated thermal distribution diagram shown in fig. 4F is obtained, the reliability of the thermal distribution diagram is improved, and the correction accuracy and efficiency are improved.
A flow chart of yet further embodiments of the thermodynamic analysis method of the present disclosure is shown in fig. 5.
In step 501, a surveillance video of a target area is obtained by an image capture device. In some embodiments, surveillance video may be collected by one or more cameras distributed over a target area.
In step 502, the position of the pedestrian in each frame of image of the surveillance video is detected by a pedestrian detection and identification algorithm. In some embodiments, the position of the image capture device, the relationship to the target area coordinates, etc. may be calibrated in advance to maximize the accuracy of the initial thermodynamic profile.
In step 503, an initial thermodynamic profile of the target area is determined based on the number of people staying at each location for more than a predetermined period of time and the length of stay. In some embodiments, the monitoring video may be decomposed into picture frames, the number of people appearing at each position in the picture frames is determined, and the number of picture frames in which people appear at each position is determined and accumulated, so as to collect the thermal distribution situation from both the number of people and the retention time.
In some embodiments, in order to implement image stitching and avoid repeated statistics of acquired overlapping regions, it is necessary to determine the inter-image position relationship by combining the actual conditions of a target region through the region and size of a monitoring image in advance to implement image stitching, and for an overlapping portion, only the monitoring image of the overlapping portion acquired by one camera is used, or for the overlapping portion, the thermal values in the monitoring images acquired by all cameras capable of acquiring the overlapping portion are averaged, so as to further improve the accuracy.
In step 504, a thermal distribution legal area and a thermal distribution illegal area are determined in the map of the target area. In some embodiments, the thermal distribution legal area and the thermal distribution illegal area may be determined in any of the ways mentioned above.
In step 505, the position of the thermal value other than 0 in the illegal region of thermal distribution in the initial thermal distribution map is determined as an abnormal position.
In some embodiments, after obtaining the article frame selection layout or updating the article frame selection layout in step 504, the output of the pixel value may be performed on the result of the map to form a two-dimensional matrix, where the value of each element of the array represents whether the image is in a closed area, for example, if black (a first predetermined color) is 0, the image represents that the image is in a non-closed area, and the image is a legal area for thermal distribution; and the white (second preset color) is 255, the area is represented as a closed area, the area is an illegal area of thermal distribution, each point on the layout chart is marked by 0 or 255, the coordinate of a reported non-0 thermal force value is assumed to be (x, y), and the x and y of the coordinate are substituted into the mapping mask matrix. If the obtained value is 0, the mapping coordinate is reasonable, and the thermal point is directly drawn; if the resulting value is 255, it indicates that the mapping coordinates are not reasonable.
In step 506, the nearest legal location corresponding to each abnormal location is determined. In some embodiments, the closest euclidean distance from the abnormal position to the legal area of the thermal distribution may be calculated as its corresponding closest legal position.
In step 507, the thermal power values of the respective abnormal locations are accumulated at the corresponding nearest legal locations. In some embodiments, for the case where different abnormal locations correspond to the same nearest legal location, the thermal force values of the respective abnormal locations corresponding to the nearest legal location are all accumulated at the nearest legal location. In some embodiments, a nearest point (x) with a value of 0 may be found on the mapping mask matrix by the Euclidean algorithm1,y1) And connecting this point(x1,y1) The coordinates are returned to replace x and y, and the thermal point is drawn as (x)1,y1)。
By the method, reasonable thermal distribution data can be obtained, even the thermal distribution of the part which shields the image acquisition can be reasonably predicted, accurate data support can be conveniently provided for subsequent intelligent decision making, and the decision making accuracy is further improved.
A schematic diagram of some embodiments of the presently disclosed thermodynamic analysis device is shown in fig. 6.
The area determination unit 601 can determine a thermal distribution legal area and a thermal distribution illegal area in the layout diagram of the target area. In some embodiments, the thermal distribution legal area refers to an area that a person can reach, and the thermal distribution illegal area refers to an area that a person cannot reach.
The initial thermal distribution acquisition unit 602 can acquire an initial thermal distribution map of the target area. In some embodiments, the initial thermal profile may be a thermal profile acquired by an image acquisition device such as a camera and analyzed by a computer vision algorithm.
The thermal distribution obtaining unit 603 can move the thermal value of the illegal region of thermal distribution in the layout to the corresponding position of the legal region of thermal distribution in the layout according to the initial thermal distribution map to obtain an updated thermal distribution map. In some embodiments, the thermal value of the illegal region of thermal distribution may be moved to the position of the legal region of thermal distribution closest to the current position in the map.
The device can obtain a thermal distribution legal area and a thermal distribution illegal area on the basis of a target area layout diagram, and further corrects the acquired initial thermal distribution diagram, so that the thermal distribution diagram is rationalized, and the accuracy of thermal analysis is improved.
In some embodiments, as shown in fig. 6, the thermal analysis device may further include a thermal profile application unit 604 capable of adjusting the inventory of the goods according to the updated thermal profile, for example, determining the items placed on the shelves nearest to the position with the highest or higher thermal value, and increasing the inventory of such items; the goods placed on the goods shelf closest to the position with the lowest or lower thermal value are determined, and the stock of the goods is reduced, so that the goods shelf is fully utilized by utilizing the popularity of the goods, and the utilization rate of space is improved.
In some embodiments, the thermal profile application unit 604 may be capable of adjusting the distribution of items based on the updated thermal profile, such as placing more profitable items on the shelves closest to the location with the highest or higher thermal value and less profitable items on the shelves closest to the location with the lowest or lower thermal value, thereby increasing the rationality of the arrangement and increasing profits with the popularity of the zones.
In some embodiments, the thermal analysis apparatus may further include a test unit 605 capable of adjusting the distribution of the articles in the target area according to the updated thermal profile test, and activating the area determination unit 601, the initial thermal profile acquisition unit 602, and the thermal profile acquisition unit 603 to acquire the updated thermal profile. The test unit 605 can compare the updated thermal distribution map obtained by the test with the updated thermal distribution map before the test, and determine the change ratio before and after the test. And under the condition that the change ratio is not greater than the preset threshold, the thermal distribution application unit adjusts the article inventory of the target area according to the requirement.
The thermal analysis device can analyze the influence factors of thermal distribution by using a test mode, thereby appointing a corresponding strategy, improving the accuracy of the application of the thermal distribution and further improving the effective utilization of the limited target area space.
A schematic diagram of one embodiment of the disclosed thermal analysis device is shown in fig. 7. The thermal analysis device includes a memory 701 and a processor 702. Wherein: the memory 701 may be a magnetic disk, flash memory, or any other non-volatile storage medium. The memory is for storing instructions in the corresponding embodiments of the thermodynamic analysis method hereinbefore described. Processor 702 is coupled to memory 701 and may be implemented as one or more integrated circuits, such as a microprocessor or microcontroller. The processor 702 is configured to execute instructions stored in the memory to rationalize the thermodynamic profile and improve the accuracy of the thermodynamic analysis.
In one embodiment, as also shown in fig. 8, a thermal analysis device 800 includes a memory 801 and a processor 802. The processor 802 is coupled to the memory 801 by a BUS 803. The thermal analysis device 800 may also be coupled to an external storage device 805 via a storage interface 804 for accessing external data, and may also be coupled to a network or another computer system (not shown) via a network interface 806. And will not be described in detail herein.
In the embodiment, the data instructions are stored in the memory, and the instructions are processed by the processor, so that the thermodynamic distribution diagram can be rationalized, and the accuracy of thermodynamic analysis is improved.
In another embodiment, a computer readable storage medium has stored thereon computer program instructions which, when executed by a processor, implement the steps of the method in the corresponding embodiment of the thermal analysis method. As will be appreciated by one skilled in the art, embodiments of the present disclosure may be provided as a method, apparatus, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable non-transitory storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
A schematic diagram of some embodiments of the presently disclosed thermodynamic analysis system is shown in fig. 9. The thermal analysis device 91 may be any of the above. The image capturing device 92 can monitor a target area and obtain a monitoring video, such as a camera for monitoring the target area. In some embodiments, the image capture device 92 may be one or more.
The thermal analysis system can acquire the monitoring video and obtain an initial thermal distribution map, obtain a thermal distribution legal area and a thermal distribution illegal area on the basis of a target area layout map, and further correct the acquired initial thermal distribution map, so that the thermal distribution map is rationalized, and the accuracy of thermal analysis is improved.
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Thus far, the present disclosure has been described in detail. Some details that are well known in the art have not been described in order to avoid obscuring the concepts of the present disclosure. It will be fully apparent to those skilled in the art from the foregoing description how to practice the presently disclosed embodiments.
The methods and apparatus of the present disclosure may be implemented in a number of ways. For example, the methods and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order for the steps of the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above unless specifically stated otherwise. Further, in some embodiments, the present disclosure may also be embodied as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.
Finally, it should be noted that: the above examples are intended only to illustrate the technical solutions of the present disclosure and not to limit them; although the present disclosure has been described in detail with reference to preferred embodiments, those of ordinary skill in the art will understand that: modifications to the specific embodiments of the disclosure or equivalent substitutions for parts of the technical features may still be made; all such modifications are intended to be included within the scope of the claims of this disclosure without departing from the spirit thereof.
Claims (17)
1. A method of thermal analysis comprising:
determining a thermal distribution legal area and a thermal distribution illegal area in a layout diagram of a target area;
acquiring an initial thermodynamic distribution map of the target area;
and according to the initial thermal distribution diagram, moving the thermal value of the illegal thermal distribution area in the layout diagram to the corresponding position of the legal thermal distribution area in the layout diagram, and acquiring an updated thermal distribution diagram.
2. The method of claim 1, further comprising one or more of:
adjusting the distribution of articles in the target area according to the updated thermal distribution map; or the like, or, alternatively,
and adjusting the inventory of the objects in the target area according to the updated thermal distribution map.
3. The method of claim 1, further comprising: testing and adjusting the distribution of the articles in the target area according to the updated thermal distribution diagram, and acquiring the adjusted updated thermal distribution diagram;
under the condition that the change proportion of the updated thermal distribution map before and after the test exceeds a preset threshold, adjusting the inventory of the articles in the target area according to the updated thermal distribution map;
and under the condition that the change proportion of the updated thermal distribution map before and after the test does not exceed a preset threshold, adjusting the distribution of the articles in the target area according to the requirement.
4. The method according to any one of claims 1 to 3, wherein the determining of the thermal distribution legal area and the thermal distribution illegal area in the layout of the target area comprises:
obtaining a layout of the target area;
determining regions allowing a person to pass and regions not allowing a person to pass in the map;
and setting the area allowing the person to pass as a heat distribution legal area, and setting the area not allowing the person to pass as a heat distribution illegal area.
5. The method of claim 4, wherein the determining regions in the map that allow passage of a person and regions that do not allow passage of a person comprises:
filling the binary layout map with overflowing water and reversing to obtain an overflowing water reversal map;
acquiring an article frame selection layout according to the flooding reversal map and the binaryzation layout;
and determining the areas allowing people to pass and the areas not allowing people to pass according to the item frame selection layout.
6. The method of claim 5, wherein said determining in said layout map areas that allow passage of a person and areas that do not allow passage of a person further comprises:
expanding the item frame selection layout;
performing corrosion operation on the expanded article frame selection layout to obtain an updated article frame selection layout;
the determining the regions allowing people to pass through and the regions not allowing people to pass through according to the item frame selection layout comprises: and determining that the area surrounded by the area where the articles are placed and the area where the articles are placed is an area where people are not allowed to pass through and the area where the articles are not placed and the area surrounded by the area where the articles are not placed is an area where people are allowed to pass through according to the updated article frame layout.
7. The method of claim 5, wherein said determining in said layout map areas that allow passage of a person and areas that do not allow passage of a person further comprises:
performing binarization processing on the layout, wherein the background color of the binarized layout is a first preset color, and the non-background color part is a second preset color;
said filling and inverting for flooding comprises: filling the second preset color with the overflowing water; modifying the first predetermined color portion to the second predetermined color, modifying the second predetermined color portion to the first predetermined color;
the step of obtaining an article frame selection layout according to the flooding reversal map and the binarized layout comprises the following steps: at least one of the flooding water reverse map and the binary layout map is the position of the second predetermined color, the article framing layout map is the second predetermined color, and at the position of the first predetermined color in both the flooding water reverse map and the binary layout map, the article framing layout map is the first predetermined color;
the determining the regions allowing people to pass through and the regions not allowing people to pass through according to the item frame selection layout comprises: the second predetermined color region is a region that does not allow a person to pass through, and the first predetermined color region is a region that allows a person to pass through.
8. The method according to any one of claims 1 to 3, wherein the moving the thermal value of the illegal region of thermal distribution in the layout to the corresponding position of the legal region of thermal distribution in the layout comprises:
determining the position, which is not 0, of the thermal value of the illegal area of the thermal distribution in the initial thermal distribution map as an abnormal position;
determining a nearest legal position corresponding to each abnormal position, wherein the nearest legal position is located in the thermal distribution legal area;
and accumulating the heat force value of each abnormal position at the corresponding nearest legal position.
9. A method according to any one of claims 1 to 3, wherein said obtaining an initial thermodynamic distribution map of the target region comprises:
acquiring a monitoring video of the target area through image acquisition equipment;
detecting the positions of pedestrians in each frame of image of the monitoring video through a pedestrian detection and identification algorithm;
determining an initial thermodynamic profile of the target zone based on the number of people staying at each location for more than a predetermined period of time and the length of stay.
10. The method of claim 9, wherein said obtaining an initial thermodynamic profile of the target region further comprises:
and mapping each detection area to the plane of the same target area according to the position relation of the detection areas of the plurality of image acquisition devices.
11. The method according to any one of claims 1 to 3, wherein the layout of the target area comprises a design drawing, a construction drawing or a scene drawing of the target area recovered based on scanning.
12. A thermal analysis device comprising:
an area determination unit configured to determine a thermal distribution legal area and a thermal distribution illegal area in a layout diagram of a target area;
an initial thermal distribution acquisition unit configured to acquire an initial thermal distribution map of the target region;
and the thermal distribution acquisition unit is configured to move the thermal value of the illegal region of thermal distribution in the layout to the corresponding position of the legal region of thermal distribution in the layout according to the initial thermal distribution map to acquire an updated thermal distribution map.
13. The apparatus of claim 12, further comprising a thermodynamic distribution application unit configured to perform one or more of:
adjusting the distribution of articles in the target area according to the updated thermal distribution map; or the like, or, alternatively,
and adjusting the inventory of the objects in the target area according to the updated thermal distribution map.
14. The apparatus of claim 12, further comprising:
the testing unit is configured to test and adjust the distribution of the articles in the target area according to the updated thermal distribution diagram, and acquire the adjusted updated thermal distribution diagram;
a thermal distribution application unit configured to adjust the stock quantity of the articles in the target area according to the updated thermal distribution map in a case where a change ratio of the updated thermal distribution map before and after the test exceeds a predetermined threshold; and under the condition that the change proportion of the updated thermal distribution map before and after the test does not exceed a preset threshold, adjusting the distribution of the articles in the target area according to the requirement.
15. A thermal analysis device comprising:
a memory; and
a processor coupled to the memory, the processor configured to perform the method of any of claims 1-11 based on instructions stored in the memory.
16. A computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the method of any one of claims 1 to 11.
17. A thermal analysis system comprising:
a thermal analysis device according to any one of claims 12 to 15;
and the combination of (a) and (b),
and the image acquisition equipment is configured to monitor the target area and acquire a monitoring video.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910427547.2A CN112070623A (en) | 2019-05-22 | 2019-05-22 | Thermal analysis method, device and system |
| PCT/CN2020/080781 WO2020233221A1 (en) | 2019-05-22 | 2020-03-24 | Heatmap analysis method, device, and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910427547.2A CN112070623A (en) | 2019-05-22 | 2019-05-22 | Thermal analysis method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112070623A true CN112070623A (en) | 2020-12-11 |
Family
ID=73458383
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910427547.2A Pending CN112070623A (en) | 2019-05-22 | 2019-05-22 | Thermal analysis method, device and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112070623A (en) |
| WO (1) | WO2020233221A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113743736A (en) * | 2021-08-11 | 2021-12-03 | 上海钧正网络科技有限公司 | Thermodynamic grade determining method, thermodynamic diagram generating device and electronic equipment |
| CN113763045A (en) * | 2021-09-06 | 2021-12-07 | 武汉博创非凡智能科技有限公司 | Multi-source data fusion-based store site selection visual analysis method and system |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112488913A (en) * | 2020-11-27 | 2021-03-12 | 杭州海康威视数字技术股份有限公司 | Data processing method and device and electronic equipment |
| CN113657925B (en) * | 2021-07-28 | 2023-08-22 | 黄淮学院 | Civil engineering cost management method based on artificial intelligence |
| CN116227777B (en) * | 2023-05-08 | 2023-10-13 | 浙江飞猪网络技术有限公司 | Stroke information processing method and electronic equipment |
| CN116236993B (en) * | 2023-05-12 | 2023-08-08 | 台昌树脂(佛山)有限公司 | Optimization method and system of acrylic acid copolymer emulsion production control system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106776615B (en) * | 2015-11-20 | 2020-06-16 | 北京国双科技有限公司 | Thermodynamic diagram generation method and device |
| CN107256225B (en) * | 2017-04-28 | 2020-09-01 | 济南中维世纪科技有限公司 | Method and device for generating heat map based on video analysis |
| CN109213949A (en) * | 2017-06-19 | 2019-01-15 | 北京嘀嘀无限科技发展有限公司 | The method for drafting and device of thermodynamic chart |
| CN109697392A (en) * | 2017-10-23 | 2019-04-30 | 北京京东尚科信息技术有限公司 | Draw the method and device of target object thermodynamic chart |
| CN109146576A (en) * | 2018-09-10 | 2019-01-04 | 北京旷视科技有限公司 | Shop cargo puts the determination method, apparatus and electronic equipment of strategy |
-
2019
- 2019-05-22 CN CN201910427547.2A patent/CN112070623A/en active Pending
-
2020
- 2020-03-24 WO PCT/CN2020/080781 patent/WO2020233221A1/en active Application Filing
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113743736A (en) * | 2021-08-11 | 2021-12-03 | 上海钧正网络科技有限公司 | Thermodynamic grade determining method, thermodynamic diagram generating device and electronic equipment |
| CN113743736B (en) * | 2021-08-11 | 2024-02-27 | 上海钧正网络科技有限公司 | Thermodynamic level determination method, thermodynamic diagram generation method, thermodynamic level determination device and electronic equipment |
| CN113763045A (en) * | 2021-09-06 | 2021-12-07 | 武汉博创非凡智能科技有限公司 | Multi-source data fusion-based store site selection visual analysis method and system |
| CN113763045B (en) * | 2021-09-06 | 2024-02-23 | 武汉博创非凡智能科技有限公司 | Shop site selection visual analysis method and system based on multi-source data fusion |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020233221A1 (en) | 2020-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112070623A (en) | Thermal analysis method, device and system | |
| CN109446883B (en) | Commodity state identification method and device, electronic equipment and readable storage medium | |
| CN108985359B (en) | Commodity identification method, unmanned vending machine and computer-readable storage medium | |
| CN104424482B (en) | Image processing equipment and image processing method | |
| JP6755110B2 (en) | Video noise analyzer, residual point noise detection method and defective pixel detection method | |
| CN110472486B (en) | Goods shelf obstacle identification method, device, equipment and readable storage medium | |
| CN110866515B (en) | Method and device for identifying behaviors of objects in factory building and electronic equipment | |
| CN111242128B (en) | Object detection method, device, computer readable storage medium and computer equipment | |
| Milella et al. | Towards intelligent retail: Automated on-shelf availability estimation using a depth camera | |
| CN111091025B (en) | Image processing method, device and equipment | |
| US20170278234A1 (en) | Method for detecting a defect on a surface of a tire | |
| JP2015524946A (en) | Method and measuring apparatus for forming a super-resolution image with improved image resolution | |
| CN110059521A (en) | target tracking method and device | |
| CN111161346A (en) | Method and device for layering commodities in goods shelf and electronic equipment | |
| CN112017210A (en) | Target object tracking method and device | |
| CN113111801A (en) | Goods checking method, equipment and storage medium for automatic vending machine | |
| CN106506982A (en) | A kind of method for obtaining photometric parameter, device and terminal unit | |
| JP2016200971A (en) | Learning apparatus, identification apparatus, learning method, identification method and program | |
| CN110119675B (en) | Product identification method and device | |
| CN109086696A (en) | A kind of anomaly detection method, device, electronic equipment and storage medium | |
| CN111428743B (en) | Commodity identification method, commodity processing device and electronic equipment | |
| CN113468914A (en) | Method, device and equipment for determining purity of commodities | |
| CN110222569B (en) | Object detection method and device, electronic equipment and readable storage medium | |
| CN111429194B (en) | User track determination system, method, device and server | |
| KR101982258B1 (en) | Method for detecting object and object detecting apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |