CN117557896A - Method and device for determining quantity of fast objects, electronic equipment and storage medium - Google Patents
Method and device for determining quantity of fast objects, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117557896A CN117557896A CN202210940120.4A CN202210940120A CN117557896A CN 117557896 A CN117557896 A CN 117557896A CN 202210940120 A CN202210940120 A CN 202210940120A CN 117557896 A CN117557896 A CN 117557896A
- Authority
- CN
- China
- Prior art keywords
- express
- panoramic
- picture
- express mail
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000012546 transfer Methods 0.000 claims description 16
- 230000005540 biological transmission Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 7
- 235000013410 fast food Nutrition 0.000 claims 7
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002411 adverse Effects 0.000 description 1
- 238000013145 classification model Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
- G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10141—Special mode during image acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30242—Counting objects in image
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Information Transfer Between Computers (AREA)
- Image Analysis (AREA)
Abstract
The application provides a method, a device, electronic equipment and a storage medium for determining the number of fast elements; comprising the following steps: acquiring a panoramic express picture to be identified; judging whether the panoramic express picture is an overexposure picture or not; if the panoramic express mail picture is not overexposed, identifying and positioning express mail in the panoramic express mail picture to obtain an express mail target; the number of panoramic express objects is identified. The method comprises the steps of identifying panoramic express pictures, and judging whether the panoramic express pictures are overexposed pictures or not; if the identification of the express items and the determination of the number of the express items are not performed any more. Firstly, a panoramic express mail picture is identified, and the situation that the express mail feature near the edge is missing and cannot be identified is avoided; and the overexposed highlight pictures are removed, only the panoramic express mail pictures which are not overexposed are identified, and the express mail identification efficiency is improved; and meanwhile, the accuracy of identifying the quantity of the express mail is improved by utilizing three times of identification of panoramic express mail pictures, overexposure identification, identification positioning and quantity identification.
Description
Technical Field
The present disclosure relates to the field of express mail detection, and in particular, to a method and apparatus for determining the number of express mail, an electronic device, and a storage medium.
Background
The logistics express calculates the freight according to the weight or the volume, and the receiving end is easy to generate less freight through manual weight and volume measurement, thereby bringing a plurality of adverse effects of company income reduction and the like, so that the freight needs to be repeatedly paid and additional payment is carried out according to the repeated result.
The repeated check is to carry out freight charge additional payment on the packages with abnormal weight, the repeated result is required to be determined before carrying out freight charge additional payment, only the current unique package is arranged on the scale surface in the repeated process, and whether the object in the scale is a single piece or not is judged from the visual aspect. However, the identification of whether a package is a single piece or multiple pieces is currently not good.
Disclosure of Invention
The application aims to provide a method, a device, electronic equipment and a storage medium for determining the number of fast parts, and aims to solve the problem that the accuracy of the method for determining the number of fast parts is low in the prior art.
In one aspect, the present application provides a method of determining a number of pieces, the method comprising:
acquiring a panoramic express picture to be identified;
judging whether the panoramic express picture is an overexposure picture or not;
if the panoramic express mail picture is not an overexposure picture, identifying and positioning express mail in the panoramic express mail picture to obtain an express mail target in the panoramic express mail picture;
and carrying out quantity recognition on the express mail targets to determine the quantity of the express mail corresponding to the express mail targets in the panoramic express mail picture.
In some of the possible embodiments of the present invention,
judging whether the panoramic express image is an overexposure image or not comprises the following steps:
identifying the panoramic express mail picture by using a preset highlight picture identification model so as to determine whether the panoramic express mail picture is a highlight picture or not;
and if the panoramic express image is not a highlight image, determining that the panoramic express image is not an overexposure image.
In some possible embodiments, the method further comprises:
the method further comprises the steps of:
and if the panoramic express image is a highlight image, confirming that the panoramic express image comprises a plurality of overlapped express.
In some of the possible embodiments of the present invention,
if the panoramic express image is not an overexposure image, identifying and positioning express in the panoramic express image to obtain an express target in the panoramic express image, including:
identifying the panoramic express mail picture by using a preset express mail identification model to obtain at least one target frame comprising express mail;
if the panoramic express image comprises a transmitting device image, determining a transmitting area corresponding to a transmitting device in the panoramic express image;
and identifying and positioning the express in the panoramic express picture according to the target frame and the transmission area to obtain the express target in the panoramic express picture.
In some of the possible embodiments of the present invention,
and identifying and positioning the express mail in the panoramic express mail picture according to the transmission area and the target frame to obtain an express mail target in the panoramic express mail picture:
judging whether the target frame is overlapped with the transmission area or not;
and if the target frame and the transmission area are overlapped, determining that the position of the target frame is the position of the express, and obtaining the express target in the panoramic express picture.
In some of the possible embodiments of the present invention,
the identifying the number of the express mail targets to determine the number of the express mail corresponding to the express mail targets in the panoramic express mail picture includes:
cutting the panoramic express image according to the position of the target frame in the panoramic express image to obtain an express image to be identified, wherein the express image only comprises express targets;
acquiring a gradient map corresponding to the express mail picture;
and inputting the express mail pictures and the gradient map into a preset express mail quantity identification model, and determining the quantity of express mail corresponding to the express mail targets in the panoramic express mail pictures.
In some of the possible embodiments of the present invention,
inputting the express mail picture and the gradient map into a preset express mail quantity identification model, and determining the quantity of the express mail corresponding to the express mail target in the panoramic express mail picture comprises the following steps:
and forming the express mail pictures and the gradient map into four-channel pictures, so as to input the number of express mail corresponding to the express mail target in the panoramic express mail picture into a preset express mail number identification model.
In another aspect, the present application provides a device for determining the number of pieces, the device comprising:
the acquisition module is used for acquiring panoramic express pictures to be identified;
the overexposure judging module is used for judging whether the panoramic express picture is an overexposure picture or not;
the identification and positioning module is used for identifying and positioning the express in the panoramic express picture if the panoramic express picture is not an overexposure picture, so as to obtain an express target in the panoramic express picture;
and the quantity determining module is used for carrying out quantity identification on the express mail targets so as to determine the quantity of the express mail corresponding to the express mail targets in the panoramic express mail picture.
In another aspect, the present application further provides an electronic device, including:
one or more processors;
a memory; and
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the method of determining a number of pieces of any of the first aspects.
In another aspect, the present application also provides a computer readable storage medium having stored thereon a computer program, the computer program being loaded by a processor to perform the steps of the method for determining the number of pieces according to any one of the first aspects.
The application provides a method, a device, electronic equipment and a storage medium for determining the number of fast elements; the method comprises the following steps: acquiring a panoramic express picture to be identified; judging whether the panoramic express picture is an overexposure picture or not; if the panoramic express mail picture is not overexposed, identifying and positioning express mail in the panoramic express mail picture to obtain an express mail target; the number of panoramic express objects is identified. The method comprises the steps of identifying panoramic express pictures, and judging whether the panoramic express pictures are overexposed pictures or not; if the identification of the express items and the determination of the number of the express items are not performed any more. Firstly, a panoramic express mail picture is identified, and the situation that the express mail feature near the edge is missing and cannot be identified is avoided; and the overexposed highlight pictures are removed, only the panoramic express mail pictures which are not overexposed are identified, and the express mail identification efficiency is improved; and meanwhile, the accuracy of identifying the quantity of the express mail is improved by utilizing three times of identification of panoramic express mail pictures, overexposure identification, identification positioning and quantity identification.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic view of a system for determining the number of pieces according to an embodiment of the present disclosure;
FIG. 2 is a flow chart of one embodiment of a method for determining the number of pieces provided in an embodiment of the present application;
fig. 3 is a schematic flowchart of an embodiment of determining whether a panoramic express image is an overexposed image according to an embodiment of the present application;
FIG. 4 is a flowchart of an embodiment of identifying and positioning a widget according to an embodiment of the present application;
FIG. 5 is a flowchart illustrating an embodiment of determining the number of express mail according to the present disclosure;
FIG. 6 is a schematic diagram of a complete flow chart of an embodiment of determining the number of express mail according to the present embodiment;
FIG. 7 is a schematic view of an embodiment of a device for determining the number of fast elements according to the embodiment of the present application
Fig. 8 is a schematic structural diagram of an embodiment of an electronic device provided in an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
In the description of the present application, it should be understood that the terms "center," "longitudinal," "transverse," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like indicate an orientation or positional relationship based on that shown in the drawings, merely for convenience of description and to simplify the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be configured and operated in a particular orientation, and thus should not be construed as limiting the present application. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more features. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
In this application, the term "exemplary" is used to mean "serving as an example, instance, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is presented to enable any person skilled in the art to make and use the application. In the following description, details are set forth for purposes of explanation. It will be apparent to one of ordinary skill in the art that the present application may be practiced without these specific details. In other instances, well-known structures and processes have not been shown in detail to avoid obscuring the description of the present application with unnecessary detail. Thus, the present application is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
It should be noted that, because the method in the embodiment of the present application is executed in the electronic device, the processing objects of each electronic device exist in the form of data or information, for example, time, which is substantially time information, it can be understood that in the subsequent embodiment, if the size, the number, the position, etc. are all corresponding data, so that the electronic device processes the data, which is not described herein in detail.
The embodiment of the application provides a method, a device, an electronic device and a storage medium for determining the number of fast elements, and the detailed description is given below.
Referring to fig. 1, fig. 1 is a schematic view of a system for determining the number of pieces of a piece of equipment according to an embodiment of the present application, where the system for determining the number of pieces of equipment may include an electronic device 100, and a device for determining the number of pieces of equipment is integrated in the electronic device 100, such as the electronic device in fig. 1.
In this embodiment of the present application, the electronic device 100 may be an independent server, or may be a server network or a server cluster formed by servers, for example, the electronic device 100 described in the embodiment of the present application includes, but is not limited to, a computer, a network host, a single network server, a plurality of network server sets, or a cloud server formed by a plurality of servers. Wherein the Cloud server is composed of a large number of computers or web servers based on Cloud Computing (Cloud Computing).
It will be appreciated by those skilled in the art that the application environment shown in fig. 1 is merely an application scenario of the present application, and is not limited to the application scenario of the present application, and other application environments may also include more or fewer electronic devices than those shown in fig. 1, for example, only 1 electronic device is shown in fig. 1, and it will be appreciated that the fast-component number determining system may also include one or more other servers, which is not limited herein.
In addition, as shown in fig. 1, the number of pieces determination system may further include a storage unit 200 for storing data such as a photographed panoramic piece picture or the like.
It should be noted that, the schematic view of the scenario of the number of pieces determining system shown in fig. 1 is only an example, and the number of pieces determining system and scenario described in the embodiments of the present application are for more clearly describing the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application, and those skilled in the art can know that, with the evolution of the number of pieces determining system and the appearance of a new service scenario, the technical solutions provided in the embodiments of the present application are equally applicable to similar technical problems.
First, in an embodiment of the present application, there is provided a fast-part number determining method, an execution subject of which is a fast-part number determining apparatus that is applied to an electronic device, the fast-part number determining method including: acquiring a panoramic express picture to be identified; judging whether the panoramic express picture is an overexposure picture or not; if the panoramic express photo is not the overexposure photo, identifying and positioning express in the panoramic express photo to obtain an express target in the panoramic express photo; and carrying out quantity recognition on the express mail targets to determine the quantity of the express mail corresponding to the express mail targets in the panoramic express mail picture.
Referring to fig. 2, fig. 2 is a flow chart of an embodiment of a method for determining the number of pieces according to an embodiment of the present application. As shown in fig. 2, the method for determining the number of pieces includes the steps of:
21. and acquiring the panoramic express to be identified.
In a specific express mail delivery process, identification of the express mail on the conveying device is generally required; and because of the problem of the stack of the express items, it is necessary to determine whether the identified express item is a single express item or a plurality of express items that overlap.
In the embodiment of the application, the panoramic express mail picture corresponding to the conveying device is acquired in the process of conveying the express mail on the conveying device, so that whether the express mail in the panoramic express mail picture is one express mail or a plurality of express mails is identified. The objects in the panoramic express photo are usually more than the express itself, that is, when the panoramic image is acquired by using a camera and other devices, the distance between the camera and the conveying device needs to be set larger, so that the camera can shoot and convey the object, and other objects outside the conveying device can be acquired.
In this embodiment of the present application, the panoramic express image is taken as the image to be identified, and the image including the transmitting device is not taken as the image to be identified: the panoramic express mail picture contains the most information, so that the problems that partial characteristics of the express mail are lost due to the fact that the express mail is positioned at the edge of the conveying device, and recognition is inaccurate due to the fact that only part of the express mail falls above the conveying device can be avoided.
22. And judging whether the panoramic express picture is an overexposure picture or not.
23. And if the panoramic express image is not the overexposure image, identifying and positioning express in the panoramic express image to obtain an express target in the panoramic express image.
In the embodiment of the application, the panoramic express photo is obtained by using equipment such as a camera, and the overexposure condition exists in the panoramic express photo due to the problems of light and shooting angles; i.e. the specific texture of the widget cannot be seen clearly. Therefore, it is first required to determine whether the panoramic express mail picture is an overexposed picture, and whether the express mail texture cannot be determined.
If the panoramic express mail picture is not the overexposure picture, the subsequent step of determining the quantity of the express mail can be carried out; if the panoramic express image is an overexposure image, the default panoramic express image includes a plurality of overlapped express, and then the express in the panoramic express image needs to be checked again, so that the problems of abnormal weight of the express and the like caused by the overlapping of the express are avoided.
In the embodiment of the application, the express items existing in the panoramic express item picture are generally identified and positioned by utilizing the express item identification model, and then further quantity judgment is carried out on the identified express items to be identified.
24. And carrying out quantity recognition on the express mail targets to determine the quantity of express mail to be recognized.
Typically, a panoramic express image includes a plurality of express items being transmitted, but due to the problem of express item stacking, some express items are blocked and cannot be identified. In the embodiment of the present application, therefore, it is mainly determined that the actual number of the express items corresponding to the express item targets already identified in the panoramic express item picture, rather than determining whether one or more express items exist in the entire panoramic express item picture.
In the embodiment of the application, the number of the identified express items can be judged by using a preset express item number prediction model so as to further judge the number of the express items on the basis of the identified express items.
The method for determining the quantity of the fast parts provided by the embodiment of the application comprises the following steps: acquiring a panoramic express picture to be identified; judging whether the panoramic express picture is an overexposure picture or not; if the panoramic express photo is not the overexposure photo, identifying and positioning an express target in the panoramic express photo; and carrying out quantity recognition on the express mail targets to determine the quantity of the express mail corresponding to the express mail targets. The method comprises the steps of identifying panoramic express pictures, and judging whether the panoramic express pictures are overexposed pictures or not; if the image is not the overexposed image, the identification of the express mail and the determination of the number of the express mail are carried out. Firstly, a panoramic express mail picture is identified, and the situation that the express mail feature near the edge is missing and cannot be identified is avoided; the overexposed pictures are removed, only the panoramic express pictures which are not overexposed are identified, and the express identification efficiency is improved; and meanwhile, the accuracy of identifying the quantity of the express mail corresponding to the single express mail target is improved by utilizing three times of identification of panoramic express mail picture-overexposure identification-identification positioning-quantity identification.
As shown in fig. 3, an embodiment of a flowchart for determining whether a panoramic express image is an overexposed image according to the embodiment of the present application may include:
31. and identifying the panoramic express mail picture by using a preset highlight picture identification model so as to determine whether the panoramic express mail picture is a highlight picture or not.
32. And if the panoramic express image is not a highlight image, determining that the panoramic express image is not an overexposure image.
In the embodiment of the application, whether the panoramic express image is an overexposed image can be judged by using the two-classification highlight image recognition model. Judging whether the panoramic express mail picture is a highlight picture or not, and if the panoramic express mail picture is the highlight picture, judging that the panoramic express mail picture is an overexposure picture; if the image is not a highlight image, the image is not an overexposed image.
In a specific embodiment, the highlight picture recognition model may be an effective convolutional neural network, and the network structure is obtained by combining a composite model expansion method with a neural structure search technology. At this time, the output of the highlight picture recognition model may be 0 or 1; wherein, 0 represents that the panoramic express image is a normal image which is not overexposed, and 1 represents that the panoramic express image is overexposed. In other embodiments, the highlight picture recognition model may be other classification models, which are not limited in the embodiments of the present application.
In the above embodiment, if the panoramic express image is identified as the highlight image, the panoramic express image is an overexposure image, and the default overexposure image includes a plurality of overlapped express images; the default panoramic express image comprises a plurality of overlapped express items, and the following steps of express item identification positioning and express item quantity determining are not needed.
After determining the non-overexposed panoramic express mail picture, it is also necessary to further determine the position of the express mail in the panoramic express mail picture. Therefore, the express items in the panoramic express item picture need to be identified and positioned by using the preset express item identification model, so that the express items to be identified are obtained. As shown in fig. 4, a flowchart of an embodiment of identifying and positioning a widget according to an embodiment of the present application may include:
41. and identifying the panoramic express mail picture by using a preset express mail identification model to obtain at least one target frame comprising the express mail.
In a specific express item identification process, a plurality of target frames are generated, wherein each target frame comprises an express item, and the plurality of express items correspond to the plurality of target frames. The process of identifying the express item is also a process of continuously adjusting the position and size of the target frame in practice.
It should be noted that, when identifying a widget, a plurality of overlapped widgets will be identified as a widget corresponding to a target frame.
42. And if the panoramic express image comprises the image of the transmitting device, determining a transmitting area corresponding to the transmitting device in the panoramic express image.
In the embodiment of the present application, since the express mail is transferred on the transfer device, and the panoramic express mail picture obtained in the embodiment of the present application includes other structures besides the transfer device, it is also necessary to determine a transfer area corresponding to the transfer device in the panoramic express mail picture, so as to determine the express mail currently located on the transfer area.
43. It is determined whether or not the target frame and the transfer area overlap.
44. And if the target frame and the transmission area are overlapped, determining that the position of the target frame is the position of the express mail, and obtaining the express mail target in the panoramic express mail picture.
In the embodiment of the application, the panoramic express mail picture is firstly acquired so as to avoid missing express mail; the transfer area is cut separately to determine the express items on the transfer area. In order to avoid missing the express mail again, in the embodiment of the present application, it is determined whether the target frame including the express mail overlaps with the transfer area, so as to determine whether the express mail is in the transfer area.
In the embodiment of the present application, as long as the target frame and the transfer area overlap, it is considered that the express item exists in the target frame, and the position where the target frame is located is the position where the express item is located. In the embodiment of the present application, it is not necessary to determine the size of the area overlapping between the target frame and the transfer area, as long as the overlapping occurs between the two. This is because some of the express items may be at the edges of the transfer area, and the portions of the express items beyond the transfer area are removed when the transfer area is determined. If the size of the overlapping area between the target frame and the transmission area is determined, and whether the target frame is a express item is determined, the express item may be omitted.
In the above embodiment, the target frame is generally the smallest circumscribed rectangle corresponding to the express item; in the embodiment of the application, whether the target frame and the conveying area are overlapped is mainly judged, and whether any one of the four vertex angles of the target frame and the center point of the target frame falls inside the conveying area or not, including falling on the edge of the conveying area.
After the quick-service to be identified is determined, the corresponding number of quick-service to be identified needs to be further determined. As shown in fig. 5, a flowchart of an embodiment of determining the number of the express mail according to the embodiment of the present application may include:
51. and cutting the panoramic express image according to the position of the target frame in the panoramic express image to obtain the express image to be identified, wherein the express image only comprises express targets.
When the number of the express items corresponding to the express item targets is determined, other picture information except the express item targets is not needed, so that the express item targets can be cut out of the panoramic express item pictures independently. The position of the express target in the panoramic express picture is actually determined while the express target is identified, so that the panoramic express picture can be cut, and the express picture only comprising the express target is obtained.
In general, the input of the neural network model is a regular picture, so that the panoramic express image is cut according to the size of the target frame, and the cut express image is a regular rectangle image; rather than being cut to the specific contours of the express item.
52. And acquiring a gradient map corresponding to the express mail picture.
After determining the express mail image only comprising express mail, the gradient image corresponding to the express mail image can be further determined; the gradient map of the express mail is mainly used for acquiring the outline of the express mail to be identified so as to determine the quantity of the express mail in the express mail to be identified according to the outline of the express mail to be identified. The specific method for determining the gradient map corresponding to the express mail picture can refer to the prior art, and is not limited herein.
53. And forming a four-channel picture by the express mail picture and the gradient picture, inputting the four-channel picture into a preset express mail quantity prediction model, and determining the quantity of the express mail in the express mail to be identified.
In the embodiment of the application, not only the gradient map corresponding to the express mail picture, but also the express mail picture itself is utilized simultaneously to identify the number of express mail.
The concrete main steps are as follows: and determining an RGB three-channel image corresponding to the express mail image, and forming the RGB three-channel image and the gradient image into a four-channel image, so that the four-channel image is input into a preset express mail quantity identification model, and the quantity of the express mails to be identified is determined.
In the above embodiment, since the features corresponding to the gradient map are relatively obvious, the gradient map corresponding to the express mail picture is obtained in the embodiment of the present application; and combining the gradient map of the single channel and the RGB map of the three channels to form a four-channel map, taking the four-channel map as the input of a rapid number identification model, and assisting the model to distinguish the characteristic information of single pieces and multiple pieces so as to realize the identification of the rapid number.
Specifically, the number of fast objects recognition model can be a two-class model, and the output is 0 or 1; and 0 represents that only one express item exists in the express items to be identified, and no express items which are placed in an overlapping manner exist; and 1 represents that the to-be-identified express item is formed by overlapping a plurality of express items.
It should be noted that, in the embodiment of the present application, only whether the to-be-identified express item is one or more can be determined; when the number of the express items to be identified is multiple, the specific number of the express items cannot be identified.
As shown in fig. 6, a complete flow chart of an embodiment of determining the number of the express mail provided in the embodiment of the present application is shown, in fig. 6, firstly, a highlight picture identification model is used to perform highlight identification on a panoramic express mail picture, and whether the panoramic express mail picture is a highlight picture is judged; if the panoramic express mail picture is not the overexposed highlight picture, utilizing the express mail identification positioning model to identify express mail in the panoramic express mail picture, and positioning the position of the express mail.
After the position of the express mail target is determined, the express mail target can be cut out of the panoramic express mail picture, and the express mail picture only comprising the express mail target is obtained; and acquiring an RGB three-channel image and a single-channel gradient image corresponding to the express image, merging the RGB three-channel image and the single-channel gradient image into a four-channel image, and then inputting the four-channel image into an express quantity prediction model to determine whether the express object is a single piece or a plurality of pieces.
The embodiment of the application also provides a device for determining the number of pieces, as shown in fig. 7, which is a schematic diagram of an embodiment of the device for determining the number of pieces provided in the embodiment of the application, and may include:
the obtaining module 701 is configured to obtain a panoramic express image to be identified.
The overexposure judging module 702 is configured to judge whether the panoramic express image is an overexposed image.
And the identification and positioning module 703 is configured to identify and position a express item in the panoramic express item picture if the panoramic express item picture is not overexposed, so as to obtain an express item target in the panoramic express item picture.
And the quantity determining module 704 is configured to perform quantity identification on the express mail targets to determine the quantity of express mail corresponding to the express mail targets in the panoramic express mail picture.
The embodiment of the application provides a device for determining the number of fast elements, and firstly provides a method, a device, electronic equipment and a storage medium for determining the number of fast elements; comprising the following steps: acquiring a panoramic express picture to be identified; judging whether the panoramic express picture is an overexposure picture or not; if the panoramic express mail picture is not overexposed, identifying and positioning express mail in the panoramic express mail picture to obtain an express mail target; the number of panoramic express objects is identified. The method comprises the steps of identifying panoramic express pictures, and judging whether the panoramic express pictures are overexposed pictures or not; if the identification of the express items and the determination of the number of the express items are not performed any more. Firstly, a panoramic express mail picture is identified, and the situation that the express mail feature near the edge is missing and cannot be identified is avoided; and the overexposed highlight pictures are removed, only the panoramic express mail pictures which are not overexposed are identified, and the express mail identification efficiency is improved; and meanwhile, the accuracy of identifying the quantity of the express mail is improved by utilizing three times of identification of panoramic express mail pictures, overexposure identification, identification positioning and quantity identification.
In some embodiments, the overexposure determination module 702 may be specifically configured to: identifying the panoramic express mail picture by using a preset highlight picture identification model so as to determine whether the panoramic express mail picture is a highlight picture or not; if the panoramic express image is not a highlight image, determining that the panoramic express image is not an overexposure image; and if the panoramic express image is a highlight image, confirming that the panoramic express image comprises a plurality of overlapped express.
In some embodiments, the identification positioning module 703 may be specifically configured to: identifying the panoramic express mail picture by using a preset express mail identification model to obtain at least one target frame comprising express mail; if the panoramic express image comprises a transmission device image, determining a transmission area corresponding to a transmission device in the panoramic express image; and identifying and positioning the express in the panoramic express picture according to the target frame and the transmission area to obtain the express target in the panoramic express picture.
In some embodiments, the identification positioning module 703 may be specifically configured to: judging whether the target frame is overlapped with the transmission area or not; and if the target frame and the transmission area are overlapped, determining that the position of the target frame is the position of the express mail, and obtaining the express mail target in the panoramic express mail picture.
In some embodiments, the quantity determination module 704 may be specifically configured to: cutting the panoramic express mail picture according to the position of the target frame in the panoramic express mail picture to obtain an express mail picture to be identified, wherein the express mail picture only comprises express mail targets; acquiring a gradient map corresponding to the express mail picture; and inputting the express mail pictures and the gradient map into a preset express mail quantity identification model, and determining the quantity of express mail corresponding to the express mail targets in the panoramic express mail pictures.
In some embodiments, the quantity determination module 704 may be specifically configured to: and forming the express mail pictures and the gradient pictures into four-channel pictures, and inputting the four-channel pictures into a preset express mail quantity identification model, wherein the express mail quantity corresponds to the express mail target in the panoramic express mail picture.
The embodiment of the application also provides electronic equipment, which integrates any of the number of pieces determining device provided by the embodiment of the application. As shown in fig. 8, a schematic structural diagram of a server according to an embodiment of the present application is shown, specifically:
the electronic device may include one or more processing cores 'processors 801, one or more computer-readable storage media's memory 802, power supply 803, and input unit 804, among other components. It will be appreciated by those skilled in the art that the electronic device structure shown in the figures is not limiting of the electronic device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components. Wherein:
the processor 801 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 802, and calling data stored in the memory 802, thereby performing overall monitoring of the electronic device. Optionally, the processor 801 may include one or more processing cores; preferably, the processor 801 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 801.
The memory 802 may be used to store software programs and modules, and the processor 801 executes various functional applications and data processing by executing the software programs and modules stored in the memory 802. The memory 802 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the electronic device, etc. In addition, memory 802 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 802 may also include a memory controller to provide the processor 801 with access to the memory 802.
The electronic device further comprises a power supply 803 for powering the various components, preferably the power supply 803 can be logically coupled to the processor 801 via a power management system such that functions such as managing charging, discharging, and power consumption are performed by the power management system. The power supply 803 may also include one or more of any components, such as a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The electronic device may further comprise an input unit 804, which input unit 804 may be used for receiving input digital or character information and for generating keyboard, mouse, joystick, optical or trackball signal inputs in connection with user settings and function control.
Although not shown, the electronic device may further include a display unit or the like, which is not described herein. In particular, in this embodiment, the processor 801 in the electronic device loads executable files corresponding to the processes of one or more application programs into the memory 802 according to the following instructions, and the processor 801 executes the application programs stored in the memory 802, so as to implement various functions as follows:
acquiring a panoramic express picture to be identified; judging whether the panoramic express picture is an overexposure picture or not; if the panoramic express photo is not the overexposure photo, identifying and positioning express in the panoramic express photo to obtain an express target in the panoramic express photo; and carrying out quantity recognition on the express mail targets to determine the quantity of the express mail corresponding to the express mail targets in the panoramic express mail picture.
Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.
To this end, embodiments of the present application provide a computer readable storage medium, which may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like. On which a computer program is stored, the computer program being loaded by a processor for performing the steps of any of the number of pieces determination methods provided by the embodiments of the present application. For example, the loading of the computer program by the processor may perform the steps of:
acquiring a panoramic express picture to be identified; judging whether the panoramic express picture is an overexposure picture or not; if the panoramic express photo is not the overexposure photo, identifying and positioning express in the panoramic express photo to obtain an express target in the panoramic express photo; and carrying out quantity recognition on the express mail targets to determine the quantity of the express mail corresponding to the express mail targets in the panoramic express mail picture.
In the foregoing embodiments, the descriptions of the embodiments are focused on, and the portions of one embodiment that are not described in detail in the foregoing embodiments may be referred to in the foregoing detailed description of other embodiments, which are not described herein again.
In the implementation, each unit or structure may be implemented as an independent entity, or may be implemented as the same entity or several entities in any combination, and the implementation of each unit or structure may be referred to the foregoing method embodiments and will not be repeated herein.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
The foregoing has described in detail the method, apparatus, electronic device and storage medium for determining the number of pieces according to the embodiments of the present application, and specific examples have been applied to illustrate the principles and embodiments of the present application, where the foregoing examples are only used to help understand the method and core idea of the present application; meanwhile, as those skilled in the art will vary in the specific embodiments and application scope according to the ideas of the present application, the contents of the present specification should not be construed as limiting the present application in summary.
Claims (10)
1. A method of determining a quantity of fast objects, the method comprising:
acquiring a panoramic express picture to be identified;
judging whether the panoramic express picture is an overexposure picture or not;
if the panoramic express mail picture is not an overexposure picture, identifying and positioning express mail in the panoramic express mail picture to obtain an express mail target in the panoramic express mail picture;
and carrying out quantity recognition on the express mail targets to determine the quantity of the express mail corresponding to the express mail targets in the panoramic express mail picture.
2. The method of claim 1, wherein the determining whether the panoramic express image is an overexposed image comprises:
identifying the panoramic express mail picture by using a preset highlight picture identification model so as to determine whether the panoramic express mail picture is a highlight picture or not;
and if the panoramic express image is not a highlight image, determining that the panoramic express image is not an overexposure image.
3. The method of claim 2, further comprising:
and if the panoramic express image is a highlight image, confirming that the panoramic express image comprises a plurality of overlapped express.
4. The method for determining the quantity of the express mail according to claim 1, wherein if the panoramic express mail picture is not an overexposed picture, identifying and positioning the express mail in the panoramic express mail picture to obtain the express mail target in the panoramic express mail picture includes:
identifying the panoramic express mail picture by using a preset express mail identification model to obtain at least one target frame comprising express mail;
if the panoramic express image comprises a transmitting device image, determining a transmitting area corresponding to a transmitting device in the panoramic express image;
and identifying and positioning the express in the panoramic express picture according to the target frame and the transmission area to obtain the express target in the panoramic express picture.
5. The method according to claim 4, wherein the identifying and locating the express mail in the panoramic express mail picture according to the transfer area and the target frame obtains an express mail target in the panoramic express mail picture:
judging whether the target frame is overlapped with the transmission area or not;
and if the target frame and the transmission area are overlapped, determining that the position of the target frame is the position of the express, and obtaining the express target in the panoramic express picture.
6. The method of claim 4, wherein the performing quantity recognition on the express mail target to determine the express mail quantity corresponding to the express mail target in the panoramic express mail picture includes:
cutting the panoramic express image according to the position of the target frame in the panoramic express image to obtain an express image to be identified, wherein the express image only comprises express targets;
acquiring a gradient map corresponding to the express mail picture;
and inputting the express mail pictures and the gradient map into a preset express mail quantity identification model, and determining the quantity of express mail corresponding to the express mail targets in the panoramic express mail pictures.
7. The method for determining the quantity of the fast food according to claim 6, wherein the inputting the fast food picture and the gradient map into a preset fast food quantity recognition model to determine the quantity of the fast food corresponding to the fast food object in the panoramic fast food picture comprises:
and forming the express mail pictures and the gradient map into four-channel pictures, so as to input the number of express mail corresponding to the express mail target in the panoramic express mail picture into a preset express mail number identification model.
8. A number of fast food determining apparatus, the apparatus comprising:
the acquisition module is used for acquiring panoramic express pictures to be identified;
the overexposure judging module is used for judging whether the panoramic express picture is an overexposure picture or not;
the identification and positioning module is used for identifying and positioning the express in the panoramic express picture if the panoramic express picture is not an overexposure picture, so as to obtain an express target in the panoramic express picture;
and the quantity determining module is used for carrying out quantity identification on the express mail targets so as to determine the quantity of the express mail corresponding to the express mail targets in the panoramic express mail picture.
9. An electronic device, the electronic device comprising:
one or more processors;
a memory; and
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the method of fast-order quantity determination of any of claims 1 to 7.
10. A computer-readable storage medium, having stored thereon a computer program, the computer program being loaded by a processor to perform the steps of the method of determining the number of pieces of any of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210940120.4A CN117557896A (en) | 2022-08-05 | 2022-08-05 | Method and device for determining quantity of fast objects, electronic equipment and storage medium |
| PCT/CN2023/122075 WO2024027854A1 (en) | 2022-08-05 | 2023-09-27 | Method and apparatus for determining number of express items, and electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210940120.4A CN117557896A (en) | 2022-08-05 | 2022-08-05 | Method and device for determining quantity of fast objects, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117557896A true CN117557896A (en) | 2024-02-13 |
Family
ID=89821085
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210940120.4A Pending CN117557896A (en) | 2022-08-05 | 2022-08-05 | Method and device for determining quantity of fast objects, electronic equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN117557896A (en) |
| WO (1) | WO2024027854A1 (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109376656A (en) * | 2018-10-24 | 2019-02-22 | 弭吉荣 | A kind of method and system for differentiating type of goods and number of computations by shooting style |
| CN109740606B (en) * | 2018-12-20 | 2021-02-05 | 上海众源网络有限公司 | Image identification method and device |
| CN114693039A (en) * | 2020-12-30 | 2022-07-01 | 顺丰科技有限公司 | Abnormal express identification method and device, computer equipment and storage medium |
| CN114612739A (en) * | 2022-02-24 | 2022-06-10 | 江西裕丰智能农业科技有限公司 | Binocular panoramic image target detection method and device and computer equipment |
| CN114781527A (en) * | 2022-04-27 | 2022-07-22 | 武汉大学中南医院 | Karyotype identification method and device based on fluorescent photograph and electronic equipment |
-
2022
- 2022-08-05 CN CN202210940120.4A patent/CN117557896A/en active Pending
-
2023
- 2023-09-27 WO PCT/CN2023/122075 patent/WO2024027854A1/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024027854A1 (en) | 2024-02-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108460908A (en) | Automatic vending method and system and automatic vending device and automatic vending machine | |
| CN107077744A (en) | Generated using the threedimensional model at edge | |
| WO2023236825A1 (en) | Method and apparatus for monitoring capacity utilization rate, and computer-readable storage medium | |
| CN108875474A (en) | Assess the method, apparatus and computer storage medium of face recognition algorithms | |
| CN115908913A (en) | RGBD-based parcel category detection method and electronic equipment | |
| CN113804418A (en) | Laser position adjusting method and device | |
| CN112756265A (en) | Article sorting abnormity detection method, device industrial control equipment and storage medium | |
| CN114529843A (en) | Cargo congestion identification method and device, electronic equipment and storage medium | |
| CN117557896A (en) | Method and device for determining quantity of fast objects, electronic equipment and storage medium | |
| CN117788742A (en) | Irregular part identification method, irregular part identification device, computer equipment and storage medium | |
| CN115619698A (en) | Method and device for detecting defects of circuit board and model training method | |
| CN112990189B (en) | Cargo congestion identification method and device, electronic equipment and storage medium | |
| CN118279223A (en) | Method and device for determining position of package and related equipment | |
| CN115019157B (en) | Object detection method, device, equipment and computer readable storage medium | |
| CN116266392A (en) | Legacy detection positioning method, legacy detection positioning device, server and storage medium | |
| CN118262203A (en) | Contraband detection method, device, computer equipment and storage medium | |
| CN117372738A (en) | Target object quantity detection method and device, electronic equipment and storage medium | |
| CN118279898A (en) | Automatic identification method and device for regular box body of express mail and related equipment thereof | |
| CN117416140B (en) | Printer paper-out detection alarm method and related device | |
| WO2024088251A1 (en) | Parcel size measurement method and apparatus, computer device and storage medium | |
| JP6939855B2 (en) | Information processing equipment, information processing systems, control methods, and programs | |
| CN115995095A (en) | Method and device for detecting personnel dressing and computer readable storage medium | |
| CN118247719A (en) | Early warning method and device for dumping cage vehicle and related equipment thereof | |
| CN117994715A (en) | Contraband detection method and device, electronic equipment and storage medium | |
| CN118279927A (en) | Method and device for determining package falling risk |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |