CN114067488B - Recovery system - Google Patents
Recovery system Download PDFInfo
- Publication number
- CN114067488B CN114067488B CN202111296590.3A CN202111296590A CN114067488B CN 114067488 B CN114067488 B CN 114067488B CN 202111296590 A CN202111296590 A CN 202111296590A CN 114067488 B CN114067488 B CN 114067488B
- Authority
- CN
- China
- Prior art keywords
- network
- recovery
- rgb
- door
- feature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000011084 recovery Methods 0.000 title claims abstract description 57
- 238000004566 IR spectroscopy Methods 0.000 claims abstract description 17
- 238000005303 weighing Methods 0.000 claims abstract description 5
- 238000004064 recycling Methods 0.000 claims description 43
- 238000000605 extraction Methods 0.000 claims description 41
- 239000000463 material Substances 0.000 claims description 22
- 238000000034 method Methods 0.000 claims description 15
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 claims description 14
- 239000010814 metallic waste Substances 0.000 claims description 8
- 229910052742 iron Inorganic materials 0.000 claims description 7
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 claims description 6
- 229910052782 aluminium Inorganic materials 0.000 claims description 6
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 claims description 6
- 229910052802 copper Inorganic materials 0.000 claims description 6
- 239000010949 copper Substances 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 6
- 238000004140 cleaning Methods 0.000 claims description 5
- 239000010922 glass waste Substances 0.000 claims description 4
- 239000010784 textile waste Substances 0.000 claims description 4
- 239000011159 matrix material Substances 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 239000004744 fabric Substances 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 239000013598 vector Substances 0.000 description 3
- 208000037170 Delayed Emergence from Anesthesia Diseases 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000008241 heterogeneous mixture Substances 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 239000004753 textile Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F7/00—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus
- G07F7/06—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus by returnable containers, i.e. reverse vending systems in which a user is rewarded for returning a container that serves as a token of value, e.g. bottles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01G—WEIGHING
- G01G19/00—Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
- G01G19/52—Weighing apparatus combined with other objects, e.g. furniture
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/30—Administration of product recycling or disposal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/08—Payment architectures
- G06Q20/14—Payment architectures specially adapted for billing systems
- G06Q20/145—Payments according to the detected use or quantity
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C9/00—Individual registration on entry or exit
- G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
- G07C9/00896—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys specially adapted for particular uses
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02W—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO WASTEWATER TREATMENT OR WASTE MANAGEMENT
- Y02W90/00—Enabling technologies or technologies with a potential or indirect contribution to greenhouse gas [GHG] emissions mitigation
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Data Mining & Analysis (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Accounting & Taxation (AREA)
- Molecular Biology (AREA)
- Mathematical Physics (AREA)
- Evolutionary Biology (AREA)
- General Business, Economics & Management (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Finance (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Computing Systems (AREA)
- Sustainable Development (AREA)
- Entrepreneurship & Innovation (AREA)
- Marketing (AREA)
- Development Economics (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a recovery system, comprising: the device comprises a box body, a recovery bin arranged below the inside of the box body, a camera arranged in the recovery bin and an article identifier for identifying and classifying recovered articles, wherein a bottom plate is arranged at the bottom end of the inside of the recovery bin, a weight sensor is arranged at the bottom end of the bottom plate and used for weighing the recovered articles on the bottom plate, and the camera is arranged above the bottom plate, is aligned with the recovered articles on the bottom plate and is used for acquiring RGB data and IR data of the recovered articles; a billing system is also included. The scheme automatically performs category-based pricing on the recyclable item. When more than one type of recyclable item is detected, the price is calculated based on the lowest priced item type and the weight of the recyclable item.
Description
Technical Field
The invention relates to the technical field of recovery, in particular to a recovery system.
Background
At present, along with the increasing importance of people on environmental protection, recycling technology is also developed greatly, and various recycling systems such as a clothes recycling box and a mobile phone recycling station are proposed for recycling. An automated recovered article recovery system is required to identify different types of recovered articles for recovery or to provide the customer with a cost of recovered article treatment, respectively, based on the different types of recovered articles.
The chinese patent publication CN112543680a discloses a method of recovering coins from waste material by capturing image data of each piece in a heterogeneous mixture of materials moving through the camera in a stream, wherein the materials in the heterogeneous mixture of materials have various different shapes including one or more different geometries; classifying materials having one or more specified geometries into a first class; classifying materials that do not have the one or more specified geometries into a second classification; and sorting, by an automatic sorting apparatus, materials classified into the first classification from materials classified into the second classification.
The method solves the recovery problem that the existing recovery box or recovery station cannot intelligently identify a certain type of products to a certain extent. However, most of the current consumer product recycling fields are oriented to electronic equipment such as mobile phones and fabrics, so that the current recycling technology needs cannot be met with maximum efficiency. And the electronic equipment is easy to cause secondary damage due to overlarge drop when being put into the box.
Therefore, there is a need for a recycling system that solves the above problems.
Disclosure of Invention
The invention aims to: in order to overcome the defects in the prior art, the invention provides a recovery system which is reasonable in layout and simple to manufacture.
The technical scheme is as follows: a recovery system, comprising:
The front side of the box body is provided with a delivery door and a recovery door in sequence from top to bottom;
the recovery bin is arranged below the box body and is respectively communicated with the delivery door and the recovery door, a bottom plate is arranged at the bottom end of the recovery bin, and a weight sensor is arranged at the bottom end of the bottom plate and used for weighing recovered objects on the bottom plate;
the camera is arranged above the bottom plate, is aligned with the recovered objects on the bottom plate and is used for acquiring RGB data and IR data of the recovered objects;
An article identifier for performing the following recovery article classification identification method:
Normalizing the RGB data and IR data, respectively;
Inputting the normalized RGB data into an RGB feature extraction network to obtain an RGB feature map, wherein the RGB feature map characterizes the outline and texture of the recovered object;
Inputting the normalized IR data into an IR feature extraction network to obtain an IR feature map, wherein the IR feature map characterizes the material quality of the recovered article, and the IR feature map and the RGB feature map are equal in length and width;
Merging the RGB feature map and the IR feature map into a feature dataset and inputting the feature dataset into a classification network to obtain a classification of the recovered articles, wherein the recovered article classification comprises metal waste, textile waste and glass waste and the metal waste classification comprises at least one sub-classification of iron, aluminum, copper;
the system also comprises a charging system for generating a payment amount according to the classification and the weight of the recovered articles and paying.
Further, the system also comprises a notification system for notifying a cleaning person to recycle the recycled objects according to the fact that the total weight of the recycled objects exceeds a preset value.
Further, the RGB feature extraction network and the IR feature network respectively include a first convolution network, the first convolution network shares parameters with a depth residual network, and the training method of the RGB feature extraction network and the IR feature network specifically includes:
Extracting a first convolution network: training the depth residual error network through a training set; a first convolutional network of parameters discarded by the depth residual network; scoring the first convolutional network by a test set;
And circularly executing the first convolution network extraction on the depth residual error network to obtain a plurality of groups of first convolution networks and scores corresponding to the first convolution networks.
And respectively designating the highest scores in a plurality of groups of first convolution networks as the convolution layers in the RGB feature extraction network or the IR feature network.
Further, the delivery door is arranged to be rotatable open only in the direction of the inside of the recovery compartment.
Further, a first electronic lock used for locking the delivery door is arranged on the delivery door, and a second electronic lock used for locking the recovery door is arranged on the recovery door.
Further, a mobile phone recycling bin for recycling electronic equipment is further arranged in the box body, a mobile phone bin door for opening or closing the mobile phone recycling bin is arranged on the box body, a third electronic lock is arranged on the mobile phone bin door, and a detection device is arranged in the mobile phone recycling bin and used for detecting whether the electronic equipment exists in the mobile phone recycling bin or not and notifying cleaning personnel to recycle through the notification system.
Further, the detection device is a pressure sensor or a data line.
Further, a printer is further arranged on one side of the recycling bin in the box body.
Further, the top is equipped with L type support in the box L type support bottom is equipped with the camera, including IR camera and RGB camera, just the camera is close to retrieve the door setting.
Further, a lamp box is arranged at the top of the box body.
The beneficial effects are that: in the recycling system, a camera is arranged on a traditional recycling box body, RGB data and IR data are respectively acquired for recyclable objects, and an RGB feature map and an IR feature map are respectively extracted, wherein the RGB feature map and the IR feature map reflect the image features of one recyclable object. The RGB feature map contains rich information, can embody the outline and texture of the recyclable item, and is beneficial to identifying specific items of the recyclable item. The IR characteristic map mainly reflects the material property of the recyclable item through reflection, and the IR data is obtained through infrared rays, so that the IR characteristic map can reflect the material property of the recyclable item under various illumination environments. Then, the weight of the recyclable material is calculated by classification, and the recycled material can be converted into money to be paid to personnel delivering the recycled material by a charging system, so that the recycling enthusiasm is improved. The scheme is that the recyclable article is weighed through a weighing table, then corresponding unit price is carried out according to the detected type of the recyclable article, and the recyclable article is priced through a charging system and is output. The scheme automatically performs category-based pricing on the recyclable item. When more than one type of recyclable item is detected, the price is calculated based on the lowest priced item type and the weight of the recyclable item.
Drawings
FIG. 1 is a schematic perspective view of one embodiment of a recovery system of the present application;
FIG. 2 is a schematic cross-sectional plan view of the recovery system of FIG. 1;
FIG. 3 is a flow chart of article sorting by the article sorter of the recycling system of FIG. 1;
FIG. 4 is a flow chart of a training method of the step RGB feature extraction network and IR feature network of FIG. 3;
FIG. 5 is an additional flow chart of the item classifier classification process of FIG. 3;
fig. 6 is a schematic diagram of the embodiment shown in fig. 1.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that the descriptions of "first," "second," "left," "right," etc. in this disclosure are for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In addition, the technical solutions of the embodiments may be combined with each other, but it is necessary to base that the technical solutions can be realized by those skilled in the art, and when the technical solutions are contradictory or cannot be realized, the combination of the technical solutions should be considered to be absent and not within the scope of protection claimed in the present invention.
Referring to fig. 1-6, one embodiment of the recycling system of the present invention includes a housing 1, a recycling bin 2, a camera 3, an item identifier, and a billing system. It should be noted that this embodiment takes textile recycling as an example, but is not limited to recycling materials such as clothing fabrics. The front side of the box body 1 is sequentially provided with a delivery door 21 and a recovery door 22 from top to bottom, the delivery door 21 and the recovery door 22 are arranged up and down, and a user can conveniently deliver recovered articles, so that the user is prevented from squatting or bending down, and the user experience is improved.
The recovery bin 2 is arranged below the inside of the box body 1 and is respectively communicated with the delivery door 21 and the recovery door 22, a bottom plate 23 is arranged at the bottom end in the recovery bin 2, and a weight sensor 24 is arranged at the bottom end of the bottom plate 23 and used for weighing recovery articles on the bottom plate 23.
The camera 3 is arranged above the bottom plate 23 in the recycling bin 2, is aligned with the recycling object on the bottom plate 23, and is used for acquiring RGB data and IR data of the recycling object. Specifically, IR cameras and RGB cameras are included.
The article identifier, see fig. 3, is used to perform the following recovery article classification identification method:
step S100: acquiring RGB data and IR data of a recyclable item, and normalizing the RGB data and IR data, respectively;
step S200: inputting the normalized RGB data into an RGB feature extraction network to obtain an RGB feature map, wherein the RGB feature map characterizes the outline and texture of the recyclable item;
Step S300: inputting the normalized IR data into an IR feature extraction network to obtain an IR feature map, wherein the IR feature map characterizes the material of the recyclable item, the IR feature map and the RGB feature map being equal in length and width;
Step S400: the RGB feature map and the IR feature map are combined into a feature dataset and the feature dataset is input into a classification network to obtain a classification of the recyclable item, wherein the recyclable item classification comprises metal waste, textile waste, and glass waste and the metal waste classification comprises at least one sub-classification of iron, aluminum, copper. In one embodiment, the three sub-classifications of iron, aluminum and copper can be provided at the same time, and the two sub-classifications of iron, aluminum or iron and copper can be provided.
The charging system is used for generating a payment amount according to the classification and the weight of the recovered articles and paying.
Preferably, the object identifier is a hardware or software processor with the above functions, and in this embodiment, may be specifically an android-based management program APP. In other embodiments, it may be divided into the following modules:
A preprocessing module 100 for normalizing the RGB data and the IR data, respectively;
an RGB extraction module 200 for inputting the normalized RGB data into an RGB feature extraction network to obtain an RGB feature map, wherein the RGB feature map characterizes the outline and texture of the recyclable item;
An IR extraction module 300 for inputting normalized IR data into an IR feature extraction network to obtain an IR feature map, wherein the IR feature map characterizes the material of the recyclable item, and the IR feature map and the RGB feature map are equal in length and width;
a classification module 400 for merging the RGB feature map and the IR feature map into feature data sets and inputting the feature data sets into a classification network to obtain a classification of the recyclable item, wherein the classification of the recyclable item comprises metal waste, textile waste, and glass waste, and the classification of the metal waste comprises iron, aluminum, copper sub-classification.
In the recycling system, a camera 3 is arranged on a traditional recycling box body 1, RGB data and IR data are respectively acquired for recyclable objects, and an RGB feature map and an IR feature map are respectively extracted, wherein the RGB feature map and the IR feature map reflect the image features of one recyclable object. The RGB feature map contains rich information, can embody the outline and texture of the recyclable item, and is beneficial to identifying specific items of the recyclable item. The IR characteristic map mainly reflects the material property of the recyclable item through reflection, and the IR data is obtained through infrared rays, so that the IR characteristic map can reflect the material property of the recyclable item under various illumination environments. Then, the weight of the recyclable material is calculated by classification, and the recycled material can be converted into money to be paid to personnel delivering the recycled material by a charging system, so that the recycling enthusiasm is improved. The scheme automatically performs category-based pricing on the recyclable item. When more than one type of recyclable item is detected, the price is calculated based on the lowest priced item type and the weight of the recyclable item.
Specifically, the top is equipped with L type support 31 in the box 1L type support 31 bottom is equipped with the camera 3, just the camera 3 is close to delivery door 21 sets up, and two kinds of cameras 3 of IR and RGB are integrated simultaneously to the camera 3. Meanwhile, as the camera 3 is close to the delivery door 21, the identification can be performed at the moment that the recovered articles are input by the delivery door 21, the identification error caused by rolling and other reasons after the recovered articles fall into the recovery bin 2 is prevented, and the identification efficiency and accuracy are improved.
Further, the system also comprises a notification system for notifying a cleaning person to recycle the recycled objects according to the fact that the total weight of the recycled objects exceeds a preset value. Preferably, the notification can be performed by using instant messaging tool software such as WeChat, payment treasures and the like, and also can be performed by using short messages, telephone notification and the like.
Further referring to fig. 3, the RGB feature extraction network and the IR feature network respectively include a first convolution network, where the first convolution network shares parameters with a depth residual network, and the training method of the RGB feature extraction network and the IR feature network specifically includes:
step S11: extracting a first convolution network: training the depth residual error network through a training set; a first convolutional network of parameters discarded by the depth residual network; scoring the first convolutional network by a test set;
step S12: and circularly executing the first convolution network extraction on the depth residual error network to obtain a plurality of groups of first convolution networks and scores corresponding to the first convolution networks.
Step S13: and respectively designating the highest scoring of a plurality of groups of first convolution networks as the convolution layers in the rgb feature extraction network or the IR feature network.
The RGB feature extraction network and the IR feature extraction network are respectively trained, the steps required by training are the same, the required training set and parameter adjustment are set according to the requirements of the RGB feature extraction network or the IR feature extraction network. Taking RGB feature extraction network as an example, the method trains a depth residual error network through a training set, in the training process, in order to prevent gradient disappearance, a part of parameters of the depth residual error network are randomly discarded, and a first convolution network with smaller parameter scale is formed by combining the discarded part of parameters with a feature data set.
Along with the training, the first convolution network is extracted once in each round of training, and the discarded parameters of the depth residual error network are random, so that the discarded parameters are trained as well, the overall performance of the obtained first convolution network is improved, and a plurality of first convolution networks generated after a plurality of times of training are scored.
For the extracted plurality of first convolution networks, one of the highest scores is extracted as a portion of convolution in the RGB feature extraction network, and similarly the portion of convolution in the IR feature extraction network is also determined by extraction in the same manner. The scheme can ensure the feature extraction precision, reduce the sizes of the RGB feature extraction network and the IR feature extraction network in response on the basis of ensuring the classification precision, and reduce the parameter quantity of the RGB feature extraction network and the IR feature extraction network so as to reduce the calculation cost in the feature extraction process. And the identification efficiency of recyclable articles is improved.
In one embodiment, the feature extraction accuracy of the first network obtained after several training is 87.4%,88.6%,92.7%,94.1%,96.2%,97.5%, respectively, while the feature extraction accuracy of the residual network itself after final training is 98.7%, and the first network with the highest accuracy is visible, and the feature extraction accuracy is already very close to the level of the residual network, and the calculation cost is greatly reduced.
Further, in the depth residual network, the scaling parameter γ in the last BN layer in each residual block is set to 0 to output an all 0 vector.
The parameter gamma is set to 0 to output the all 0 vectors, so that the residual block outputs the all 0 vectors before residual connection, the scale of a residual network output matrix is reduced, and the training efficiency of the first matrix is improved. The scheme can accelerate the speed of deploying the recyclable object identification method in any environment.
Further, the learning rate of the depth residual network is set to exponentially decays, and the lowest learning rate of the depth residual network is set to five percent of the initial learning rate.
According to the scheme, the learning rate of the depth residual error network is kept, the overfitting in the first network training process is prevented, and the richness of the recyclable object features extracted by the first network is improved, so that the accuracy of the recyclable object classification is improved.
Further, in the training process of the depth residual network through the training set, when a parameter in a convolution kernel in the depth residual network is smaller than a preset value, the parameter is set to 0, so that each convolution kernel forms a sparse matrix.
Specifically, the scheme can reduce the number of parameters in the depth residual error network and the first convolution network, for some parameters with values close to 0, obvious characteristics cannot be provided, computer resources are occupied, the calculated amount of the neural network can be greatly reduced by setting the parameters to zero, meanwhile, the characteristics of recyclable articles can be prevented from being lost, and the scheme improves the identification efficiency of the recyclable articles.
Further, the non-zero parameter set in the sparse matrix forms a block.
According to the scheme, the feature extraction can be concentrated in the image, and the recyclable object can provide enough feature positions.
In some embodiments, the delivery door 21 is arranged to be rotatable open only towards the inside of the recovery compartment 2. In particular, this can be achieved by providing a unidirectional spindle, torsion spring, on the inside edge of the delivery door 21 to prevent someone from stealing the fabric in the stowage bin 2 during delivery.
The delivery door 21 is provided with a first electronic lock for locking the delivery door 21, and the recovery door 22 is provided with a second electronic lock for locking the recovery door 22. To prevent someone from stealing the recovered items in the recovery bin 2 in an unused state.
As a further optimization for this embodiment, the box 1 is further provided with a mobile phone recycling bin 4 for recycling electronic devices, the box 1 is provided with a mobile phone bin door 41 for opening or closing the mobile phone recycling bin 4, the mobile phone bin door 41 is provided with a third electronic lock, and the mobile phone recycling bin 4 is internally provided with a detection device for detecting whether the mobile phone recycling bin 4 is provided with electronic devices or not and notifying cleaning personnel of recycling through the notification system. The third electronic lock can prevent someone from stealing the electronic equipment in the mobile phone recycling bin 4.
Specifically, the detection device is a pressure sensor or a data line. The pressure sensor detects the pressure at the bottom of the mobile phone recycling bin 4, so that whether the mobile phone recycling bin 4 contains electronic equipment to be recycled is judged. The data line can be connected manually by a user, so that the electronic equipment can be charged or identified, and the state of the electronic equipment to be recovered in the mobile phone recovery bin 4 can be detected.
In another embodiment, a printer is further disposed on one side of the recycling bin 2 in the case 1, and is used for connecting with a cloud terminal, and printing a cloud terminal photograph or document to improve the entertainment function of the recycling system.
In another embodiment, the top of the box 1 is provided with a lamp box 5, which can broadcast advertisements or other information to improve the entertainment function of the recycling system.
The foregoing is only a preferred embodiment of the invention, it being noted that: it will be apparent to those skilled in the art that various modifications and adaptations can be made without departing from the principles of the present invention, and such modifications and adaptations are intended to be comprehended within the scope of the invention.
Claims (9)
1. A recycling system, comprising:
The front side of the box body is provided with a delivery door and a recovery door in sequence from top to bottom;
the recovery bin is arranged below the box body and is respectively communicated with the delivery door and the recovery door, a bottom plate is arranged at the bottom end of the recovery bin, and a weight sensor is arranged at the bottom end of the bottom plate and used for weighing recovered objects on the bottom plate;
the camera is arranged above the bottom plate, is aligned with the recovered objects on the bottom plate and is used for acquiring RGB data and IR data of the recovered objects;
An article identifier for performing the following recovery article classification identification method:
Normalizing the RGB data and IR data, respectively;
Inputting the normalized RGB data into an RGB feature extraction network to obtain an RGB feature map, wherein the RGB feature map characterizes the outline and texture of the recovered object;
Inputting the normalized IR data into an IR feature extraction network to obtain an IR feature map, wherein the IR feature map characterizes the material quality of the recovered article, and the IR feature map and the RGB feature map are equal in length and width;
Merging the RGB feature map and the IR feature map into a feature dataset and inputting the feature dataset into a classification network to obtain a classification of the recovered articles, wherein the recovered article classification comprises metal waste, textile waste and glass waste and the metal waste classification comprises at least one sub-classification of iron, aluminum, copper;
the RGB feature extraction network and the IR feature network respectively comprise a first convolution network, the first convolution network shares parameters with a depth residual error network, and the training method of the RGB feature extraction network and the IR feature network specifically comprises the following steps:
Extracting a first convolution network: training the depth residual error network through a training set; a first convolutional network of parameters discarded by the depth residual network; scoring the first convolutional network by a test set;
circularly executing extraction of a first convolution network on the depth residual error network to obtain a plurality of groups of first convolution networks and scores corresponding to the first convolution networks;
respectively designating the highest scores in a plurality of groups of first convolution networks as convolution layers in an RGB feature extraction network or an IR feature network;
the system also comprises a charging system for generating a payment amount according to the classification and the weight of the recovered articles and paying.
2. The recovery system of claim 1, wherein: the system also comprises a notification system for notifying a cleaning person to recycle the recycled objects according to the fact that the total weight of the recycled objects exceeds a preset value.
3. The recovery system of claim 1, wherein: the delivery door is arranged to be rotatable open only in the direction of the inside of the recycling bin.
4. A recovery system as claimed in claim 3, wherein: the delivery door is provided with a first electronic lock used for locking the delivery door, and the recovery door is provided with a second electronic lock used for locking the recovery door.
5. The recovery system of claim 2, wherein: still be equipped with the cell-phone recovery bin that is used for retrieving electronic equipment in the box, be equipped with the cell-phone door that is used for opening or close the cell-phone recovery bin on the box, be equipped with the third electronic lock on the cell-phone door, just be equipped with detection device in the cell-phone recovery bin for detect whether there is electronic equipment in the cell-phone recovery bin and warp notify the system and inform the clearance personnel to retrieve.
6. The recovery system of claim 5, wherein: the detection device is a pressure sensor or a data line.
7. The recovery system of claim 1, wherein: and a printer is further arranged on one side of the recycling bin in the box body.
8. The recovery system of claim 1, wherein: the top is equipped with L type support in the box L type support bottom is equipped with the camera, including IR camera and RGB camera, just the camera is close to retrieve the door setting.
9. The recovery system of claim 1, wherein: the top of the box body is provided with a lamp box.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111296590.3A CN114067488B (en) | 2021-11-03 | 2021-11-03 | Recovery system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111296590.3A CN114067488B (en) | 2021-11-03 | 2021-11-03 | Recovery system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114067488A CN114067488A (en) | 2022-02-18 |
CN114067488B true CN114067488B (en) | 2024-06-11 |
Family
ID=80273932
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111296590.3A Active CN114067488B (en) | 2021-11-03 | 2021-11-03 | Recovery system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114067488B (en) |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104609060A (en) * | 2015-01-23 | 2015-05-13 | 遂宁市为户利垃圾分类收集处理有限公司 | Intelligent garbage recycling method |
CN105480619A (en) * | 2015-12-20 | 2016-04-13 | 重庆市吉德环保工程有限公司 | Intelligent renewable resource recovery system |
CN106185115A (en) * | 2016-07-19 | 2016-12-07 | 西华大学 | A kind of classified-refuse recovery system |
CN208622166U (en) * | 2018-06-12 | 2019-03-19 | 重庆乐乐环保科技有限公司 | A kind of intelligent garbage recycling cabinet |
CN110577037A (en) * | 2018-06-08 | 2019-12-17 | 王俊杰 | Method for classifying, checking and recycling household garbage |
CN110660155A (en) * | 2019-09-11 | 2020-01-07 | 深圳鸿智云创科技有限公司 | Article recycling system and method |
CN111291604A (en) * | 2018-12-07 | 2020-06-16 | 深圳光启空间技术有限公司 | Face attribute identification method, device, storage medium and processor |
CN111797882A (en) * | 2019-07-30 | 2020-10-20 | 华为技术有限公司 | Image classification method and device |
CN112036500A (en) * | 2020-09-04 | 2020-12-04 | 广东弓叶科技有限公司 | Garbage classification method and device based on depth image and multispectral image fusion |
CN112150727A (en) * | 2020-09-29 | 2020-12-29 | 中国银行股份有限公司 | Self-service transaction processing method and device and self-service transaction cabinet |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109201514B (en) * | 2017-06-30 | 2019-11-08 | 京东方科技集团股份有限公司 | Waste sorting recycle method, garbage classification device and classified-refuse recovery system |
-
2021
- 2021-11-03 CN CN202111296590.3A patent/CN114067488B/en active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104609060A (en) * | 2015-01-23 | 2015-05-13 | 遂宁市为户利垃圾分类收集处理有限公司 | Intelligent garbage recycling method |
CN105480619A (en) * | 2015-12-20 | 2016-04-13 | 重庆市吉德环保工程有限公司 | Intelligent renewable resource recovery system |
CN106185115A (en) * | 2016-07-19 | 2016-12-07 | 西华大学 | A kind of classified-refuse recovery system |
CN110577037A (en) * | 2018-06-08 | 2019-12-17 | 王俊杰 | Method for classifying, checking and recycling household garbage |
CN208622166U (en) * | 2018-06-12 | 2019-03-19 | 重庆乐乐环保科技有限公司 | A kind of intelligent garbage recycling cabinet |
CN111291604A (en) * | 2018-12-07 | 2020-06-16 | 深圳光启空间技术有限公司 | Face attribute identification method, device, storage medium and processor |
CN111797882A (en) * | 2019-07-30 | 2020-10-20 | 华为技术有限公司 | Image classification method and device |
CN110660155A (en) * | 2019-09-11 | 2020-01-07 | 深圳鸿智云创科技有限公司 | Article recycling system and method |
CN112036500A (en) * | 2020-09-04 | 2020-12-04 | 广东弓叶科技有限公司 | Garbage classification method and device based on depth image and multispectral image fusion |
CN112150727A (en) * | 2020-09-29 | 2020-12-29 | 中国银行股份有限公司 | Self-service transaction processing method and device and self-service transaction cabinet |
Also Published As
Publication number | Publication date |
---|---|
CN114067488A (en) | 2022-02-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109300263B (en) | Settlement method and device for image recognition technology based on convolutional neural network | |
CN108335408B (en) | Article identification method, device and system for vending machine and storage medium | |
CN207742721U (en) | A kind of intelligent article retracting device | |
US7356162B2 (en) | Method for sorting postal items in a plurality of sorting passes | |
CN108665616B (en) | Garbage recycling method and device | |
CN112466035B (en) | Commodity identification method, device and system based on vision and gravity sensing | |
CN111222949A (en) | Community waste resource sharing method and system based on deep learning | |
CN110163647A (en) | A kind of data processing method and device | |
CN114937179B (en) | Junk image classification method and device, electronic equipment and storage medium | |
US20140032396A1 (en) | System and method for tracking bank notes | |
CN107480853A (en) | Goods and materials distribution method and goods and materials distributor | |
CN105095884A (en) | Pedestrian recognition system and pedestrian recognition processing method based on random forest support vector machine | |
CN108241821A (en) | Image processing equipment and method | |
CN107656960A (en) | The automatic patching system and method for subway lost objects management | |
US10118202B2 (en) | Method of sorting postal articles into a sorting frame with the sorted articles being counted automatically | |
WO2016199074A1 (en) | Universal coin sorter and coin counting machine | |
CN109903452A (en) | Waste recovery processing method, device, equipment and storage medium | |
US11341377B2 (en) | Image content moderation | |
CN114067488B (en) | Recovery system | |
JP5456776B2 (en) | How to classify multiple objects in data analysis | |
CN105788075A (en) | Device and system for classifying ring-pull cans and automatic selling device | |
JP6875760B1 (en) | Filtering processing system | |
CN113283832A (en) | Unmanned aerial vehicle pickup method, unmanned aerial vehicle pickup device, unmanned aerial vehicle sending device, unmanned aerial vehicle pickup equipment and storage medium | |
CN114529843A (en) | Cargo congestion identification method and device, electronic equipment and storage medium | |
CN1163854C (en) | Note/card handling apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |