WO2021012761A1

WO2021012761A1 - Garbage classification method, apparatus and device, and storage medium

Info

Publication number: WO2021012761A1
Application number: PCT/CN2020/090817
Authority: WO
Inventors: 石聪; 张治�; 杨宁
Original assignee: Oppo广东移动通信有限公司
Priority date: 2019-07-19
Filing date: 2020-05-18
Publication date: 2021-01-28
Also published as: CN110378418A

Abstract

Disclosed in embodiments of the present application relate to the field of garbage classification. Disclosed are a garbage classification method, apparatus and device, and a storage medium. The method comprises: transmitting original millimeter waves by means of a millimeter wave transmitter; receiving reflected millimeter waves by means of a millimeter wave receiver, the reflected millimeter waves being reflection echoes generated by projecting the original millimeter waves on garbage; and determining, according to the reflected wave characteristics of the reflected millimeter waves, a target garbage type to which garbage to be thrown belongs. Compared with the method for garbage classification in an image recognition mode in the prior art, the method provided by the embodiments of the present application facilitates the improvement of the accuracy and efficiency of garbage classification.

Description

垃圾分类方法、装置、设备及存储介质Garbage classification method, device, equipment and storage medium

本申请要求于2019年07月19日提交的申请号为201910656804.X、发明名称为“垃圾分类方法、装置、设备及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed on July 19, 2019, with the application number 201910656804.X and the invention title "Waste sorting method, device, equipment and storage medium", the entire content of which is incorporated herein by reference Applying.

技术领域Technical field

本申请实施例涉及垃圾分类领域，特别涉及一种垃圾分类方法、装置、设备及存储介质。The embodiments of the present application relate to the field of garbage classification, and in particular, to a garbage classification method, device, equipment, and storage medium.

背景技术Background technique

垃圾分类是一种按照指定标准对垃圾进行区分投放的方式，有助于提高垃圾的回收价值，并降低对环境的污染。Garbage classification is a way to differentiate and put garbage in accordance with designated standards, which helps to increase the value of garbage recycling and reduce environmental pollution.

不同地域采用的垃圾分类标准各不相同。比如，北京采用的垃圾分类标准将垃圾大致划分为可回收垃圾、厨余垃圾、有害垃圾和其他垃圾四大类，而上海采用的垃圾分类标准将垃圾大致划分为可回收垃圾、有害垃圾、干垃圾和湿垃圾四大类。可见，现有的垃圾分类较为复杂，不利于用户执行，且执行准确率较低。The garbage classification standards adopted in different regions are different. For example, the garbage classification standard adopted in Beijing roughly divides garbage into four categories: recyclable garbage, kitchen waste, hazardous garbage and other garbage, while the garbage classification standard adopted in Shanghai roughly divides garbage into recyclable garbage, hazardous garbage, and dry garbage. There are four categories of garbage and wet garbage. It can be seen that the existing garbage classification is relatively complicated, which is not conducive to user execution, and the execution accuracy rate is low.

发明内容Summary of the invention

本申请实施例提供了一种垃圾分类方法、装置、设备及存储介质。所述技术方案如下：The embodiments of the application provide a garbage classification method, device, equipment, and storage medium. The technical solution is as follows:

一方面，本申请实施例提供了一种垃圾分类方法，所述方法包括：On the one hand, an embodiment of the present application provides a garbage classification method, the method includes:

通过毫米波发射器发射原始毫米波；Transmit the original millimeter wave through the millimeter wave transmitter;

通过毫米波接收器接收反射毫米波，所述反射毫米波是所述原始毫米波投射在垃圾上产生的反射回波；Receiving a reflected millimeter wave by a millimeter wave receiver, where the reflected millimeter wave is a reflected echo generated by the original millimeter wave projected on the garbage;

根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。According to the reflected wave characteristics of the reflected millimeter wave, the target garbage type to which the garbage to be put belongs is determined.

另一方面，本申请实施例提供了一种垃圾分类装置，所述装置包括：On the other hand, an embodiment of the present application provides a garbage sorting device, which includes:

发射模块，用于通过毫米波发射器发射原始毫米波；Transmitting module, used to transmit the original millimeter wave through the millimeter wave transmitter;

接收模块，用于通过毫米波接收器接收反射毫米波，所述反射毫米波是所述原始毫米波投射在垃圾上产生的反射回波；A receiving module, configured to receive a reflected millimeter wave through a millimeter wave receiver, where the reflected millimeter wave is a reflected echo generated by the original millimeter wave projected on garbage;

分类模块，用于根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。The classification module is used to determine the target garbage type to which the garbage to be put belongs according to the reflected wave characteristics of the reflected millimeter wave.

另一方面，本申请实施例提供了一种垃圾分类设备，所述垃圾分类设备包括：处理器、存储器、毫米波发射器和毫米波接收器On the other hand, an embodiment of the present application provides a garbage sorting device, the garbage sorting device includes: a processor, a memory, a millimeter wave transmitter, and a millimeter wave receiver

所述毫米波发射器，用于发射原始毫米波；The millimeter wave transmitter is used to transmit original millimeter waves;

所述毫米波接收器，用于接收反射毫米波，所述反射毫米波是所述原始毫米波投射在垃圾上产生的反射回波；The millimeter wave receiver is configured to receive reflected millimeter waves, where the reflected millimeter waves are reflected echoes generated by the original millimeter waves projected on garbage;

所述处理器，用于根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。The processor is configured to determine the target garbage type to which the garbage to be put belongs according to the reflected wave characteristics of the reflected millimeter wave.

另一方面，本申请实施例提供了一种终端，所述终端包括如上述方面所述的垃圾分类设备和/或垃圾分类装置。On the other hand, an embodiment of the present application provides a terminal, and the terminal includes the garbage classification equipment and/or the garbage classification device as described in the foregoing aspect.

另一方面，本申请实施例提供了一种垃圾投放设备，所述垃圾投放设备包括如上述方面所述的垃圾分类设备和/或垃圾分类装置。On the other hand, an embodiment of the present application provides a garbage disposal device, which includes the garbage sorting device and/or the garbage sorting device as described in the above aspect.

另一方面，本申请实施例提供了一种垃圾回收监控设备，所述垃圾回收监控设备包括如上述方面所述的垃圾分类设备和/或垃圾分类装置。On the other hand, an embodiment of the present application provides a garbage collection monitoring device, which includes the garbage classification device and/or the garbage classification device as described in the above aspect.

另一方面，还提供了一种计算机程序产品，该计算机程序产品存储有至少一条指令，所述至少一条指令由处理器加载并执行以实现上述方面所述的垃圾分类方法。In another aspect, a computer program product is also provided, and the computer program product stores at least one instruction, and the at least one instruction is loaded and executed by a processor to implement the garbage classification method described in the foregoing aspect.

附图说明Description of the drawings

图1和图2示出了本申请一个示例性实施例提供的实施环境的示意图；Figures 1 and 2 show schematic diagrams of an implementation environment provided by an exemplary embodiment of the present application;

图3示出了本申请一个示例性实施例示出的垃圾分类方法的流程图；Fig. 3 shows a flowchart of a garbage classification method shown in an exemplary embodiment of the present application;

图4示出了本申请另一个示例性实施例示出的垃圾分类方法的流程图；Fig. 4 shows a flowchart of a garbage classification method shown in another exemplary embodiment of the present application;

图5示出了本申请另一个示例性实施例示出的垃圾分类方法的流程图；Fig. 5 shows a flowchart of a garbage classification method shown in another exemplary embodiment of the present application;

图6示出了本申请另一个示例性实施例示出的垃圾分类方法的流程图；Fig. 6 shows a flowchart of a garbage classification method shown in another exemplary embodiment of the present application;

图7和图8是图6所示垃圾分类方法实施过程的界面示意图；7 and 8 are schematic diagrams of the interface of the implementation process of the garbage classification method shown in FIG. 6;

图9示出了本申请另一个示例性实施例示出的垃圾分类方法的流程图；Fig. 9 shows a flowchart of a garbage classification method shown in another exemplary embodiment of the present application;

图10是一个示例性实施例提供的垃圾箱的结构示意图；FIG. 10 is a schematic structural diagram of a trash can provided by an exemplary embodiment;

图11示出了本申请另一个示例性实施例示出的垃圾分类方法的流程图；Fig. 11 shows a flowchart of a garbage classification method shown in another exemplary embodiment of the present application;

图12示出了本申请一个实施例提供的垃圾分类装置的结构框图；FIG. 12 shows a structural block diagram of a garbage classification device provided by an embodiment of the present application;

图13示出了本申请一个示例性实施例提供的垃圾分类设备的结构方框图。FIG. 13 shows a structural block diagram of a garbage classification device provided by an exemplary embodiment of the present application.

具体实施方式Detailed ways

为使本发明的目的、技术方案和优点更加清楚，下面将结合附图对本发明实施方式作进一步地详细描述。In order to make the objectives, technical solutions, and advantages of the present invention clearer, the embodiments of the present invention will be described in further detail below in conjunction with the accompanying drawings.

在本文中提及的“多个”是指两个或两个以上。“和/或”，描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。The "plurality" mentioned herein means two or more. "And/or" describes the association relationship of the associated objects, indicating that there can be three types of relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are in an "or" relationship.

本申请实施例提供的垃圾分类方法应用于垃圾分类设备中，该垃圾分类设备设置有毫米波发射器和毫米波接收器，毫米波发射器用于发射原始毫米波(频率在30GHz至300GHz之间，对应波长在1mm至10mm之间)，而毫米波接收器用于接收原始毫米波的反射回波。可选的，毫米波发射器和毫米波接收器可以同时集成在毫米波收发芯片中。The garbage classification method provided in the embodiments of the application is applied to a garbage classification device, which is provided with a millimeter wave transmitter and a millimeter wave receiver, and the millimeter wave transmitter is used to transmit the original millimeter wave (the frequency is between 30 GHz and 300 GHz, The corresponding wavelength is between 1mm and 10mm), and the millimeter wave receiver is used to receive the reflected echo of the original millimeter wave. Optionally, the millimeter wave transmitter and millimeter wave receiver can be integrated into the millimeter wave transceiver chip at the same time.

在一种可能的实施环境中，如图1所示，该垃圾分类设备应用于移动终端11。可选的，移动终端11中安装有垃圾分类应用程序，当需要进行垃圾分类时，用户开启垃圾分类应用程序，并根据应用程序提示将待投放垃圾12置于正对毫米波收发芯片的位置。当接收到对垃圾分类应用程序中分类功能的触发操作时，移动终端11即通过毫米波收发芯片发射毫米波，并接收反射回波，从而根据反射回波确定待投放垃圾12所属的垃圾类型。图1中，移动终端11采用文字形式对确定出的垃圾类型进行显示。In a possible implementation environment, as shown in FIG. 1, the garbage classification device is applied to the mobile terminal 11. Optionally, a garbage classification application is installed in the mobile terminal 11. When garbage classification is required, the user opens the garbage classification application and places the garbage 12 to be placed in a position facing the millimeter wave transceiver chip according to the application prompt. When receiving a trigger operation for the classification function in the garbage classification application, the mobile terminal 11 transmits millimeter waves through the millimeter wave transceiver chip and receives reflected echoes, thereby determining the type of garbage to be placed 12 belongs to according to the reflected echoes. In FIG. 1, the mobile terminal 11 displays the determined garbage types in text form.

在一种可能的实施方式中，移动终端11还与垃圾投放设备13建立有通信连接，该垃圾投放设备13是用于容纳垃圾的设备，比如，如图1所示，垃圾投放设备13是用于容纳至少一种垃圾的垃圾箱。In a possible implementation, the mobile terminal 11 also establishes a communication connection with a garbage disposal device 13, which is a device for containing garbage. For example, as shown in FIG. 1, the garbage disposal device 13 is For a trash can containing at least one type of trash.

当移动终端11确定出待投放垃圾12的垃圾类型后，通过通信连接将垃圾类型发送至垃圾投放设备13，垃圾投放设备13接收到该垃圾类型后，即开启与该垃圾类型对应的垃圾投放入口，以便用户将待投放垃圾12投放至垃圾投放设备13中。示意性的，如图1所示，移动终端11将垃圾类型“A类垃圾”发送至垃圾投放设备13后，垃圾投放设备13即开启“A类垃圾”对应的垃圾投放入口。After the mobile terminal 11 determines the type of garbage 12 to be dumped, it sends the type of garbage to the garbage disposal device 13 through the communication connection. After receiving the garbage type, the garbage disposal device 13 opens the garbage disposal entrance corresponding to the garbage type. , So that the user can put the garbage 12 to be put into the garbage putting equipment 13. Schematically, as shown in FIG. 1, after the mobile terminal 11 sends the garbage type "Type A garbage" to the garbage disposal device 13, the garbage disposal device 13 opens the garbage disposal entrance corresponding to the "Type A garbage".

在其他可能的实施方式中，该垃圾分类设备也可以应用于垃圾投放设备13中，即由垃圾投放设备13通过毫米波收发芯片对待投放垃圾的垃圾类型进行识别，并根据识别结果自动开启相应的垃圾投放入口。In other possible implementation manners, the garbage sorting device can also be applied to the garbage discharging device 13, that is, the garbage discharging device 13 recognizes the type of garbage to be dispensed through the millimeter wave transceiver chip, and automatically turns on the corresponding garbage according to the recognition result. The garbage is put into the entrance.

在另一种可能的实施环境中，如图2所示，该垃圾分类设备可以为应用于垃圾回收监控设备14，该垃圾回收监控设备14用于对用户的垃圾投放行为进行监控，并对不合规的垃圾投放行为进行记录。图2中，垃圾回收监控设备14是设置在垃圾投放设备13附近的视频监控设备。In another possible implementation environment, as shown in FIG. 2, the garbage sorting device can be a garbage collection monitoring device 14, which is used to monitor the user's garbage disposal behavior and check whether Compliance waste disposal behavior is recorded. In FIG. 2, the garbage collection monitoring device 14 is a video monitoring device set near the garbage disposal device 13.

在一种可能的实施方式中，用户投放垃圾过程中，垃圾回收监控设备14即通过毫米波收发芯片对待投放垃圾进行识别，并检测识别出的垃圾类型与用户实际投放的垃圾类型是否匹配，并在两者不匹配的情况下，对垃圾投放事件进行记录，并进一步上报至服务器，该垃圾投放事件可以包括垃圾回收监控设备14通过摄像头采集到的视频图像。In a possible implementation manner, during the user's disposal of garbage, the garbage collection monitoring device 14 recognizes the garbage to be discharged through the millimeter wave transceiver chip, and detects whether the recognized garbage type matches the garbage type actually dropped by the user, and In the case where the two do not match, the garbage disposal event is recorded and further reported to the server. The garbage disposal event may include the video image collected by the garbage collection monitoring device 14 through the camera.

当然，除了应用于上述垃圾投放场景外，上述垃圾分类设备还可以实现成为垃圾处理机器或垃圾回收车辆，从而在垃圾回收以及垃圾处理场景下实现垃圾类型识别，本申请实施例并不对此构成限定。Of course, in addition to being applied to the above-mentioned garbage disposal scenario, the above-mentioned garbage sorting device can also be realized as a garbage processing machine or garbage recycling vehicle, so as to realize garbage type identification in the garbage collection and garbage disposal scenarios, which is not limited in the embodiment of this application. .

请参考图3，其示出了本申请一个示例性实施例示出的垃圾分类方法的流程图。本实施例以该方法应用于垃圾分类设备来举例说明。该方法包括：Please refer to FIG. 3, which shows a flowchart of a garbage classification method according to an exemplary embodiment of the present application. In this embodiment, the method is applied to garbage classification equipment as an example. The method includes:

步骤301，通过毫米波发射器发射原始毫米波。Step 301: Transmit the original millimeter wave through the millimeter wave transmitter.

可选的，为了提高垃圾分类的准确率，垃圾分类设备通过预定方式提示用户将待投放垃圾放置在指定位置(比如距离毫米波发射器预定距离内，且正对毫米波发射器的位置)。比如，垃圾分类设备通过文字或语音方式进行提示。Optionally, in order to improve the accuracy of garbage classification, the garbage classification device prompts the user to place the garbage to be placed in a designated position (for example, within a predetermined distance from the millimeter wave transmitter and directly opposite to the position of the millimeter wave transmitter) in a predetermined manner. For example, the garbage sorting device will prompt by text or voice.

可选的，为了避免因垃圾之间相互遮挡，影响后续垃圾分类的准确性，垃圾分类设备通过预定方式提示用户调整待投放垃圾的角度，以便后续从多角度对待投放垃圾进行类型识别。Optionally, in order to avoid obstructing each other between garbage and affecting the accuracy of subsequent garbage classification, the garbage classification device prompts the user to adjust the angle of the garbage to be placed in a predetermined manner, so that the type of garbage to be placed can be identified from multiple angles.

在一种可能的实施方式中，垃圾分类设备按照预定发射周期发射原始毫米波，并基于每一次发射后接收到的反射回波确定垃圾类型。比如，当检测到存在垃圾分类需求时，垃圾分类设备每隔100ms发射一次原始毫米波。In a possible implementation manner, the garbage sorting device transmits the original millimeter wave according to a predetermined transmission period, and determines the type of garbage based on the reflected echo received after each transmission. For example, when it is detected that there is a need for garbage sorting, the garbage sorting device transmits raw millimeter waves every 100 ms.

可选的，为了避免其它设备发射的毫米波对垃圾分类造成影响，该原始毫米波预先经过调制，携带有垃圾分类设备的设备标识。Optionally, in order to prevent the millimeter waves emitted by other devices from affecting the garbage classification, the original millimeter waves are modulated in advance and carry the device identification of the garbage classification device.

步骤302，通过毫米波接收器接收反射毫米波，反射毫米波是原始毫米波投射在垃圾上产生的反射回波。In step 302, the reflected millimeter wave is received by the millimeter wave receiver. The reflected millimeter wave is the reflected echo generated by the original millimeter wave projected on the garbage.

电磁波在传播过程，当传播介质发生变化时，会出现反射、吸收、透射以及衍射等现象，并且电磁波的上述特性与电磁波的频率有关，其中，电磁波的频率越低(波长越长)，越容易发生透射和衍射现象，而频率越高(波长越短)，越容易发生反射现象，因此，本申请实施例中采用具有较好反射特性的毫米波(一种电磁波)，并根据毫米波的反射回波识别垃圾类型。During the propagation process of electromagnetic waves, when the propagation medium changes, reflection, absorption, transmission and diffraction will occur, and the above characteristics of electromagnetic waves are related to the frequency of electromagnetic waves. Among them, the lower the frequency of electromagnetic waves (the longer the wavelength), the easier Transmission and diffraction phenomena occur, and the higher the frequency (the shorter the wavelength), the easier the reflection phenomenon will occur. Therefore, in the embodiment of this application, the millimeter wave (an electromagnetic wave) with better reflection characteristics is used, and the reflection of the millimeter wave The echo identifies the type of garbage.

发射原始毫米波后，垃圾分类设备进一步通过毫米波接收器接收原始毫米波投射在垃圾上所产生的反射毫米波，以便后续基于该反射毫米波确定垃圾类型。After transmitting the original millimeter wave, the garbage sorting device further receives the reflected millimeter wave generated by the original millimeter wave projected on the garbage through the millimeter wave receiver, so as to subsequently determine the type of garbage based on the reflected millimeter wave.

可选的，为了区分垃圾分类设备以及其他设备发射的毫米波，通过毫米波接收器接收到反射毫米波后，垃圾分类设备对反射毫米波进行解调，并根据解调结果确定该反射毫米波是否为原始毫米波的反射回波。比如，垃圾分类设备根据解调得到的设备标识过滤出原始毫米波的反射回波。Optionally, in order to distinguish the millimeter waves emitted by the garbage sorting device from other devices, after receiving the reflected millimeter wave through the millimeter wave receiver, the garbage sorting device demodulates the reflected millimeter wave, and determines the reflected millimeter wave according to the demodulation result Whether it is the reflected echo of the original millimeter wave. For example, the garbage sorting device filters out the reflected echo of the original millimeter wave according to the device identification obtained by demodulation.

步骤303，根据反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。Step 303: Determine the target garbage type to which the garbage to be put belongs according to the reflected wave characteristics of the reflected millimeter wave.

其中，该目标垃圾类型为按照预设垃圾分类标准划分出的垃圾类型。比如，在一种垃圾分类标准下，该目标垃圾类型包括干垃圾和湿垃圾中的至少一种，在另一种垃圾分类标准下，该目标垃圾类型包括可回收垃圾、厨余垃圾、有害垃圾和其他垃圾中的至少一种，本申请实施例并不对垃圾类型进行具体限定。Among them, the target garbage type is a garbage type classified according to a preset garbage classification standard. For example, under one type of waste classification standard, the target type of waste includes at least one of dry waste and wet waste, and under another type of waste classification standard, the target type of waste includes recyclable waste, kitchen waste, and hazardous waste. And at least one of other garbage, the embodiment of this application does not specifically limit the type of garbage.

可选的，由于同一垃圾在不同分类标准下可能属于不同垃圾类型，因此垃圾分类设备根据当前地理位置，并基于当前地理位置对应的垃圾分类标准确定待投放垃圾所属的目标垃圾类型。Optionally, because the same garbage may belong to different garbage types under different classification standards, the garbage classification device determines the target garbage type to which the garbage to be put belongs according to the current geographic location and based on the garbage classification criteria corresponding to the current geographic location.

由于毫米波在不同介质中的反射、吸收以及透射等特性不同，因此，垃圾分类设备可以基于反射毫米波的反射波特征，确定待投放垃圾所属的目标垃圾类型。其中，反射毫米波的反射波特征可以包括如下至少一种：能量特征、频域特征、时域特征。Since the reflection, absorption, and transmission characteristics of millimeter waves in different media are different, the garbage sorting device can determine the target garbage type to which the garbage to be put belongs based on the reflected wave characteristics of the reflected millimeter wave. The reflected wave characteristics of the reflected millimeter wave may include at least one of the following: energy characteristics, frequency domain characteristics, and time domain characteristics.

在一种可能的实施方式中，开发人员预先对不同类型的垃圾进行毫米波反射测试(即向垃圾发射原始毫米波，并接收发射毫米波)，得到各种类型垃圾对应的反射波特征，并将垃圾类型与反射波特征之间的对应关系存储到垃圾分类设备中。后续进行垃圾类型识别时，垃圾分类设备即根据待投放垃圾对应的反射波特征以及上述对应关系确定出待投放垃圾所属的目标垃圾类型。In a possible implementation manner, the developer performs millimeter wave reflection tests on different types of garbage in advance (that is, launches original millimeter waves to the garbage, and receives and transmits millimeter waves) to obtain the reflected wave characteristics corresponding to various types of garbage, and The correspondence between the garbage type and the reflected wave characteristics is stored in the garbage sorting device. When the garbage type is subsequently identified, the garbage sorting device determines the target garbage type to which the garbage to be placed belongs according to the characteristics of the reflected wave corresponding to the garbage to be placed and the above-mentioned corresponding relationship.

可选的，确定出待投放垃圾所属的目标垃圾类型后，垃圾分类设备进一步根据目标垃圾类型进行后续操作，比如进行垃圾类型提醒、与其他设备进行信息交互或进行数据存储等等。Optionally, after determining the target garbage type to which the garbage to be placed belongs, the garbage sorting device further performs follow-up operations according to the target garbage type, such as reminding the garbage type, interacting with other devices, or storing data.

相关技术中采用图像识别技术识别垃圾类型时，若待投放垃圾被装入垃圾袋，由于无法采集到清晰的垃圾图像，导致垃圾类型的识别准确类较低，甚至无法识别；而采用本申请实施例提供的垃圾分类方法，利用毫米波的穿透特性，垃圾分类设备能够对垃圾袋内待投放垃圾的垃圾类型进行识别，不仅提高了垃圾类型的识别准确率，还扩大了垃圾类型识别的应用场景。When using image recognition technology to identify the type of garbage in related technologies, if the garbage to be placed is put into a garbage bag, since clear garbage images cannot be collected, the recognition accuracy of the garbage type is low, or even impossible to identify; this application is used for implementation The garbage classification method provided in the example uses the penetration characteristics of millimeter waves. The garbage classification equipment can identify the type of garbage to be placed in the garbage bag, which not only improves the accuracy of garbage type recognition, but also expands the application of garbage type recognition Scenes.

综上所述，本申请实施例提供的垃圾分类方法中，基于不同材质对毫米波的不同反射特性，通过毫米波发射器发射原始毫米波，并通过毫米波发射器接收原始毫米波投射在垃圾上产生的反射毫米波，从而根据反射毫米波的反射波特征，确定出待投放垃圾所述的目标垃圾类型；相较于相关技术中采用人工方式进行垃圾分类，采用本申请实施例提供的方法，有助于提高垃圾分类的效率以及准确率。In summary, in the garbage classification method provided by the embodiments of the present application, based on the different reflection characteristics of different materials on millimeter waves, the millimeter wave transmitter is used to transmit the original millimeter waves, and the millimeter wave transmitter receives the raw millimeter waves and is projected on the garbage. Based on the reflected millimeter wave generated by the reflected millimeter wave, the target type of garbage to be placed in the garbage is determined according to the reflected wave characteristics of the reflected millimeter wave; compared with the manual method of garbage classification in the related technology, the method provided in the embodiment of the application is adopted , Help to improve the efficiency and accuracy of garbage classification.

在一种可能的实施方式中，所述根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型，包括：In a possible implementation manner, the determining the target garbage type to which the garbage to be placed belongs according to the reflected wave characteristics of the reflected millimeter wave includes:

获取所述反射毫米波的反射波能量；Acquiring the reflected wave energy of the reflected millimeter wave;

根据所述反射波能量确定所述待投放垃圾所属的目标垃圾类型。Determine the target garbage type to which the garbage to be placed belongs according to the reflected wave energy.

在一种可能的实施方式中，干垃圾的所述反射波能量高于湿垃圾的所述反射波能量。In a possible implementation manner, the reflected wave energy of dry garbage is higher than the reflected wave energy of wet garbage.

对所述反射毫米波进行信号处理，信号处理方式包括时频域变换或多普勒变换中的至少一种；Performing signal processing on the reflected millimeter wave, and the signal processing manner includes at least one of time-frequency domain transform or Doppler transform;

对信号处理前以及信号处理后的所述反射毫米波进行特征提取，得到信号特征，所述信号特征包括时域信号特征、频域信号特征和多普勒特征中的至少一种；Performing feature extraction on the reflected millimeter waves before and after signal processing to obtain signal features, where the signal features include at least one of a time domain signal feature, a frequency domain signal feature, and a Doppler feature;

根据所述信号特征确定所述待投放垃圾所属的目标垃圾类型。Determine the target garbage type to which the garbage to be placed belongs according to the signal characteristics.

在一种可能的实施方式中，所述根据所述信号特征确定所述待投放垃圾所属的目标垃圾类型，包括：In a possible implementation manner, the determining the target garbage type to which the garbage to be placed belongs according to the signal characteristics includes:

将所述信号特征与预设信号特征进行特征匹配，其中，不同垃圾类型与不同预设信号特征之间存在映射关系；根据所述信号特征与所述预设信号特征的特征匹配度，确定所述待投放垃圾所属的目标垃圾类型；Perform feature matching between the signal feature and the preset signal feature, where there is a mapping relationship between different garbage types and different preset signal features; determine the matching degree between the signal feature and the preset signal feature State the target garbage type to which the garbage to be placed belongs;

或者，or,

将所述信号特征输入分类模型；根据所述分类模型输出的预测垃圾类型以及所述预测垃圾类型对应的预测概率，确定所述待投放垃圾所属的目标垃圾类型。The signal feature is input into a classification model; according to the predicted garbage type output by the classification model and the predicted probability corresponding to the predicted garbage type, the target garbage type to which the garbage to be put belongs is determined.

在一种可能的实施方式中，所述方法应用于设置有所述毫米波发射器和所述毫米波接收器的终端；In a possible implementation manner, the method is applied to a terminal provided with the millimeter wave transmitter and the millimeter wave receiver;

所述根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型之后，所述方法还包括：After determining the target garbage type to which the garbage to be placed belongs according to the reflected wave characteristics of the reflected millimeter wave, the method further includes:

响应于所述目标垃圾类型中包括至少两种垃圾类型，通过预定方式提示对所述至少两种垃圾类型进行分类。In response to the target garbage type including at least two garbage types, prompting to classify the at least two garbage types in a predetermined manner.

在一种可能的实施方式中，所述根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型之后，所述方法还包括：In a possible implementation manner, after determining the target garbage type to which the garbage to be placed belongs according to the reflected wave characteristics of the reflected millimeter wave, the method further includes:

响应于所述目标垃圾类型为单一垃圾类型，向所述垃圾投放设备发送垃圾投放指令，所述垃圾投放指令中包含所述目标垃圾类型，所述垃圾投放设备用于开启与所述目标垃圾类型对应的垃圾投放入口。In response to the target garbage type being a single garbage type, a garbage placement instruction is sent to the garbage placement device, the garbage placement instruction includes the target garbage type, and the garbage placement device is used to enable and The corresponding garbage disposal entrance.

在一种可能的实施方式中，所述方法应用于设置有所述毫米波发射器和所述毫米波接收器的垃圾投放设备；In a possible implementation manner, the method is applied to a garbage disposal device provided with the millimeter wave transmitter and the millimeter wave receiver;

所述通过毫米波发射器发射原始毫米波，包括：The transmitting the original millimeter wave through the millimeter wave transmitter includes:

响应于无法通过图像识别技术确定所述待投放垃圾所属的所述目标垃圾类型，通过所述毫米波发射器发射所述原始毫米波。In response to the inability to determine the target garbage type to which the garbage to be placed belongs through the image recognition technology, the original millimeter wave is transmitted through the millimeter wave transmitter.

响应于所述目标垃圾类型为单一垃圾类型，开启与所述目标垃圾类型对应的垃圾投放入口；In response to the target garbage type being a single garbage type, opening a garbage disposal inlet corresponding to the target garbage type;

响应于所述目标垃圾类型中包括至少两种垃圾类型，关闭各个垃圾投放入口，并通过预定方式提示对所述至少两种垃圾类型进行分类。In response to the target garbage type including at least two garbage types, each garbage discharge entrance is closed, and a predetermined method is used to prompt to classify the at least two garbage types.

在一种可能的实施方式中，所述方法应用于设置有毫米波发射器和毫米波接收器的垃圾回收监控设备；In a possible implementation manner, the method is applied to a garbage collection monitoring device provided with a millimeter wave transmitter and a millimeter wave receiver;

响应于所述目标垃圾类型中包括至少两种垃圾类型，或者，所述目标垃圾类型为单一垃圾类型，且选择垃圾类型与所述目标垃圾类型不同，记录所述待投放垃圾对应的投放事件，所述选择垃圾类型是投放所述待投放垃圾时选择的垃圾类型，所述投放事件包括投放时间、投放图像以及投放视频中的至少一种；Responsive to the target garbage type including at least two garbage types, or the target garbage type is a single garbage type, and the selected garbage type is different from the target garbage type, recording the placement event corresponding to the garbage to be placed, The selected garbage type is a garbage type selected when the garbage to be placed is placed, and the placement event includes at least one of placement time, placement image, and placement video;

向服务器上报所述投放事件。Report the delivery event to the server.

针对上述实施例中根据反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型的过程，在一种可能的实施方式中，在图3的基础上，如图4所示，步骤303可以包括如下步骤。Regarding the process of determining the target garbage type to which the garbage to be put belongs in the foregoing embodiment according to the reflected wave characteristics of the reflected millimeter wave, in a possible implementation manner, on the basis of FIG. 3, as shown in FIG. 4, step 303 may be Including the following steps.

步骤303A，获取反射毫米波的反射波能量。 Step 303A: Obtain the reflected wave energy of the reflected millimeter wave.

由于不同介质对毫米波的吸收能力不同，相应的，其反射回波的能量也存在差异，因此垃圾分类设备可以基于反射毫米波的反射波能量，确定垃圾类型。Since different media have different absorption capabilities for millimeter waves, and correspondingly, the energy of their reflected echoes is also different. Therefore, the garbage sorting equipment can determine the type of garbage based on the reflected wave energy of the reflected millimeter waves.

在一种可能的实施方式中，为了提高分类准确性，垃圾分类设备多次发射原始毫米波，并获取各次发射后接收到的反射毫米波的反射波能量，从而基于多个反射波能量最终确定反射波能量。In a possible implementation manner, in order to improve the classification accuracy, the garbage classification device emits the original millimeter wave multiple times, and obtains the reflected wave energy of the reflected millimeter wave received after each transmission, so that the final energy based on the multiple reflected wave energy Determine the reflected wave energy.

步骤303B，根据反射波能量确定待投放垃圾所属的目标垃圾类型。 Step 303B: Determine the target garbage type to which the garbage to be put belongs according to the reflected wave energy.

在一种可能的实施方式中，开发人员预先对不同类型的垃圾进行毫米波反射测试，从而根据测试结果得到各种垃圾类型对应的反射波能量范围。在进行垃圾类型识别过程中，垃圾分类设备即确定与当前获取到的反射波能量相匹配的反射波能量范围，从而将匹配的反射波能量范围对应的垃圾类型确定为目标垃圾类型。In a possible implementation manner, the developer performs millimeter wave reflection tests on different types of garbage in advance, so as to obtain the reflected wave energy ranges corresponding to various types of garbage according to the test results. In the process of identifying the type of garbage, the garbage classification device determines the reflected wave energy range that matches the currently acquired reflected wave energy, thereby determining the garbage type corresponding to the matched reflected wave energy range as the target garbage type.

可选的，由于湿垃圾的湿度较大，因此其反射回波的反射波能量较低；而干垃圾的湿度较低，因此其反射回波的反射波能量较高，因此垃圾分类设备可以根据反射波能量的高低区分干垃圾和湿垃圾。Optionally, due to the high humidity of wet garbage, the reflected wave energy of the reflected echo is low; while the humidity of dry garbage is low, so the reflected wave energy of the reflected echo is high, so the garbage classification equipment can be based on The level of reflected wave energy distinguishes dry garbage and wet garbage.

需要说明的是，当待投放垃圾中包含多种不同类型的垃圾时，垃圾分类设备接收到对应不同反射波能量的反射毫米波，进而确定出多种目标垃圾类型。It should be noted that when the garbage to be put in contains multiple different types of garbage, the garbage sorting device receives reflected millimeter waves corresponding to different reflected wave energy, and then determines multiple target garbage types.

本实施例中，垃圾分类设备基于反射毫米波的反射波能量，进行待投放垃圾的垃圾类型进行识别，能够实现简单的垃圾分类。In this embodiment, the garbage sorting equipment is based on the reflected wave energy of the reflected millimeter wave to identify the type of garbage to be put in, which can realize simple garbage classification.

为了进一步提高垃圾分类的准确性，在一种可能的实施方式中，垃圾分类设备可以先对反射毫米波的进行信号处理，并对信号处理前后的反射毫米波进行信号特征提取，从而基于提取到的信号特征识别垃圾类型。在图3的基础上，如图5所示，步骤303可以包括如下步骤：In order to further improve the accuracy of garbage classification, in a possible implementation, the garbage classification device may first process the reflected millimeter wave signal, and perform signal feature extraction on the reflected millimeter wave before and after the signal processing, so as to The signal characteristics identify the type of garbage. On the basis of FIG. 3, as shown in FIG. 5, step 303 may include the following steps:

步骤303C，对反射毫米波进行信号处理，信号处理方式包括时频域变换或多普勒变换中的至少一种。 Step 303C: Perform signal processing on the reflected millimeter wave, and the signal processing method includes at least one of time-frequency domain transform or Doppler transform.

为了方便后续提取各个维度的信号特征，接收到反射毫米波后，垃圾分类设备首先通过预定方式对发射毫米波进行信号处理。In order to facilitate subsequent extraction of signal characteristics in various dimensions, after receiving the reflected millimeter wave, the garbage sorting device first performs signal processing on the transmitted millimeter wave in a predetermined manner.

在一种可能的实施方式中，由于接收到的反射毫米波为时域信号，因此，垃圾分类设备通过时频域转换技术，将反射毫米波由时域信号转换为频域信号，以便后续提取反射毫米波在频域上的信号特征，其中，该时频域转换技术可以为傅里叶变换算法，本申请实施例对此不作限定。In a possible implementation manner, since the received reflected millimeter wave is a time domain signal, the garbage sorting device converts the reflected millimeter wave from a time domain signal into a frequency domain signal through a time-frequency domain conversion technology for subsequent extraction The signal characteristic of the reflected millimeter wave in the frequency domain, where the time-frequency domain conversion technique may be a Fourier transform algorithm, which is not limited in the embodiment of the present application.

在另一种可能的实施方式中，由于原始毫米波会在待投放垃圾上产生多普勒(Doppler)效应，因此垃圾分类设备还可以通过多普勒变换算法对反射毫米波进行处理，得到相应的多普勒频谱信号。In another possible implementation manner, since the original millimeter wave will produce a Doppler effect on the garbage to be placed, the garbage classification equipment can also process the reflected millimeter wave through the Doppler transform algorithm to obtain the corresponding Doppler spectrum signal.

当然，除了对反射毫米波进行上述处理外，垃圾分类设备还可以进行其他信号处理和转换，以便后续提取其他维度的信号特征，本申请实施例对此不作限定。Of course, in addition to the above-mentioned processing of reflected millimeter waves, the garbage classification device may also perform other signal processing and conversion so as to subsequently extract signal features of other dimensions, which is not limited in the embodiment of the present application.

步骤303D，对信号处理前以及信号处理后的反射毫米波进行特征提取，得到信号特征，信号特征包括时域信号特征、频域信号特征和多普勒特征中的至少一种。 Step 303D: Perform feature extraction on the reflected millimeter waves before and after the signal processing to obtain signal features. The signal features include at least one of a time domain signal feature, a frequency domain signal feature, and a Doppler feature.

对反射毫米波进行处理后，垃圾分类设备进一步从不同维度对反射毫米波进行特征提取，从而得到不同维度的信号特征。After processing the reflected millimeter waves, the garbage sorting device further extracts the characteristics of the reflected millimeter waves from different dimensions, thereby obtaining signal characteristics of different dimensions.

可选的，垃圾分类设备对处理前的反射毫米波进行时域特征提取，得到反射毫米波的时域信号特征，该时域信号特征可以包括反射延时；垃圾分类设备对时频域转换后的反射毫米波进行频域特征提取，得到反射毫米波的频域信号特征，该频域信号特征可以包括频域能量特征；垃圾分类设备对多普勒变换后的反射毫米波进行多普勒特征提取，得到反射毫米波的多普勒信号特征。Optionally, the garbage sorting device extracts time-domain features of the reflected millimeter waves before processing to obtain the time-domain signal characteristics of the reflected millimeter waves. The time-domain signal characteristics may include reflection delay; after the garbage sorting device converts the time-frequency domain The reflected millimeter wave is extracted in the frequency domain to obtain the frequency domain signal characteristic of the reflected millimeter wave. The frequency domain signal characteristic may include the frequency domain energy characteristic; the garbage classification equipment performs the Doppler characteristic on the reflected millimeter wave after Doppler transformation Extract the Doppler signal characteristics of the reflected millimeter wave.

由于上述时域信号特征、频域信号特征和多普勒特征可以从不同维度反映出待识别垃圾的材料、尺寸以及形状等特征，因此后续基于上述特征进行垃圾类型识别有助于提高识别准确率。Since the above-mentioned time-domain signal features, frequency-domain signal features, and Doppler features can reflect the material, size, and shape of the garbage to be identified from different dimensions, subsequent garbage type recognition based on the above-mentioned features will help improve the recognition accuracy. .

步骤303E，根据信号特征确定待投放垃圾所属的目标垃圾类型。 Step 303E: Determine the target garbage type to which the garbage to be placed belongs according to the signal characteristics.

关于根据信号特征确定目标垃圾类型的方式，可以采用如下两种方式中的任意一种。Regarding the method of determining the target garbage type based on the signal characteristics, either of the following two methods can be used.

一、将信号特征与预设信号特征进行特征匹配，其中，不同垃圾类型与不同预设信号特征之间存在映射关系；根据信号特征与预设信号特征的特征匹配度确定待投放垃圾所属的目标垃圾类型。1. Perform feature matching between signal features and preset signal features, where there is a mapping relationship between different types of garbage and different preset signal features; determine the target of garbage to be placed according to the feature matching degree between signal features and preset signal features Type of garbage.

在一种可能的实施方式中，开发人员预先对预设垃圾类型的垃圾进行毫米波反射测试，从而根据测试结果得到各种垃圾类型与预设信号特征之间的映射关系。其中，进行毫米波反射测试的过程可以参考上述步骤301至302，且测试结果中包含各个维度对应的信号特征。In a possible implementation manner, a developer performs a millimeter wave reflection test on garbage of a preset garbage type in advance, so as to obtain a mapping relationship between various garbage types and preset signal characteristics according to the test result. The process of performing the millimeter wave reflection test can refer to the above steps 301 to 302, and the test results include signal characteristics corresponding to each dimension.

可选的，垃圾类型识别过程中，垃圾分类设备即将上述步骤303D中提取到的信号特征与相应维度下的预设信号特征进行匹配，得到特征匹配度。进一步的，垃圾分类设备将特征匹配度高于匹配度阈值的预设信号特征所对应的预设垃圾类型确定为目标垃圾类型，该目标垃圾类型为至少一种。比如，该匹配度阈值为85％。Optionally, in the process of identifying the type of garbage, the garbage classification device matches the signal features extracted in step 303D above with preset signal features in the corresponding dimensions to obtain the feature matching degree. Further, the garbage classification device determines the preset garbage type corresponding to the preset signal feature whose feature matching degree is higher than the matching degree threshold as the target garbage type, and the target garbage type is at least one. For example, the matching degree threshold is 85%.

采用上述方法，垃圾分类设备可以通过简单的特征匹配度计算确定出待投放垃圾所属的目标垃圾类型，从而提高了垃圾类型的识别效率。Using the above method, the garbage classification device can determine the target garbage type to which the garbage to be put belongs through simple feature matching degree calculation, thereby improving the identification efficiency of the garbage type.

二、将信号特征输入分类模型；根据分类模型输出的预测垃圾类型以及预测垃圾类型对应的预测概率，确定待投放垃圾所属的目标垃圾类型。2. Input the signal characteristics into the classification model; according to the predicted garbage type output by the classification model and the predicted probability corresponding to the predicted garbage type, determine the target garbage type to which the garbage to be put belongs.

在一种可能的实施方式中，开发人员预先对样本预设垃圾类型的垃圾进行毫米波反射测试，从而得到相应的样本信号特征；进一步的，以样本预设垃圾类型为样本输出，以样本信号特征为样本输入，通过机器学习算法训练分类模型，该分类模型的模型输入即为信号特征，模型输出即为垃圾类型。In a possible implementation manner, the developer performs a millimeter wave reflection test on the garbage of the sample preset garbage type in advance to obtain the corresponding sample signal characteristics; further, the sample preset garbage type is used as the sample output, and the sample signal The feature is the sample input, and the classification model is trained through the machine learning algorithm. The model input of the classification model is the signal feature, and the model output is the garbage type.

可选的，该分类模型可以是基于卷积神经网络的深度学习网络模型，其中包括特征提取网络和分类网络，特征提取网络用于通过卷积核对输入的信号特征进行特征提取，而分类网络用于根据提取到的特征进行分类，该分类网络可以是全连接网络，且全连接网络的节点对应垃圾类型；且训练过程中可以采用梯度下降算法、反向传播算法等等，本申请实施例对此不作限定。Optionally, the classification model may be a deep learning network model based on a convolutional neural network, which includes a feature extraction network and a classification network. The feature extraction network is used to extract features of the input signal through the convolution kernel, and the classification network uses For classification based on the extracted features, the classification network can be a fully connected network, and the nodes of the fully connected network correspond to the type of garbage; and the gradient descent algorithm, back propagation algorithm, etc. can be used in the training process. This is not limited.

垃圾类型识别过程中，垃圾分类设备即将提取到的信号特征输入分类模型，得到分类模型输出的各种垃圾类型及其对应的预测概率。可选的，垃圾分类设备根据垃圾类型对应的预测概率，将预测概率大于概率阈值(比如80％)的垃圾类型确定为目标垃圾类型。In the process of identifying garbage types, the signal features to be extracted by the garbage classification equipment are input into the classification model to obtain various types of garbage output by the classification model and their corresponding predicted probabilities. Optionally, the garbage classification device determines the garbage type whose predicted probability is greater than a probability threshold (for example, 80%) as the target garbage type according to the predicted probability corresponding to the garbage type.

需要说明的是，将信号特征输入分类模型前，垃圾分类设备还需要将信号特征处理为符合模型输入要求的特征向量，本实施例在此不再赘述。It should be noted that, before inputting signal features into the classification model, the garbage classification device also needs to process the signal features into feature vectors that meet the model input requirements, which will not be repeated in this embodiment.

采用上述方法，垃圾分类设备利用机器学习训练得到的分类模型进行垃圾类型预测，由于该分类模型在训练过程中综合了多个维度的信号特征，因此得到的预测结果的准确率较高。Using the above method, the garbage classification equipment uses the classification model obtained by machine learning training to predict the type of garbage. Since the classification model integrates signal features of multiple dimensions during the training process, the accuracy of the obtained prediction result is high.

除了上述几种识别方式外，在其他可能的实施方式中，垃圾分类设备还可以基于反射毫米波的信号特征，重构待识别垃圾中各种垃圾的三维轮廓，从而通过轮廓识别技术，确定垃圾所处的目标垃圾类型，本实施例在此不再赘述。In addition to the above-mentioned identification methods, in other possible implementation manners, the garbage classification equipment can also reconstruct the three-dimensional contours of various garbage in the garbage to be identified based on the signal characteristics of the reflected millimeter wave, so as to determine the garbage through the contour recognition technology. The type of the target garbage is not described here in this embodiment.

上述实施例对垃圾类型的确定过程进行了详细描述，下面采用示意性的实施例对确定出目标垃圾类型后，垃圾分类设备后续执行的操作进行说明。The foregoing embodiments describe in detail the process of determining the type of garbage. The following uses an illustrative embodiment to describe the subsequent operations performed by the garbage sorting device after the target type of garbage is determined.

请参考图6，其示出了本申请另一个示例性实施例示出的垃圾分类方法的流程图。本实施例以该方法应用于终端(设置有毫米波发射器和毫米波接收器)来举例说明。该方法包括：Please refer to FIG. 6, which shows a flowchart of a garbage classification method shown in another exemplary embodiment of the present application. In this embodiment, the method is applied to a terminal (with a millimeter wave transmitter and a millimeter wave receiver) as an example. The method includes:

步骤601，通过毫米波发射器发射原始毫米波。Step 601: Transmit the original millimeter wave through the millimeter wave transmitter.

在一种可能的实施方式中，终端安装有垃圾分类应用程序，当垃圾分类应用程序开启，并接收到对垃圾分类功能的触发操作时，终端提示用户将待投放垃圾放置在终端前方指定位置，并通过毫米波发射器发射原始毫米波。In a possible implementation, the terminal is installed with a garbage classification application. When the garbage classification application is started and a trigger operation of the garbage classification function is received, the terminal prompts the user to place the garbage to be placed in a designated position in front of the terminal. And launch the original millimeter wave through the millimeter wave transmitter.

步骤602，通过毫米波接收器接收反射毫米波，反射毫米波是原始毫米波投射在垃圾上产生的反射回波。Step 602: Receive the reflected millimeter wave through the millimeter wave receiver, where the reflected millimeter wave is the reflected echo generated by the original millimeter wave projected on the garbage.

本步骤的实施方式可以参考上述步骤302，本实施例在此不再赘述。For the implementation of this step, reference may be made to the above step 302, which will not be repeated in this embodiment.

步骤603，根据反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。Step 603: Determine the target garbage type to which the garbage to be placed belongs according to the reflected wave characteristics of the reflected millimeter wave.

本步骤的实施方式可以参考上述步骤303以及步骤303A至303E，本实施例在此不再赘述。For the implementation of this step, reference may be made to the above step 303 and steps 303A to 303E, which will not be repeated in this embodiment.

步骤604，若目标垃圾类型中包括至少两种垃圾类型，则通过预定方式提示对至少两种垃圾类型进行分类。Step 604: If the target garbage types include at least two types of garbage, a predetermined method is used to prompt to classify the at least two types of garbage.

当目标垃圾类型中包括至少两种垃圾类型时，表明待投放垃圾无法同时投放到属于同一垃圾类型的垃圾回收设备中，因此终端(垃圾分类应用程序)通过预定方式提示对至少两种垃圾类型进行分类。其中，该预定方式包括文字提示、语音提示、动画提示中的至少一种，且提示内容中包含至少两种垃圾类型。When the target garbage type includes at least two types of garbage, it indicates that the garbage to be placed cannot be put into the garbage collection equipment belonging to the same garbage type at the same time. Therefore, the terminal (garbage classification application) prompts for at least two types of garbage through a predetermined method. classification. Wherein, the predetermined manner includes at least one of text prompt, voice prompt, and animation prompt, and the prompt content includes at least two types of garbage.

在一种可能的实施方式中，为了提高用户的垃圾分类效率，对至少两种垃圾类型进行提示时，终端显示待投放垃圾中，属于各种目标垃圾类型的垃圾名称，以便用户基于垃圾名称进行分类。In a possible implementation manner, in order to improve the user’s garbage classification efficiency, when prompting for at least two types of garbage, the terminal displays the names of the garbage belonging to various target garbage types among the garbage to be put, so that the user can perform the classification based on the garbage name. classification.

示意性的，如图7所示，当识别出待投放垃圾中包含A类垃圾和B类垃圾时，终端71采用文字方式对识别出的垃圾类型进行显示，同时显示待投放垃圾中可能属于该垃圾类型的垃圾，方便用户快速分拣。Schematically, as shown in Fig. 7, when it is recognized that the garbage to be put in contains A garbage and B garbage, the terminal 71 uses text to display the recognized garbage type, and at the same time displays that the garbage to be put in may belong to this The garbage type is convenient for users to sort quickly.

步骤605，若目标垃圾类型为单一垃圾类型，则向垃圾投放设备发送垃圾投放指令，垃圾投放指令中包含目标垃圾类型，垃圾投放设备用于开启与目标垃圾类型对应的垃圾投放入口。Step 605: If the target garbage type is a single garbage type, a garbage placement instruction is sent to the garbage placement device. The garbage placement instruction includes the target garbage type, and the garbage placement device is used to open a garbage placement entrance corresponding to the target garbage type.

在一种可能的实施方式中，终端除了通过垃圾分类应用程序识别垃圾类型外，还可能通过垃圾分类应用程序控制垃圾投放设备开启指定的垃圾投放入口，方便用户投放垃圾。In a possible implementation manner, in addition to identifying the type of garbage through the garbage classification application, the terminal may also control the garbage disposal device to open a designated garbage disposal entrance through the garbage classification application to facilitate users to dispose of garbage.

可选的，当识别出的目标垃圾类型为单一垃圾类型时，终端采用预定方式向垃圾投放设备发送垃圾投放指令，以便垃圾投放设备根据垃圾投放指令中包含的目标垃圾类型开启相应的垃圾投放入口。Optionally, when the identified target garbage type is a single garbage type, the terminal sends a garbage disposal instruction to the garbage disposal device in a predetermined manner, so that the garbage disposal device opens the corresponding garbage disposal entrance according to the target garbage type contained in the garbage disposal instruction .

其中，终端可以与垃圾投放设备建立无线连接(比如蓝牙)，从而通过无线连接发送垃圾投放指令，或者，终端在垃圾分类应用程序的应用界面中选择距离最近的垃圾投放设备，从而向后台服务器发送包含垃圾投放设备标识以及目标垃圾类型的垃圾投放指令，由后台服务器根据垃圾投放设备标识向垃圾投放设备转发垃圾投放指令。Among them, the terminal can establish a wireless connection (such as Bluetooth) with the garbage disposal device to send garbage disposal instructions through the wireless connection, or the terminal can select the nearest garbage disposal device in the application interface of the garbage classification application to send it to the background server The garbage disposal instruction including the identifier of the garbage disposal device and the target type of garbage, and the background server forwards the garbage disposal instruction to the garbage disposal device according to the identifier of the garbage disposal device.

示意性的，如图8所示，终端81显示识别结果界面，该识别结果界面中显示有至少一个候选垃圾箱对应的选择控件，当接收到对选择控件选择信号，并接收到对投放控件82的点击信号时，终端81即通过后台服务器向垃圾箱发送垃圾投放指令，相应的，终端81显示投放提示信息，提示用户在指定时间内投放垃圾。Schematically, as shown in FIG. 8, the terminal 81 displays a recognition result interface. The recognition result interface displays a selection control corresponding to at least one candidate trash can. When a selection signal for the selection control is received, and a selection control 82 is received When the signal is clicked, the terminal 81 sends a garbage disposal instruction to the trash bin through the background server, and accordingly, the terminal 81 displays a notification message for disposal to prompt the user to put garbage within a specified time.

本实施例中，终端通过毫米波收发器实现对垃圾类型的识别，并能够基于垃圾类别识别结果，控制垃圾投放设备开启相应的垃圾投放入口，从而完成垃圾分类投放流程，简化了，垃圾分类投放流程，并提高了垃圾分类投放的准确率。In this embodiment, the terminal uses the millimeter wave transceiver to recognize the type of garbage, and can control the garbage disposal equipment to open the corresponding garbage disposal entrance based on the result of garbage classification, thereby completing the garbage sorting and putting process, simplifying the garbage sorting and putting Process and improve the accuracy of garbage classification and placement.

请参考图9，其示出了本申请另一个示例性实施例示出的垃圾分类方法的流程图。本实施例以该方法应用于垃圾投放设备(设置有毫米波发射器和毫米波接收器)来举例说明。该方法包括：Please refer to FIG. 9, which shows a flowchart of a garbage classification method according to another exemplary embodiment of the present application. In this embodiment, the method is applied to a garbage disposal device (with a millimeter wave transmitter and a millimeter wave receiver) as an example. The method includes:

步骤901，通过摄像组件采集待投放垃圾的垃圾图像。Step 901: Collect garbage images of garbage to be dropped by the camera component.

在一种可能的实施方式中，垃圾投放设备上设置有摄像组件，该摄像组件用于采集垃圾图像。示意性的，如图10所示，垃圾回收箱1001上设置有显示屏1002以及摄像头1003，当用户需要投放垃圾时，显示屏1002显示提示信息，提示用户将垃圾放置在平台上，由摄像头1003采集垃圾图像。In a possible implementation manner, a camera component is provided on the garbage disposal device, and the camera component is used to collect garbage images. Schematically, as shown in Figure 10, the garbage collection box 1001 is provided with a display screen 1002 and a camera 1003. When the user needs to put garbage, the display screen 1002 displays a prompt message to prompt the user to place the garbage on the platform. The camera 1003 Collect garbage images.

可选的，采集到待投放垃圾的垃圾图像后，垃圾投放设备对垃圾图像中包含的垃圾进行识别，从而得到垃圾类型。其中，垃圾投放设备可以在本地进行垃圾识别，也可以将垃圾图像上传至服务器，由服务器进行垃圾识别。Optionally, after collecting the garbage image of the garbage to be put in, the garbage disposal device recognizes the garbage contained in the garbage image to obtain the garbage type. Among them, the garbage disposal device can perform garbage identification locally, or upload the garbage image to the server, and the server can identify the garbage.

可选的，当无法得到垃圾类型识别结果(比如识别出垃圾被放置在垃圾袋中)，或垃圾类型识别结果的置信度低于阈值时，垃圾投放设备确定无法通过图像识别技术确定待投放垃圾所属的目标垃圾类型，并执行步骤902。Optionally, when the garbage type recognition result cannot be obtained (for example, it is recognized that the garbage is placed in a garbage bag), or the confidence level of the garbage type recognition result is lower than a threshold, the garbage disposal device determines that the garbage to be deposited cannot be determined by image recognition technology The target garbage type belongs to, and step 902 is executed.

步骤902，若无法通过图像识别技术确定待投放垃圾所属的目标垃圾类型，则通过毫米波发射器发射原始毫米波。Step 902: If the target garbage type to which the garbage to be put belongs cannot be determined through the image recognition technology, the original millimeter wave is transmitted through the millimeter wave transmitter.

其中，通过毫米波发射器发射原始毫米波的过程可以参考上述步骤301，本实施例在此不再赘述。Among them, the process of transmitting the original millimeter wave through the millimeter wave transmitter can refer to the above step 301, which will not be repeated in this embodiment.

步骤903，通过毫米波接收器接收反射毫米波，反射毫米波是原始毫米波投射在垃圾上产生的反射回波。In step 903, the reflected millimeter wave is received by the millimeter wave receiver, and the reflected millimeter wave is the reflected echo generated by the original millimeter wave projected on the garbage.

步骤904，根据反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。Step 904: Determine the target garbage type to which the garbage to be placed belongs according to the reflected wave characteristics of the reflected millimeter wave.

步骤905，若目标垃圾类型为单一垃圾类型，则开启与目标垃圾类型对应的垃圾投放入口。In step 905, if the target garbage type is a single garbage type, the garbage disposal entrance corresponding to the target garbage type is opened.

当识别出待投放垃圾为单一垃圾类型时，垃圾投放设备即通过机械结构开启与目标垃圾类型对应的垃圾投放入口，并提示用户投放垃圾。When it is recognized that the waste to be placed is a single type of waste, the waste placing equipment opens the waste placing entrance corresponding to the target type of waste through a mechanical structure, and prompts the user to throw the waste.

步骤906，若目标垃圾类型中包括至少两种垃圾类型，则关闭各个垃圾投放入口，并通过预定方式提示对至少两种垃圾类型进行分类。Step 906: If the target garbage types include at least two types of garbage, close each garbage input entrance, and prompt to classify the at least two types of garbage in a predetermined manner.

在一种可能的实施方式中，垃圾投放设备通过预定方式提示对至少两种垃圾类型进行分类。其中，该预定方式包括文字提示、语音提示、动画提示中的至少一种，且提示内容中包含至少两种垃圾类型。In a possible implementation manner, the garbage placing device prompts to classify at least two types of garbage in a predetermined manner. Wherein, the predetermined manner includes at least one of text prompt, voice prompt, and animation prompt, and the prompt content includes at least two types of garbage.

在一种可能的实施方式中，为了提高用户的垃圾分类效率，对至少两种垃圾类型进行提示时，垃圾投放设备显示待投放垃圾中，属于各种目标垃圾类型的垃圾名称，以便用户基于垃圾名称进行分类。In a possible implementation manner, in order to improve the user’s garbage classification efficiency, when prompting at least two types of garbage, the garbage discharging device displays the names of garbage belonging to various target garbage types among the garbage to be dispensed, so that the user can base on the garbage Classification by name.

示意性的，如图10所示，垃圾回收箱1001可以在显示屏1002中显示识别出的垃圾类型，并提示用户进行分类。Schematically, as shown in FIG. 10, the garbage collection box 1001 may display the recognized garbage type on the display screen 1002 and prompt the user to classify.

本实施例中，垃圾投放设备通过设置的毫米波收发器实现垃圾类型识别，并能够根据识别结果自动开启相应的投放入口，在用户并不知悉垃圾分类规则的情况下，也能够实现准确的垃圾分类投放，提高了垃圾分类的准确性。In this embodiment, the garbage disposal device realizes garbage type recognition through the millimeter wave transceiver, and can automatically open the corresponding disposal entrance according to the recognition result. Even if the user does not know the garbage classification rules, it can also realize accurate garbage Classified placement improves the accuracy of garbage classification.

请参考图11，其示出了本申请另一个示例性实施例示出的垃圾分类方法的流程图。本实施例以该方法应用于垃圾回收监控设备(设置有毫米波发射器和毫米波接收器)来举例说明。该方法包括：Please refer to FIG. 11, which shows a flowchart of a garbage classification method according to another exemplary embodiment of the present application. In this embodiment, the method is applied to a garbage collection monitoring device (equipped with a millimeter wave transmitter and a millimeter wave receiver) as an example. The method includes:

步骤1101，通过毫米波发射器发射原始毫米波。Step 1101: Transmit the original millimeter wave through the millimeter wave transmitter.

步骤1102，通过毫米波接收器接收反射毫米波，反射毫米波是原始毫米波投射在垃圾上产生的反射回波。Step 1102: Receive the reflected millimeter wave through the millimeter wave receiver, where the reflected millimeter wave is the reflected echo generated by the original millimeter wave projected on the garbage.

步骤1103，根据反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。Step 1103: Determine the target garbage type to which the garbage to be placed belongs according to the reflected wave characteristics of the reflected millimeter wave.

上述步骤1101至1103的实施方式可以参考步骤301至303(包括步骤303A至303E)，本实施例在此不再赘述。For the implementation of the foregoing steps 1101 to 1103, reference may be made to steps 301 to 303 (including steps 303A to 303E), which will not be repeated in this embodiment.

步骤1104，若目标垃圾类型中包括至少两种垃圾类型，或者，目标垃圾类型为单一垃圾类型，且选择垃圾类型与目标垃圾类型不同，则记录待投放垃圾对应的投放事件。In step 1104, if the target garbage type includes at least two garbage types, or the target garbage type is a single garbage type, and the selected garbage type is different from the target garbage type, record the release event corresponding to the garbage to be placed.

在一种可能的实施方式中，垃圾回收监控设备当监控到垃圾投放行为时，通过毫米波发射器和毫米波接收器对垃圾进行垃圾类型识别，并检测识别出的目标垃圾类型与用户选择垃圾类型是否一致，若两者一致，则确定投放正确，若两者不一致，垃圾回收监控设备则确定投放错误，并记录错误的投放事件。In a possible implementation manner, when the garbage collection monitoring device monitors the behavior of garbage disposal, it uses the millimeter wave transmitter and the millimeter wave receiver to identify the garbage type, and detects the identified target garbage type and the user's selection of garbage Whether the types are the same, if the two are the same, it is determined that the delivery is correct; if the two are inconsistent, the garbage collection monitoring equipment determines the delivery error and records the wrong delivery event.

在其他可能的实施方式中，当识别出的目标垃圾类型包括至少两种垃圾类型时，垃圾回收监控设备确定投放错误，并记录错误的投放事件。In other possible implementation manners, when the identified target garbage types include at least two types of garbage, the garbage collection monitoring device determines the placement error, and records the error placement event.

其中，选择垃圾类型是投放待投放垃圾时选择的垃圾类型，该选择垃圾类型可以由垃圾投放设备发送给垃圾回收监控设备，或者，由垃圾回收监控设备通过投放时采集的垃圾投放图像识别得到。Among them, the selected garbage type is the garbage type selected when the garbage to be put is placed. The selected garbage type can be sent by the garbage disposal device to the garbage collection monitoring device, or can be recognized by the garbage collection monitoring device through the garbage disposal image collected during the disposal.

可选的，投放事件包括投放时间、投放图像以及投放视频中的至少一种，其中，投放图像和投放视频由垃圾回收监控设备通过摄像组件采集得到。Optionally, the delivery event includes at least one of delivery time, delivery image, and delivery video, where the delivery image and delivery video are collected by the garbage collection monitoring device through the camera component.

步骤1105，向服务器上报投放事件。Step 1105: Report the delivery event to the server.

进一步的，垃圾回收监控设备将记录的投放事件上报至服务器。Further, the garbage collection monitoring device reports the recorded delivery event to the server.

可选的，服务器对投放图像中包含的人脸进行人脸识别，从而确定该投放事件对应的投放用户，以便后续对投放用户进行相应的惩处。Optionally, the server performs face recognition on the human face contained in the posted image, thereby determining the posting user corresponding to the posting event, so that the posting user can be subsequently punished accordingly.

本实施例中，垃圾回收监控设备通过识别投放垃圾的类型，对分类错误的投放事件进行记录，并将投放事件上传至服务器，实现对垃圾投放行为的智能化监督，有助于提高对垃圾投放行为的监督准确性。In this embodiment, the garbage collection monitoring device recognizes the type of garbage discharged, records the misclassified placement events, and uploads the placement events to the server, so as to realize the intelligent supervision of the garbage placement behavior, which helps to improve the garbage placement. Monitoring accuracy of behavior.

请参考图12，其示出了本申请一个实施例提供的垃圾分类装置的结构框图。该装置可以通过软件、硬件或者两者的结合实现成为垃圾分类设备的全部或一部分。该装置包括：Please refer to FIG. 12, which shows a structural block diagram of a garbage classification device provided by an embodiment of the present application. The device can be implemented as all or part of the garbage sorting equipment through software, hardware or a combination of the two. The device includes:

发射模块1201，用于通过毫米波发射器发射原始毫米波；The transmitting module 1201 is used to transmit the original millimeter wave through the millimeter wave transmitter;

接收模块1202，用于通过毫米波接收器接收反射毫米波，所述反射毫米波是所述原始毫米波投射在垃圾上产生的反射回波；The receiving module 1202 is configured to receive a reflected millimeter wave through a millimeter wave receiver, where the reflected millimeter wave is a reflected echo generated by the original millimeter wave projected on garbage;

分类模块1203，用于根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。The classification module 1203 is configured to determine the target garbage type to which the garbage to be put belongs according to the reflected wave characteristics of the reflected millimeter wave.

可选的，所述分类模块1203，包括：Optionally, the classification module 1203 includes:

获取单元，用于获取所述反射毫米波的反射波能量；An obtaining unit for obtaining the reflected wave energy of the reflected millimeter wave;

第一确定单元，用于根据所述反射波能量确定所述待投放垃圾所属的目标垃圾类型。The first determining unit is configured to determine the target garbage type to which the garbage to be placed belongs according to the reflected wave energy.

可选的，干垃圾的所述反射波能量高于湿垃圾的所述反射波能量。Optionally, the reflected wave energy of dry garbage is higher than the reflected wave energy of wet garbage.

处理单元，用于对所述反射毫米波进行信号处理，信号处理方式包括时频域变换或多普勒变换中的至少一种；A processing unit, configured to perform signal processing on the reflected millimeter wave, and the signal processing mode includes at least one of time-frequency domain transform or Doppler transform;

提取单元，用于对信号处理前以及信号处理后的所述反射毫米波进行特征提取，得到信号特征，所述信号特征包括时域信号特征、频域信号特征和多普勒特征中的至少一种；The extraction unit is configured to extract features of the reflected millimeter waves before and after signal processing to obtain signal features, where the signal features include at least one of a time domain signal feature, a frequency domain signal feature, and a Doppler feature Species

第二确定单元，用于根据所述信号特征确定所述待投放垃圾所属的目标垃圾类型。The second determining unit is configured to determine the target garbage type to which the garbage to be placed belongs according to the signal characteristics.

可选的，所述第二确定单元，用于：Optionally, the second determining unit is configured to:

将所述信号特征与预设信号特征进行特征匹配，其中，不同垃圾类型与不同预设信号特征之间存在映射关系；根据所述信号特征与所述预设信号特征的特征匹配度确定所述待投放垃圾所属的目标垃圾类型；Perform feature matching between the signal feature and the preset signal feature, where there is a mapping relationship between different garbage types and different preset signal features; the feature matching degree between the signal feature and the preset signal feature is determined. The target garbage type to which the garbage to be placed belongs;

或者，or,

将所述信号特征输入分类模型；根据所述分类模型输出的预测垃圾类型以及所述预测垃圾类型对应的预测概率，确定所述待投放垃圾所属的目标垃圾类型。The signal feature is input into a classification model; the target garbage type to which the garbage to be put belongs is determined according to the predicted garbage type output by the classification model and the predicted probability corresponding to the predicted garbage type.

可选的，所述装置应用于设置有所述毫米波发射器和所述毫米波接收器的终端；Optionally, the device is applied to a terminal provided with the millimeter wave transmitter and the millimeter wave receiver;

所述装置还包括：The device also includes:

提示模块，用于响应于所述目标垃圾类型中包括至少两种垃圾类型，通过预定方式提示对所述至少两种垃圾类型进行分类。The prompting module is configured to prompt to classify the at least two types of rubbish in a predetermined manner in response to the target type of rubbish including at least two types of rubbish.

可选的，所述装置还包括：Optionally, the device further includes:

发送模块，用于响应于所述目标垃圾类型为单一垃圾类型，向所述垃圾投放设备发送垃圾投放指令，所述垃圾投放指令中包含所述目标垃圾类型，所述垃圾投放设备用于开启与所述目标垃圾类型对应的垃圾投放入口。The sending module is configured to respond to the target garbage type being a single garbage type, and send a garbage disposal instruction to the garbage disposal device, the garbage disposal instruction includes the target garbage type, and the garbage disposal device is used to turn on and The garbage disposal entrance corresponding to the target garbage type.

可选的，所述装置应用于设置有所述毫米波发射器和所述毫米波接收器的垃圾回收设备；Optionally, the device is applied to a garbage collection device provided with the millimeter wave transmitter and the millimeter wave receiver;

所述发射模块1201，用于：The transmitting module 1201 is used to:

可选的，所述装置还包括：Optionally, the device further includes:

开启模块，用于响应于所述目标垃圾类型为单一垃圾类型，开启与所述目标垃圾类型对应的垃圾投放入口；An opening module, configured to respond to the target garbage type being a single garbage type, opening a garbage disposal entrance corresponding to the target garbage type;

关闭模块，用于响应于所述目标垃圾类型中包括至少两种垃圾类型，关闭各个垃圾投放入口，并通过预定方式提示对所述至少两种垃圾类型进行分类。The closing module is configured to respond to the target garbage type including at least two garbage types, close each garbage disposal entrance, and prompt to classify the at least two garbage types in a predetermined manner.

可选的，所述装置应用于设置有毫米波发射器和毫米波接收器的垃圾回收监控设备；Optionally, the device is applied to a garbage collection monitoring device provided with a millimeter wave transmitter and a millimeter wave receiver;

所述装置还包括：The device also includes:

记录模块，用于响应于所述目标垃圾类型中包括至少两种垃圾类型，或者，所述目标垃圾类型为单一垃圾类型，且选择垃圾类型与所述目标垃圾类型不同，则记录所述待投放垃圾对应的投放事件，所述选择垃圾类型是投放所述待投放垃圾时选择的垃圾类型，所述投放事件包括投放时间、投放图像以及投放视频中的至少一种；The recording module is configured to respond to the target garbage type including at least two garbage types, or if the target garbage type is a single garbage type, and the selected garbage type is different from the target garbage type, then recording the to-be-delivered garbage type A garbage release event corresponding to the garbage, the selected garbage type is a garbage type selected when the garbage to be placed is placed, and the release event includes at least one of a release time, a placement image, and a placement video;

上报模块，用于向服务器上报所述投放事件。The reporting module is used to report the delivery event to the server.

综上所述，本申请实施例中，基于不同材质对毫米波的不同反射特性，通过毫米波发射器发射原始毫米波，并通过毫米波发射器接收原始毫米波投射在垃圾上产生的反射毫米波，从而根据反射毫米波的反射波特征，确定出待投放垃圾所述的目标垃圾类型；相较于相关技术中采用人工方式进行垃圾分类，采用本申请实施例提供的方法，有助于提高垃圾分类的效率以及准确率。To sum up, in the embodiments of this application, based on the different reflection characteristics of different materials on millimeter waves, the millimeter wave transmitter is used to transmit the original millimeter wave, and the millimeter wave transmitter is used to receive the reflected millimeter wave projected on the garbage. Therefore, according to the reflected wave characteristics of the reflected millimeter wave, the target type of garbage to be put into the garbage is determined; compared with the manual garbage classification in the related technology, the method provided by the embodiment of this application is helpful to improve The efficiency and accuracy of garbage classification.

请参考图13，其示出了本申请一个示例性实施例提供的垃圾分类设备的结构方框图。本申请中的垃圾分类设备可以包括一个或多个如下部件：处理器1310、存储器1320和毫米波收发器1330。Please refer to FIG. 13, which shows a structural block diagram of a garbage classification device provided by an exemplary embodiment of the present application. The garbage sorting device in this application may include one or more of the following components: a processor 1310, a memory 1320, and a millimeter wave transceiver 1330.

处理器1310可以包括一个或者多个处理核心。处理器1310利用各种接口和线路连接整个垃圾分类设备内的各个部分，通过运行或执行存储在存储器1320内的指令、程序、代码集或指令集，以及调用存储在存储器1320内的数据，执行垃圾分类设备的各种功能和处理数据。可选地，处理器1310可以采用数字信号处理(Digital Signal Processing，DSP)、现场可编程门阵列(Field－Programmable Gate Array，FPGA)、可编程逻辑阵列(Programmable Logic Array，PLA)中的至少一种硬件形式来实现。处理器1310可集成中央处理器(Central Processing Unit，CPU)、图像处理器(Graphics Processing Unit，GPU)、神经网络处理器(Neural-network Processing Unit，NPU)和调制解调器等中的一种或几种的组合。其中，CPU主要处理操作***、用户界面和应用程序等；GPU用于负责触摸显示屏所需要显示的内容的渲染和绘制；NPU用于实现人工智能(Artificial Intelligence，AI)功能；调制解调器用于处理无线通信。可以理解的是，上述调制解调器也可以不集成到处理器1310中，单独通过一块芯片进行实现。The processor 1310 may include one or more processing cores. The processor 1310 uses various interfaces and lines to connect various parts of the entire garbage sorting equipment, and executes by running or executing instructions, programs, code sets, or instruction sets stored in the memory 1320, and calling data stored in the memory 1320. Various functions and processing data of garbage sorting equipment. Optionally, the processor 1310 may use at least one of digital signal processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). A kind of hardware form to realize. The processor 1310 can integrate one or more of the central processing unit (CPU), graphics processing unit (GPU), neural network processing unit (NPU), modem, etc. The combination. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is used to render and draw the content that needs to be displayed on the touch screen; the NPU is used to implement artificial intelligence (AI) functions; the modem is used for processing Wireless communication. It is understandable that the aforementioned modem may not be integrated into the processor 1310, but may be implemented by a chip alone.

存储器1320可以包括随机存储器(Random Access Memory，RAM)，也可以包括只读存储器(Read-Only Memory)。可选地，该存储器1320包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器1320可用于存储指令、程序、代码、代码集或指令集。存储器1320可包括存储程序区和存储数据区，其中，存储程序区可存储用于实现操作***的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等；存储数据区可存储根据垃圾分类设备的使用所创建的数据(比如音频数据、电话本)等。The memory 1320 may include random access memory (RAM), or read-only memory (Read-Only Memory). Optionally, the memory 1320 includes a non-transitory computer-readable storage medium. The memory 1320 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 1320 may include a program storage area and a data storage area, where the program storage area may store instructions for implementing the operating system and instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), Instructions for implementing the following various method embodiments, etc.; the storage data area can store data (such as audio data, phone book) created according to the use of the garbage sorting device.

毫米波收发器1330是用于发射原始毫米波以及接收反射毫米波的组件，其可以实现成为毫米波收发芯片。可选的，毫米波收发器1330还具有信号调制解调功能，用于向原始毫米波中添加数据以及解调出反射毫米波中的数据。The millimeter wave transceiver 1330 is a component for transmitting the original millimeter wave and receiving the reflected millimeter wave, which can be implemented as a millimeter wave transceiver chip. Optionally, the millimeter wave transceiver 1330 also has a signal modulation and demodulation function for adding data to the original millimeter wave and demodulating the data in the reflected millimeter wave.

可选的，垃圾分类设备还包括显示屏。显示屏用于显示用户界面的显示组件。可选的，本申请实施例中的显示屏还具有触控功能，用于接收用户使用手指、触摸笔等任何适合的物体在其上或附近的触摸操作。显示屏通常设置在垃圾分类设备的前面板。显示屏可被设计成为全面屏、曲面屏、异型屏、双面屏或折叠屏。显示屏还可被设计成为全面屏与曲面屏的结合，异型屏与曲面屏的结合，本实施例对此不加以限定。Optionally, the garbage sorting equipment also includes a display screen. The display screen is used to display the display components of the user interface. Optionally, the display screen in the embodiment of the present application also has a touch function, which is used to receive a user's touch operation on or near it using a finger, a touch pen, or any suitable object. The display screen is usually set on the front panel of the garbage sorting equipment. The display screen can be designed as a full screen, curved screen, special-shaped screen, double-sided screen or folding screen. The display screen can also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in this embodiment.

除此之外，本领域技术人员可以理解，上述附图所示出的垃圾分类设备的结构并不构成对垃圾分类设备的限定，终端可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。比如，垃圾分类设备中还包括射频电路、输入单元、传感器、音频电路、无线保真(Wireless Fidelity，WiFi)模块、电源、蓝牙模块等部件，在此不再赘述。In addition, those skilled in the art can understand that the structure of the garbage sorting equipment shown in the above drawings does not constitute a limitation on the garbage sorting equipment, and the terminal may include more or less components than shown in the figure, or a combination Certain components, or different component arrangements. For example, the garbage sorting equipment also includes radio frequency circuits, input units, sensors, audio circuits, wireless fidelity (Wireless Fidelity, WiFi) modules, power supplies, Bluetooth modules and other components, which will not be repeated here.

本申请实施例还提供了一种终端，该终端包括如上述实施例所述的垃圾分类设备和/或垃圾分类装置；An embodiment of the present application also provides a terminal, which includes the garbage classification equipment and/or the garbage classification device as described in the foregoing embodiment;

本申请实施例还提供了一种垃圾投放设备，该垃圾投放设备包括如上述实施例所述的垃圾分类设备和/或垃圾分类装置；An embodiment of the present application also provides a garbage placing device, which includes the garbage sorting device and/or the garbage sorting device as described in the foregoing embodiment;

本申请实施例还提供了一种垃圾回收监控设备，该垃圾回收监控设备包括如上述实施例所述的垃圾分类设备和/或垃圾分类装置。An embodiment of the present application also provides a garbage collection monitoring device, which includes the garbage classification device and/or garbage classification device as described in the foregoing embodiment.

本申请实施例还提供了一种计算机可读介质，该计算机可读介质存储有至少一条指令，所述至少一条指令由所述处理器加载并执行以实现如上各个实施例所述的垃圾分类方法。The embodiments of the present application also provide a computer-readable medium that stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the garbage classification method described in each of the above embodiments .

本申请实施例还提供了一种计算机程序产品，该计算机程序产品存储有至少一条指令，所述至少一条指令由所述处理器加载并执行以实现如上各个实施例所述的垃圾分类方法。The embodiments of the present application also provide a computer program product, and the computer program product stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the garbage classification method described in each of the above embodiments.

本领域技术人员应该可以意识到，在上述一个或多个示例中，本申请实施例所描述的功能可以用硬件、软件、固件或它们的任意组合来实现。当使用软件实现时，可以将这些功能存储在计算机可读介质中或者作为计算机可读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质，其中通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。存储介质可以是通用或专用计算机能够存取的任何可用介质。Those skilled in the art should be aware that, in one or more of the foregoing examples, the functions described in the embodiments of the present application may be implemented by hardware, software, firmware, or any combination thereof. When implemented by software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on the computer-readable medium. The computer-readable medium includes a computer storage medium and a communication medium, where the communication medium includes any medium that facilitates the transfer of a computer program from one place to another. The storage medium may be any available medium that can be accessed by a general-purpose or special-purpose computer.

以上所述仅为本申请的较佳实施例，并不用以限制本申请，凡在本申请的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本申请的保护范围之内。The above descriptions are only preferred embodiments of this application and are not intended to limit this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the protection of this application. Within range.

Claims

一种垃圾分类方法，所述方法包括：A garbage classification method, the method includes:

通过毫米波发射器发射原始毫米波；Transmit the original millimeter wave through the millimeter wave transmitter;

通过毫米波接收器接收反射毫米波，所述反射毫米波是所述原始毫米波投射在垃圾上产生的反射回波；Receiving a reflected millimeter wave by a millimeter wave receiver, where the reflected millimeter wave is a reflected echo generated by the original millimeter wave projected on the garbage;

根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。According to the reflected wave characteristics of the reflected millimeter wave, the target garbage type to which the garbage to be put belongs is determined.
根据权利要求1所述的方法，其中，所述根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型，包括：The method according to claim 1, wherein the determining the target garbage type to which the garbage to be put belongs according to the reflected wave characteristics of the reflected millimeter wave comprises:

获取所述反射毫米波的反射波能量；Acquiring the reflected wave energy of the reflected millimeter wave;

根据所述反射波能量确定所述待投放垃圾所属的目标垃圾类型。Determine the target garbage type to which the garbage to be placed belongs according to the reflected wave energy.
根据权利要求2所述的方法，其中，干垃圾的所述反射波能量高于湿垃圾的所述反射波能量。The method according to claim 2, wherein the reflected wave energy of dry garbage is higher than the reflected wave energy of wet garbage.
根据权利要求1所述的方法，其中，所述根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型，包括：The method according to claim 1, wherein the determining the target garbage type to which the garbage to be put belongs according to the reflected wave characteristics of the reflected millimeter wave comprises:

对所述反射毫米波进行信号处理，信号处理方式包括时频域变换或多普勒变换中的至少一种；Performing signal processing on the reflected millimeter wave, and the signal processing manner includes at least one of time-frequency domain transform or Doppler transform;

对信号处理前以及信号处理后的所述反射毫米波进行特征提取，得到信号特征，所述信号特征包括时域信号特征、频域信号特征和多普勒特征中的至少一种；Performing feature extraction on the reflected millimeter waves before and after signal processing to obtain signal features, where the signal features include at least one of a time domain signal feature, a frequency domain signal feature, and a Doppler feature;

根据所述信号特征确定所述待投放垃圾所属的目标垃圾类型。Determine the target garbage type to which the garbage to be placed belongs according to the signal characteristics.
根据权利要求4所述的方法，其中，所述根据所述信号特征确定所述待投放垃圾所属的目标垃圾类型，包括：The method according to claim 4, wherein the determining the target garbage type to which the garbage to be placed belongs according to the signal characteristics comprises:

将所述信号特征与预设信号特征进行特征匹配，其中，不同垃圾类型与不同预设信号特征之间存在映射关系；根据所述信号特征与所述预设信号特征的特征匹配度，确定所述待投放垃圾所属的目标垃圾类型；Perform feature matching between the signal feature and the preset signal feature, where there is a mapping relationship between different garbage types and different preset signal features; determine the matching degree between the signal feature and the preset signal feature State the target garbage type to which the garbage to be placed belongs;

或者，or,

将所述信号特征输入分类模型；根据所述分类模型输出的预测垃圾类型以及所述预测垃圾类型对应的预测概率，确定所述待投放垃圾所属的目标垃圾类型。The signal feature is input into a classification model; according to the predicted garbage type output by the classification model and the predicted probability corresponding to the predicted garbage type, the target garbage type to which the garbage to be put belongs is determined.
根据权利要求1至5任一所述的方法，其中，所述方法应用于设置有所述毫米波发射器和所述毫米波接收器的终端；The method according to any one of claims 1 to 5, wherein the method is applied to a terminal provided with the millimeter wave transmitter and the millimeter wave receiver;

所述根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型之后，所述方法还包括：After determining the target garbage type to which the garbage to be placed belongs according to the reflected wave characteristics of the reflected millimeter wave, the method further includes:

响应于所述目标垃圾类型中包括至少两种垃圾类型，通过预定方式提示对所述至少两种垃圾类型进行分类。In response to the target garbage type including at least two garbage types, prompting to classify the at least two garbage types in a predetermined manner.
根据权利要求6所述的方法，其中，所述根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型之后，所述方法还包括：The method according to claim 6, wherein after the determining the target garbage type to which the garbage to be dropped belongs according to the reflected wave characteristics of the reflected millimeter wave, the method further comprises:

响应于所述目标垃圾类型为单一垃圾类型，向所述垃圾投放设备发送垃圾投放指令，所述垃圾投放指令中包含所述目标垃圾类型，所述垃圾投放设备用于开启与所述目标垃圾类型对应的垃圾投放入口。In response to the target garbage type being a single garbage type, a garbage placement instruction is sent to the garbage placement device, the garbage placement instruction includes the target garbage type, and the garbage placement device is used to enable and The corresponding garbage disposal entrance.
根据权利要求1至5任一所述的方法，其中，所述方法应用于设置有所述毫米波发射器和所述毫米波接收器的垃圾投放设备；The method according to any one of claims 1 to 5, wherein the method is applied to a garbage disposal device provided with the millimeter wave transmitter and the millimeter wave receiver;

所述通过毫米波发射器发射原始毫米波，包括：The transmitting the original millimeter wave through the millimeter wave transmitter includes:

响应于无法通过图像识别技术确定所述待投放垃圾所属的所述目标垃圾类型，通过所述毫米波发射器发射所述原始毫米波。In response to the inability to determine the target garbage type to which the garbage to be placed belongs through the image recognition technology, the original millimeter wave is transmitted through the millimeter wave transmitter.
根据权利要求8所述的方法，其中，所述根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型之后，所述方法还包括：The method according to claim 8, wherein after the determining the target garbage type to which the garbage to be placed belongs according to the reflected wave characteristics of the reflected millimeter wave, the method further comprises:

响应于所述目标垃圾类型为单一垃圾类型，开启与所述目标垃圾类型对应的垃圾投放入口；In response to the target garbage type being a single garbage type, opening a garbage disposal inlet corresponding to the target garbage type;

响应于所述目标垃圾类型中包括至少两种垃圾类型，关闭各个垃圾投放入口，并通过预定方式提示对所述至少两种垃圾类型进行分类。In response to the target garbage type including at least two garbage types, each garbage discharge entrance is closed, and a predetermined method is used to prompt to classify the at least two garbage types.
根据权利要求1至5任一所述的方法，其中，所述方法应用于设置有毫米波发射器和毫米波接收器的垃圾回收监控设备；The method according to any one of claims 1 to 5, wherein the method is applied to a garbage collection monitoring device provided with a millimeter wave transmitter and a millimeter wave receiver;

所述根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型之后，所述方法还包括：After determining the target garbage type to which the garbage to be placed belongs according to the reflected wave characteristics of the reflected millimeter wave, the method further includes:

响应于所述目标垃圾类型中包括至少两种垃圾类型，或者，所述目标垃圾类型为单一垃圾类型，且选择垃圾类型与所述目标垃圾类型不同，记录所述待投放垃圾对应的投放事件，所述选择垃圾类型是投放所述待投放垃圾时选择的垃圾类型，所述投放事件包括投放时间、投放图像以及投放视频中的至少一种；Responsive to the target garbage type including at least two garbage types, or the target garbage type is a single garbage type, and the selected garbage type is different from the target garbage type, recording the placement event corresponding to the garbage to be placed, The selected garbage type is a garbage type selected when the garbage to be placed is placed, and the placement event includes at least one of placement time, placement image, and placement video;

向服务器上报所述投放事件。Report the delivery event to the server.
一种垃圾分类装置，所述装置包括：A garbage sorting device, the device includes:

发射模块，用于通过毫米波发射器发射原始毫米波；Transmitting module, used to transmit the original millimeter wave through the millimeter wave transmitter;

接收模块，用于通过毫米波接收器接收反射毫米波，所述反射毫米波是所述原始毫米波投射在垃圾上产生的反射回波；A receiving module, configured to receive a reflected millimeter wave through a millimeter wave receiver, where the reflected millimeter wave is a reflected echo generated by the original millimeter wave projected on garbage;

分类模块，用于根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。The classification module is used to determine the target garbage type to which the garbage to be put belongs according to the reflected wave characteristics of the reflected millimeter wave.
根据权利要求11所述的装置，其中，所述装置应用于设置有所述毫米波发射器和所述毫米波接收器的终端；The device according to claim 11, wherein the device is applied to a terminal provided with the millimeter wave transmitter and the millimeter wave receiver;

所述装置还包括：The device also includes:

提示模块，用于响应于所述目标垃圾类型中包括至少两种垃圾类型，通过预定方式提示对所述至少两种垃圾类型进行分类。The prompting module is configured to prompt to classify the at least two types of rubbish in a predetermined manner in response to the target type of rubbish including at least two types of rubbish.
根据权利要求12所述的装置，其中，所述装置还包括：The device according to claim 12, wherein the device further comprises:

发送模块，用于响应于所述目标垃圾类型为单一垃圾类型，向所述垃圾投放设备发送垃圾投放指令，所述垃圾投放指令中包含所述目标垃圾类型，所述垃圾投放设备用于开启与所述目标垃圾类型对应的垃圾投放入口。The sending module is configured to respond to the target garbage type being a single garbage type, and send a garbage disposal instruction to the garbage disposal device, the garbage disposal instruction includes the target garbage type, and the garbage disposal device is used to turn on and The garbage disposal entrance corresponding to the target garbage type.
根据权利要求11所述的装置，其中，所述装置应用于设置有所述毫米波发射器和所述毫米波接收器的垃圾投放设备；The device according to claim 11, wherein the device is applied to a garbage disposal facility provided with the millimeter wave transmitter and the millimeter wave receiver;

所述发射模块，用于：The transmitting module is used for:

响应于无法通过图像识别技术确定所述待投放垃圾所属的所述目标垃圾类型，通过所述毫米波发射器发射所述原始毫米波。In response to the inability to determine the target garbage type to which the garbage to be placed belongs through the image recognition technology, the original millimeter wave is transmitted through the millimeter wave transmitter.
根据权利要求14所述的装置，其中，所述装置还包括：The device according to claim 14, wherein the device further comprises:

开启模块，用于响应于所述目标垃圾类型为单一垃圾类型，开启与所述目标垃圾类型对应的垃圾投放入口；An opening module, configured to respond to the target garbage type being a single garbage type, opening a garbage disposal entrance corresponding to the target garbage type;

关闭模块，用于若所述目标垃圾类型中包括至少两种垃圾类型，则关闭各个垃圾投放入口，并通过预定方式提示对所述至少两种垃圾类型进行分类。The closing module is configured to, if the target garbage types include at least two types of garbage, close each garbage disposal entrance, and prompt to classify the at least two types of garbage in a predetermined manner.
根据权利要求11所述的装置，其中，所述装置应用于设置有毫米波发射器和毫米波接收器的垃圾回收监控设备；The device according to claim 11, wherein the device is applied to a garbage collection monitoring equipment provided with a millimeter wave transmitter and a millimeter wave receiver;

所述装置还包括：The device also includes:

记录模块，用于若所述目标垃圾类型中包括至少两种垃圾类型，或者，所述目标垃圾类型为单一垃圾类型，且选择垃圾类型与所述目标垃圾类型不同，则记录所述待投放垃圾对应的投放事件，所述选择垃圾类型是投放所述待投放垃圾时选择的垃圾类型，所述投放事件包括投放时间、投放图像以及投放视频中的至少一种；A recording module, configured to record the garbage to be placed if the target garbage type includes at least two garbage types, or the target garbage type is a single garbage type, and the selected garbage type is different from the target garbage type Corresponding to the release event, the selected garbage type is the type of garbage selected when the garbage to be placed is placed, and the placement event includes at least one of a release time, a placement image, and a placement video;

上报模块，用于向服务器上报所述投放事件。The reporting module is used to report the delivery event to the server.
一种垃圾分类设备，所述垃圾分类设备包括：处理器、存储器、毫米波发射器和毫米波接收器；A garbage classification device, the garbage classification device includes: a processor, a memory, a millimeter wave transmitter and a millimeter wave receiver;

所述毫米波发射器，用于发射原始毫米波；The millimeter wave transmitter is used to transmit original millimeter waves;

所述毫米波接收器，用于接收反射毫米波，所述反射毫米波是所述原始毫米波投射在垃圾上产生的反射回波；The millimeter wave receiver is configured to receive reflected millimeter waves, where the reflected millimeter waves are reflected echoes generated by the original millimeter waves projected on garbage;

所述处理器，用于根据所述反射毫米波的反射波特征确定待投放垃圾所属的目标垃圾类型。The processor is configured to determine the target garbage type to which the garbage to be put belongs according to the reflected wave characteristics of the reflected millimeter wave.
根据权利要求17所述的垃圾分类设备，其中，The garbage sorting equipment according to claim 17, wherein:

所述处理器，用于获取所述反射毫米波的反射波能量；根据所述反射波能量确定所述待投放垃圾所属的目标垃圾类型。The processor is configured to obtain reflected wave energy of the reflected millimeter wave; and determine the target garbage type to which the garbage to be put belongs according to the reflected wave energy.
根据权利要求17所述的垃圾分类设备，其中，The garbage sorting equipment according to claim 17, wherein:

所述处理器，还用于对所述反射毫米波进行信号处理，信号处理方式包括时频域变换或多普勒变换中的至少一种；The processor is further configured to perform signal processing on the reflected millimeter wave, and the signal processing manner includes at least one of time-frequency domain transform or Doppler transform;

对信号处理前以及信号处理后的所述反射毫米波进行特征提取，得到信号特征，所述信号特征包括时域信号特征、频域信号特征和多普勒特征中的至少一种；Performing feature extraction on the reflected millimeter waves before and after signal processing to obtain signal features, where the signal features include at least one of a time domain signal feature, a frequency domain signal feature, and a Doppler feature;

根据所述信号特征确定所述待投放垃圾所属的目标垃圾类型。Determine the target garbage type to which the garbage to be placed belongs according to the signal characteristics.
根据权利要求19所述的垃圾分类设备，其中，The garbage sorting device according to claim 19, wherein:

所述处理器，用于将所述信号特征与预设信号特征进行特征匹配，其中，不同垃圾类型与不同预设信号特征之间存在映射关系；根据所述信号特征与所述预设信号特征的特征匹配度确定所述待投放垃圾所属的目标垃圾类型；The processor is configured to perform feature matching between the signal feature and the preset signal feature, wherein there is a mapping relationship between different garbage types and different preset signal features; according to the signal feature and the preset signal feature The feature matching degree of determines the target garbage type to which the garbage to be placed belongs;

或者，or,

将所述信号特征输入分类模型；根据所述分类模型输出的预测垃圾类型以及所述预测垃圾类型对应的预测概率，确定所述待投放垃圾所属的目标垃圾类型。The signal feature is input into a classification model; according to the predicted garbage type output by the classification model and the predicted probability corresponding to the predicted garbage type, the target garbage type to which the garbage to be put belongs is determined.
一种终端，所述终端包括如权利要求17至20任一所述的垃圾分类设备，和/或，包括如权利要求11至13任一所述的垃圾分类装置。A terminal comprising the garbage sorting device according to any one of claims 17 to 20, and/or comprising the garbage sorting device according to any one of claims 11 to 13.
一种垃圾投放设备，所述垃圾投放设备包括如权利要求17至20任一所述的垃圾分类设备，和/或，包括如权利要求11、14以及15中任一所述的垃圾分类装置。A garbage discharging device, which comprises the garbage sorting device according to any one of claims 17 to 20, and/or comprises the garbage sorting device according to any one of claims 11, 14 and 15.
一种垃圾回收监控设备，所述垃圾回收监控设备包括如权利要求17至20任一所述的垃圾分类设备，和/或，包括如权利要求11和16中任一所述的垃圾分类装置。A garbage collection monitoring device, which includes the garbage classification device according to any one of claims 17 to 20, and/or includes the garbage classification device according to any one of claims 11 and 16.
一种计算机可读存储介质，所述存储介质存储有至少一条指令，所述至少一条指令用于被处理器执行以实现如权利要求1至10任一所述的垃圾分类方法。A computer-readable storage medium, the storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the garbage classification method according to any one of claims 1 to 10.