CN115323713A - Washing machine and control method thereof - Google Patents

Abstract

The application provides a washing machine and a control method thereof, and particularly relates to the technical field of household appliances. The washing machine includes: the image acquisition module is used for acquiring a target clothes image of a user; the controller is electrically connected with the image acquisition module; the controller is configured to: uploading the target clothes image acquired by the image acquisition module to a cloud server; the cloud server is used for determining the image quality and the image type of a target clothes image, acquiring clothes information according to the image type of the target clothes image under the condition that the image quality meets a preset condition, determining a target washing program according to the clothes information, and sending a washing instruction corresponding to the target washing program to the washing machine; the clothes information comprises one or more of colors, types and materials of clothes; and receiving a washing and protecting instruction sent by the cloud server, and responding to the washing and protecting instruction to execute a target washing and protecting program.

Description

Washing machine and control method thereof

Technical Field

The application relates to the technical field of household appliances, in particular to a washing machine and a control method thereof.

Background

With the progress of science and technology, household electrical appliances tend to be intelligent increasingly. Washing machines are also increasingly used as household electrical appliances essential to daily life. For example, the washing machine may implement a function of intelligently setting a washing program according to the material of the laundry.

The technology for identifying clothes to be washed by a user in a washing machine on the market at present mainly comprises a Radio Frequency Identification (RFID) technology, a near infrared spectrum analysis technology and the like. In the RFID technology, the clothes are accurately and quickly identified through the RFID tags of the clothes, but the current use prevalence rate of the RFID tags in the clothes is low, and not all the information of the clothes can be identified in the way; the near infrared spectrum analysis technology is used for analyzing the material components of clothes through fabric spectrum, but the equipment cost of the technology is high, and the fabric with the same components (such as real silk and wool components are all protein) cannot be distinguished in detail, so that the material of the clothes cannot be accurately identified, and a proper washing and protecting program is matched for a user.

Disclosure of Invention

The application provides a washing machine and a control method thereof, and particularly relates to the technical field of household appliances.

In order to achieve the purpose, the technical scheme is as follows:

in a first aspect, the present application provides a washing machine comprising a housing and a cartridge assembly disposed within the housing, the apparatus further comprising:

the image acquisition module is used for acquiring a target clothes image of a user;

the controller is electrically connected with the image acquisition module; the controller is configured to:

uploading the target clothes image acquired by the image acquisition module to a cloud server; the cloud server is used for determining the image quality and the image type of a target clothes image, acquiring clothes information according to the image type of the target clothes image under the condition that the image quality meets a preset condition, determining a target washing program according to the clothes information, and sending a washing instruction corresponding to the target washing program to the washing machine; the clothes information comprises one or more of colors, types, materials and sizes of clothes;

and receiving a washing and protecting instruction sent by the cloud server, and responding to the washing and protecting instruction to execute a target washing and protecting program.

The technical scheme provided by the application at least brings the following beneficial effects: the washing machine uploads a target clothes image acquired by the image acquisition module to the cloud server, the cloud server determines the image quality and the image type of the target clothes image, and determines a target washing and protecting program according to the clothes information acquired by the image type and sends a washing and protecting instruction corresponding to the target washing and protecting program to the washing machine under the condition that the image quality meets a preset condition, so that the washing machine can receive the washing and protecting instruction sent by the cloud server and respond to the washing and protecting instruction to execute the corresponding target washing and protecting program. The method can obtain more accurate clothes image recognition results, so that more comprehensive clothes information can be obtained, washing programs more suitable for processing current clothes can be matched for users, and the experience of the users in using the washing machine is improved.

In some embodiments, the cloud server is further configured to: determining the image quality of the target clothes image based on the image quality characteristics of the plurality of sample clothes images; each sample clothing image in the plurality of sample clothing images comprises one or more image quality characteristics of light intensity, fuzzy degree and obstruction degree. In this embodiment, the cloud server can determine the image quality of the target clothes image according to the image quality characteristics of the plurality of sample clothes images, so that the cloud server can accurately identify the clothes information of the target clothes according to the target clothes image under the condition that the image quality meets the preset condition, more comprehensive clothes information can be obtained, the washing and caring program more suitable for treating the current clothes can be matched for a user, and the experience of the user in using the washing machine is improved.

In some embodiments, the controller of the washing machine is further configured to: acquiring a first instruction sent by a cloud server; the first instruction is an instruction sent by the cloud server under the condition that the image quality does not meet a preset condition, and the first instruction is used for instructing the washing machine to acquire the target clothes image again; and controlling the image acquisition module to acquire the clothes image of the user again in response to the first instruction. In this embodiment, the cloud server sends a first instruction for instructing the washing machine to reacquire the target clothes image to the washing machine when the image quality does not satisfy the preset condition, so that the washing machine can control the image acquisition module to reacquire the clothes image of the user according to the first instruction, and the clothes image can satisfy the preset condition.

In some embodiments, the cloud server is further configured to: determining an image type of the target clothes image based on the image type features of the plurality of sample clothes images; each sample clothes image in the plurality of sample clothes images comprises one or more image type characteristics such as clothes washing mark characteristics, clothes overall characteristics, clothes local characteristics and clothes stacking characteristics; the image types comprise a clothes overall picture, a clothes local picture, a clothes washing label picture and a multi-clothes stacking picture. In this embodiment, the cloud server determines the whole picture, the local picture, the washing tag picture and the multiple image types of the multiple stacked clothes pictures of the target clothes according to each sample clothes image in the multiple sample clothes images, so that the cloud server can accurately identify the clothes information of the target clothes according to the image types of the target clothes images, more comprehensive clothes information can be obtained, a washing program more suitable for processing the current clothes can be matched for a user, and the experience of the user in using the washing machine is improved.

In some embodiments, the cloud server is further configured to: under the condition that the image type is a clothes washing mark picture, a clothes integral picture or a multi-clothes stacking picture, obtaining a clothes area in a target clothes image through a first algorithm, and obtaining clothes information according to the clothes area; the first algorithm is used to distinguish between clothing regions and non-clothing regions in the target clothing image, or to distinguish between multiple clothing regions in the target clothing image. In the embodiment, under the condition that the clothes washing target picture, the whole clothes picture or the multiple clothes stacking pictures are of the image types, the cloud server distinguishes clothes areas and non-clothes areas in the target clothes image through the first algorithm, or distinguishes the clothes areas of the target clothes image to obtain the clothes areas of the target clothes image, and then obtains the clothes information according to the clothes areas, so that more comprehensive clothes information is obtained, a washing and protecting program which is more suitable for processing the current clothes can be matched for a user, and the experience of the user in using the washing machine is improved.

In some embodiments, the cloud server is further configured to: under the condition that the image type is a clothes washing label picture, identifying a washing label area in the target clothes image through a second algorithm to obtain clothes information; the second algorithm is used for identifying text information and graphic information in the washing mark area, the text information comprises one or more items of clothes size, clothes material, clothes brand and the like, and the graphic information comprises washing description identification of the clothes. In this embodiment, under the condition that the identified image type is the laundry washing label picture, the cloud server acquires the laundry information by identifying the text information and the graphic information in the laundry washing label region, so as to acquire more comprehensive laundry information, and further match the washing and caring program more suitable for processing the current laundry for the user, thereby improving the experience of the user in using the washing machine.

In some embodiments, the cloud server is further configured to: under the condition that the image type is a clothes washing mark picture, a clothes whole picture, a clothes local picture or a multi-clothes stacking picture, clothes information in the target clothes image is obtained through a third algorithm; the third algorithm determines the clothing material of the target clothing image based on the clothing material characteristics of the plurality of sample clothing images, wherein the clothing material characteristics comprise one or more of clothing texture characteristics, clothing material component characteristics and the like. In this embodiment, under the condition that the identified image type is a laundry washing mark picture, a laundry overall picture, a laundry local picture or a multi-laundry stacked picture, the cloud server determines one or more laundry information items such as a laundry texture feature, a laundry material component feature and the like of the target laundry image through a third algorithm, so as to obtain more comprehensive laundry information items, and further match a washing and caring program more suitable for treating current laundry for a user, thereby improving the experience of the user in using the washing machine.

In some embodiments, the cloud server is further configured to: under the condition that the image type is a clothes washing mark picture, a clothes whole picture, a clothes local picture or a multi-clothes stacked picture, clothes information in the target clothes image is obtained through a fourth algorithm; the fourth algorithm is used to identify the color of the clothing in the target clothing image. In this embodiment, under the condition that the identified image type is a laundry mark picture, a laundry overall picture, a laundry local picture or a multi-laundry stacked picture, the cloud server determines the laundry information of the laundry color of the target laundry image through a fourth algorithm, so as to obtain more comprehensive laundry information, and further match a washing and caring program more suitable for processing the current laundry for a user, thereby improving the experience of the user in using the washing machine.

In a second aspect, the present application provides a control method of a washing machine, which may be applied to the washing machine of the first aspect. The method comprises the following steps:

uploading the target clothes image acquired by the image acquisition module to a cloud server; the cloud server is used for determining the image quality and the image type of a target clothes image, acquiring clothes information according to the image type of the target clothes image under the condition that the image quality meets a preset condition, determining a target washing program according to the clothes information, and sending a washing instruction corresponding to the target washing program to the washing machine; the clothes information comprises one or more of colors, types and materials of clothes; and receiving a washing and protecting instruction sent by the cloud server, and responding to the washing and protecting instruction to execute a target washing and protecting program.

In some embodiments, the above method further comprises: determining the image quality of the target clothes image based on the image quality characteristics of the plurality of sample clothes images; each sample clothes image in the plurality of sample clothes images comprises one or more image quality characteristics of light intensity, fuzzy degree and shading degree.

In a third aspect, the present application provides a controller comprising: one or more processors; one or more memories; wherein the one or more memories are for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the controller to carry out the method of controlling a laundry machine as provided in the second aspect and possible implementations.

In a fourth aspect, the present application provides a computer-readable storage medium comprising computer instructions which, when run on a computer, cause the computer to perform the control method of a laundry machine provided in the second aspect and possible implementations.

In a fifth aspect, embodiments of the present invention provide a computer program product directly loadable into a memory and containing software code, which, when loaded and executed by a computer, is able to implement a control method of a washing machine as provided in the second aspect and possible implementations.

It should be noted that all or part of the computer instructions may be stored on the computer readable storage medium. The computer readable storage medium may be packaged with or separately from a processor of the controller, which is not limited in this application.

For the beneficial effects described in the second aspect to the fifth aspect in the present application, reference may be made to the beneficial effect analysis of the first aspect, which is not described herein again.

Drawings

Fig. 1 is a schematic view of a washing machine according to an embodiment of the present disclosure;

fig. 2 is a block diagram of a hardware configuration of a washing machine according to an embodiment of the present disclosure;

fig. 3 is a flowchart of a control method of a washing machine according to an embodiment of the present disclosure;

FIG. 4 is a schematic diagram illustrating a method for classifying types of clothing images according to an embodiment of the present disclosure;

fig. 5 is a schematic diagram of a method for identifying a clothing image according to an embodiment of the present application;

FIG. 6 is a schematic diagram illustrating another method for recognizing an image of a garment according to an embodiment of the present application;

FIG. 7 is a schematic diagram illustrating another method for recognizing an image of a garment according to an embodiment of the present application;

FIG. 8 is a schematic diagram illustrating another method for recognizing an image of a garment according to an embodiment of the present application;

fig. 9 is a flowchart illustrating a control method of a further washing machine according to an embodiment of the present disclosure;

FIG. 10 is a flowchart of a control method for a washing machine according to an embodiment of the present application

Fig. 11 is a schematic hardware structure diagram of a controller according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.

The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present application, "a plurality" means two or more unless otherwise specified.

In the description of the present application, it is to be noted that the terms "connected" and "connected" are to be interpreted broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected, unless explicitly stated or limited otherwise. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art. In addition, when a pipeline is described, the terms "connected" and "connected" are used in this application to have a meaning of conducting. The specific meaning is to be understood in conjunction with the context.

In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present relevant concepts in a concrete fashion.

With the progress of science and technology, household electrical appliances tend to be intelligent increasingly. Washing machines are also increasingly used as household electrical appliances essential to daily life. The washing machine can realize the function of intelligently setting the washing program according to the material of clothes.

The technology for identifying clothes to be washed by a user in a washing machine on the market at present mainly comprises a Radio Frequency Identification (RFID) technology, a near infrared spectrum analysis technology and the like. In the RFID technology, the clothes are accurately and quickly identified through the RFID tags of the clothes, but the current RFID tags are used in the clothes at a low prevalence rate, and not all the information of the clothes can be identified in the mode; the near infrared spectrum analysis technology is used for analyzing the material components of clothes through fabric spectrum, but the equipment cost of the technology is high, and the fabric with the same components (such as real silk and wool components are all protein) cannot be distinguished in detail, so that the material of the clothes cannot be accurately identified, and a proper washing and protecting program is matched for a user.

Therefore, the current clothes identification mode has low applicability, all the clothes information cannot be identified, and the identification result is not accurate enough.

The embodiment of the application provides a washing machine and a control method thereof, the washing machine uploads an acquired clothes image to a cloud server, the cloud server judges the type of the clothes image according to the acquired clothes image, and then acquires clothes information in the clothes image through different algorithms according to the type of the image, so that the cloud server matches a washing and protecting program according to a plurality of acquired clothes information, and the washing machine executes related intelligent operation according to the washing and protecting program. The method can obtain more accurate clothes image recognition results, so that more comprehensive clothes information can be obtained, washing and protecting programs more suitable for processing current clothes can be matched for users, and the experience of the users in using the washing machine is improved.

As shown in fig. 1, the washing machine 11 may include: cabinet 101, washing tub 102, display 103. Wherein, the washing tub 102 is provided in the cabinet 101.

In some embodiments, the washing tub 102 may be used to hold laundry therein. Exemplarily, when the washing machine 11 is a drum washing machine, the washing tub 102 of the washing machine may include a tub assembly, i.e., an inner tub and an outer tub.

In some embodiments, the display 103 may be a liquid crystal display, an organic light-emitting diode (OLED) display. The particular type, size, resolution, etc. of the display 103 is not limited, and those skilled in the art will appreciate that the display 103 may be varied in performance and parameters as desired.

In some embodiments, the display 103 may be used to display a control panel of the washing machine 11 or other image information. For example, the washing machine may display current operation information of the washing machine, such as a type of a washing course, an operation time period of the washing course and a remaining operation time period, a washing water amount, etc., through the display 103.

Fig. 2 schematically shows a block diagram of the hardware configuration of the washing machine 11 in the embodiment of the present application.

As shown in fig. 2, the washing machine 11 may further include: a controller 104, an image acquisition module 105, a communication module 106, and a power supply 107. The image acquisition module 105, the communication module 106 and the power supply 107 are all connected to the controller 104.

In some embodiments, the controller 104 refers to a device that can generate an operation control signal instructing the washing machine 11 to execute a control instruction according to the instruction operation code and the timing signal. Illustratively, the controller 104 may be a Central Processing Unit (CPU), a general purpose processor Network Processor (NP), a Digital Signal Processor (DSP), a microprocessor, a microcontroller, a Programmable Logic Device (PLD), or any combination thereof. The controller 104 may also be other devices with processing functions, such as a circuit, a device, or a software module, which is not limited in any way by the embodiments of the present application.

Illustratively, the controller 104 uploads the target clothes image acquired by the image acquisition module 105 to the cloud server; the controller 104 receives a washing and protecting instruction sent by the cloud server, and responds to the washing and protecting instruction to execute a washing and protecting program; the controller 104 acquires a first instruction sent by the cloud server, and controls the image acquisition module 105 to acquire the clothes image of the user again in response to the first instruction.

In some embodiments, the image capturing module 105 may be located on the surface of the box 101 and inside the washing tub 102, the image capturing module 105 located on the surface of the box 101 may be used to obtain a washing target picture, a whole picture, a partial picture, etc. of the user's clothes, and the image capturing module 105 located inside the washing tub 102 may be used to obtain a partial picture, a multiple clothes stack picture, etc. of the user's clothes.

In some embodiments, the communication module 106 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communication module 106 may include at least one of a wireless communication technology (Wi-Fi) module, a bluetooth module, a wired ethernet module, a Near Field Communication (NFC) module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The communication module 106 may be used for communicating with other devices or communication networks (e.g., ethernet, radio Access Network (RAN), wireless Local Area Networks (WLAN), etc.). Illustratively, the controller 104 uploads the image of the target clothes acquired by the image acquisition module 105 to the cloud server through the communication module 106.

The power supply 107 may provide power supply support for the washing machine 11 from power input from an external power source under the control of the controller 104.

Based on the above washing machine, as shown in fig. 3, an embodiment of the present application provides a control method of a washing machine, including the following steps:

s101, the washing machine uploads the target clothes image acquired by the image acquisition module to a cloud server.

The image acquisition module can comprise a camera, namely, the camera arranged on the washing machine can shoot the target clothes image. And, the target laundry image means an image of the user's laundry, such as a photograph, etc.

In some embodiments, during the process that the user puts the laundry into the washing machine, the washing machine may acquire the target laundry image through the image capture module.

After receiving the target clothes image, the cloud server can determine the image quality and the image type of the target clothes image. Under the condition that the image quality meets the preset condition, the cloud server acquires clothes information according to the image type of the target clothes image, determines a target washing and protecting program according to the clothes information, and sends a washing and protecting instruction corresponding to the target washing and protecting program to the washing machine. The clothes information comprises one or more of colors, types, materials and sizes of clothes.

In some embodiments, the cloud server may further combine the acquired laundry information with factors such as real-time weather and water quality of the location of the washing machine to determine the target washing and caring program.

In some embodiments, the target clothes image may also be captured by a user, and the user may capture the target clothes image of the clothes to be washed through the mobile terminal, and then upload the target clothes image to the cloud server through an application program corresponding to the washing machine. Therefore, the user can also set a reasonable washing and protecting program for the clothes to be treated under the condition of not being close to the washing machine.

In some embodiments, the determination of the image quality of the target garment image is based on image quality characteristics of a plurality of sample garment images, wherein each sample garment image of the plurality of sample garment images comprises one or more of light intensity, degree of blur, degree of occlusion. Or the cloud server can perform learning training to determine the image quality by using the neural network model, and performs learning training to a plurality of sample clothes images by using the neural network model to obtain the image quality characteristics, so that the cloud server determines the image quality of the target clothes image according to the image quality characteristics.

In some embodiments, the image quality meeting the preset condition may indicate whether the image quality is greater than or equal to one or more of a preset light intensity value, an occlusion degree value of an image, and a blur degree value of the image, and when determining whether the image quality meets the preset condition, the one or more may be determined, which is not specifically limited in the embodiment of the present application. The cloud server sets a preset condition through image quality characteristics in the sample clothes images, and judges whether the image quality of the target clothes image meets the preset condition or not by comparing the target clothes image with the preset condition.

In some embodiments, the determination of the image type of the target garment image is based on image type features of a plurality of sample garment images, wherein each of the plurality of sample garment images includes one or more image type features such as a garment watermark feature, a garment global feature, a garment local feature, a garment stacking feature, and the like, and the image types include a garment global picture, a garment local picture, a garment watermark picture, and a multiple garment stacking picture. Or the cloud server can perform learning training to determine the image type by using the neural network model, and performs learning training to a plurality of sample clothes images by using the neural network model to obtain the image type characteristics, so that the cloud server determines the image type of the target clothes image according to the image type characteristics.

For example, as shown in fig. 4, the cloud server may include an image type detection module, the image type detection module learns different clothes image type characteristics by using the neural network model, and after a new picture is input into the neural network model, the image type detection module determines an image type of a target clothes image according to the image type characteristics, where the image type includes a whole clothes picture, a partial clothes picture, a laundry washing label picture, and a multiple clothes stacked picture. Therefore, the cloud server can accurately identify the type of the target clothes image through the image type detection module and then acquire the clothes information, so that the washing machine can acquire a reasonable washing and protecting program set by the cloud server according to the clothes information, and more excellent washing experience is brought to a user.

In some embodiments, after determining the image type of the target laundry image, the cloud server may randomly extract a plurality of sample laundry images (including a laundry overall image, a laundry local image, a laundry tag image, and a multi-laundry stacked image) of different laundry types, compare the target laundry image with the sample laundry images in similarity, determine whether the image type determined by the neural network model is consistent with the image type of the sample laundry image with the highest similarity in the sample laundry images, so as to verify the neural network algorithm determination result, and determine a final result of the image type of the target laundry image.

S102, the washing machine receives the washing and protection instruction sent by the cloud server and responds to the washing and protection instruction to execute a target washing and protection program.

The cloud server acquires the clothes information according to the image type of the target clothes image, and then determines the washing and protecting instruction sent by the target washing and protecting program according to the clothes information.

The foregoing embodiments include at least the following benefits: the washing machine uploads a target clothes image acquired by the image acquisition module to the cloud server, the cloud server determines the image quality and the image type of the target clothes image, and determines a target washing program according to the clothes information acquired by the image type and sends a washing instruction corresponding to the target washing program to the washing machine under the condition that the image quality meets a preset condition, so that the washing machine can receive the washing instruction sent by the cloud server and respond to the washing instruction to execute the corresponding washing program. The method can obtain more accurate clothes image recognition results, so that more comprehensive clothes information can be obtained, washing and protecting programs more suitable for processing current clothes can be matched for users, and the experience of the users in using the washing machine is improved.

In some embodiments, as shown in fig. 5, in the case that the image type is a laundry mark picture, a whole picture of clothes, or a stacked picture of multiple clothes, the manner of the cloud server obtaining the clothes information may be: and acquiring a clothes area in the target clothes image through a first algorithm, and acquiring clothes information according to the clothes area. Wherein the first algorithm may represent an image segmentation algorithm for distinguishing clothing regions from non-clothing regions in the target clothing image, or for distinguishing a plurality of clothing regions in the target clothing image.

For example, the image segmentation algorithm divides the laundry washing target picture, the laundry overall picture and the multiple-laundry stacked picture into a laundry area, a background area and a plurality of laundry areas (including a first laundry area, a second laundry area, a third laundry area and the like), so that the cloud server can acquire corresponding laundry information only according to the laundry areas. Wherein, the non-laundry area may represent a washing target area, a background area, etc.

In some embodiments, as shown in fig. 6, in the case that the image type is a laundry washing tag picture, the manner of the cloud server acquiring the laundry information may be: and identifying a water washing mark area in the target clothes image through a second algorithm to obtain the clothes information. The second algorithm can represent a text detection algorithm and/or an image detection algorithm, the second algorithm is used for identifying text information, graphic information and the like in the washing mark area, the text information comprises one or more items of clothes size, clothes material, clothes brand and the like, and the graphic information comprises washing description marks of clothes and the like.

Illustratively, in the case that the image type of the target clothes image is a clothes washing label picture, the washing target area is obtained through an image segmentation algorithm, and then the text information of the washing target area is obtained through a text detection algorithm, for example, the content of the cotton component is 90%, the content of the polyester component is 5%, the size is 120, and the like. And, the image detection algorithm is used to obtain the graphic information in the washing label, for example, the target clothes can not be dry-cleaned according to the washing instruction identification pattern. The cloud server can determine that the target clothes are children's clothes through the information.

In some embodiments, as shown in fig. 7, in the case that the image type is a laundry label picture, a whole laundry picture, a partial laundry picture, or a stacked multiple laundry picture, the manner of the cloud server acquiring the laundry information may be: and acquiring clothes information of the clothes area in the target clothes image through a third algorithm. The third algorithm may represent a texture classification algorithm, and the third algorithm may determine the texture of the target clothing image based on the clothing texture features of the plurality of sample clothing images, where the clothing texture features include one or more of clothing texture features, clothing texture component features, and the like.

For example, in the case that the image type is a laundry icon picture, the image segmentation algorithm is used to obtain the laundry area, and then the material classification algorithm is used to obtain the laundry material information of the target laundry image, for example, it is determined that the laundry material of the target laundry image is cotton and polyester, and the content of the cotton component is 90%, the content of the polyester component is 5%, and the like.

In some embodiments, as shown in fig. 8, in the case that the image type is a laundry icon picture, a whole laundry picture, a partial laundry picture, or a multi-laundry stacked picture, the laundry information may be obtained by: clothes information of a clothes area in the target clothes image is obtained through a fourth algorithm; wherein, the fourth algorithm can be expressed as a color recognition algorithm, and the fourth algorithm is used for recognizing the color of the clothes in the target clothes image.

For example, in the case that the image type is a multiple-clothing-stacked picture, the first clothing region, the second clothing region, and the third clothing region are obtained through an image segmentation algorithm, and then the color of the clothing region is obtained through a color recognition algorithm, for example, the color of the first clothing region is black, the color of the second clothing region is black, the color of the third clothing region is red, and the like.

In some embodiments, the cloud server may further obtain the style and brand information of the target clothing through the target clothing image. For example, in the case that the image type is a laundry target picture, the cloud server may obtain text information about a brand and a style of a target laundry in the laundry target area through a text detection algorithm.

The foregoing embodiments include at least the following advantageous effects:

1. the user can place target clothes to be identified or washed at will, the clothes image of the target clothes is obtained without specially aligning the water washing label of the target clothes to an image acquisition module of a washing machine or a mobile terminal camera of the user, and the randomly obtained target clothes image can obtain corresponding clothes information through a third algorithm (material classification algorithm) and a fourth algorithm (color identification algorithm). Such operation is more convenient and more comprehensive laundry information can be acquired, so that the determined washing program is more accurate.

2. When the method is applied, the cloud server can obtain corresponding clothes information through a third algorithm (material classification algorithm) and a fourth algorithm (color identification algorithm) under the condition that clothes information cannot be directly obtained through the second algorithm (including a text detection algorithm and an image detection algorithm) due to the fact that the washing mark of the target clothes is lost or worn. Thereby preventing the condition that the washing mark of the target clothes is lost or worn out and the clothes information can not be obtained through the clothes image.

3. The cloud server can acquire more comprehensive clothes information in the target clothes image through various algorithms, so that a washing and protecting program more suitable for processing the current clothes can be matched for a user. The washing machine responds to the washing and protection instruction sent by the cloud server according to the washing and protection program, corresponding washing and protection operation is executed, and therefore better use experience is brought to a user.

In some embodiments, as shown in fig. 9, in the case that the image quality does not satisfy the preset condition, the following steps may be included:

s201, the washing machine obtains a first instruction sent by the cloud server.

The first instruction is an instruction sent by the cloud server under the condition that the image quality does not meet a preset condition, and the first instruction is used for instructing the washing machine to acquire the target clothes image again.

For example, under the condition that the preset shielding degree is set to be 60%, the cloud server obtains, through an image quality detection algorithm, that the shielding degree of the target clothes image is 75%, and the shielding degree of the target clothes image is greater than the preset shielding degree, if the image quality of the target clothes image does not meet the preset condition, the cloud server sends a first instruction to the washing machine to instruct the washing machine to re-acquire the target clothes image, and instructs the washing machine to re-acquire the clothes image.

In other embodiments, the cloud server may also send a second instruction to the mobile terminal of the user to instruct the user to shoot the clothes image of the target clothes again when the image quality does not meet the preset condition. For example, if the blocking degree of the target clothes image uploaded by the user is greater than the preset blocking degree, the image quality of the target clothes image does not meet the preset condition, the cloud server sends a second instruction to the mobile terminal of the user, the second instruction is used for instructing the user to shoot the clothes image of the target clothes again, the mobile terminal of the user obtains the second instruction, and the mobile terminal responds to the second instruction and displays a prompt of 'the image blocking degree of the target clothes shot by the user does not meet the identification condition, and the user asks to shoot the image of the clothes again' on the display page.

S202, the washing machine responds to the first instruction and controls the image acquisition module to acquire the clothes image of the user again.

In some embodiments, the image capturing module may obtain a clearer image of the target clothes by adjusting a method for capturing the image of the target clothes (for example, adjusting a focusing direction and a focusing degree of the image capturing device).

In some embodiments, after the washing machine acquires the clothes image of the user again, the clothes image of the user is uploaded to the cloud server again.

The foregoing embodiments include at least the following advantageous effects: the cloud server sends a first instruction for instructing the washing machine to reacquire a target clothes image to the washing machine under the condition that the image quality does not meet the preset condition, the washing machine responds to the first instruction to reacquire the clothes image of the user, so that the clothes image can meet the preset condition, the cloud server can acquire a more accurate clothes image recognition result and acquire more comprehensive clothes information, and then a washing and protecting program more suitable for processing the current clothes can be matched for the user, and the experience of the user in using the washing machine is improved.

Illustratively, as shown in fig. 10, the method in the embodiment of the present application may further include the following steps:

s1, the washing machine collects images of target clothes and uploads the collected images of the target clothes to a cloud server;

s2, the cloud server acquires a target clothes image;

s3, the cloud server judges whether the target clothes image is fuzzy or not through an image quality detection algorithm;

s4, if the target clothes image is fuzzy, the washing machine adjusts a method for collecting the target clothes image (for example, the focusing direction and the focusing degree of an image collecting device are adjusted), and the step S1 is executed;

s5, if the target clothes image is clear, the cloud server acquires the image type of the target clothes image;

s6, the cloud server acquires clothes information according to the image type of the target clothes image and determines a target washing and caring program according to the clothes information;

s7, the cloud server sends a washing and protection instruction corresponding to the target washing and protection program to the washing machine;

and S8, the washing machine executes a target washing program according to the washing instruction.

The foregoing embodiments include at least the following advantageous effects: the washing machine uploads a target clothes image acquired by the image acquisition module to the cloud server, the cloud server determines the image quality and the image type of the target clothes image, and determines a target washing program according to the clothes information acquired by the image type and sends a washing instruction corresponding to the target washing program to the washing machine under the condition that the image quality meets a preset condition, so that the washing machine can receive the washing instruction sent by the cloud server and respond to the washing instruction to execute the corresponding washing program. The method can obtain more accurate clothes image recognition results, so that more comprehensive clothes information can be obtained, washing programs more suitable for processing current clothes can be matched for users, and the experience of the users in using the washing machine is improved.

It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation to the washing machine. In other embodiments of the present application, a washing machine may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

In the embodiment of the present application, the controller may be divided into functional modules according to the above example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. Optionally, the division of the modules in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

The embodiment of the present application further provides a controller, as shown in fig. 11, the controller 104 includes a processor 108, and optionally, a memory 109 and a communication interface 110, which are connected to the processor 108. The processor 108, memory 109 and communication interface 110 are connected by a bus 111.

The processor 108 may be a Central Processing Unit (CPU), a Network Processor (NP), a Digital Signal Processor (DSP), a microprocessor, a microcontroller, a Programmable Logic Device (PLD), or any combination thereof. The processor 108 may also be any other means having a processing function such as a circuit, device or software module. The processor 108 may also include multiple CPUs, and the processor 108 may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor herein may refer to one or more devices, circuits, or processing cores that process data (e.g., computer program instructions).

The memory 109 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disk read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, which is not limited by the embodiments of the present application. The memory 109 may be separate or integrated with the processor 108. The memory 109 may have computer program code embodied therein. The processor 108 is configured to execute the computer program codes stored in the memory 109, so as to implement the control method provided by the embodiment of the present application.

Communication interface 110 may be used to communicate with other devices or communication networks (e.g., ethernet, radio Access Network (RAN), wireless Local Area Networks (WLAN), etc.).

The bus 111 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus 111 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 11, but this is not intended to represent only one bus or type of bus.

The embodiment of the present application further provides a computer-readable storage medium, which includes computer-executable instructions, and when the computer-readable storage medium runs on a computer, the computer is caused to execute any one of the control methods provided by the above embodiments.

The embodiment of the present application further provides a computer program product containing computer executable instructions, which when run on a computer, causes the computer to execute any one of the control methods provided by the above embodiments.

Those skilled in the art will recognize that, in one or more of the examples described above, the functions described in this invention may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

Through the description of the foregoing embodiments, it will be clear to those skilled in the art that, for convenience and simplicity of description, only the division of the functional modules is illustrated, and in practical applications, the above function distribution may be completed by different functional modules as needed, that is, the internal structure of the apparatus may be divided into different functional modules to complete all or part of the above described functions.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules or units is only one logical function division, and there may be other division ways in actual implementation. For example, various elements or components may be combined or may be integrated into another device, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form. Units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed to a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. The integrated unit, if implemented as a software functional unit and sold or used as a separate product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. A washing machine, characterized by comprising:

the image acquisition module is used for acquiring a target clothes image of a user;

the controller is electrically connected with the image acquisition module; the controller is configured to:

uploading the target clothes image acquired by the image acquisition module to a cloud server; the cloud server is used for determining the image quality and the image type of the target clothes image, acquiring clothes information according to the image type of the target clothes image under the condition that the image quality meets a preset condition, determining a target washing program according to the clothes information, and sending a washing instruction corresponding to the target washing program to the washing machine; the clothing information comprises one or more of color, type, material and size of the clothing;

and receiving the washing and protecting instruction sent by the cloud server, responding to the washing and protecting instruction, and executing the target washing and protecting program.

2. The washing machine as claimed in claim 1, wherein the cloud server is further configured to:

determining the image quality of the target clothes image based on the image quality characteristics of a plurality of sample clothes images; each sample garment image of the plurality of sample garment images includes one or more image quality characteristics of light intensity, degree of blurring, degree of occlusion.

3. The washing machine as claimed in claim 1 or 2, wherein the controller is further configured to:

acquiring a first instruction sent by the cloud server; the first instruction is an instruction sent by the cloud server under the condition that the image quality does not meet the preset condition, and the first instruction is used for instructing the washing machine to reacquire the target clothes image;

in response to the first instruction, controlling the image acquisition module to acquire the clothing image of the user again.

4. The washing machine of claim 1, wherein the cloud server is further configured to:

determining an image type of the target clothes image based on image type features of a plurality of sample clothes images; each sample clothes image in the plurality of sample clothes images comprises one or more image type characteristics such as clothes washing mark characteristics, clothes overall characteristics, clothes local characteristics and clothes stacking characteristics; the image types comprise clothes whole pictures, clothes local pictures, clothes washing label pictures and multi-clothes stacking pictures.

5. The washing machine as claimed in claim 4, wherein the cloud server is further configured to:

under the condition that the image type is a clothes washing mark picture, a clothes integral picture or a multi-clothes stacking picture, obtaining a clothes area in the target clothes image through a first algorithm, and obtaining the clothes information according to the clothes area; the first algorithm is used to distinguish between clothing regions and non-clothing regions in the target clothing image, or to distinguish between clothing regions in the target clothing image.

6. The washing machine of claim 4, wherein the cloud server is further configured to:

under the condition that the image type is a clothes washing label picture, identifying a washing label area in the target clothes image through a second algorithm to obtain the clothes information; the second algorithm is used for identifying text information and graphic information in the washing mark area, the text information comprises one or more items of clothes size, clothes material, clothes brand and the like, and the graphic information comprises washing description identification of clothes.

7. The washing machine of claim 4, wherein the cloud server is further configured to:

under the condition that the image type is a clothes washing mark picture, a clothes whole picture, a clothes local picture or a multi-clothes stacking picture, clothes information in the target clothes image is obtained through a third algorithm; the third algorithm determines the clothing material of the target clothing image based on the clothing material characteristics of the plurality of sample clothing images, wherein the clothing material characteristics comprise one or more of clothing texture characteristics, clothing material composition characteristics and the like.

8. The washing machine of claim 4, wherein the cloud server is further configured to:

under the condition that the image type is a clothes washing mark picture, a clothes whole picture, a clothes local picture or a multi-clothes stacked picture, clothes information in the target clothes image is obtained through a fourth algorithm; the fourth algorithm is used for identifying the clothes color in the target clothes image.

9. A control method of a washing machine, characterized in that the method comprises:

uploading the target clothes image acquired by the image acquisition module to a cloud server; the cloud server is used for determining the image quality and the image type of the target clothes image, acquiring clothes information according to the image type of the target clothes image under the condition that the image quality meets a preset condition, determining a target washing and protecting program according to the clothes information, and sending a washing and protecting instruction corresponding to the target washing and protecting program to the washing machine; the clothes information comprises one or more of color, type and material of the clothes;

and receiving the washing and protecting instruction sent by the cloud server, responding to the washing and protecting instruction, and executing the target washing and protecting program.

10. The method of claim 9, wherein the method comprises: determining the image quality of the target clothes image based on the image quality characteristics of a plurality of sample clothes images; each sample garment image of the plurality of sample garment images includes one or more image quality characteristics of light intensity, degree of blurring, degree of occlusion.

Images