CN113463327A - Clothes display method and device, electronic equipment and computer readable storage medium - Google Patents
Clothes display method and device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN113463327A CN113463327A CN202110738679.4A CN202110738679A CN113463327A CN 113463327 A CN113463327 A CN 113463327A CN 202110738679 A CN202110738679 A CN 202110738679A CN 113463327 A CN113463327 A CN 113463327A
- Authority
- CN
- China
- Prior art keywords
- image
- clothes
- probability value
- display
- pixel point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000010586 diagram Methods 0.000 claims abstract description 50
- 238000005406 washing Methods 0.000 claims description 89
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 20
- 238000012790 confirmation Methods 0.000 claims description 11
- 238000013527 convolutional neural network Methods 0.000 claims description 11
- 238000013528 artificial neural network Methods 0.000 claims description 10
- 230000011218 segmentation Effects 0.000 claims description 8
- 239000003086 colorant Substances 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 15
- 230000003993 interaction Effects 0.000 abstract description 12
- 230000008569 process Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000004364 calculation method Methods 0.000 description 4
- 238000013473 artificial intelligence Methods 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000001035 drying Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000003756 stirring Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Images
Classifications
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F33/00—Control of operations performed in washing machines or washer-dryers
- D06F33/30—Control of washing machines characterised by the purpose or target of the control
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F33/00—Control of operations performed in washing machines or washer-dryers
- D06F33/50—Control of washer-dryers characterised by the purpose or target of the control
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F34/00—Details of control systems for washing machines, washer-dryers or laundry dryers
- D06F34/14—Arrangements for detecting or measuring specific parameters
- D06F34/18—Condition of the laundry, e.g. nature or weight
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F58/00—Domestic laundry dryers
- D06F58/32—Control of operations performed in domestic laundry dryers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/001—Texturing; Colouring; Generation of texture or colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- D—TEXTILES; PAPER
- D06—TREATMENT OF TEXTILES OR THE LIKE; LAUNDERING; FLEXIBLE MATERIALS NOT OTHERWISE PROVIDED FOR
- D06F—LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES
- D06F2103/00—Parameters monitored or detected for the control of domestic laundry washing machines, washer-dryers or laundry dryers
- D06F2103/02—Characteristics of laundry or load
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Textile Engineering (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Control Of Washing Machine And Dryer (AREA)
Abstract
The invention discloses a clothes display method and device, electronic equipment and a computer readable storage medium, wherein the clothes display method is applied to clothes processing equipment and comprises the following steps: acquiring an image of laundry in a laundry drum of a laundry treatment device; processing the image to obtain the probability value of clothes existing in each pixel point in the image; generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point; and generating an explicit image according to the thermodynamic diagram and the image, and controlling the clothes processing equipment to display the explicit image. According to the display method, the probability value of clothes existing in each pixel point in the image is obtained to generate the thermodynamic diagram, and the thermodynamic diagram and the image are generated into the explicit image for display, so that a user can directly feel the algorithm effect, and interaction with the user is realized.
Description
Technical Field
The present invention relates to the field of home appliances, and in particular, to a clothes display method, a clothes display apparatus, an electronic device, and a computer-readable storage medium.
Background
At present, the intellectualization and interconnection trend of household electrical appliances develops rapidly, a plurality of household electrical appliances are endowed with an intelligent function, a plurality of artificial intelligence algorithms are embedded into the household electrical appliances, and the washing machine is not exceptional. However, most of the intelligent products on the market at present only have 'intelligent' labels, and users cannot really feel the intelligent effect; in addition, the intelligent function lacks interaction with the user, the intelligent function cannot be upgraded, and the high-quality life requirement of people cannot be met.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art. Therefore, a first object of the present invention is to provide a method for displaying clothes, which generates a thermodynamic diagram by obtaining a probability value of clothes existing in each pixel point in an image, and displays the thermodynamic diagram and an explicit image generated from the image, so that a user can directly feel an algorithm effect, thereby realizing interaction with the user.
A second object of the present invention is to provide a clothes display device.
A third object of the invention is to propose an electronic device.
A fourth object of the invention is to propose a computer-readable storage medium.
In order to achieve the above object, a clothes display method is provided in an embodiment of a first aspect of the present invention, which is applied to a clothes processing apparatus, and includes: acquiring an image of laundry in a laundry drum of the laundry treatment apparatus; processing the image to obtain the probability value of clothes existing in each pixel point in the image; generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point; generating an dominating image according to the thermodynamic diagram and the image, and controlling the clothes treatment equipment to display the dominating image.
According to the clothes display method, firstly, an image of clothes in a washing drum of the clothes processing equipment is obtained, the probability value of clothes existing at each pixel point in the image is obtained through processing the image, then, a thermodynamic diagram is generated according to the probability value of clothes existing at each pixel point, an explicit image is generated according to the thermodynamic diagram and the image, and the clothes processing equipment is controlled to display the explicit image. Therefore, the method generates the thermodynamic diagram by acquiring the probability value of clothes existing in each pixel point in the image, and generates the explicit image with the image for displaying, so that a user can directly feel the algorithm effect, and the interaction with the user is realized.
In addition, the clothes display method according to the above embodiment of the present invention may further have the following additional technical features:
according to one embodiment of the invention, generating an explicative image from the thermodynamic map and the image comprises: superimposing the thermodynamic map on the image to generate the dominating image.
According to one embodiment of the invention, generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point comprises the following steps: acquiring a display color corresponding to the probability value of clothes existing in each pixel point; and generating the thermodynamic diagram according to the acquired different display colors.
According to an embodiment of the present invention, processing the image to obtain a probability value of clothes existing at each pixel point in the image includes: and carrying out segmentation prediction on the image by adopting a deep convolutional neural network so as to obtain the probability value of clothes existing at each pixel point in the image.
According to one embodiment of the invention, the segmentation prediction of the image by using the deep convolutional neural network comprises the following steps: processing the image through a lower convolution module in the deep convolution neural network to obtain the characteristics of the clothes; and processing the characteristics of the clothes through an upper convolution module in the deep convolution neural network so as to obtain the probability value of clothes existing in each pixel point in the image.
According to an embodiment of the present invention, the above clothing displaying method further includes: acquiring the number of pixel points with the probability value larger than a first preset value; determining the volume ratio of the clothes in the washing drum according to the number of the pixel points and the total number of the pixel points in the image; and acquiring a washing water level according to the volume ratio, and controlling the clothes treatment equipment according to the washing water level.
According to an embodiment of the present invention, the above clothing displaying method further includes: and determining that a confirmation instruction of the user to the dominance image is received, or determining that the confirmation instruction of the user is not received within a first preset time, and acquiring the volume ratio of the clothes in the washing drum.
In order to achieve the above object, a second aspect of the present invention provides a clothes display device, applied to a clothes treatment apparatus, the device including: an acquisition module for acquiring an image of laundry in a laundry drum of the laundry treatment apparatus; the image processing module is used for processing the image to acquire the probability value of clothes existing in each pixel point in the image; the generating module is used for generating thermodynamic diagrams according to the probability value of clothes existing in each pixel point; and the display control module is used for generating an explicit image according to the thermodynamic diagram and the image and controlling the clothes treatment equipment to display the explicit image.
According to the clothes display device provided by the embodiment of the invention, the image of clothes in the washing drum of the clothes processing equipment is obtained through the obtaining module, the image is processed through the image processing module so as to obtain the probability value of clothes existing in each pixel point in the image, the thermodynamic diagram is generated through the generating module according to the probability value of clothes existing in each pixel point, the display control module generates an explicit image according to the thermodynamic diagram and the image, and the clothes processing equipment is controlled to display the explicit image. Therefore, the device generates thermodynamic diagrams by acquiring the probability value of clothes existing in each pixel point in the images, and generates an explicit image with the images for displaying, so that a user can directly feel the algorithm effect, and interaction with the user is realized.
To achieve the above object, an electronic device according to a third aspect of the present invention includes: the clothes display system comprises a memory, a processor and a clothes display program which is stored on the memory and can run on the processor, wherein when the processor executes the clothes display program, the clothes display method is realized.
According to the electronic equipment provided by the embodiment of the invention, the clothes display method is realized by executing the clothes display program through the processor, and the user can directly feel the algorithm effect and realize the interaction with the user by displaying the explicit image.
In order to achieve the above object, a computer-readable storage medium according to a fourth aspect of the present invention is provided, on which a clothes display program is stored, and the clothes display program realizes the clothes display method when being executed by a processor.
According to the computer-readable storage medium of the embodiment of the invention, the clothes display method is realized by executing the clothes display program, and the user can directly feel the algorithm effect by displaying the explicit image, so that the interaction with the user is realized.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a flowchart of a clothes displaying method according to an embodiment of the present invention;
fig. 2 is a schematic view of an explicit display washing machine of a laundry display method according to an embodiment of the present invention;
FIG. 3 is a block diagram of a garment display device according to an embodiment of the invention;
fig. 4 is a block diagram of an electronic device according to an embodiment of the invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
A clothing presentation method, a clothing presentation apparatus, an electronic device, and a computer-readable storage medium according to embodiments of the present invention will be described below with reference to the accompanying drawings.
Fig. 1 is a flowchart of a clothing displaying method according to an embodiment of the present invention. In one embodiment of the invention, the clothes display method can be applied to the clothes treatment equipment, so that a user can visually check the state and the position of clothes in a washing drum on a display screen of the clothes treatment equipment. The clothes treatment device can be a pulsator washing machine, a drum washing machine, a stirring washing machine, a jet washing machine, a drying all-in-one machine, a clothes dryer and other devices with a display screen.
As shown in fig. 1, the clothes displaying method according to the embodiment of the present invention may include the steps of:
s1, acquiring an image of the laundry inside the washing drum of the laundry treating device.
Specifically, taking the laundry treating apparatus as an example of a drum type washing machine, as shown in fig. 2, the drum type washing machine 100 has a side-opening structure, the washing machine door 110 is located at one side of the drum type washing machine 100, and the washing machine door 110 is configured in a circular shape adapted to a washing tub of the drum type washing machine 100. The drum type washing machine 100 is provided with a touch screen display and control area 130 above the same side as the washing machine door 110, and a user can selectively control an operation program of the washing machine through the touch screen display and control area 130. The middle part of the washing machine door 110 is provided with a camera 120, and the camera 120 is used for shooting and collecting clothes in the washing drum. In a specific application process, a user puts clothes into the washing drum, closes the door 110 of the washing machine, and opens the start button in the touch screen display and control area 130, so that the camera 120 receives a trigger signal and shoots the inside of the washing drum to acquire an image of the clothes in the washing drum. The shooting action of the camera 120 can be triggered by a power-on signal of the clothes treatment device. When the user puts the clothes again, the shooting action of the camera 120 is triggered again through the closing of the washing machine door 110, that is, the clothes in the washing drum are shot again to form a new image, and at the moment, the newly acquired image is used as an image which needs to be processed subsequently.
It should be noted that the installation position of the camera 120 is only a specific implementation manner of an embodiment of the present invention. On the premise of ensuring effective collection of images in the washing machine barrel, the optimal installation position can be selected according to the structure of the washing machine. Such as: the washing machine door of the pulsator washing machine is on the top, so that the camera can be installed above the pulsator washing machine, i.e., on the washing machine door. In addition, the installation position of the camera and the parameters of the camera have a crucial influence on the image quality of clothes in the washing drum, so that the camera is selected and assembled according to the requirements of the washing machine.
And S2, processing the image to obtain the probability value of clothes existing in each pixel point in the image.
According to an embodiment of the present invention, processing the image to obtain a probability value of clothes existing at each pixel point in the image further includes: and (3) carrying out segmentation prediction on the image by adopting a deep convolutional neural network so as to obtain the probability value of clothes existing at each pixel point in the image.
Further, according to an embodiment of the present invention, the performing segmentation prediction on the image by using a deep convolutional neural network includes: processing the image through a lower convolution module in the deep convolution neural network to obtain the characteristics of the clothes; the characteristics of the clothes are processed through an upper convolution module in the deep convolution neural network so as to obtain the probability value of clothes existing in each pixel point in the image.
Specifically, the image shot by the camera is uploaded to the server side in a photo encryption mode so as to ensure personal privacy security. When the server receives the image, the image is processed in a deep convolution neural network mode, and then the image is calculated on the basis of the characteristic value of the image. And the deep convolution neural network processes the image received by the server end in a hole convolution mode through the lower convolution module. The void convolution characteristic grabbing technology improves the identification accuracy of the position and the volume of the clothes, so that the identification accuracy of the empty drum reaches 100%, and the identification accuracy of small clothes reaches 98%. For example, a piece of clothes is put in the washing drum, and an image shot by the camera is the washing drum with the piece of clothes, wherein the inner wall of the washing drum is inevitably subjected to image acquisition in order to ensure that the image in the washing drum is effectively shot by the camera, and when the number of the clothes is less, the coverage area of the washing drum is reduced, and the image area of the inner wall of the washing drum in the image shot by the opposite camera is increased. When the lower convolution module processes the image, the image is trained according to a preset model, and the characteristic information of the clothes, including the material information, can be obtained. The upper convolution module processes the clothes features extracted by the lower convolution module, and the probability value of clothes existing in each pixel point in the image can be obtained.
And S3, generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point.
According to one embodiment of the invention, generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point comprises the following steps: and generating a thermodynamic diagram according to the acquired different display colors. The corresponding relationship between the display color and the probability value may be preset, for example, the larger the probability value is, the darker the color is, the smaller the probability value is, and the lighter the color is.
Specifically, after the probability value that clothes exist in each pixel point in the image is acquired through the embodiment, the thermodynamic diagram is generated through the deep convolutional neural network according to the corresponding relation between the probability value and the display color. When the probability value is within a certain interval, the probability value corresponds to one display color, and the probability values are sequentially corresponding to the order of red, orange, yellow, green, blue and purple from large to small, for example, when the probability value is between [0.8 and 1], the corresponding display color is red, and when the probability value is between [0 and 0.2], the corresponding display color is purple. And determining the display color according to the relationship between the set display color and the probability value of the clothes at the pixel point, thereby generating a corresponding thermodynamic diagram.
It should be noted that the correspondence between the display color and the clothing existence probability value is only a specific description of an embodiment of the present invention, and in order to ensure the developing accuracy of the thermodynamic diagram, a plurality of display colors may be set, so as to refine the relationship between the clothing existence probability value and the display colors.
And S4, generating an explicit image according to the thermodynamic diagram and the image, and controlling the clothes processing equipment to display the explicit image.
In one embodiment of the invention, generating an explicated image from the thermodynamic map and the image comprises: the thermodynamic diagram is superimposed on the image to generate an explicated image.
Specifically, the thermodynamic diagram obtained according to the corresponding relation between the display color and the probability value of the clothes is superposed on the image of the clothes in the washing drum acquired by the original camera, the thermodynamic diagram result after data processing and the corresponding image are superposed to obtain a corresponding dominant image, the dominant image is displayed through a touch screen of the washing machine and a display screen in a control area, and a user can view the dominant image through the area, so that the artificial intelligence algorithm has a dominant effect, and the user can directly feel the algorithm effect and know the position of the clothes in the washing drum.
According to an embodiment of the present invention, the clothing display method further includes: and determining that a confirmation instruction of the user for the visualized image is received, or determining that the confirmation instruction of the user is not received within a first preset time, and acquiring the volume ratio of the clothes in the washing drum. The first preset time may be set according to an actual application, for example, the first preset time may be 10 s.
Specifically, the display of the dominance image is displayed through a touch screen of the washing machine, so that a user can check the dominance image and judge whether the dominance image is objected, namely whether the overlapping degree of the acquired dominance image and the original clothes image meets the requirement. When the user does not disagree with the dominant image, a confirmation instruction can be sent through a touch key in the touch screen display; when the user disagrees with the dominant image, a cancel instruction can be sent through a touch key in the touch screen display, the image of the clothes in the washing drum is obtained again at the moment, the operation is carried out on the clothes image, and the dominant image is generated. When the explicit images with the different meanings output by the user are subjected to marking, the server side marks the explicit images with the different meanings, uniformly arranges the marked explicit images in a preset period, and optimizes and improves the performance of the depth convolution model based on the explicit images.
When the server receives a confirmation instruction of the user or receives no feedback information of the user within a first preset time (such as 10s), the server considers that the user has no objection to the domination image, and determines the volume ratio of the clothes in the washing drum according to the clothes existence probability value to further determine the washing water level.
In order to improve the accuracy of the data calculation result, in the whole clothes identification process, the camera shoots a plurality of images of clothes in the washing machine barrel, and outputs a plurality of dominant images through the operation, so that a user can select the optimal dominant image, determine the washing water level according to the volume ratio corresponding to the dominant image and perform washing operation. When the first preset time is counted down and no reaction is finished, the dominance image at the first position can be selected as the subsequent washing water level determination basis. And when there is an objection to the dominance image, repeating the image capturing and recognizing process.
According to an embodiment of the present invention, the clothing displaying method may further include: acquiring the number of pixel points with probability values larger than a first preset value; determining the volume ratio of the clothes in the washing drum according to the number of the pixel points and the total number of the pixel points in the image; and acquiring a washing water level according to the volume ratio, and controlling the clothes treatment equipment according to the washing water level. The first preset value may be preset according to practical applications, for example, the first preset value may be 0.8.
Specifically, the above-mentioned probability value may be set to be between 0 and 1, where 0 represents that no laundry exists, 1 represents that laundry exists, and a value between 0 and 1 represents that a probability value exists, and for example, when the probability value is 0.8, it is considered that there is a high possibility that laundry exists; when the probability value is 0.2, it is considered that the probability of the presence of laundry is small, that is, the closer the probability value is to 1, the greater the probability of the presence of laundry is, and the closer to 0, the smaller the probability of the presence of laundry is. After the probability value between 0 and 1 is determined for each pixel point in the clothes image by adopting a deep convolutional neural network, whether clothes exist is determined by combining with the set probability value. When the probability value is greater than 0.8, the pixel point is determined to have clothes; and when the probability value corresponding to the pixel point is less than or equal to 0.8, determining that no clothing exists in the pixel point.
Assuming that the total number of all pixel points in the image acquired by the camera is N, the total number of the pixel points with the probability value larger than 0.8 (the first preset value) is acquired and recorded as N, and then the volume ratio of the clothes in the washing machine cylinder is N/N. The system can be used for carrying out a corresponding relation table or a calculation formula of the volume ratio and the washing water level in advance to form a database. When the volume ratio is obtained, calling the corresponding relation between the volume ratio and the washing water level in the database, finding out the corresponding washing water level, and then controlling a water inlet in the clothes treatment equipment according to the washing water level, thereby realizing the precision control of the washing water level according to the clothes volume ratio.
It should be noted that the above-mentioned confirmation method of the volume ratio between the laundry and the washing drum is only an embodiment of the present invention, i.e. a specific description is made on the premise of a structure that a camera is installed in the middle of the door of the washing machine. In order to improve the calculation accuracy of the volume ratio, the accuracy of the probability value of clothes existing in each pixel point in the image can be improved by installing a plurality of cameras, and further the calculation accuracy of the volume ratio is improved.
In addition, in the above manner, the acquired clothes image is sent to the cloud server, and a series of processing is performed through the cloud server to generate an explicit image and obtain the washing water level of the clothes processing equipment. It is of course also possible to generate an explicative image and obtain the wash water level of the laundry treating apparatus by the control chip of the laundry treating apparatus itself.
In conclusion, the clothes display method includes the steps that an image in a washing drum is shot based on a built-in camera of the washing machine, the image is uploaded to a server in an encryption mode, a deep convolutional neural network is adopted in the server to extract characteristic values in the image, the identification accuracy of positions and volumes of clothes is guaranteed, the probability of clothes existence of each pixel point in the image is predicted, the prediction result is output in a thermodynamic diagram mode, the thermodynamic diagram and an initial image are further synthesized into an explicit image, the explicit image is finally transmitted to a washing machine end, and the display and control area of the washing machine is used for displaying, so that an artificial intelligence algorithm has an explicit effect, a user can directly feel the algorithm effect, and the result is interacted and fed back. If the user does not disagree with the dominating image or does not respond within a first preset time, counting and calculating the total number of pixel points with the clothes existence probability larger than a first preset value, dividing the total number of the pixel points by the number of the pixel points of the washing machine barrel to obtain the volume ratio of the clothes in the barrel, and recommending the washing water level according to the volume ratio. And if the user disagrees with the dominance image, re-carrying out the image shooting and identifying process. In addition, for images with different meanings for users, the server side can regularly arrange the images, the models are optimized and the performance is improved based on the images, the interaction between the intelligent function and the users is improved, and the upgrading of the intelligent function is realized.
In summary, according to the clothing display method provided by the embodiment of the invention, the probability value of clothing existing in each pixel point in the image is obtained to generate the thermodynamic diagram, and the thermodynamic diagram and the image are displayed to generate the explicit image, so that the user can directly feel the algorithm effect, and the interaction with the user is realized.
Corresponding to the embodiment, the invention further provides a clothes display device.
Fig. 3 is a block diagram of a laundry displaying apparatus according to an embodiment of the present invention. In one embodiment of the present invention, the clothes display device can be applied to a clothes treatment apparatus, such as a pulsator washing machine, a drum washing machine, a pulsator washing machine, a jet washing machine, a dryer, etc., so that a user can visually check the state and position of clothes in a washing tub on a display screen of the clothes treatment apparatus.
As shown in fig. 3, the clothes display apparatus may include: an acquisition module 10, an image processing module 20, a generation module 30 and a presentation control module 40.
Wherein the acquisition module 10 is used for acquiring an image of laundry inside a laundry drum of a laundry treatment apparatus. The image processing module 20 is configured to process the image to obtain a probability value that each pixel point in the image has clothes. The generating module 30 is configured to generate a thermodynamic diagram according to the probability value of the clothes existing in each pixel point. The display control module 40 is used for generating an explicit image according to the thermodynamic diagram and the image and controlling the clothes processing equipment to display the explicit image.
According to an embodiment of the present invention, the presentation control module 40 generates an dominating image from the thermodynamic diagram and the image, and is specifically configured to: the thermodynamic diagram is superimposed on the image to generate an explicated image.
According to an embodiment of the present invention, the presentation control module 30 generates a thermodynamic diagram according to the probability value of the existence of the clothes at each pixel point, specifically configured to: and generating a thermodynamic diagram according to the acquired different display colors.
According to an embodiment of the present invention, the image processing module 20 processes the image to obtain a probability value that each pixel point in the image has clothes, and is specifically configured to: and (3) carrying out segmentation prediction on the image by adopting a deep convolutional neural network so as to obtain the probability value of clothes existing at each pixel point in the image.
According to an embodiment of the present invention, the image processing module 20 performs segmentation prediction on the image by using a deep convolutional neural network, and is specifically configured to: processing the image through a lower convolution module in the deep convolution neural network to obtain the characteristics of the clothes; the characteristics of the clothes are processed through an upper convolution module in the deep convolution neural network so as to obtain the probability value of clothes existing in each pixel point in the image.
According to an embodiment of the present invention, the image processing module 20 is specifically configured to: acquiring the number of pixel points with probability values larger than a first preset value; determining the volume ratio of the clothes in the washing drum according to the number of the pixel points and the total number of the pixel points in the image; and acquiring a washing water level according to the volume ratio, and controlling the clothes treatment equipment according to the washing water level.
According to one embodiment of the present invention, the presentation control module 40 is further configured to: and determining that a confirmation instruction of the user to the dominance image is received, or determining that the confirmation instruction of the user is not received within a first preset time, and acquiring the volume ratio of the clothes in the washing drum.
It should be noted that, for details not disclosed in the clothes displaying apparatus according to the embodiment of the present invention, please refer to details disclosed in the clothes displaying method according to the above embodiment of the present invention, and detailed description thereof is omitted here.
According to the clothes display device, the probability value of clothes existing in each pixel point in the image is obtained to generate the thermodynamic diagram, and the thermodynamic diagram and the image are generated into the explicit image for displaying, so that a user can directly feel the algorithm effect, and interaction with the user is realized.
Corresponding to the above embodiment, the present invention further provides an electronic device 200.
As shown in fig. 4, the electronic device 200 may include: the clothes display system comprises a memory 210, a processor 220 and a clothes display program which is stored on the memory 210 and can run on the processor 220, wherein when the processor 220 executes the clothes display program, the clothes display method is realized.
According to the electronic equipment provided by the embodiment of the invention, the clothes display method is realized by executing the clothes display program through the processor, so that a user can directly feel the algorithm effect and realize the interaction with the user.
In correspondence with the above embodiment, the present invention further provides a computer readable storage medium, on which a clothes display program is stored, which when executed by a processor implements the clothes display method described above.
According to the computer-readable storage medium of the embodiment of the invention, the clothes display method is realized by executing the clothes display program, so that a user can directly feel the algorithm effect and realize the interaction with the user.
It should be noted that the logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (10)
1. A clothes display method is characterized by being applied to a clothes treatment device, and the method comprises the following steps:
acquiring an image of laundry in a laundry drum of the laundry treatment apparatus;
processing the image to obtain the probability value of clothes existing in each pixel point in the image;
generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point;
generating an dominating image according to the thermodynamic diagram and the image, and controlling the clothes treatment equipment to display the dominating image.
2. The garment presentation method of claim 1, wherein generating an overt image from the thermodynamic diagram and the image comprises:
superimposing the thermodynamic map on the image to generate the dominating image.
3. The clothing presentation method of claim 1, wherein generating a thermodynamic diagram according to the probability value of the clothing existence at each pixel point comprises:
acquiring a display color corresponding to the probability value of clothes existing in each pixel point;
and generating the thermodynamic diagram according to the acquired different display colors.
4. The clothing display method of claim 1, wherein processing the image to obtain a probability value of clothing at each pixel point in the image comprises:
and carrying out segmentation prediction on the image by adopting a deep convolutional neural network so as to obtain the probability value of clothes existing at each pixel point in the image.
5. The clothing presentation method of claim 4, wherein the performing segmentation prediction on the image using a deep convolutional neural network comprises:
processing the image through a lower convolution module in the deep convolution neural network to obtain the characteristics of the clothes;
and processing the characteristics of the clothes through an upper convolution module in the deep convolution neural network so as to obtain the probability value of clothes existing in each pixel point in the image.
6. The garment presentation method according to any one of claims 1-5, further comprising:
acquiring the number of pixel points with the probability value larger than a first preset value;
determining the volume ratio of the clothes in the washing drum according to the number of the pixel points and the total number of the pixel points in the image;
and acquiring a washing water level according to the volume ratio, and controlling the clothes treatment equipment according to the washing water level.
7. The garment presentation method of claim 6, further comprising:
and determining that a confirmation instruction of the user to the dominance image is received, or determining that the confirmation instruction of the user is not received within a first preset time, and acquiring the volume ratio of the clothes in the washing drum.
8. A clothes display device, which is applied to clothes processing equipment, and comprises:
an acquisition module for acquiring an image of laundry in a laundry drum of the laundry treatment apparatus;
the image processing module is used for processing the image to acquire the probability value of clothes existing in each pixel point in the image;
the generating module is used for generating thermodynamic diagrams according to the probability value of clothes existing in each pixel point;
and the display control module is used for generating an explicit image according to the thermodynamic diagram and the image and controlling the clothes treatment equipment to display the explicit image.
9. An electronic device, comprising: the clothes display system comprises a memory, a processor and a clothes display program which is stored on the memory and can run on the processor, wherein when the processor executes the clothes display program, the clothes display method according to any one of claims 1-7 is realized.
10. A computer-readable storage medium, on which a clothing presentation program is stored, which when executed by a processor implements a clothing presentation method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110738679.4A CN113463327B (en) | 2021-06-30 | 2021-06-30 | Clothing display method and device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110738679.4A CN113463327B (en) | 2021-06-30 | 2021-06-30 | Clothing display method and device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113463327A true CN113463327A (en) | 2021-10-01 |
| CN113463327B CN113463327B (en) | 2024-03-12 |
Family
ID=77876766
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110738679.4A Active CN113463327B (en) | 2021-06-30 | 2021-06-30 | Clothing display method and device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113463327B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114000303A (en) * | 2021-11-15 | 2022-02-01 | Tcl家用电器（合肥）有限公司 | Control method and device of washing machine, storage medium and washing machine |
| CN114934370A (en) * | 2022-04-24 | 2022-08-23 | 无锡小天鹅电器有限公司 | Laundry control method, device, equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003225491A (en) * | 2002-02-06 | 2003-08-12 | Sanyo Electric Co Ltd | Washing machine, server and remote control system |
| CN103334265A (en) * | 2013-06-19 | 2013-10-02 | 松下家电研究开发（杭州）有限公司 | Intelligent washing machine, washing control method and remote monitoring method |
| CN107893309A (en) * | 2017-10-31 | 2018-04-10 | 珠海格力电器股份有限公司 | Washing methods and device, clothes washing method and device |
| CN109610132A (en) * | 2018-11-22 | 2019-04-12 | 无锡小天鹅股份有限公司 | Laundry process, device and controller |
| CN110273259A (en) * | 2018-03-15 | 2019-09-24 | Lg电子株式会社 | Washing machine, Cloud Server and its setting method based on things sensing set-up function |
| WO2020046079A2 (en) * | 2018-08-30 | 2020-03-05 | 엘지전자 주식회사 | Artificial intelligence washing machine and method for controlling artificial intelligence washing machine |
| CN111549486A (en) * | 2019-01-24 | 2020-08-18 | 珠海格力电器股份有限公司 | Detergent dosage determining method and device, storage medium and washing machine |
-
2021
- 2021-06-30 CN CN202110738679.4A patent/CN113463327B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003225491A (en) * | 2002-02-06 | 2003-08-12 | Sanyo Electric Co Ltd | Washing machine, server and remote control system |
| CN103334265A (en) * | 2013-06-19 | 2013-10-02 | 松下家电研究开发（杭州）有限公司 | Intelligent washing machine, washing control method and remote monitoring method |
| CN107893309A (en) * | 2017-10-31 | 2018-04-10 | 珠海格力电器股份有限公司 | Washing methods and device, clothes washing method and device |
| CN110273259A (en) * | 2018-03-15 | 2019-09-24 | Lg电子株式会社 | Washing machine, Cloud Server and its setting method based on things sensing set-up function |
| WO2020046079A2 (en) * | 2018-08-30 | 2020-03-05 | 엘지전자 주식회사 | Artificial intelligence washing machine and method for controlling artificial intelligence washing machine |
| CN109610132A (en) * | 2018-11-22 | 2019-04-12 | 无锡小天鹅股份有限公司 | Laundry process, device and controller |
| CN111549486A (en) * | 2019-01-24 | 2020-08-18 | 珠海格力电器股份有限公司 | Detergent dosage determining method and device, storage medium and washing machine |
Non-Patent Citations (1)
| Title |
|---|
| 刘玉琴: "基于科研关系网络的高校科研管理研究", 知识产权出版社, pages: 75 - 76 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114000303A (en) * | 2021-11-15 | 2022-02-01 | Tcl家用电器（合肥）有限公司 | Control method and device of washing machine, storage medium and washing machine |
| CN114000303B (en) * | 2021-11-15 | 2024-06-04 | Tcl家用电器（合肥）有限公司 | Control method and device of washing machine, storage medium and washing machine |
| CN114934370A (en) * | 2022-04-24 | 2022-08-23 | 无锡小天鹅电器有限公司 | Laundry control method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113463327B (en) | 2024-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107904860B (en) | Method and device for treating clothes in washing machine | |
| CN108411565B (en) | Washing machine control method and device | |
| CN109137388B (en) | Laundry washing method, apparatus and laundry treating apparatus | |
| CN109477824B (en) | Method for determining a treatment parameter of a fabric by means of structural information | |
| US11299838B2 (en) | Washing machine and cloud server setting function based on object sensing using artificial intelligence, and method for setting function | |
| CN113463327B (en) | Clothing display method and device, electronic equipment and computer readable storage medium | |
| CN106757976B (en) | Washing machine and its control method of washing and device based on image recognition clothing volume | |
| WO2019109785A1 (en) | Personalized laundry appliance | |
| CN107904856A (en) | Washing machine starts method and device | |
| CN106854808A (en) | Washing machine and its control method of washing and device | |
| CN114600167A (en) | Adjusting machine settings through multi-channel training of target detection models | |
| CN110735283B (en) | Washing machine and laundry control method thereof | |
| EP3751454B1 (en) | Method and system for preparing and performing a laundry washing cycle | |
| CN110735281A (en) | Washing machine and clothes washing control method thereof | |
| CN109137392B (en) | Clothes washing method and device and clothes treatment device | |
| CN112481975A (en) | Clothes care method and device and clothes care equipment | |
| CN113622144B (en) | Laundry control method, laundry control system, washing machine and computer readable storage medium | |
| CN113622145B (en) | Laundry control method, laundry control system, washing machine and computer readable storage medium | |
| CN114507968A (en) | Washing machine clothes detection method, device, equipment and storage medium | |
| CN113201905A (en) | Clothes volume estimation method and control method of clothes treatment equipment and clothes treatment system | |
| CN113373651B (en) | Method, device and equipment for identifying clothes color-mixing and storage medium | |
| US11859329B2 (en) | Method and device for controlling laundry equipment, and storage medium | |
| CN115538089A (en) | Clothes washing control method and device | |
| CN112195611B (en) | Clothes treatment equipment and control method thereof | |
| US20230343127A1 (en) | Household appliance with smart protected user detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |