CN113852521A - Household appliance, control method thereof and computer readable storage medium - Google Patents

Household appliance, control method thereof and computer readable storage medium Download PDF

Info

Publication number
CN113852521A
CN113852521A CN202010521712.3A CN202010521712A CN113852521A CN 113852521 A CN113852521 A CN 113852521A CN 202010521712 A CN202010521712 A CN 202010521712A CN 113852521 A CN113852521 A CN 113852521A
Authority
CN
China
Prior art keywords
music
sound effect
household appliance
playing
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010521712.3A
Other languages
Chinese (zh)
Inventor
张新健
霍伟明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GD Midea Air Conditioning Equipment Co Ltd
Original Assignee
GD Midea Air Conditioning Equipment Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GD Midea Air Conditioning Equipment Co Ltd filed Critical GD Midea Air Conditioning Equipment Co Ltd
Priority to CN202010521712.3A priority Critical patent/CN113852521A/en
Priority to PCT/CN2021/081349 priority patent/WO2021248964A1/en
Publication of CN113852521A publication Critical patent/CN113852521A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0091—Means for obtaining special acoustic effects
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
    • G10L15/063—Training
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/155—Musical effects
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
    • G10L15/063—Training
    • G10L2015/0631—Creating reference templates; Clustering

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Artificial Intelligence (AREA)
  • Quality & Reliability (AREA)
  • Automation & Control Theory (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The invention discloses a control method of a household appliance, wherein the household appliance is provided with a music identification model, and the control method of the household appliance comprises the following steps: acquiring an audio signal corresponding to played or to-be-played music; identifying the audio signal by the music recognition model to determine a type of the music; determining the sound effect of the music according to the type; and determining the playing parameters of the playing device of the household appliance according to the sound effect, and controlling the playing device to play the music according to the playing parameters. The invention also discloses a household appliance and a computer readable storage medium. The household appliance has rich music playing effect.

Description

Household appliance, control method thereof and computer readable storage medium
Technical Field
The present invention relates to the field of home appliances, and in particular, to a home appliance, a control method thereof, and a computer-readable storage medium.
Background
Household appliances such as air conditioners, electric fans and the like have become essential products for people as living appliances. With the rapid development of artificial intelligence technology, household appliances with voice recognition function are also in endless, and interaction and experience between the household appliances are greatly improved.
With the popularization and development of the intelligent sound box, the household appliance also has the function of music playing. Through the voice recognition system in the household appliance, the user can randomly select favorite songs to play. However, the main function of the household appliance is not song playing, which results in low configuration of the playing device on the household appliance, so that the playing device has good hearing sense when playing certain types of music or songs, but has poor hearing sense when playing other types of music or songs, and the music playing effect of the household appliance is single.
Disclosure of Invention
The invention mainly aims to provide a household appliance, a control method thereof and a computer readable storage medium, and aims to solve the problem that the music playing effect of the household appliance is single.
In order to achieve the above object, the present invention provides a method for controlling a home appliance, the home appliance having a music recognition model, the method comprising:
acquiring an audio signal corresponding to played or to-be-played music;
identifying the audio signal by the music recognition model to determine a type of the music;
determining the sound effect of the music according to the type;
and determining the playing parameters of the playing device of the household appliance according to the sound effect, and controlling the playing device to play the music according to the playing parameters.
In an embodiment, the step of determining a playing parameter of a playing device of the household appliance according to the sound effect, and controlling the playing device to play the music according to the playing parameter includes:
determining playing parameters corresponding to each audio segment of the music played by the playing device according to the sound effect;
and when the playing device plays each audio segment, controlling the playing device to play the music according to the playing parameters corresponding to the played audio segment.
In an embodiment, the step of determining the playing parameters of the playing device of the household appliance according to the sound effect includes:
acquiring the environmental noise of the environment where the household appliance is located;
and determining the playing parameters of the playing device according to the environmental noise and the sound effect.
In one embodiment, the step of identifying the audio signal by the music recognition model to determine the type of music comprises:
acquiring music parameters corresponding to the audio signals; and identifying the music parameters through the music identification model to determine the type of the music.
In one embodiment, the step of identifying the audio signal by the music recognition model to determine the type of music comprises:
acquiring the output recognition result of the music recognition model;
when the recognition result comprises the type of the music, determining the type of the music according to the recognition result;
and when the identification result does not comprise the type of the music, sending the audio signal to a server, and receiving the type of the music fed back by the server.
In an embodiment, the method for controlling a home appliance further includes:
detecting whether the household appliance meets a sound effect adjusting condition;
and when the household appliance meets the sound effect adjusting condition, executing the step of acquiring the audio signal corresponding to the played or to-be-played music.
In one embodiment, the sound effect adjusting condition includes at least one of the following:
receiving a sound effect adjusting instruction;
the user of the space where the household appliance is located is a preset user;
the household appliance is in a sound effect adjusting mode.
In an embodiment, after the step of identifying the audio signal by the music identification model to determine the type of music, the method further includes:
determining whether the household appliance stores a sound effect file corresponding to the music according to the type;
when the household appliance stores the sound effect file corresponding to the music, controlling the playing device to play the sound effect file so as to play the music, wherein when the playing device plays the music with the adjusted sound effect for the first time, the music with the adjusted sound effect is stored as the type and the sound effect file corresponding to the music;
and when the household appliance does not store the sound effect file corresponding to the music, executing the step of determining the playing parameters of the playing device of the household appliance according to the sound effect.
In order to achieve the above object, the present invention further provides a household appliance, including a music recognition model, a memory, a processor, and a household appliance control program stored in the memory and executable on the processor, wherein the music recognition model is connected to the processor, and the household appliance control program implements the steps of the household appliance control method when executed by the processor.
In order to achieve the above object, the present invention further provides a computer-readable storage medium storing a control program of an appliance, which when executed by a processor, implements the steps of the control method of an appliance as described above.
The household appliance is provided with a music identification model, and after acquiring an audio signal of music to be played or played, the household appliance identifies the audio signal through the music identification model to determine the type of the music and determines the sound effect of the music according to the type, so that the playing parameter of a playing device of the household appliance is determined according to the sound effect to control the playing device to play the music according to the playing parameter. Because the household appliance can adjust the playing parameters of the playing device on the household appliance according to the type of the music to be played or played, the sound effect of the music played by the household appliance is the target sound effect corresponding to the music type, and the music playing effect of the household appliance is rich.
Drawings
Fig. 1 is a schematic diagram of a hardware architecture of a home appliance according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating a first embodiment of a method for controlling a home appliance according to the present invention;
fig. 3 is a detailed flowchart of step S40 in the second embodiment of the method for controlling a home appliance according to the present invention;
fig. 4 is a detailed flowchart of step S40 in the third embodiment of the method for controlling a home appliance according to the present invention;
fig. 5 is a detailed flowchart of step S20 in the fourth embodiment of the method for controlling a home appliance according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: acquiring an audio signal corresponding to played or to-be-played music; identifying the audio signal by the music recognition model to determine a type of the music; determining the sound effect of the music according to the type; and determining the playing parameters of the playing device of the household appliance according to the sound effect, and controlling the playing device to play the music according to the playing parameters.
Because the household appliance can adjust the playing parameters of the playing device on the household appliance according to the type of the music to be played or played, the sound effect of the music played by the household appliance is the target sound effect corresponding to the music type, and the music playing effect of the household appliance is rich.
As shown in fig. 1, fig. 1 is a schematic diagram of a hardware architecture of a home appliance according to an embodiment of the present invention.
The terminal related to the scheme of the embodiment of the invention can be a household appliance, the household appliance can be an air conditioner, a television, and the like, and the household appliance comprises: a processor 101, e.g. a CPU, a memory 102 and a communication bus 103 and a music recognition model 104. Wherein, the communication bus 103 is used for realizing the connection communication between the components, and the music identification model 104 is used for identifying the type of music.
The memory 102 may be a high-speed RAM memory or a non-volatile memory (e.g., a disk memory). As shown in fig. 1, a memory 103, which is a kind of computer storage medium, may include a control program of the home appliance therein; and the processor 101 may be configured to call up a control program of the home appliance stored in the memory 102 and perform the following operations:
acquiring an audio signal corresponding to played or to-be-played music;
identifying the audio signal by the music recognition model to determine a type of the music;
determining the sound effect of the music according to the type;
and determining the playing parameters of the playing device of the household appliance according to the sound effect, and controlling the playing device to play the music according to the playing parameters.
In one embodiment, the processor 101 may be configured to call a control program of the home appliance stored in the memory 102, and perform the following operations:
determining playing parameters corresponding to each audio segment of the music played by the playing device according to the sound effect;
and when the playing device plays each audio segment, controlling the playing device to play the music according to the playing parameters corresponding to the played audio segment.
In one embodiment, the processor 101 may be configured to call a control program of the home appliance stored in the memory 102, and perform the following operations:
acquiring the environmental noise of the environment where the household appliance is located;
and determining the playing parameters of the playing device according to the environmental noise and the sound effect.
In one embodiment, the processor 101 may be configured to call a control program of the home appliance stored in the memory 102, and perform the following operations:
acquiring music parameters corresponding to the audio signals; and identifying the music parameters through the music identification model to determine the type of the music.
In one embodiment, the processor 101 may be configured to call a control program of the home appliance stored in the memory 102, and perform the following operations:
acquiring the output recognition result of the music recognition model;
when the recognition result comprises the type of the music, determining the type of the music according to the recognition result;
and when the identification result does not comprise the type of the music, sending the audio signal to a server, and receiving the type of the music fed back by the server.
In one embodiment, the processor 101 may be configured to call a control program of the home appliance stored in the memory 102, and perform the following operations:
detecting whether the household appliance meets a sound effect adjusting condition;
and when the household appliance meets the sound effect adjusting condition, executing the step of acquiring the audio signal corresponding to the played or to-be-played music.
In one embodiment, the processor 101 may be configured to call a control program of the home appliance stored in the memory 102, and perform the following operations:
receiving a sound effect adjusting instruction;
the user of the space where the household appliance is located is a preset user;
the household appliance is in a sound effect adjusting mode.
In one embodiment, the processor 101 may be configured to call a control program of the home appliance stored in the memory 102, and perform the following operations:
determining whether the household appliance stores a sound effect file corresponding to the music according to the type;
when the household appliance stores the sound effect file corresponding to the music, controlling the playing device to play the sound effect file so as to play the music, wherein when the playing device plays the music with the adjusted sound effect for the first time, the music with the adjusted sound effect is stored as the type and the sound effect file corresponding to the music;
and when the household appliance does not store the sound effect file corresponding to the music, executing the step of determining the playing parameters of the playing device of the household appliance according to the sound effect.
According to the scheme, the household appliance is provided with the music identification model, after the household appliance obtains the audio signal of the music to be played or played, the household appliance identifies the audio signal through the music identification model to determine the type of the music, and determines the sound effect of the music according to the type, so that the playing parameter of the playing device of the household appliance is determined according to the sound effect, and the playing device is controlled to play the music according to the playing parameter. Because the household appliance can adjust the playing parameters of the playing device on the household appliance according to the type of the music to be played or played, the sound effect of the music played by the household appliance is the target sound effect corresponding to the music type, and the music playing effect of the household appliance is rich.
Based on the hardware architecture of the household appliance, the embodiment of the control method of the household appliance is provided.
Referring to fig. 2, fig. 2 is a first embodiment of a method for controlling a home appliance according to the present invention, the method comprising the steps of:
step S10, acquiring an audio signal corresponding to the music played or to be played;
in this embodiment, the execution subject is a home appliance. The household appliance can be an air conditioner, a television, an electric fan and other equipment. The household appliance is provided with a playing device which can be a sound box. The playing device can be used for playing music, reading materials, voice prompt information of household appliances and the like.
The household appliance can be connected with the music server through the network, so that the transmitted songs are played through the network. Of course, the household appliance may also store music, and the stored music may be uploaded by the user or downloaded by the music server. That is, the household appliance may obtain the audio signal corresponding to the music to be played through local storage or from the music server. When the household appliance plays music, the household appliance records the music according to the set time window from the music playing channel to obtain the audio signal, namely the household appliance obtains the audio signal of the played music from the playing channel.
The household appliance can detect whether the household appliance meets the sound effect adjusting condition in real time, and if the household appliance meets the sound effect adjusting condition, the household appliance can determine the type of music played or to be played. The sound effect adjusting condition comprises at least one of receiving a sound effect adjusting instruction, setting a user of a space where the household appliance is located as a preset user and setting the household appliance in a sound effect adjusting mode. When the household appliance meets the sound effect adjusting condition, the household appliance can play music, for example, when the household appliance plays music, a sound effect adjusting instruction is received; or the household appliance may be about to play music, for example, when the household appliance starts the playing device, the sound effect adjustment instruction is received.
Step S20, identifying the audio signal through the music identification model to determine the type of the music;
the household appliance is provided with a music recognition model. The music recognition model is obtained by training different types of music segments with a certain order of magnitude as a training set. When the household appliance plays music, the music is recorded from a music playing channel according to a set time window to obtain an audio signal, and the audio signal is input into a music identification model, so that the type of the music is determined. And when the music is to be played, extracting audio information corresponding to the music from the database, converting the audio information into an audio signal according to the audio information, inputting the audio signal into the music recognition model to obtain a result output by the music recognition model, wherein the result is the type of the music. Of course, the home appliance may request an audio signal of music to be played from the music server.
The music recognition model comprises an acoustic model and a language model, wherein the acoustic model is obtained through information training of tone, loudness and the like of music, and the language model is obtained through word training of the music. After the audio signal is input into the music recognition model, the characteristics (such as the tone color of music) of the audio signal are extracted firstly, the characteristics are input into the acoustic model, and the acoustic model integrates the knowledge of acoustics and pronunciations to obtain the score of the acoustic model. The extracted features (words, sentences, etc. of the music) are then input into the language model to obtain a language model score. It will be appreciated that each music type determined by the music recognition model includes an acoustic model score and a language model score, and that the highest overall score for a music type is the result of the output. The type of the music can be more accurately determined through the acoustic model and the language model.
It should be noted that, after the home appliance acquires the audio signal, the home appliance may perform processing such as noise elimination and channel distortion on the audio signal to convert the audio signal from the time domain to the frequency domain, so as to extract an appropriate feature for the acoustic model.
The type of music may be determined according to the timbre of the music, for example, it may be divided according to the timbre of the singer of the music, or it may be divided according to the instruments used for the music. The type of music may also be determined according to the mood expressed by the music, e.g., cheerful music is determined as a class, sad music is determined as a class. The type of music may also be determined according to the style of music, e.g. rock music as a category, ballad music as a category, etc.
Step S30, determining the sound effect of the music according to the type;
the household appliance stores a mapping relation table between types and sound effects. After the type of the music is determined, the sound effect of the music can be searched according to the type and the mapping relation table. Taking the determined type of music style as an example, the following examples are given:
type of music Sound effect
Rocking and rolling device Sound effect A
Popularity of Sound effect B
Jazz (Jazz) Sound effect C
Blue tone Sound effect D
Light music Sound effect E
Opera Sound effect F
And step S40, determining the playing parameters of the playing device of the household appliance according to the sound effect, and controlling the playing device to play the music according to the playing parameters.
After the sound effect corresponding to the music is determined, the household appliance can determine the playing parameters of the playing device corresponding to the sound effect. The playing parameter may be the volume of the playing device, the power of the audio signal at the power amplifier, and the playing gain value. It can be understood that the playing parameter is volume, power or playing gain value, and the household appliance can reasonably and effectively correct and compensate distortion generated in the conversion, transmission, amplification and playing processes of the audio signal. That is, the sound effect corresponding to the playing parameter is actually a compensation value. The compensation values corresponding to different sound effects are different, so that after the sound effects are determined, the compensation values corresponding to the sound effects are determined, and then the playing parameters to be adopted when the playing device plays the music are corrected according to the compensation values, so that the playing parameters actually adopted when the playing device plays the music are obtained. In addition, the playing parameters can also be sound effect modes, such as stereo surround sound effect, digital sound effect and the like.
After the playing parameters are determined, the household appliance can control the playing device to play music according to the determined playing parameters, so that the household appliance plays the sound effect matched with the music type.
In the technical scheme provided by this embodiment, a music recognition model is provided in the household appliance, and after the household appliance obtains an audio signal of music to be played or played, the household appliance recognizes the audio signal through the music recognition model to determine the type of the music, and determines the sound effect of the music according to the type, thereby determining the playing parameter of the playing device of the household appliance according to the sound effect, and controlling the playing device to play the music according to the playing parameter. Because the household appliance can adjust the playing parameters of the playing device on the household appliance according to the type of the music to be played or played, the sound effect of the music played by the household appliance is the target sound effect corresponding to the music type, and the music playing effect of the household appliance is rich.
Referring to fig. 3, fig. 3 is a second embodiment of the method for controlling a home appliance according to the present invention, where based on the first embodiment, the step S40 includes:
step S41, according to the sound effect, determining the playing parameters corresponding to each audio segment of the music played by the playing device;
step S42, when the playing device plays each audio segment, controlling the playing device to play the music according to the playing parameters corresponding to the played audio segment.
The audio signal of music comprises a plurality of audio frequency segments, and the high and low of the frequency interval of the audio frequency segments represent the emotion expressed by the music. For example, the type of music is rock, the higher the frequency interval of the audio segment is, the more intense the emotion expressed by the audio segment is, and the lower the frequency interval of the audio segment is, the more depressed the emotion is. The lower the audio frequency section is, the more the emotion is suppressed, and the suppressed emotion can break out in the higher area of the audio frequency section, so that the low-frequency audio frequency section of the rock-and-roll type music can properly reduce the volume, and the high-frequency audio frequency section can properly increase the volume to embody the style of rock-and-roll music. The degree of enhancement and reduction of the audio piece varies with the type of music. For example, the volume increment value corresponding to the audio band of the high frequency of the cheerful music may be smaller than the volume increment value corresponding to the high frequency band of the rock music. It is understood that, in the present embodiment, the playback parameter includes the volume.
The sound effect of the music can represent the type of the music, so that a mapping relation table of the sound effect and the playing parameter of each audio segment can be established. And after the sound effect is determined, the household appliance determines a mapping relation table corresponding to the sound effect, so that the playing parameters corresponding to each audio frequency section of the playing device are determined. When the playing device plays music, the audio frequency section corresponding to the played music is determined firstly, so that the playing device operates according to the playing parameter corresponding to the audio frequency section, and when the playing device plays each audio frequency section, the playing device is controlled to play the music according to the playing parameter corresponding to the played audio frequency section.
In the technical scheme provided by this embodiment, the household appliance determines, according to the sound effect, the playing parameters corresponding to each audio segment of the music played by the playing device, and controls the playing device to play the playing parameters corresponding to the audio segments when the playing device plays each audio segment, so as to reasonably play the music.
Referring to fig. 4, fig. 4 is a third embodiment of the method for controlling a home appliance according to the present invention, wherein based on the first or second embodiment, the determining, in step S40, the playing parameter of the playing device of the home appliance according to the sound effect includes:
step S43, acquiring the environmental noise of the environment where the household appliance is located;
step S44, determining the playing parameters of the playing device according to the environmental noise and the sound effect.
In this embodiment, the home appliance can acquire ambient noise. The ambient noise is background noise, i.e. the ambient noise does not include the sound produced by music. If the music is to be played, the decibel value acquired by the noise sensor is acquired as the environmental noise, and the noise sensor can be arranged on a household appliance playing the music, can also be arranged on other household appliances, and can also be independently arranged in a room where the household appliance is positioned.
And if the music is the music currently played by the household appliance, determining the starting time point of the music played by the household appliance, and extracting the environmental sound corresponding to the starting time point from the stored environmental sound to be used as the environmental noise.
The larger the ambient noise, the larger the playback parameters should be. For this, the household appliance determines the to-be-determined playing parameter of the playing device according to the sound effect, the to-be-determined playing parameter may be a playing parameter corresponding to each audio segment, and the determination method of the to-be-played playing parameter may refer to the above description. The household appliance corrects the to-be-determined playing parameter according to the environmental noise, and the larger the noise is, the larger the corrected amplitude is, namely, the larger the corrected playing parameter is.
In the technical scheme provided by this embodiment, the household appliance obtains the environmental noise of the environment where the household appliance is located, so that the playing parameters of the playing device can be accurately determined according to the environmental noise and the sound effect.
Referring to fig. 5, fig. 5 is a fourth embodiment of the method for controlling a home appliance according to the present invention, where based on any one of the first to third embodiments, the step S20 includes:
step S21, acquiring music parameters corresponding to the audio signals;
step S22, recognizing the music parameter through the music recognition model to determine the type of the music.
In this embodiment, the played music and the music to be played have corresponding music parameters, and the music parameters may be acoustic characteristics such as timbre, pitch, loudness, and the like of the audio signal. And the music recognition model is recognized through music parameters of music. In the technical scheme provided by this embodiment, the household appliance obtains the music parameter corresponding to the music being played or to be played, so as to determine the type of the music according to the music parameter, and further determine the playing parameter of the playing device according to the type.
In an embodiment, after acquiring an audio signal of music to be played or played, the home appliance inputs the audio signal into the music recognition model, and the music recognition model may not necessarily recognize the type of the music. The household appliance obtains the recognition result output by the music recognition model. The type of music identified is typically included in the recognition result. And the household appliance analyzes the recognition result, and if the recognition result comprises the description of the type of the music, the type of the music is extracted from the recognition result. If the identification result does not include the type of the music, for example, the identification result is that the music cannot be identified, the home appliance sends the audio signal to the server, so that the server identifies the audio signal, and the type of the music is determined. The server feeds back the type of the music to the household appliance.
In an embodiment, when the household appliance plays music with adjusted sound effect, the household appliance stores the playing parameters corresponding to the sound effect and the audio signal of the music in an associated manner, so as to form a sound effect file corresponding to the music and the type of the music. That is, when the music with the adjusted sound effect is played for the first time at the home, the music and the sound effect file corresponding to the music type can be stored. And if the sound effect file is stored, the sound effect file is directly called to play the sound effect file. If the sound effect file is not stored, step S40 is executed, that is, the playing parameters of the playing device are determined, so as to control the playing device to play the music according to the playing parameters.
The invention also provides a household appliance, which comprises a music recognition model, a memory, a processor and a household appliance control program stored in the memory and capable of running on the processor, wherein the music recognition model is connected with the processor, and the household appliance control program realizes the steps of the household appliance control method in the embodiment when executed by the processor.
The present invention also provides a computer-readable storage medium storing a control program for an appliance, which, when executed by a processor, implements the steps of the method for controlling an appliance according to the above embodiment.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention essentially or contributing to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioning device, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent structures or equivalent flow transformations that may be embodied in the present specification and drawings, or directly or indirectly applied to other related arts, and are within the scope of the present invention.

Claims (10)

1. A control method of a household appliance is characterized in that the household appliance is provided with a music recognition model, and the control method of the household appliance comprises the following steps:
acquiring an audio signal corresponding to played or to-be-played music;
identifying the audio signal by the music recognition model to determine a type of the music;
determining the sound effect of the music according to the type;
and determining the playing parameters of the playing device of the household appliance according to the sound effect, and controlling the playing device to play the music according to the playing parameters.
2. The method for controlling a home appliance according to claim 1, wherein the step of determining a playing parameter of a playing device of the home appliance according to the sound effect and controlling the playing device to play the music according to the playing parameter comprises:
determining playing parameters corresponding to each audio segment of the music played by the playing device according to the sound effect;
and when the playing device plays each audio segment, controlling the playing device to play the music according to the playing parameters corresponding to the played audio segment.
3. The method for controlling an electronic appliance according to claim 1, wherein the step of determining the playing parameters of the playing device of the electronic appliance according to the sound effects comprises:
acquiring the environmental noise of the environment where the household appliance is located;
and determining the playing parameters of the playing device according to the environmental noise and the sound effect.
4. The method for controlling an electronic appliance according to claim 1, wherein the step of recognizing the audio signal through the music recognition model to determine the type of the music comprises:
acquiring music parameters corresponding to the audio signals; and identifying the music parameters through the music identification model to determine the type of the music.
5. The method for controlling an electronic appliance according to claim 1, wherein the step of recognizing the audio signal through the music recognition model to determine the type of the music comprises:
acquiring the output recognition result of the music recognition model;
when the recognition result comprises the type of the music, determining the type of the music according to the recognition result;
and when the identification result does not comprise the type of the music, sending the audio signal to a server, and receiving the type of the music fed back by the server.
6. The method for controlling an electronic appliance according to any one of claims 1 to 5, further comprising:
detecting whether the household appliance meets a sound effect adjusting condition;
and when the household appliance meets the sound effect adjusting condition, executing the step of acquiring the audio signal corresponding to the played or to-be-played music.
7. The control method of an electric home appliance according to claim 6, wherein the sound effect adjustment condition includes at least one of:
receiving a sound effect adjusting instruction;
the user of the space where the household appliance is located is a preset user;
the household appliance is in a sound effect adjusting mode.
8. The method for controlling an electronic appliance according to any one of claims 1 to 5, wherein the step of recognizing the audio signal by the music recognition model to determine the type of music is followed by further comprising:
determining whether the household appliance stores a sound effect file corresponding to the music according to the type;
when the household appliance stores the sound effect file corresponding to the music, controlling the playing device to play the sound effect file so as to play the music, wherein when the playing device plays the music with the adjusted sound effect for the first time, the music with the adjusted sound effect is stored as the type and the sound effect file corresponding to the music;
and when the household appliance does not store the sound effect file corresponding to the music, executing the step of determining the playing parameters of the playing device of the household appliance according to the sound effect.
9. An appliance comprising a music recognition model, a memory, a processor, and a control program for the appliance stored in the memory and executable on the processor, the music recognition model being connected to the processor, the control program for the appliance, when executed by the processor, implementing the steps of the method for controlling an appliance according to any one of claims 1 to 8.
10. A computer-readable storage medium storing a control program for an appliance, the control program for an appliance implementing the steps of the method for controlling an appliance according to any one of claims 1 to 8 when executed by a processor.
CN202010521712.3A 2020-06-09 2020-06-09 Household appliance, control method thereof and computer readable storage medium Pending CN113852521A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010521712.3A CN113852521A (en) 2020-06-09 2020-06-09 Household appliance, control method thereof and computer readable storage medium
PCT/CN2021/081349 WO2021248964A1 (en) 2020-06-09 2021-03-17 Home appliance and control method therefor, and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010521712.3A CN113852521A (en) 2020-06-09 2020-06-09 Household appliance, control method thereof and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN113852521A true CN113852521A (en) 2021-12-28

Family

ID=78845145

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010521712.3A Pending CN113852521A (en) 2020-06-09 2020-06-09 Household appliance, control method thereof and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN113852521A (en)
WO (1) WO2021248964A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115410544B (en) * 2022-08-26 2024-01-30 镁佳(北京)科技有限公司 Sound effect processing method and device and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104735528A (en) * 2015-03-02 2015-06-24 青岛海信电器股份有限公司 Sound effect matching method and device
CN105632521A (en) * 2015-12-22 2016-06-01 深圳市智行畅联科技有限公司 Automobile-based random sound source automatic sound control device
CN106020766A (en) * 2016-05-26 2016-10-12 北京小米移动软件有限公司 Music playing method and device
CN107590152A (en) * 2016-07-07 2018-01-16 乐视控股（北京）有限公司 A kind of method and device for the audio pattern for adjusting audio
CN109615682A (en) * 2018-12-07 2019-04-12 北京微播视界科技有限公司 Animation producing method, device, electronic equipment and computer readable storage medium
CN110853606A (en) * 2019-11-26 2020-02-28 Oppo广东移动通信有限公司 Sound effect configuration method and device and computer readable storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104735528A (en) * 2015-03-02 2015-06-24 青岛海信电器股份有限公司 Sound effect matching method and device
CN105632521A (en) * 2015-12-22 2016-06-01 深圳市智行畅联科技有限公司 Automobile-based random sound source automatic sound control device
CN106020766A (en) * 2016-05-26 2016-10-12 北京小米移动软件有限公司 Music playing method and device
CN107590152A (en) * 2016-07-07 2018-01-16 乐视控股（北京）有限公司 A kind of method and device for the audio pattern for adjusting audio
CN109615682A (en) * 2018-12-07 2019-04-12 北京微播视界科技有限公司 Animation producing method, device, electronic equipment and computer readable storage medium
CN110853606A (en) * 2019-11-26 2020-02-28 Oppo广东移动通信有限公司 Sound effect configuration method and device and computer readable storage medium

Also Published As

Publication number Publication date
WO2021248964A1 (en) 2021-12-16

Similar Documents

Publication Publication Date Title
US11605393B2 (en) Audio cancellation for voice recognition
CN1964187B (en) A system, device and method to manage sound volume
CN101622805B (en) System and method for intelligent equalization
JP7196294B2 (en) Method and Apparatus for Adjusting Audio Playback Settings Based on Analysis of Audio Characteristics
CN109378006B (en) Cross-device voiceprint recognition method and system
JP2013109346A (en) Automatic gain control
CN1981433A (en) Method of and system for automatically adjusting the loudness of an audio signal
US10861472B2 (en) Algorithm-based audio optimization method, intelligent terminal and storage device
CN104123938A (en) Voice control system, electronic device and voice control method
CN107948869B (en) Audio processing method, audio processing device, audio system, and storage medium
WO2019114015A1 (en) Robot performance control method and robot
CN105229947A (en) Audio mixer system
CN107360507A (en) A kind of play parameter Automatic adjustment method, intelligent sound box and storage medium
US9053710B1 (en) Audio content presentation using a presentation profile in a content header
US20220238089A1 (en) Performance analysis method and performance analysis device
CN113852521A (en) Household appliance, control method thereof and computer readable storage medium
JPH10271595A (en) Speaker equipment utilizing feedback
CN102549669B (en) System and method for modifying an audio signal
CN1983804B (en) Audio-frequency processor and volume management method
CN112995854A (en) Audio processing method and device and electronic equipment
CN109147739B (en) Sound effect adjusting method, medium, device and computing equipment based on voice control
CN115119110A (en) Sound effect adjusting method, audio playing device and computer readable storage medium
CN116132869A (en) Earphone volume adjusting method, earphone and storage medium
CN111868821A (en) Method and apparatus for extracting tone-independent timbre attributes from a media signal
CN2465434Y (en) Frequency equalizing automatic regulator

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20211228

RJ01 Rejection of invention patent application after publication