CN118245011A - Vehicle-mounted method, system and related equipment based on multi-level music information - Google Patents
Vehicle-mounted method, system and related equipment based on multi-level music information Download PDFInfo
- Publication number
- CN118245011A CN118245011A CN202410364318.1A CN202410364318A CN118245011A CN 118245011 A CN118245011 A CN 118245011A CN 202410364318 A CN202410364318 A CN 202410364318A CN 118245011 A CN118245011 A CN 118245011A
- Authority
- CN
- China
- Prior art keywords
- music
- signal
- vehicle
- information
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 230000008859 change Effects 0.000 claims abstract description 50
- 238000004458 analytical method Methods 0.000 claims abstract description 29
- 230000033764 rhythmic process Effects 0.000 claims abstract description 26
- 238000012545 processing Methods 0.000 claims description 6
- 238000013528 artificial neural network Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- HAORKNGNJCEJBX-UHFFFAOYSA-N cyprodinil Chemical group N=1C(C)=CC(C2CC2)=NC=1NC1=CC=CC=C1 HAORKNGNJCEJBX-UHFFFAOYSA-N 0.000 description 3
- 238000000605 extraction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Electrophonic Musical Instruments (AREA)
Abstract
The invention provides a vehicle-mounted control method, a vehicle-mounted control system and related equipment based on multi-level music information, wherein the method comprises the following steps: acquiring a music signal; analyzing the music signal, and extracting music analysis contents including basic characteristics, change points, beat points, music structures, music attributes and music styles from the music signal; and generating a control signal according to the music analysis content and a preset generation rule template, and transmitting the control signal to a vehicle-mounted system to realize vibration and light control. According to the invention, the control signals of the seat vibration and the light rhythm which are more in line with the music characteristics in the vehicle-mounted system are generated by combining the multi-level music information, so that more immersive vehicle-mounted audio experience is brought to the user.
Description
[ Field of technology ]
The present invention relates to a signal processing method, and in particular, to a vehicle control method, system and related device based on multi-level music information.
[ Background Art ]
Along with the continuous development of vehicle-mounted technology and the improvement of audio experience requirements of users in vehicles, the multi-mode audio technology for carrying out seat vibration and lamplight rhythm by combining music information is also more and more mature. The music information extraction technology is one of key technologies for realizing seat and light control by combining music information, and can extract various useful information such as rhythm, melody, attribute, emotion and the like from music by using an audio signal processing and feature extraction method, and the information can be further used for controlling the change of the seat and the light. Further, the chair and light control technology is another key technology for realizing the chair and light change in combination with music information. At present, many vehicles have functions of seat and light control, and more immersive audio experience can be created by adjusting elements such as vibration frequency, intensity and direction of the seat, brightness and color of light and the like.
Most of existing vehicle-mounted lamplight rhythm and seat vibration systems based on music information are based on basic characteristics such as music energy, rhythm and tone, so as to control the frequency and intensity of vibration and the brightness and color of lamplight.
However, although the existing vehicle-mounted system can enrich the audio experience in the vehicle to a certain extent, the signals of the seats and the lights are relatively simple to control because the music signals are not analyzed more comprehensively, and the final experience effect is relatively single; in addition, the existing scheme generally controls the seat and the light respectively without further combining the two, so that the consistency of the user experience is not good.
Therefore, it is necessary to provide a new vehicle-mounted control method to solve the above-described problems.
[ Invention ]
The invention aims to provide a vehicle-mounted control method, a vehicle-mounted control system and related equipment based on multi-level music information, wherein the vibration and light control effects of the vehicle-mounted control method, the vehicle-mounted control system and the related equipment are more in accordance with the music characteristics.
In order to solve the technical problems, in a first aspect, the present invention provides a vehicle-mounted control method based on multi-level music information, the vehicle-mounted control method comprising the following steps:
Acquiring a music signal;
Analyzing the music signal, and extracting music analysis contents including basic characteristics, change points, beat points, music structures, music attributes and music styles from the music signal;
And generating a control signal according to the music analysis content and a preset generation rule template, and transmitting the control signal to a vehicle-mounted system to realize vibration and light control.
Preferably, the step of extracting the basic feature from the music signal specifically includes:
Carrying out frame division processing on the music signals to obtain a plurality of music frames, analyzing and marking preset acquisition basic characteristics in each music frame, and defining the basic characteristics extracted from the ith music frame as follows It satisfies the following conditions:
M represents the category number of the preset acquisition basic features;
defining the music frames in the music signal as Nf, the set F of all the basic features satisfying:
preferably, the step of extracting the change point from the music signal specifically includes:
Judging whether the current music frame contains the change points according to the energy change degree of the time domain or the frequency domain of the previous and subsequent frames of the current music frame, if so, extracting the change points from the music frame, defining the change points in the music signal as No, wherein the set O of all the change points satisfies the following conditions:
Preferably, the step of extracting the beat point from the music signal specifically includes:
based on a preset neural network, performing beat tracking on the music signal, marking out beats and re-beats, defining Nb beats and Nd beats in the music signal, wherein the set B of all beats meets the following conditions:
All the set D of beats satisfy:
preferably, the step of extracting the music structure from the music signal specifically includes:
segmenting the music signal according to the structural information of the music signal to obtain a plurality of music paragraphs, and defining the ith music paragraph in the music signal as the ith music paragraph It satisfies the following conditions:
wherein t begin(i)、tend (i) respectively represents that the music paragraphs are The total number of music paragraphs is Ns, and the set S of all music paragraphs satisfies:
wherein, defining the category of the ith music passage as ki, the passage category information K of the music signal satisfies:
K＝[k1,k2,...,kNs]。
preferably, the step of extracting the music attribute from the music signal specifically includes:
Segmenting the music signal to obtain a plurality of music bars, calculating the intensity of rhythm attribute according to the number of played notes in each music bar, and defining the ith music bar in the music signal as It satisfies the following conditions:
the total number of the music sections is Nr, and the set R of all the music sections meets the following conditions:
Wherein, defining the intensity of the rhythm attribute of the ith music measure as mi, the information M of the intensity of the rhythm attribute of the music signal satisfies:
M＝[m1,m2,...,mNr]。
Preferably, the step of generating a control signal according to a preset generation rule template according to the music analysis content includes the following substeps:
Defining C as the music style of the music signal, and generating the preset generation rule template according to the music bar, the rhythm attribute intensity information, the music paragraph, the paragraph category information and the respective sets { R, M, S, K and C } of the music style;
generating a time point control signal T for vibration control according to the change point, the beat and the re-beat respectively set { O, B and D }, and the preset generation rule template;
Generating a vector control signal P for controlling the lamplight according to the set F of the basic features and the time point control signal and the preset generation rule template;
And the time point control signal T and the vector control signal P are used as the control signals together and output.
In a second aspect, the present invention also provides a vehicle-mounted control system based on multi-level music information, including:
the data acquisition module is used for acquiring music signals;
the multi-level music analysis module is used for analyzing the music signals and extracting music analysis contents including basic characteristics, change points, beat points, music structures, music attributes and music styles from the music signals;
and the control module is used for generating control signals according to the music analysis content and a preset generation rule template and transmitting the control signals to the vehicle-mounted system so as to realize vibration and light control.
In a third aspect, the present invention also provides a computer device comprising: the system comprises a memory, a processor and a multi-level music information-based vehicle-mounted control program which is stored in the memory and can be run on the processor, wherein the steps in the multi-level music information-based vehicle-mounted control method are realized when the processor executes the multi-level music information-based vehicle-mounted control program.
In a fourth aspect, the present invention also provides a computer readable storage medium, on which a vehicle-mounted control program based on multi-level music information is stored, which when executed by a processor, implements the steps in the vehicle-mounted control method based on multi-level music information as described in any one of the above.
Compared with the related art, the vehicle-mounted control method based on the multi-level music information comprises the following steps of: acquiring a music signal; analyzing the music signal, and extracting music analysis contents including basic characteristics, change points, beat points, music structures, music attributes and music styles from the music signal; and generating a control signal according to the music analysis content and a preset generation rule template, and transmitting the control signal to a vehicle-mounted system to realize vibration and light control. The method combines multi-level music information, including audio basic characteristics, change points, beat points, music structures, music attributes, music wind information and the like, and further generates control signals of seat vibration and light rhythm which are more in line with music characteristics in the vehicle-mounted system according to the information, so that more immersive vehicle-mounted audio experience is brought to a user.
[ Description of the drawings ]
For a clearer description of the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the description below are only some embodiments of the present invention, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art, wherein:
Fig. 1 is a block flow diagram of steps of a vehicle-mounted control method based on multi-level music information according to an embodiment of the present invention;
Fig. 2 is a schematic structural diagram of a vehicle-mounted control system based on multi-level music information according to an embodiment of the present invention;
Fig. 3 is a schematic structural diagram of a computer device according to an embodiment of the present invention.
[ Detailed description ] of the invention
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, fig. 1 is a block flow diagram of steps of a vehicle-mounted control method based on multi-level music information according to an embodiment of the present invention, where the vehicle-mounted control method includes the following steps:
S101, acquiring a music signal;
S102, analyzing the music signal, and extracting music analysis contents including basic characteristics, change points, beat points, music structures, music attributes and music styles from the music signal;
S103, generating a control signal according to the music analysis content and a preset generation rule template, and transmitting the control signal to a vehicle-mounted system to realize vibration and light control.
In the embodiment of the present invention, the music signal in step S101 may be obtained by various methods, including in-vehicle real-time/off-line analysis, invoking a cloud service, or storing in a song file in the form of metadata during production, which is not particularly limited in the embodiment of the present invention.
Specifically, step S102 of the embodiment of the present invention is used to extract multi-level music analysis content from the bottom up from the basic features of the frame level to the style classification of the whole song.
Specifically, the step of extracting the basic feature from the music signal specifically includes:
the music signal is subjected to framing processing, for example, a frame is taken for 10ms, a plurality of music frames are obtained, preset acquisition basic features in each music frame are analyzed and marked, and the basic features extracted from the ith music frame are defined as follows It satisfies the following conditions:
M represents the category number of the preset acquisition basic features;
defining the music frames in the music signal as Nf, the set F of all the basic features satisfying:
the step of extracting the change point from the music signal specifically includes:
Judging whether the current music frame contains the change points according to the energy change degree of the time domain or the frequency domain of the previous and subsequent frames of the current music frame, wherein the specific form of the change points can be a starting point of drumbeats or other musical instruments, if yes, the change points are extracted from the music frame, the change points in the music signal are defined as No, and the set O of all the change points meets the following conditions:
The step of extracting the beat point from the music signal specifically includes:
Based on a preset neural network, performing beat tracking on the music signal, marking beats (beats) and re-beats (downbeats), defining that the beats in the music signal are Nb, the re-beats are Nd, and all the beats in the set B satisfy the following conditions:
All the set D of beats satisfy:
the step of extracting the music structure from the music signal specifically includes:
Segmenting the music signal according to the structural information of the music signal, wherein the segmenting can be in the form of a primer (Introduction), a main song (Verse), a sub song (chord), a transition section (Bridge), a tail sound (Outro) and the like, so as to obtain a plurality of music paragraphs, and defining the ith music paragraph in the music signal as the following music paragraphs It satisfies the following conditions:
wherein t begin(i)、tend (i) respectively represents that the music paragraphs are The total number of music paragraphs is Ns, and the set S of all music paragraphs satisfies:
wherein, defining the category of the ith music passage as ki, the passage category information K of the music signal satisfies:
K＝[k1,k2,...,kNs]。
the step of extracting the musical attribute from the music signal specifically includes:
segmenting the music signal to obtain a plurality of music bars (bar), calculating the rhythm attribute intensity (RHYTHM INTENSITY) according to the number of played notes in each music bar, and defining the ith music bar in the music signal as the following music bar It satisfies the following conditions:
the total number of the music sections is Nr, and the set R of all the music sections meets the following conditions:
Wherein, defining the intensity of the rhythm attribute of the ith music measure as mi, the information M of the intensity of the rhythm attribute of the music signal satisfies:
M＝[m1,m2,...,mNr]。
Generating a control signal according to the music analysis content and a preset generation rule template, wherein the control signal comprises the following substeps:
Defining C as the music style of the music signal, such as pop, rock, jazz, ballad, etc., in practice the music style may be identified by signal processing or deep learning methods. Specifically, the preset generation rule template is generated according to the music bar, the rhythm attribute intensity information, the music paragraphs, the paragraph category information and the respective sets { R, M, S, K, C } of the music styles;
generating a time point control signal T for vibration control according to the change point, the beat and the re-beat respectively set { O, B and D }, and the preset generation rule template;
Generating a vector control signal P for controlling the lamplight according to the set F of the basic features and the time point control signal and the preset generation rule template;
And the time point control signal T and the vector control signal P are used as the control signals together and output.
For a complete song (music signal), defining the song to generate Nc control signals in total, a specific control signal may be expressed as:
T＝[t1,t2,...,tNc]；
For example, for the primer of the ballad and the chorus part of the popular song, the section can obtain different template values wi according to a function func_mode (m i,ki, C) of a preset design, and further different control signal generation methods are adopted:
And generating different time points and vector control signals corresponding to the preset generation rule template by the method.
It should be noted that, because the templates corresponding to the time point control signal and the vector control signal are different, in the implementation process, different templates can be selected according to the intensity attribute of the music measure section, the category of the section where the music measure section is located and the category of the music style to generate corresponding signals, for example, for the ballad song primer, a control signal conforming to the soothing style can be generated,The method only selects the change point corresponding to the duplicate beat as the preset generation rule template,The method can be used for generating a gentle vibration control signal or a soft light control signal according to the energy and the tone of the change point in the basic characteristics as the preset generation rule template;
For the chorus part of a popular song, The method can simultaneously select the change points and the time point set corresponding to the beats as the preset generation rule template, and the method comprises the following steps ofThe method can be used for generating a rule template according to the energy of the audio and the type of the time point, and generating a slight vibration and soft light control signal according to the change point. And for beat points, vibration and bright light control signals with different intensity degrees are generated according to the rhythm intensity types of different bars of the chorus part.
In addition, the two signals may be generated separately according to respective rules, or may be combined together to cooperate with each other. For example, the beat change point can be used for controlling light rhythm, the re-beat change point is used for controlling seat vibration, the beat point and the re-beat point of music are better reflected through the cooperation of light change and seat vibration, and the immersion of audio experience in the vehicle is improved.
Compared with the related art, the vehicle-mounted control method based on the multi-level music information comprises the following steps of: acquiring a music signal; analyzing the music signal, and extracting music analysis contents including basic characteristics, change points, beat points, music structures, music attributes and music styles from the music signal; and generating a control signal according to the music analysis content and a preset generation rule template, and transmitting the control signal to a vehicle-mounted system to realize vibration and light control. The method combines multi-level music information, including audio basic characteristics, change points, beat points, music structures, music attributes, music wind information and the like, and further generates control signals of seat vibration and light rhythm which are more in line with music characteristics in the vehicle-mounted system according to the information, so that more immersive vehicle-mounted audio experience is brought to a user.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a vehicle-mounted control system based on multi-level music information provided by the embodiment of the present invention, where the vehicle-mounted control system 200 based on multi-level music information includes:
a data acquisition module 201 for acquiring a music signal;
A multi-level music analysis module 202 for analyzing the music signal and extracting music analysis contents including basic characteristics, change points, beat points, music structure, music attributes and music styles from the music signal;
and the control module 203 is configured to generate a control signal according to the music analysis content and a preset generation rule template, and transmit the control signal to a vehicle-mounted system to realize vibration and light control.
The vehicle-mounted control system 200 based on multi-level music information can implement the steps in the vehicle-mounted control method based on multi-level music information in the above embodiment, and can implement the same technical effects, and is not described in detail herein with reference to the description in the above embodiment.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a computer device according to an embodiment of the present invention, where the computer device 300 includes: the device comprises a memory 302, a processor 301 and an on-board control program which is stored on the memory 302 and can run on the processor 301 and is based on multi-level music information.
The processor 301 invokes the vehicle-mounted control program based on the multi-level music information stored in the memory 302 to execute the steps in the vehicle-mounted control method based on the multi-level music information provided in the embodiment of the present invention, please refer to fig. 1, specifically including the following steps:
S101, acquiring a music signal;
S102, analyzing the music signal, and extracting music analysis contents including basic characteristics, change points, beat points, music structures, music attributes and music styles from the music signal;
S103, generating a control signal according to the music analysis content and a preset generation rule template, and transmitting the control signal to a vehicle-mounted system to realize vibration and light control.
Preferably, the step of extracting the basic feature from the music signal specifically includes:
Carrying out frame division processing on the music signals to obtain a plurality of music frames, analyzing and marking preset acquisition basic characteristics in each music frame, and defining the basic characteristics extracted from the ith music frame as follows It satisfies the following conditions:
M represents the category number of the preset acquisition basic features;
defining the music frames in the music signal as Nf, the set F of all the basic features satisfying:
preferably, the step of extracting the change point from the music signal specifically includes:
Judging whether the current music frame contains the change points according to the energy change degree of the time domain or the frequency domain of the previous and subsequent frames of the current music frame, if so, extracting the change points from the music frame, defining the change points in the music signal as No, wherein the set O of all the change points satisfies the following conditions:
Preferably, the step of extracting the beat point from the music signal specifically includes:
based on a preset neural network, performing beat tracking on the music signal, marking out beats and re-beats, defining Nb beats and Nd beats in the music signal, wherein the set B of all beats meets the following conditions:
All the set D of beats satisfy:
preferably, the step of extracting the music structure from the music signal specifically includes:
segmenting the music signal according to the structural information of the music signal to obtain a plurality of music paragraphs, and defining the ith music paragraph in the music signal as the ith music paragraph It satisfies the following conditions:
wherein t begin(i)、tend (i) respectively represents that the music paragraphs are The total number of music paragraphs is Ns, and the set S of all music paragraphs satisfies:
wherein, defining the category of the ith music passage as ki, the passage category information K of the music signal satisfies:
K＝[k1,k2,...,kNs]。
preferably, the step of extracting the music attribute from the music signal specifically includes:
Segmenting the music signal to obtain a plurality of music bars, calculating the intensity of rhythm attribute according to the number of played notes in each music bar, and defining the ith music bar in the music signal as It satisfies the following conditions:
the total number of the music sections is Nr, and the set R of all the music sections meets the following conditions:
Wherein, defining the intensity of the rhythm attribute of the ith music measure as mi, the information M of the intensity of the rhythm attribute of the music signal satisfies:
M＝[m1,m2,...,mNr]。
Preferably, the step of generating a control signal according to a preset generation rule template according to the music analysis content includes the following substeps:
Defining C as the music style of the music signal, and generating the preset generation rule template according to the music bar, the rhythm attribute intensity information, the music paragraph, the paragraph category information and the respective sets { R, M, S, K and C } of the music style;
generating a time point control signal T for vibration control according to the change point, the beat and the re-beat respectively set { O, B and D }, and the preset generation rule template;
Generating a vector control signal P for controlling the lamplight according to the set F of the basic features and the time point control signal and the preset generation rule template;
And the time point control signal T and the vector control signal P are used as the control signals together and output.
The computer device 300 provided in the embodiment of the present invention can implement the steps in the vehicle-mounted control method based on multi-level music information in the above embodiment, and can implement the same technical effects, and is not described in detail herein with reference to the description in the above embodiment.
The embodiment of the invention also provides a computer readable storage medium, on which a vehicle-mounted control program based on multi-level music information is stored, and when the vehicle-mounted control program based on the multi-level music information is executed by a processor, the processes and steps in the vehicle-mounted control method based on the multi-level music information provided by the embodiment of the invention are realized, and the same technical effects can be realized, so that repetition is avoided, and no redundant description is provided here.
Those skilled in the art will appreciate that implementing all or part of the above-described methods may be accomplished by instructing the associated hardware by a vehicle-mounted control program based on multi-level music information, where the program may be stored in a computer-readable storage medium, and where the program, when executed, may include the steps of the above-described embodiments of the methods. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM) or the like.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
While the invention has been described with respect to the above embodiments, it should be noted that modifications can be made by those skilled in the art without departing from the inventive concept, and these are all within the scope of the invention.
Claims (10)
1. The vehicle-mounted control method based on the multi-level music information is characterized by comprising the following steps of:
Acquiring a music signal;
Analyzing the music signal, and extracting music analysis contents including basic characteristics, change points, beat points, music structures, music attributes and music styles from the music signal;
And generating a control signal according to the music analysis content and a preset generation rule template, and transmitting the control signal to a vehicle-mounted system to realize vibration and light control.
2. The method for controlling a vehicle based on multi-level music information according to claim 1, wherein the step of extracting the basic feature from the music signal is specifically:
Carrying out frame division processing on the music signals to obtain a plurality of music frames, analyzing and marking preset acquisition basic characteristics in each music frame, and defining the basic characteristics extracted from the ith music frame as follows It satisfies the following conditions:
M represents the category number of the preset acquisition basic features;
defining the music frames in the music signal as Nf, the set F of all the basic features satisfying:
3. the on-vehicle control method based on multi-level music information according to claim 2, wherein the step of extracting the change point from the music signal is specifically:
Judging whether the current music frame contains the change points according to the energy change degree of the time domain or the frequency domain of the previous frame and the subsequent frame of the current music frame, if so, extracting the change points from the music frame, defining the change points in the music signal as No, wherein the set O of all the change points satisfies the following conditions:
4. The method for controlling a vehicle based on multi-level music information according to claim 3, wherein the step of extracting the beat point from the music signal is specifically:
based on a preset neural network, performing beat tracking on the music signal, marking out beats and re-beats, defining Nb beats and Nd beats in the music signal, wherein the set B of all beats meets the following conditions:
All the set D of beats satisfy:
5. The method for controlling a vehicle based on multi-level musical information according to claim 4, wherein the step of extracting the musical structure from the musical signal is specifically:
segmenting the music signal according to the structural information of the music signal to obtain a plurality of music paragraphs, and defining the ith music paragraph in the music signal as the ith music paragraph It satisfies the following conditions:
wherein t begin(i)、tend (i) respectively represents that the music paragraphs are The total number of music paragraphs is Ns, and the set S of all music paragraphs satisfies:
wherein, defining the category of the ith music passage as ki, the passage category information K of the music signal satisfies:
K＝[k1,k2,...,kNs]。
6. the method for controlling a vehicle based on multi-level music information according to claim 5, wherein the step of extracting the music attribute from the music signal is specifically:
Segmenting the music signal to obtain a plurality of music bars, calculating the intensity of rhythm attribute according to the number of played notes in each music bar, and defining the ith music bar in the music signal as It satisfies the following conditions:
the total number of the music sections is Nr, and the set R of all the music sections meets the following conditions:
Wherein, defining the intensity of the rhythm attribute of the ith music measure as mi, the information M of the intensity of the rhythm attribute of the music signal satisfies:
M＝[m1,m2,...,mNr]。
7. the on-vehicle control method based on multi-level music information according to claim 6, wherein the step of generating a control signal according to a preset generation rule template according to the music analysis content, comprises the sub-steps of:
Defining C as the music style of the music signal, and generating the preset generation rule template according to the music bar, the rhythm attribute intensity information, the music paragraph, the paragraph category information and the respective sets { R, M, S, K and C } of the music style;
generating a time point control signal T for vibration control according to the change point, the beat and the re-beat respectively set { O, B and D }, and the preset generation rule template;
generating a vector control signal P for controlling the lamplight according to the set F of the basic features and the time point control signal T and the preset generation rule template;
And the time point control signal T and the vector control signal P are used as the control signals together and output.
8. A vehicle-mounted control system based on multi-level music information, comprising:
the data acquisition module is used for acquiring music signals;
The music analysis module is used for analyzing the music signal and extracting music analysis contents including basic characteristics, change points, beat points, music structures, music attributes and music styles from the music signal;
and the control module is used for generating control signals according to the music analysis content and a preset generation rule template and transmitting the control signals to the vehicle-mounted system so as to realize vibration and light control.
9. A computer device, comprising: the method for controlling the vehicle-mounted based on the multi-level music information comprises a memory, a processor and a vehicle-mounted control program which is stored in the memory and can run on the processor, wherein the steps in the vehicle-mounted control method based on the multi-level music information are realized when the processor executes the vehicle-mounted control program based on the multi-level music information.
10. A computer-readable storage medium, wherein a multi-level music information-based in-vehicle control program is stored thereon, which when executed by a processor, implements the steps of the multi-level music information-based in-vehicle control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410364318.1A CN118245011A (en) | 2024-03-27 | 2024-03-27 | Vehicle-mounted method, system and related equipment based on multi-level music information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410364318.1A CN118245011A (en) | 2024-03-27 | 2024-03-27 | Vehicle-mounted method, system and related equipment based on multi-level music information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118245011A true CN118245011A (en) | 2024-06-25 |
Family
ID=91564321
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410364318.1A Pending CN118245011A (en) | 2024-03-27 | 2024-03-27 | Vehicle-mounted method, system and related equipment based on multi-level music information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118245011A (en) |
-
2024
- 2024-03-27 CN CN202410364318.1A patent/CN118245011A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Yang et al. | MidiNet: A convolutional generative adversarial network for symbolic-domain music generation | |
| US5736666A (en) | Music composition | |
| US9818396B2 (en) | Method and device for editing singing voice synthesis data, and method for analyzing singing | |
| CN107657017A (en) | Method and apparatus for providing voice service | |
| CN109949783A (en) | Song synthetic method and system | |
| CN106373580A (en) | Singing synthesis method based on artificial intelligence and device | |
| US20090254349A1 (en) | Speech synthesizer | |
| US11842719B2 (en) | Sound processing method, sound processing apparatus, and recording medium | |
| CN111680185A (en) | Music generation method, music generation device, electronic device and storage medium | |
| CN112992109B (en) | Auxiliary singing system, auxiliary singing method and non-transient computer readable recording medium | |
| US11322124B2 (en) | Chord identification method and chord identification apparatus | |
| KR20220000655A (en) | Driving sound library, apparatus for generating driving sound library and vehicle comprising driving sound library | |
| US11996081B2 (en) | Visual responses to user inputs | |
| CN118245011A (en) | Vehicle-mounted method, system and related equipment based on multi-level music information | |
| WO2019176954A1 (en) | Machine learning method, electronic apparatus, electronic musical instrument, model generator for part selection, and method of part determination | |
| Tachibana et al. | A real-time audio-to-audio karaoke generation system for monaural recordings based on singing voice suppression and key conversion techniques | |
| CN116168678A (en) | Speech synthesis method, device, computer equipment and storage medium | |
| CN115938340A (en) | Voice data processing method based on vehicle-mounted voice AI and related equipment | |
| CN115273806A (en) | Song synthesis model training method and device and song synthesis method and device | |
| Jiang et al. | Music signal recognition based on the mathematical and physical equation inversion method | |
| TWI836255B (en) | Method and apparatus in designing a personalized virtual singer using singing voice conversion | |
| CN112992177B (en) | Training method, device, equipment and storage medium of voice style migration model | |
| CN116645957B (en) | Music generation method, device, terminal, storage medium and program product | |
| CN115457923B (en) | Singing voice synthesis method, device, equipment and storage medium | |
| US20240087552A1 (en) | Sound generation method and sound generation device using a machine learning model |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination |