TWI745338B - Method and device for providing accompaniment music - Google Patents

Method and device for providing accompaniment music Download PDF

Info

Publication number
TWI745338B
TWI745338B TW106101925A TW106101925A TWI745338B TW I745338 B TWI745338 B TW I745338B TW 106101925 A TW106101925 A TW 106101925A TW 106101925 A TW106101925 A TW 106101925A TW I745338 B TWI745338 B TW I745338B
Authority
TW
Taiwan
Prior art keywords
voiceprint
music
accompaniment music
voiceprint feature
information
Prior art date
Application number
TW106101925A
Other languages
Chinese (zh)
Other versions
TW201828278A (en
Inventor
馮樺
Original Assignee
香港商阿里巴巴集團服務有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 香港商阿里巴巴集團服務有限公司 filed Critical 香港商阿里巴巴集團服務有限公司
Priority to TW106101925A priority Critical patent/TWI745338B/en
Publication of TW201828278A publication Critical patent/TW201828278A/en
Application granted granted Critical
Publication of TWI745338B publication Critical patent/TWI745338B/en

Links

Images

Landscapes

  • Auxiliary Devices For Music (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本申請案公開了一種伴奏音樂的提供方法和裝置,其中,所述方法包括以下步驟:接收利用音頻採集裝置採集的使用者的音頻資訊;對採集的音頻資訊進行聲紋識別,提取音頻資訊的聲紋特徵;根據聲紋特徵在預先建立的音樂資料庫中查找匹配的歌曲資訊;提取歌曲資訊對應的伴奏音樂;將伴奏音樂發送至使用者的客戶端。本申請案實施例的伴奏音樂的提供方法,能夠方便地為使用者提供與所唱歌曲相同步的伴奏音樂。 This application discloses a method and device for providing accompaniment music, wherein the method includes the following steps: receiving user audio information collected by an audio collecting device; performing voiceprint recognition on the collected audio information, and extracting audio information Voiceprint features; search for matching song information in a pre-established music database based on voiceprint features; extract accompaniment music corresponding to the song information; send the accompaniment music to the user's client. The method for providing accompaniment music in the embodiment of the present application can conveniently provide the user with accompaniment music synchronized with the song being sung.

Description

伴奏音樂的提供方法和裝置 Method and device for providing accompaniment music

本申請案涉及智慧識別技術領域,特別涉及一種伴奏音樂的提供方法和裝置。 This application relates to the technical field of smart recognition, and in particular to a method and device for providing accompaniment music.

目前,與音樂相關的電子設備正朝著智慧化、人性化的方向發展,而人們對於音樂的體驗已不僅僅停留在欣賞階段,多數人更願意嘗試演唱所喜愛的歌曲。 At present, music-related electronic devices are developing in the direction of intelligence and humanization, and people's experience of music is not just at the stage of appreciation, and most people are more willing to try singing their favorite songs.

無論是在家中、車內,還是KTV(Karaoke Television,提供影音設備與視唱空間的場所)等娛樂場所,為了達到更好的演唱效果,人們在演唱歌曲時,大多喜歡跟隨對應的伴奏音樂進行演唱。而在目前的條件下,需要透過手動輸入歌名等方式來搜索伴奏音樂,非常不方便,並且獲取伴奏音樂的操作成本較高。此外,在搜索完成後,往往需要跟隨著伴奏音樂的播放進度來演唱歌曲,或者調整伴奏音樂的進度,難以給使用者流暢的演唱體驗,使用者體驗差。 Whether it is at home, in the car, or KTV (Karaoke Television, a place that provides audio-visual equipment and sight-singing space) and other entertainment venues, in order to achieve better singing effects, people mostly like to follow the corresponding accompaniment music when singing songs. Singing. However, under current conditions, it is necessary to manually enter the song name to search for the accompaniment music, which is very inconvenient, and the operation cost of obtaining the accompaniment music is relatively high. In addition, after the search is completed, it is often necessary to follow the playing progress of the accompaniment music to sing the song, or adjust the progress of the accompaniment music, which is difficult to give the user a smooth singing experience, and the user experience is poor.

本申請案旨在至少在一定程度上解決相關技術中的技術問題之一。為此,本申請案的一個目的在於提出一種伴奏音樂的提供方法,能夠方便地為使用者提供與所唱歌曲相同步的伴奏音樂。 This application aims to solve one of the technical problems in related technologies at least to a certain extent. For this reason, one purpose of this application is to propose a method for providing accompaniment music, which can conveniently provide users with accompaniment music synchronized with the song being sung.

本申請案的第二個目的在於提出一種伴奏音樂的提供裝置。 The second purpose of this application is to provide a device for providing accompaniment music.

根據本申請案第一方面實施例的伴奏音樂的提供方法,包括以下步驟:接收利用音頻採集裝置採集的使用者的音頻資訊;對採集的音頻資訊進行聲紋識別,提取所述音頻資訊的聲紋特徵;根據所述聲紋特徵在預先建立的音樂資料庫中查找匹配的歌曲資訊;提取所述歌曲資訊對應的伴奏音樂;將所述伴奏音樂發送至使用者的客戶端。 The method for providing accompaniment music according to the embodiment of the first aspect of the present application includes the following steps: receiving user audio information collected by an audio collecting device; performing voiceprint recognition on the collected audio information, and extracting the sound of the audio information Pattern characteristics; search for matching song information in a pre-established music database according to the voiceprint characteristics; extract accompaniment music corresponding to the song information; and send the accompaniment music to the user's client.

根據本申請案實施例的伴奏音樂的提供方法,根據本申請案實施例的伴奏音樂的提供方法,透過提取音頻採集裝置採集的使用者音頻資訊的聲紋特徵查找匹配的歌曲資訊,並根據該歌曲資訊提取對應的伴奏音樂,並發送至使用者的客戶端,由此,在使用者演唱歌曲的過程中,可自動為使用者提供該歌曲的伴奏音樂,智慧、方便,大大提高了使用者體驗。 According to the method for providing accompaniment music according to the embodiment of the application, the method for providing accompaniment music according to the embodiment of the application searches for matching song information by extracting the voiceprint characteristics of the user's audio information collected by the audio collecting device, and according to the The song information extracts the corresponding accompaniment music and sends it to the user's client. As a result, the user can automatically provide the user with the accompaniment music of the song when the user sings the song, which is smart and convenient, which greatly improves the user Experience.

根據本申請案第二方面實施例的伴奏音樂的提供裝置,包括:接收模組,用於接收利用音頻採集裝置採集的使用者的音頻資訊;聲紋識別模組,用於對採集的音頻資訊進行聲紋識別,提取所述音頻資訊的聲紋特徵;查找模組,用於根據所述聲紋特徵在預先建立的音樂資料庫中查 找匹配的歌曲資訊;提取模組,用於提取所述歌曲資訊對應的伴奏音樂;發送模組,用於將所述伴奏音樂發送至使用者的客戶端。 The apparatus for providing accompaniment music according to the embodiment of the second aspect of the present application includes: a receiving module for receiving user audio information collected by an audio collecting device; a voiceprint recognition module for recognizing the collected audio information Perform voiceprint recognition to extract the voiceprint features of the audio information; a search module for searching for matching song information in a pre-established music database based on the voiceprint features; an extraction module for extracting the Accompaniment music corresponding to the song information; a sending module for sending the accompaniment music to the user's client.

根據本申請案實施例的伴奏音樂的提供裝置,根據本申請案實施例的伴奏音樂的提供方法,透過提取音頻採集裝置採集的使用者音頻資訊的聲紋特徵查找匹配的歌曲資訊,並根據該歌曲資訊提取對應的伴奏音樂,並發送至使用者的客戶端,由此,在使用者演唱歌曲的過程中,可自動為使用者提供該歌曲的伴奏音樂,智慧、方便,大大提高了使用者體驗。 According to the accompaniment music providing device of the embodiment of the application, according to the accompaniment music providing method of the embodiment of the application, the matching song information is searched for by extracting the voiceprint characteristics of the user's audio information collected by the audio collecting device, and based on the The song information extracts the corresponding accompaniment music and sends it to the user's client. As a result, the user can automatically provide the user with the accompaniment music of the song when the user sings the song, which is smart and convenient, which greatly improves the user Experience.

本申請案的附加方面和優點將在下面的描述中部分給出,部分將從下面的描述中變得明顯,或透過本申請案的實踐瞭解到。 The additional aspects and advantages of this application will be partly given in the following description, and some will become obvious from the following description, or be understood through the practice of this application.

10‧‧‧接收模組 10‧‧‧Receiving Module

20‧‧‧聲紋識別模組 20‧‧‧Voiceprint recognition module

30‧‧‧查找模組 30‧‧‧Search Module

40‧‧‧提取模組 40‧‧‧Extraction Module

50‧‧‧發送模組 50‧‧‧Send module

圖1為根據本申請案一個實施例的伴奏音樂的提供方法的流程圖;圖2為根據本申請案另一個實施例的伴奏音樂的提供方法的流程圖;圖3為根據本申請案一個實施例的伴奏音樂的提供裝置的結構方塊圖。 Fig. 1 is a flowchart of a method for providing accompaniment music according to an embodiment of the present application; Fig. 2 is a flowchart of a method for providing accompaniment music according to another embodiment of the present application; Fig. 3 is an implementation according to the present application An example of a block diagram of the structure of an accompaniment music providing device.

下面詳細描述本申請案的實施例,所述實施例的示例 在附圖中示出,其中自始至終相同或類似的標號表示相同或類似的元件或具有相同或類似功能的元件。下面透過參考附圖描述的實施例是示例性的,旨在用於解釋本申請案,而不能理解為對本申請案的限制。 The embodiments of the present application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, in which the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the drawings are exemplary, and are intended to explain the application, but should not be construed as a limitation to the application.

圖1為根據本申請案一個實施例的伴奏音樂的提供方法的流程圖。 Fig. 1 is a flowchart of a method for providing accompaniment music according to an embodiment of the present application.

如圖1所示,本申請案實施例的伴奏音樂的提供方法,可包括以下步驟: As shown in Figure 1, the method for providing accompaniment music in the embodiment of the present application may include the following steps:

S101,接收利用音頻採集裝置採集的使用者的音頻資訊。 S101: Receive user audio information collected by an audio collection device.

舉例來說,音頻採集裝置可為話筒。音頻採集裝置可內置或者外接於使用者端設備。使用者端設備可將音頻採集裝置採集的使用者的音頻資訊發送至伺服器。 For example, the audio collection device may be a microphone. The audio collection device can be built-in or externally connected to the user equipment. The user terminal device can send the user's audio information collected by the audio collection device to the server.

其中,使用者端設備可以是移動終端(如手機、平板電腦、筆記型電腦等)、專用音樂設備和家用或車載智慧設備、電視機等多種使用者端設備。例如,智慧音箱、手機、電視以及汽車音箱等。 Among them, the user-end devices can be mobile terminals (such as mobile phones, tablet computers, notebook computers, etc.), special music devices, home or in-vehicle smart devices, televisions and other user-end devices. For example, smart speakers, mobile phones, TVs, and car speakers.

S102,對採集的音頻資訊進行聲紋識別,提取音頻資訊的聲紋特徵。 S102: Perform voiceprint recognition on the collected audio information, and extract voiceprint features of the audio information.

在本申請案的實施例中,伺服器可對使用者的音頻資訊進行聲紋識別以提取音頻資訊,從而基於伺服器端強大的處理能力,能夠使識別結果更加準確。 In the embodiment of the present application, the server can perform voiceprint recognition on the audio information of the user to extract the audio information, so that based on the powerful processing capability of the server, the recognition result can be more accurate.

具體地,可透過對採集的音頻資訊進行聲紋識別以提取該音頻資訊的韻律、節奏等聲紋特徵。 Specifically, voiceprint recognition can be performed on the collected audio information to extract the voiceprint features of the audio information such as rhythm and rhythm.

S103,根據聲紋特徵在預先建立的音樂資料庫中查找匹配的歌曲資訊。 S103: Search for matching song information in a pre-established music database according to the voiceprint characteristics.

在本申請案的一個實施例中,音樂資料庫中儲存有多個聲紋特徵和與多個聲紋特徵對應的歌曲資訊,S103可具體包括:根據聲紋特徵查找音樂資料庫,以判斷音樂資料庫中是否存在與聲紋特徵相匹配聲紋特徵。如果存在與聲紋特徵相匹配的聲紋特徵,則將與聲紋特徵相匹配的聲紋特徵對應的歌曲資訊作為與聲紋特徵匹配的歌曲資訊。 In an embodiment of the present application, a plurality of voiceprint features and song information corresponding to the plurality of voiceprint features are stored in the music database. S103 may specifically include: searching the music database according to the voiceprint features to determine the music Whether there is a voiceprint feature matching the voiceprint feature in the database. If there is a voiceprint feature that matches the voiceprint feature, the song information corresponding to the voiceprint feature that matches the voiceprint feature is used as the song information that matches the voiceprint feature.

具體地,可將上述音頻資訊的聲紋特徵與音樂資料庫中的多個聲紋特徵分別進行匹配,直至找到與上述音頻資訊的聲紋特徵相匹配的聲紋特徵,或者音樂資料庫中的多個聲紋特徵都已進行匹配。如果查找到與上述音頻資訊的聲紋特徵相匹配的聲紋特徵,則可將查找到的聲紋特徵對應的歌曲資訊作為與上述音頻資訊的聲紋特徵相匹配的歌曲資訊。 Specifically, the voiceprint feature of the audio information can be matched with multiple voiceprint features in the music database until a voiceprint feature matching the voiceprint feature of the audio information is found, or a voiceprint feature in the music database is found. Multiple voiceprint features have been matched. If a voiceprint feature matching the voiceprint feature of the audio information is found, the song information corresponding to the found voiceprint feature can be used as the song information that matches the voiceprint feature of the audio information.

其中,歌曲資訊可包括歌名、演唱者、歌詞、作詞人、作曲人等資訊。 Among them, the song information may include information such as the name of the song, the singer, the lyrics, the lyricist, and the composer.

在本申請案的一個實施例中,可透過以下步驟建立音樂資料庫:S1,對多個歌曲進行聲紋識別,以分別提取多個歌曲的聲紋特徵,並分別獲取多個歌曲的歌曲資訊;S2分別建立多個歌曲的聲紋特徵與多個歌曲的歌曲資訊的對應關係。 In an embodiment of this application, a music database can be established through the following steps: S1, perform voiceprint recognition on multiple songs to extract voiceprint features of multiple songs, and obtain song information of multiple songs respectively ; S2 respectively establish the corresponding relationship between the voiceprint features of multiple songs and the song information of multiple songs.

在本申請案的一個示例中,音樂資料庫中還可包括對 應的伴奏音樂。 In an example of this application, the music database may also include corresponding accompaniment music.

S104,提取歌曲資訊對應的伴奏音樂。 S104: Extract accompaniment music corresponding to the song information.

在本申請案的一個實施例中,歌曲資訊對應的伴奏音樂可預先儲存在音樂資料庫中,從而在查找到匹配的歌曲資訊後,可提取出對應的伴奏音樂。 In an embodiment of the present application, the accompaniment music corresponding to the song information can be pre-stored in the music database, so that after the matching song information is found, the corresponding accompaniment music can be extracted.

在本申請案的另一個實施例中,音樂資料庫中也可以不預存伴奏音樂,而是在查找到匹配的歌曲資訊後,根據該歌曲資訊進行搜索,以提取對應的伴奏音樂。 In another embodiment of the present application, the accompaniment music may not be pre-stored in the music database, but after the matching song information is found, a search is performed according to the song information to extract the corresponding accompaniment music.

S105,將伴奏音樂發送至使用者的客戶端。 S105: Send the accompaniment music to the user's client terminal.

具體地,客戶端在接收到伴奏音樂後,可進行播放,以將伴奏音樂提供給使用者。 Specifically, after receiving the accompaniment music, the client can play it to provide the accompaniment music to the user.

根據本申請案實施例的伴奏音樂的提供方法,透過提取音頻採集裝置採集的使用者音頻資訊的聲紋特徵查找匹配的歌曲資訊,並根據該歌曲資訊提取對應的伴奏音樂,並發送至使用者的客戶端,由此,在使用者演唱歌曲的過程中,可自動為使用者提供該歌曲的伴奏音樂,智慧、方便,大大提高了使用者體驗。 According to the method for providing accompaniment music according to the embodiment of the present application, the matching song information is searched for by extracting the voiceprint characteristics of the user's audio information collected by the audio collection device, and the corresponding accompaniment music is extracted according to the song information, and sent to the user As a result, when the user sings a song, it can automatically provide the user with the accompaniment music of the song, which is smart and convenient, and greatly improves the user experience.

此外,為了進一步提升使用者體驗,還可提取採集到的音頻資訊的聲紋特徵在伴奏音樂中對應的時間軸,從而客戶端可根據該時間軸控制伴奏音樂播放。 In addition, in order to further enhance the user experience, the time axis corresponding to the voiceprint feature of the collected audio information in the accompaniment music can be extracted, so that the client can control the playback of the accompaniment music according to the time axis.

具體地,如圖2所示,本申請案實施例的伴奏音樂的提供方法,可包括以下步驟: Specifically, as shown in FIG. 2, the method for providing accompaniment music in the embodiment of the present application may include the following steps:

S201,接收利用音頻採集裝置採集的使用者的音頻資訊。 S201: Receive user audio information collected by an audio collection device.

S202,對採集的音頻資訊進行聲紋識別,提取音頻資訊的聲紋特徵。 S202: Perform voiceprint recognition on the collected audio information, and extract voiceprint features of the audio information.

S203,根據聲紋特徵在預先建立的音樂資料庫中查找匹配的歌曲資訊。 S203: Search for matching song information in a pre-established music database according to the voiceprint characteristics.

S204,提取歌曲資訊對應的伴奏音樂。 S204: Extract accompaniment music corresponding to the song information.

S205,提取音頻資訊的聲紋特徵在伴奏音樂中對應的時間軸。 S205: Extract a time axis corresponding to the voiceprint feature of the audio information in the accompaniment music.

其中,聲紋特徵對應的時間軸為該聲紋特徵在整首歌曲中所對應的時間。具體地,可將音頻資訊的聲紋特徵與伴奏音樂進行匹配,以找到該聲紋特徵在整首歌曲中所對應的時間。 Among them, the time axis corresponding to the voiceprint feature is the time corresponding to the voiceprint feature in the entire song. Specifically, the voiceprint feature of the audio information can be matched with the accompaniment music to find the time corresponding to the voiceprint feature in the entire song.

S206,將伴奏音樂和時間軸發送至使用者的客戶端。 S206: Send the accompaniment music and the timeline to the user's client terminal.

S207,客戶端根據時間軸確定伴奏音樂的播放音樂軸。 S207: The client determines the playing music axis of the accompaniment music according to the time axis.

具體地,客戶端可根據聲紋特徵對應的時間軸確定伴奏音樂的播放位置,即播放音樂軸。 Specifically, the client can determine the playback position of the accompaniment music according to the time axis corresponding to the voiceprint feature, that is, the playback music axis.

S208,客戶端根據播放音樂軸播放伴奏音樂。 S208: The client plays the accompaniment music according to the play music axis.

由此,可透過確定音頻資訊的聲紋特徵在伴奏音樂中對應的時間軸並發送至客戶端,以使客戶端根據時間軸確定伴奏音樂的播放音樂軸,並據此播放伴奏音樂,從而可根據使用者演唱的內容,提供與使用者的音頻資訊相同步的伴奏音樂。 Thus, the time axis corresponding to the voiceprint feature of the audio information in the accompaniment music can be determined and sent to the client, so that the client can determine the playback music axis of the accompaniment music according to the time axis, and play the accompaniment music accordingly. According to the content sung by the user, accompaniment music synchronized with the audio information of the user is provided.

為實現上述實施例的伴奏音樂的提供方法,本申請案還提出一種伴奏音樂的提供裝置。 In order to realize the method for providing accompaniment music in the foregoing embodiment, this application also proposes a device for providing accompaniment music.

圖3為根據本申請案一個實施例的伴奏音樂的提供裝置的結構方塊圖。 Fig. 3 is a block diagram of the structure of an accompaniment music providing device according to an embodiment of the present application.

如圖3所示,本申請案實施例的伴奏音樂的提供裝置,包括:接收模組10、聲紋識別模組20、查找模組30、提取模組40和發送模組50。 As shown in FIG. 3, the device for providing accompaniment music in the embodiment of the present application includes: a receiving module 10, a voiceprint recognition module 20, a searching module 30, an extracting module 40, and a sending module 50.

具體地,接收模組10用於接收利用音頻採集裝置採集的使用者的音頻資訊;舉例來說,音頻採集裝置可為話筒。音頻採集裝置可內置或者外接於使用者端設備。使用者端設備可將音頻採集裝置採集的使用者的音頻資訊發送至接收模組10。 Specifically, the receiving module 10 is used to receive the user's audio information collected by an audio collecting device; for example, the audio collecting device may be a microphone. The audio collection device can be built-in or externally connected to the user equipment. The user-end equipment can send the user's audio information collected by the audio collection device to the receiving module 10.

聲紋識別模組20用於對採集的音頻資訊進行聲紋識別,提取音頻資訊的聲紋特徵。 The voiceprint recognition module 20 is used for performing voiceprint recognition on the collected audio information, and extracting voiceprint features of the audio information.

具體地,聲紋識別模組20可透過對採集的音頻資訊進行聲紋識別以提取該音頻資訊的韻律、節奏等聲紋特徵。 Specifically, the voiceprint recognition module 20 may perform voiceprint recognition on the collected audio information to extract the voiceprint features of the audio information such as rhythm and rhythm.

查找模組30用於根據聲紋特徵在預先建立的音樂資料庫中查找匹配的歌曲資訊。 The searching module 30 is used for searching for matching song information in a pre-established music database according to the voiceprint characteristics.

在本申請案的一個實施例中,音樂資料庫中儲存有多個聲紋特徵和與多個聲紋特徵對應的歌曲資訊,查找模組30可具體用於:根據聲紋特徵查找音樂資料庫,以判斷音樂資料庫中是否存在與聲紋特徵相匹配聲紋特徵。如果存在與聲紋特徵相匹配的聲紋特徵,則將與聲紋特徵相匹配的聲紋特徵對應的歌曲資訊作為與聲紋特徵匹配的歌曲資訊。 In an embodiment of the present application, a plurality of voiceprint features and song information corresponding to the plurality of voiceprint features are stored in the music database, and the search module 30 can be specifically used to: search the music database according to the voiceprint features , To determine whether there is a voiceprint feature matching the voiceprint feature in the music database. If there is a voiceprint feature that matches the voiceprint feature, the song information corresponding to the voiceprint feature that matches the voiceprint feature is used as the song information that matches the voiceprint feature.

具體地,查找模組30可將上述音頻資訊的聲紋特徵與音樂資料庫中的多個聲紋特徵分別進行匹配,直至找到與上述音頻資訊的聲紋特徵相匹配的聲紋特徵,或者音樂資料庫中的多個聲紋特徵都已進行匹配。如果查找到與上述音頻資訊的聲紋特徵相匹配的聲紋特徵,則可將查找到的聲紋特徵對應的歌曲資訊作為與上述音頻資訊的聲紋特徵相匹配的歌曲資訊。 Specifically, the search module 30 can match the voiceprint feature of the audio information with multiple voiceprint features in the music database, respectively, until a voiceprint feature that matches the voiceprint feature of the audio information is found, or music Multiple voiceprint features in the database have been matched. If a voiceprint feature matching the voiceprint feature of the audio information is found, the song information corresponding to the found voiceprint feature can be used as the song information that matches the voiceprint feature of the audio information.

其中,歌曲資訊可包括歌名、演唱者、歌詞、作詞人、作曲人等資訊。 Among them, the song information may include information such as the name of the song, the singer, the lyrics, the lyricist, and the composer.

提取模組40用於提取歌曲資訊對應的伴奏音樂。 The extraction module 40 is used for extracting accompaniment music corresponding to the song information.

在本申請案的一個實施例中,歌曲資訊對應的伴奏音樂可預先儲存在音樂資料庫中,從而在查找到匹配的歌曲資訊後,提取模組40可提取出對應的伴奏音樂。 In an embodiment of the present application, the accompaniment music corresponding to the song information can be pre-stored in the music database, so that after finding the matching song information, the extraction module 40 can extract the corresponding accompaniment music.

在本申請案的另一個實施例中,音樂資料庫中也可以不預存伴奏音樂,而是在查找到匹配的歌曲資訊後,提取模組40根據該歌曲資訊進行搜索,以提取對應的伴奏音樂。 In another embodiment of the present application, the accompaniment music may not be pre-stored in the music database, but after finding the matching song information, the extraction module 40 searches according to the song information to extract the corresponding accompaniment music .

發送模組50用於將伴奏音樂發送至使用者的客戶端。 The sending module 50 is used to send the accompaniment music to the user's client.

具體地,客戶端在接收到伴奏音樂後,可進行播放,以將伴奏音樂提供給使用者。 Specifically, after receiving the accompaniment music, the client can play it to provide the accompaniment music to the user.

在本申請案的另一個實施例中,為了進一步提升使用者體驗,還可提取採集到的音頻資訊的聲紋特徵在伴奏音樂中對應的時間軸,從而客戶端可根據該時間軸控制伴奏 音樂播放。 In another embodiment of the present application, in order to further enhance the user experience, the voiceprint feature of the collected audio information can also be extracted in the corresponding time axis in the accompaniment music, so that the client can control the accompaniment music according to the time axis Play.

具體地,提取模組40還用於在提取歌曲資訊對應的伴奏音樂之後,進一步提取音頻資訊的聲紋特徵在伴奏音樂中對應的時間軸。其中,聲紋特徵對應的時間軸為該聲紋特徵在整首歌曲中所對應的時間。具體地,可將音頻資訊的聲紋特徵與伴奏音樂進行匹配,以找到該聲紋特徵在整首歌曲中所對應的時間。 Specifically, the extraction module 40 is also used to extract the time axis corresponding to the voiceprint feature of the audio information in the accompaniment music after extracting the accompaniment music corresponding to the song information. Among them, the time axis corresponding to the voiceprint feature is the time corresponding to the voiceprint feature in the entire song. Specifically, the voiceprint feature of the audio information can be matched with the accompaniment music to find the time corresponding to the voiceprint feature in the entire song.

發送模組50還用於將時間軸發送至使用者的客戶端。 The sending module 50 is also used to send the time axis to the user's client.

客戶端具體用於:根據時間軸確定伴奏音樂的播放音樂軸;以及根據播放音樂軸播放伴奏音樂。具體地,客戶端可根據聲紋特徵對應的時間軸確定伴奏音樂的播放位置,即播放音樂軸。 The client is specifically used for: determining the playing music axis of the accompaniment music according to the time axis; and playing the accompaniment music according to the playing music axis. Specifically, the client can determine the playback position of the accompaniment music according to the time axis corresponding to the voiceprint feature, that is, the playback music axis.

由此,可透過確定音頻資訊的聲紋特徵在伴奏音樂中對應的時間軸並發送至客戶端,以使客戶端根據時間軸確定伴奏音樂的播放音樂軸,並據此播放伴奏音樂,從而可根據使用者演唱的內容,提供與使用者的音頻資訊相同步的伴奏音樂。 Thus, the time axis corresponding to the voiceprint feature of the audio information in the accompaniment music can be determined and sent to the client, so that the client can determine the playback music axis of the accompaniment music according to the time axis, and play the accompaniment music accordingly. According to the content sung by the user, accompaniment music synchronized with the audio information of the user is provided.

根據本申請案實施例的伴奏音樂的提供裝置,透過提取音頻採集裝置採集的使用者音頻資訊的聲紋特徵查找匹配的歌曲資訊,並根據該歌曲資訊提取對應的伴奏音樂,並發送至使用者的客戶端,由此,在使用者演唱歌曲的過程中,可自動為使用者提供該歌曲的伴奏音樂,智慧、方便,大大提高了使用者體驗。 According to the accompaniment music providing device of the embodiment of the present application, the matching song information is searched for by extracting the voiceprint characteristics of the user's audio information collected by the audio collection device, and the corresponding accompaniment music is extracted according to the song information, and sent to the user As a result, when the user sings a song, it can automatically provide the user with the accompaniment music of the song, which is smart and convenient, and greatly improves the user experience.

在本說明書的描述中,參考術語“一個實施例”、“一些實施例”、“示例”、“具體示例”、或“一些示例”等的描述意指結合該實施例或示例描述的具體特徵、結構、材料或者特點包含於本申請案的至少一個實施例或示例中。在本說明書中,對上述術語的示意性表述不必須針對的是相同的實施例或示例。而且,描述的具體特徵、結構、材料或者特點可以在任一個或多個實施例或示例中以合適的方式結合。此外,在不相互矛盾的情況下,本領域的技術人員可以將本說明書中描述的不同實施例或示例以及不同實施例或示例的特徵進行結合和組合。 In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean specific features described in conjunction with the embodiment or example , The structure, materials, or characteristics are included in at least one embodiment or example of this application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples and the features of the different embodiments or examples described in this specification without contradicting each other.

此外,術語“第一”、“第二”僅用於描述目的,而不能理解為指示或暗示相對重要性或者隱含指明所指示的技術特徵的數量。由此,限定有“第一”、“第二”的特徵可以明示或者隱含地包括至少一個該特徵。在本申請案的描述中,“多個”的含義是至少兩個,例如兩個,三個等,除非另有明確具體的限定。 In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, "a plurality of" means at least two, such as two, three, etc., unless otherwise specifically defined.

流程圖中或在此以其他方式描述的任何過程或方法描述可以被理解為,表示包括一個或更多個用於實現特定邏輯功能或過程的步驟的可執行指令的代碼的模組、片段或部分,並且本申請案的優選實施方式的範圍包括另外的實現,其中可以不按所示出或討論的順序,包括根據所涉及的功能按基本同時的方式或按相反的順序,來執行功能,這應被本申請案的實施例所屬技術領域的技術人員所理解。 Any process or method description described in the flowchart or described in other ways herein can be understood as a module, segment, or code that includes one or more executable instructions for implementing specific logical functions or steps of the process. Part, and the scope of the preferred embodiments of the present application includes additional implementations, which may not be in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, This should be understood by those skilled in the art to which the embodiments of this application belong.

在流程圖中表示或在此以其他方式描述的邏輯和/或步驟,例如,可以被認為是用於實現邏輯功能的可執行指令的定序列表,可以具體實現在任何電腦可讀媒體中,以供指令執行系統、裝置或設備(如基於電腦的系統、包括處理器的系統或其他可以從指令執行系統、裝置或設備取指令並執行指令的系統)使用,或結合這些指令執行系統、裝置或設備而使用。就本說明書而言,"電腦可讀媒體"可以是任何可以包含、儲存、通信、傳播或傳輸程式以供指令執行系統、裝置或設備或結合這些指令執行系統、裝置或設備而使用的裝置。電腦可讀媒體的更具體的示例(非窮盡性列表)包括以下:具有一個或多個佈線的電連接部(電子裝置),可攜式電腦匣(磁裝置),隨機存取記憶體(RAM),唯讀記憶體(ROM),可擦除可編輯唯讀記憶體(EPROM或閃速記憶體),光纖裝置,以及可攜式光碟唯讀記憶體(CDROM)。另外,電腦可讀媒體甚至可以是可在其上列印所述程式的紙或其他合適的媒體,因為可以例如透過對紙或其他媒體進行光學掃描,接著進行編輯、解譯或必要時以其他合適方式進行處理來以電子方式獲得所述程式,然後將其儲存在電腦記憶體中。 The logic and/or steps represented in the flowchart or described in other ways herein, for example, can be considered as a sequenced list of executable instructions for realizing logic functions, and can be embodied in any computer-readable medium, For use by instruction execution systems, devices, or equipment (such as computer-based systems, systems including processors, or other systems that can fetch and execute instructions from instruction execution systems, devices, or equipment), or combine these instruction execution systems, devices Or equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transmit a program for use by an instruction execution system, device, or device or in combination with these instruction execution systems, devices, or devices. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connections (electronic devices) with one or more wiring, portable computer cases (magnetic devices), random access memory (RAM ), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable CD-ROM (CDROM). In addition, the computer-readable medium can even be paper or other suitable media on which the program can be printed, because it can be used, for example, by optically scanning paper or other media, and then editing, interpreting, or other appropriate media if necessary. The program is processed in a suitable manner to obtain the program electronically, and then stored in the computer memory.

應當理解,本申請案的各部分可以用硬體、軟體、固件或它們的組合來實現。在上述實施方式中,多個步驟或方法可以用儲存在記憶體中且由合適的指令執行系統執行的軟體或固件來實現。例如,如果用硬體來實現,和在另 一實施方式中一樣,可用本領域公知的下列技術中的任一項或他們的組合來實現:具有用於對資料信號實現邏輯功能的邏輯閘電路的離散邏輯電路,具有合適的組合邏輯閘電路的專用積體電路,可程式設計閘陣列(PGA),現場可程式設計閘陣列(FPGA)等。 It should be understood that each part of this application can be implemented by hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if it is implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: having a logic gate circuit for implementing logic functions on data signals Discrete logic circuits, dedicated integrated circuits with suitable combinational logic gate circuits, programmable gate array (PGA), field programmable gate array (FPGA), etc.

本技術領域的普通技術人員可以理解實現上述實施例方法攜帶的全部或部分步驟是可以透過程式來指令相關的硬體完成,所述的程式可以儲存於一種電腦可讀儲存媒體中,該程式在執行時,包括方法實施例的步驟之一或其組合。 Those of ordinary skill in the art can understand that all or part of the steps carried in the method of the above-mentioned embodiments can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. When executed, it includes one of the steps of the method embodiment or a combination thereof.

此外,在本申請案各個實施例中的各功能單元可以集成在一個處理模組中,也可以是各個單元單獨物理存在,也可以兩個或兩個以上單元集成在一個模組中。上述集成的模組既可以採用硬體的形式實現,也可以採用軟體功能模組的形式實現。所述集成的模組如果以軟體功能模組的形式實現並作為獨立的產品銷售或使用時,也可以儲存在一個電腦可讀取儲存媒體中。 In addition, the functional units in the various embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented either in the form of hardware or in the form of software functional modules. If the integrated module is realized in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium.

上述提到的儲存媒體可以是唯讀記憶體,磁片或光碟等。儘管上面已經示出和描述了本申請案的實施例,可以理解的是,上述實施例是示例性的,不能理解為對本申請案的限制,本領域的普通技術人員在本申請案的範圍內可以對上述實施例進行變化、修改、替換和變型。 The storage medium mentioned above can be a read-only memory, a floppy disk or an optical disc, etc. Although the embodiments of this application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the application. Those of ordinary skill in the art are within the scope of this application. Variations, modifications, substitutions, and modifications can be made to the above-mentioned embodiments.

Claims (5)

一種伴奏音樂的提供方法,其特徵在於,包括以下步驟:接收利用音頻採集裝置採集的使用者的音頻資訊;對採集的音頻資訊進行聲紋識別,提取所述音頻資訊的聲紋特徵,所述聲紋特徵包括所述音頻資訊的韻律和節奏;根據所述音頻資訊的韻律和節奏在預先建立的音樂資料庫中查找匹配的歌曲資訊,其中,所述音樂資料庫中儲存有歌曲資訊的聲紋特徵與歌曲資訊的對應關係;提取所述歌曲資訊對應的伴奏音樂;提取所述音頻資訊的聲紋特徵在所述伴奏音樂中對應的時間軸;將所述伴奏音樂和所述時間軸發送至使用者的客戶端,以使所述客戶端根據所述時間軸確定所述伴奏音樂的播放音樂軸,並根據所述播放音樂軸播放所述伴奏音樂。 A method for providing accompaniment music is characterized in that it comprises the following steps: receiving audio information of a user collected by an audio collecting device; performing voiceprint recognition on the collected audio information, and extracting the voiceprint characteristics of the audio information. Voiceprint features include the rhythm and rhythm of the audio information; according to the rhythm and rhythm of the audio information, search for matching song information in a pre-established music database, wherein the music database stores the sound of the song information Correspondence between pattern features and song information; extract the accompaniment music corresponding to the song information; extract the time axis corresponding to the voiceprint feature of the audio information in the accompaniment music; send the accompaniment music and the time axis To the user's client terminal, so that the client terminal determines the playing music axis of the accompaniment music according to the time axis, and plays the accompaniment music according to the playing music axis. 如申請專利範圍第1項所述的伴奏音樂的提供方法,其中,所述音樂資料庫中儲存有多個聲紋特徵和與所述多個聲紋特徵對應的歌曲資訊,所述根據所述聲紋特徵在預先建立的音樂資料庫中查找匹配的歌曲資訊具體包括:根據所述聲紋特徵查找所述音樂資料庫,以判斷所述音樂資料庫中是否存在與所述聲紋特徵相匹配聲紋特徵;如果存在與所述聲紋特徵相匹配的聲紋特徵,則將與 所述聲紋特徵相匹配的聲紋特徵對應的歌曲資訊作為與所述聲紋特徵匹配的歌曲資訊。 According to the method for providing accompaniment music according to item 1 of the scope of patent application, the music database stores a plurality of voiceprint features and song information corresponding to the plurality of voiceprint features, according to the The voiceprint feature searching for matching song information in a pre-established music database specifically includes: searching the music database according to the voiceprint feature to determine whether there is a match in the music database with the voiceprint feature Voiceprint feature; if there is a voiceprint feature matching the voiceprint feature, it will be The song information corresponding to the voiceprint feature matching the voiceprint feature is used as the song information matching the voiceprint feature. 如申請專利範圍第1-2項之任一項所述的伴奏音樂的提供方法,其中,透過以下步驟建立所述音樂資料庫:對多個歌曲進行聲紋識別,以分別提取所述多個歌曲的聲紋特徵,並分別獲取所述多個歌曲的歌曲資訊;分別建立所述多個歌曲的聲紋特徵與所述多個歌曲的歌曲資訊的對應關係。 The method for providing accompaniment music according to any one of items 1-2 of the scope of the patent application, wherein the music database is established by the following steps: voiceprint recognition is performed on a plurality of songs to extract the plurality of songs respectively The voiceprint features of the songs, and the song information of the multiple songs are obtained respectively; and the corresponding relationships between the voiceprint features of the multiple songs and the song information of the multiple songs are respectively established. 一種伴奏音樂的提供裝置,其特徵在於,包括:接收模組,用於接收利用音頻採集裝置採集的使用者的音頻資訊;聲紋識別模組,用於對採集的音頻資訊進行聲紋識別,提取所述音頻資訊的聲紋特徵,所述聲紋特徵包括所述音頻資訊的韻律和節奏;查找模組,用於根據所述音頻資訊的韻律和節奏在預先建立的音樂資料庫中查找匹配的歌曲資訊,其中,所述音樂資料庫中儲存有歌曲資訊的聲紋特徵與歌曲資訊的對應關係;提取模組,用於提取所述歌曲資訊對應的伴奏音樂;所述提取模組,還用於提取所述音頻資訊的聲紋特徵在所述伴奏音樂中對應的時間軸;發送模組,用於將所述伴奏音樂和所述時間軸發送至使用者的客戶端,以使所述客戶端根據所述時間軸確定所 述伴奏音樂的播放音樂軸,並根據所述播放音樂軸播放所述伴奏音樂。 A device for providing accompaniment music is characterized by comprising: a receiving module for receiving user audio information collected by an audio collecting device; a voiceprint recognition module for performing voiceprint recognition on the collected audio information, Extracting voiceprint features of the audio information, the voiceprint features including the rhythm and rhythm of the audio information; a search module for searching for matches in a pre-established music database according to the rhythm and rhythm of the audio information Song information, wherein the corresponding relationship between the voiceprint feature of the song information and the song information is stored in the music database; the extraction module is used to extract the accompaniment music corresponding to the song information; the extraction module also The voiceprint feature of the audio information is used to extract the corresponding time axis in the accompaniment music; a sending module is used to send the accompaniment music and the time axis to the user's client, so that the The client determines the location according to the timeline The playing music axis of the accompaniment music is described, and the accompaniment music is played according to the playing music axis. 如申請專利範圍第4項所述的伴奏音樂的提供裝置,其中,所述音樂資料庫中儲存有多個聲紋特徵和與所述多個聲紋特徵對應的歌曲資訊,所述查找模組具體用於:根據所述聲紋特徵查找所述音樂資料庫,以判斷所述音樂資料庫中是否存在與所述聲紋特徵相匹配聲紋特徵;如果存在與所述聲紋特徵相匹配的聲紋特徵,則將與所述聲紋特徵相匹配的聲紋特徵對應的歌曲資訊作為與所述聲紋特徵匹配的歌曲資訊。 The device for providing accompaniment music according to item 4 of the scope of patent application, wherein the music database stores multiple voiceprint features and song information corresponding to the multiple voiceprint features, and the search module Specifically used for: searching the music database according to the voiceprint feature to determine whether there is a voiceprint feature matching the voiceprint feature in the music database; if there is a voiceprint feature matching the voiceprint feature For the voiceprint feature, the song information corresponding to the voiceprint feature that matches the voiceprint feature is used as the song information that matches the voiceprint feature.
TW106101925A 2017-01-19 2017-01-19 Method and device for providing accompaniment music TWI745338B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW106101925A TWI745338B (en) 2017-01-19 2017-01-19 Method and device for providing accompaniment music

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW106101925A TWI745338B (en) 2017-01-19 2017-01-19 Method and device for providing accompaniment music

Publications (2)

Publication Number Publication Date
TW201828278A TW201828278A (en) 2018-08-01
TWI745338B true TWI745338B (en) 2021-11-11

Family

ID=63960080

Family Applications (1)

Application Number Title Priority Date Filing Date
TW106101925A TWI745338B (en) 2017-01-19 2017-01-19 Method and device for providing accompaniment music

Country Status (1)

Country Link
TW (1) TWI745338B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008164966A (en) * 2006-12-28 2008-07-17 Daiichikosho Co Ltd Karaoke system equipped with singing scoring function
CN102404278A (en) * 2010-09-08 2012-04-04 盛乐信息技术(上海)有限公司 Song request system based on voiceprint recognition and application method thereof
CN105243093A (en) * 2015-09-11 2016-01-13 福建星网视易信息***有限公司 Singer recommendation method and apparatus
CN105679324A (en) * 2015-12-29 2016-06-15 福建星网视易信息***有限公司 Voiceprint identification similarity scoring method and apparatus
AU2016101313A4 (en) * 2016-07-28 2016-09-08 Benjamin, Thomas Earl DR Music Learning System Based on Open String and One-Finger Chords
CN105989842A (en) * 2015-01-30 2016-10-05 福建星网视易信息***有限公司 Method and device for voiceprint similarity comparison and application thereof in digital entertainment on-demand system
WO2016192395A1 (en) * 2015-06-05 2016-12-08 福建星网视易信息***有限公司 Singing score display method, apparatus and system
CN106486128A (en) * 2016-09-27 2017-03-08 腾讯科技(深圳)有限公司 A kind of processing method and processing device of double-tone source audio data

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008164966A (en) * 2006-12-28 2008-07-17 Daiichikosho Co Ltd Karaoke system equipped with singing scoring function
CN102404278A (en) * 2010-09-08 2012-04-04 盛乐信息技术(上海)有限公司 Song request system based on voiceprint recognition and application method thereof
CN105989842A (en) * 2015-01-30 2016-10-05 福建星网视易信息***有限公司 Method and device for voiceprint similarity comparison and application thereof in digital entertainment on-demand system
WO2016192395A1 (en) * 2015-06-05 2016-12-08 福建星网视易信息***有限公司 Singing score display method, apparatus and system
CN105243093A (en) * 2015-09-11 2016-01-13 福建星网视易信息***有限公司 Singer recommendation method and apparatus
CN105679324A (en) * 2015-12-29 2016-06-15 福建星网视易信息***有限公司 Voiceprint identification similarity scoring method and apparatus
AU2016101313A4 (en) * 2016-07-28 2016-09-08 Benjamin, Thomas Earl DR Music Learning System Based on Open String and One-Finger Chords
CN106486128A (en) * 2016-09-27 2017-03-08 腾讯科技(深圳)有限公司 A kind of processing method and processing device of double-tone source audio data

Also Published As

Publication number Publication date
TW201828278A (en) 2018-08-01

Similar Documents

Publication Publication Date Title
WO2017028704A1 (en) Method and device for providing accompaniment music
US6476306B2 (en) Method and a system for recognizing a melody
KR100615522B1 (en) music contents classification method, and system and method for providing music contents using the classification method
US20190236208A1 (en) Smart speaker with music recognition
EP3522043A1 (en) Music sharing method and system
CN101438342A (en) Method and electronic device for aligning a song with its lyrics
CN110010159B (en) Sound similarity determination method and device
CN105766001A (en) System and method for audio processing using arbitrary triggers
US9569532B1 (en) Melody recognition systems
CN109756628A (en) Method and device for playing function key sound effect and electronic equipment
JP2010008847A (en) System for retrieval of low level musical piece corresponding to person selecting music
TWI745338B (en) Method and device for providing accompaniment music
CN114664277A (en) Audio evaluation method and device
JP2009147775A (en) Program reproduction method, apparatus, program, and medium
US11114079B2 (en) Interactive music audition method, apparatus and terminal
KR101573868B1 (en) Method for displaying music lyrics automatically, server for recognizing music lyrics and system for displaying music lyrics automatically comprising the server
JP5220493B2 (en) A high-level music search system for music selectors
US20190205089A1 (en) Server device, information processing terminal, system, and method
CN111046218A (en) Audio acquisition method, device and system based on screen locking state
US11398212B2 (en) Intelligent accompaniment generating system and method of assisting a user to play an instrument in a system
JP6713032B2 (en) Sound source mixing method and system capable of atmosphere control
JP6916580B1 (en) Karaoke equipment
CN114900726B (en) Audio interaction identification method, electronic equipment and readable storage medium
JP2016071186A (en) Karaoke device and program
JP6667332B2 (en) Karaoke system