CN105867718A - Multimedia interaction method and apparatus - Google Patents
Multimedia interaction method and apparatus Download PDFInfo
- Publication number
- CN105867718A CN105867718A CN201510917973.6A CN201510917973A CN105867718A CN 105867718 A CN105867718 A CN 105867718A CN 201510917973 A CN201510917973 A CN 201510917973A CN 105867718 A CN105867718 A CN 105867718A
- Authority
- CN
- China
- Prior art keywords
- voice messaging
- multimedia file
- play
- barrage
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a multimedia interaction method and apparatus. The method comprises the steps of in a process of playing a multimedia file, obtaining the screen popup content corresponding to a current playing moment from a server, wherein the screen popup content at least comprises voice information and text information corresponding to the voice information; displaying a voice playing control and the text information in a screen popup form in a playing interface of the multimedia file; detecting whether a touch operation on the voice playing control is received or not; when the touch operation on the voice playing control is received, playing a sound corresponding to the voice information. Compared with the text information, the voice information in the screen popup content displayed in the method can contain information such as tone, intonation or the like, so that the information contained in the screen popup content is richer and a user can better perform interaction when viewing the multimedia file.
Description
Technical field
It relates to Internet technical field, particularly relate to a kind of multimedia interaction method and device.
Background technology
Along with developing rapidly of network technology, the Internet is widely used, and has had become as people's work, life
In one of most important instrument.People are possible not only to browse network video in the Internet, but also can be at viewing network
Make comments during video.
During Internet video is play, terminal can show the review information that user delivers dynamically, and these dynamically show
The review information shown can be referred to as barrage information.These barrage information be usually user viewing video during, input
Some texts or emoticon, to express user to the analysis of plot this moment and mood etc..
But this display text or the barrage information of symbol, be visual information, domestic consumer, when viewing, can only see
To the character string or the symbol that there is no any emotion, it is impossible to by the mode such as the tone or intonation, it is thus achieved that deliver barrage information
The more information of user, for Chinese, identical word, state with the different tone or intonation, reason
Solution to the meaning differ often.
Summary of the invention
For overcoming problem present in correlation technique, the disclosure provides a kind of multimedia interaction method and device.
First aspect according to disclosure embodiment, it is provided that a kind of multimedia interaction method, including:
In multimedia file playing process, obtain the barrage content corresponding with the currently playing moment, described bullet from server
Curtain content at least includes: voice messaging and the text message corresponding with described voice messaging；
In the broadcast interface of described multimedia file, the form with barrage shows speech play control and described text envelope
Breath；
Detect whether to receive the touch control operation that described speech play control is operated；
When receiving the touch control operation that described speech play control is operated, play corresponding with described voice messaging
Sound.
Alternatively, described in the broadcast interface of described multimedia file with the form of barrage show described text message and
Speech play control, including:
Generate the speech play control being associated with described voice messaging；
In the way of rolling or be static, described speech play control is shown in the broadcast interface of described multimedia file；
Predeterminated position around the display position of described speech play control shows all or part of of described text message.
Alternatively, the sound that described broadcasting is corresponding with described voice messaging includes:
Detect whether described multimedia file suspends broadcasting；
When described multimedia file suspends and plays, generate the acoustical signal corresponding with described voice messaging and play.
Alternatively, the sound that described broadcasting is corresponding with described voice messaging, including:
Detect described multimedia file the most to play；
When described multimedia file is play, the volume of the acoustical signal controlling described multimedia file reduces；
Generate the acoustical signal corresponding with described voice messaging and play.
Alternatively, the sound that described broadcasting is corresponding with described voice messaging, including:
Detect described multimedia file the most to play；
When described multimedia file is play, the acoustical signal controlling described multimedia file is play in the first sound channel；
Generate the acoustical signal corresponding with described voice messaging, and the described acoustical signal when second sound channel is play.
Second aspect according to disclosure embodiment, it is provided that a kind of multimedia interaction method, including:
In multimedia file playing process, detect whether to receive voice barrage input trigger action；
When receiving voice barrage input trigger action, record the broadcasting moment that described voice barrage input trigger action is corresponding,
And receive the voice messaging that voice capture device collects；
Obtain the text message corresponding with described voice messaging；
Described text message and voice messaging are determined the barrage content corresponding with the described broadcasting moment and stores server
In.
Alternatively, described described voice messaging is carried out speech recognition, obtains the text message corresponding with described voice messaging,
Including:
Utilize speech recognition technology that described voice messaging is all identified, obtain corresponding with described voice messaging complete
Content of text is made, and described full copy content is defined as described text message；Or,
Utilize speech recognition technology that described voice messaging is all identified, obtain corresponding with described voice messaging complete
Content of text, extracts the text snippet information of described full copy content, and described text snippet information is defined as described literary composition
This information；Or,
Utilize speech recognition technology that described voice messaging is carried out part identification, obtain the text corresponding with described voice messaging
Clip Text；Described text snippet content is defined as described text message.
The third aspect according to disclosure embodiment, it is provided that a kind of Multi-media interactive device, including:
Barrage content obtaining module, in multimedia file playing process, obtains and the currently playing moment from server
Corresponding barrage content, described barrage content at least includes: voice messaging and the text envelope corresponding with described voice messaging
Breath；
Barrage display module, is used in the broadcast interface of described multimedia file showing speech play control with the form of barrage
Part and described text message；
Touch control operation detection module, for detecting whether receive the touch control operation operating described speech play control；
Play control module, for when receiving the touch control operation that described speech play control is operated, play with
The sound that described voice messaging is corresponding.
Alternatively, described barrage display module, including:
Control generates submodule, for generating the speech play control being associated with described voice messaging；
Control display sub-module, for showing institute in the broadcast interface of described multimedia file in the way of rolling or be static
Predicate sound play control；
Text display sub-module, shows described literary composition for the predeterminated position around the display position of described speech play control
This information all or part of.
Alternatively, described broadcasting control module, including:
First plays detection sub-module, is used for detecting whether described multimedia file suspends broadcasting；
First signal generates submodule, for when described multimedia file suspends and plays, generating and described voice messaging pair
The acoustical signal answered；
First plays submodule, for playing the described acoustical signal of generation.
Alternatively, described broadcasting control module, including:
Second plays detection sub-module, is used for detecting described multimedia file and the most plays；
Volume controls submodule, for when described multimedia file is play, controls the sound of described multimedia file
The volume of signal reduces；
Secondary signal generates submodule, for generating the acoustical signal corresponding with described voice messaging；
Second plays submodule, for playing the described acoustical signal of generation.
Alternatively, described broadcasting control module, including:
3rd plays detection sub-module, is used for detecting described multimedia file and the most plays；
3rd plays submodule, for when described multimedia file is play, when multimedia file is play,
The acoustical signal controlling described multimedia file is play in the first sound channel；
3rd signal generates submodule, for generating the acoustical signal corresponding with described voice messaging；
4th plays submodule, for the described acoustical signal when second sound channel is play.
Fourth aspect according to disclosure embodiment, it is provided that a kind of multimedia interactive device, including:
Operation detection module, in multimedia file playing process, detects whether that receiving the input of voice barrage triggers
Operation；
Play moment logging modle, for when receiving voice barrage input trigger action, recording the input of described voice barrage
The broadcasting moment that trigger action is corresponding；
Voice messaging receiver module, for receiving the voice messaging that voice capture device collects；
Text message acquisition module, for obtaining the text message corresponding with described voice messaging；
Determine module, for described text message and voice messaging being determined the barrage content corresponding with the described broadcasting moment；
Memory module, for storing described barrage content in server.
Alternatively, described text message acquisition module, including:
First sound identification module, is used for utilizing speech recognition technology all to identify described voice messaging, obtain with
The full copy content that described voice messaging is corresponding；First determines submodule, and it is described for being used for described full copy content
Text message；Or,
Second sound identification module, is used for utilizing speech recognition technology all to identify described voice messaging, obtain with
The full copy content that described voice messaging is corresponding；Extract submodule, pluck for extracting the text of described full copy content
Want information；Second determines submodule, is used for described text snippet information as described text message；Or,
3rd sound identification module, is used for utilizing speech recognition technology that described voice messaging is carried out part identification, obtain with
The text snippet content that described voice messaging is corresponding；3rd determines submodule, for described text snippet content being defined as
Described text message.
The 5th aspect according to disclosure embodiment, it is provided that a kind of multimedia interactive system, including:
Multi-media interactive device as described in the above-mentioned third aspect and the Multi-media interactive device as described in above-mentioned fourth aspect.
Embodiment of the disclosure that the technical scheme of offer can include following beneficial effect:
The method that disclosure embodiment provides, when showing barrage information, except can merely in addition to text exhibition information,
Can also show the text message of voice messaging and correspondence, so user by interactive operation just can when barrage shows,
Hear the barrage content of voice messaging.For text message, due to the voice in the barrage content that the method is shown
Can comprise the information such as the tone or intonation in information, the information that therefore, it can comprise so that barrage content is abundanter, side
Just user is when watching multimedia file, can be preferably interactive.
It should be appreciated that it is only exemplary and explanatory that above general description and details hereinafter describe, can not
Limit the disclosure.
Accompanying drawing explanation
Accompanying drawing herein is merged in description and constitutes the part of this specification, it is shown that meet embodiments of the invention,
And for explaining the principle of the present invention together with description.
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
In technology description, the required accompanying drawing used is briefly described, it should be apparent that, for those of ordinary skill in the art
Speech, on the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the schematic flow sheet according to a kind of multimedia interaction method shown in an exemplary embodiment；
Fig. 2 is the schematic flow sheet according to the another kind of multimedia interaction method shown in an exemplary embodiment；
Fig. 3 is the schematic flow sheet of step S202 in Fig. 2；
Fig. 4 is the structural representation according to a kind of Multi-media interactive device shown in an exemplary embodiment；
Fig. 5 is the structural representation according to the another kind of Multi-media interactive device shown in an exemplary embodiment.
Detailed description of the invention
Here will illustrate exemplary embodiment in detail, its example represents in the accompanying drawings.Explained below relates to attached
During figure, unless otherwise indicated, the same numbers in different accompanying drawings represents same or analogous key element.Following exemplary is implemented
Embodiment described in example does not represent all embodiments consistent with the present invention.On the contrary, they be only with such as
The example of the apparatus and method that some aspects that described in detail in appended claims, the present invention are consistent.
In order to solve the problem that the barrage content of existing textual form is brought, embodiments provide a kind of the most
Media scheme, on the one hand the program can record the voice of user and can also show as barrage content, another aspect
When showing barrage content, user can be allowed to play voice.
Illustrate as barrage content below for the voice how recording user:
Fig. 1 is the schematic flow sheet according to a kind of multimedia interaction method shown in an exemplary embodiment.As it is shown in figure 1,
The method may comprise steps of:
Step S101: in multimedia file playing process, detects whether to receive voice barrage input trigger action.
When barrage input trigger action can be multimedia file broadcasting, it is arranged on the voice barrage load button of side, uses
This barrage load button is clicked at family, it may be determined that receive voice barrage input trigger action.
When receiving voice barrage input trigger action, step S102: record described voice barrage input trigger action corresponding
The broadcasting moment, and receive the voice messaging that voice capture device collects.
Owing to the barrage content of user's input is relevant to the plot of the multimedia file play this moment, so needing record this moment
The broadcasting moment.Meanwhile, mike or the voice messaging of miscellaneous equipment collection user input are utilized.
Step S103: obtain the text message corresponding with described voice messaging.
In the disclosed embodiments, it is possible to use the voice messaging got is identified by this speech recognition technology, and then
Obtain the text message that voice messaging is corresponding.
In an embodiment of the invention, step S103 can be in the following ways:
Utilize speech recognition technology that described voice messaging is all identified, obtain corresponding with described voice messaging complete
Content of text is made, and described full copy content is defined as described text message.
Visible, in aforesaid way, when corresponding voice messaging identification, the full content of voice messaging is identified,
Then whole full copy contents identification obtained, are defined as the text message corresponding with voice messaging.
Full text content owing to will obtain after voice messaging identification is more, compares redundancy as display during barrage content,
So in another embodiment, step S103 can be in the following ways:
Utilize speech recognition technology that described voice messaging is all identified, obtain corresponding with described voice messaging complete
Content of text, extracts the text snippet information of described full copy content, and described text snippet information is defined as described literary composition
This information.
In embodiments of the present invention, the extraction text snippet information in the full copy content all recognized, and completely
Content of text is compared, and the text snippet information representation meaning is succinct, and memory space is less.
In previous embodiment, need voice messaging is all identified, then extract text snippet, although obtain
Text snippet information is less than full copy content indirection, memory space, but all identifies voice messaging, the most relatively
Long, cause treatment effeciency to reduce.So in an alternative embodiment of the invention, step S103 can also be in the following ways:
Utilize speech recognition technology that described voice messaging is carried out part identification, obtain the text corresponding with described voice messaging
Clip Text；Described text snippet content is defined as described text message
In embodiments of the present invention, it is also possible to voice messaging is carried out part identification, such as: identify front 1/3rd or two
/ mono-, naturally it is also possible to carry out the amount of deciding section identification according to the size of voice messaging, such as: for the language within 5M
Message ceases, 0.3M before identifying, for the information of 10-100M, and 1M before identifying.The side identified by part
Formula, can shorten the time of identification, improves recognition efficiency.
Step S104: described text message and voice messaging are determined the barrage content corresponding with the described broadcasting moment and deposits
Store up in server.
After identification obtains text message, can directly using the text message recognized and voice messaging all as barrage content,
And set up barrage content and the corresponding relation play between the moment, finally store in server, in order to other user broadcasts
When putting same multimedia file, the barrage content comprising voice messaging can be sent and be shown.
The method that the embodiment of the present invention provides, when multimedia file is play, it is also possible to the voice letter of typing user input
Breath, as barrage content, for text message, can comprise the information such as the tone or intonation so that barrage content bag
The information contained is abundanter, facilitate user when watching multimedia file, can be preferably interactive.
Below for how when showing barrage content, the voice messaging allowing user play in barrage content illustrates.
Fig. 2 is the schematic flow sheet according to a kind of multimedia interaction method shown in an exemplary embodiment.As in figure 2 it is shown,
The method may comprise steps of:
Step S201: in multimedia file playing process, obtains in the barrage corresponding with the currently playing moment from server
Hold.
In embodiments of the present invention, barrage content at least includes: voice messaging and the text corresponding with described voice messaging
Information.The description of embodiment the most shown in Figure 1, it is known that the text message corresponding with voice messaging, can be straight
Connect the full copy content obtained after voice messaging identification, or, can be the text snippet information of full copy content,
Again or, it is also possible to be voice messaging is carried out part identification after the text snippet information that obtains.
No matter which kind of text message, all can facilitate user that the content in voice messaging is carried out preview, provides the user and is
The no foundation opening voice messaging.
Step S202: the form with barrage shows speech play control and institute in the broadcast interface of described multimedia file
State text message.
Owing to, in the barrage content that receives, including voice messaging, so user plays this voice messaging for convenience,
It is therefore desirable to generate a speech play control, then in broadcast interface, show this speech play control with the form of barrage
Part, and show text message, such as simultaneously: text message may be located on speech play information control, it is also possible to for
Speech play information control is positioned at the above or below of text message, in order to user just can be pre-by reading text message
Look at the general contents of voice messaging.
Step S203: detect whether to receive the touch control operation that described speech play control is operated.
For the speech play control shown in broadcast interface, when user clicks on speech play control according to text message,
Determine the touch control operation received speech play space, that is, need to play the voice corresponding with this speech play control
Information.
When receiving the touch control operation that described speech play control is operated, step S204: play and described voice
The sound that information is corresponding.
The method that disclosure embodiment provides, when showing barrage information, except can merely in addition to text exhibition information,
Can also show the text message of voice messaging and correspondence, so user by interactive operation just can when barrage shows,
Hear the barrage content of voice messaging.For text message, the information such as the tone or intonation can be comprised so that bullet
The curtain information that comprises of content is abundanter, facilitate user when watching multimedia file, can be preferably interactive.
In an embodiment of the invention, as it is shown on figure 3, step S202 in Fig. 2 may comprise steps of:
Step S2021: generate the speech play control being associated with described voice messaging.
Step S2022: show that described voice is broadcast in the way of rolling or be static in the broadcast interface of described multimedia file
Put control.
Step S2023: the predeterminated position around the display position of described speech play control shows described text message
Completely or partially.
When showing text message, can all show the full text information corresponding with voice messaging, furthermore, it is contemplated that
The length of text importing on barrage, it is also possible to only show partial text information, such as: before showing in all text messages
20 words etc..
In an embodiment of the invention, step S204 in the embodiment depicted in figure 2 may comprise steps of:
Detect whether described multimedia file suspends broadcasting.
When described multimedia file suspends and plays, generate the acoustical signal corresponding with described voice messaging and play.
Owing to when multimedia file is play, himself being that there is certain audio, all at this point for linguistic information for,
When multimedia file suspends, then the sound corresponding with voice messaging can be play.
In above-described embodiment, only when multimedia file suspends, just play the voice messaging that barrage content is corresponding, so
Although effect is bad, but the voice messaging as barrage can be realized and multimedia voice messaging does not conflicts.In the present invention
In another embodiment, step S204 in embodiment described in Fig. 2 may comprise steps of:
Detect described multimedia file the most to play.
When described multimedia file is play, the volume of the acoustical signal controlling described multimedia file reduces.
Generate the acoustical signal corresponding with described voice messaging and play.
In embodiments of the present invention, even if multimedia file is play, the most still play the voice in barrage content
Information, although two sound overlaps, but can realize user watch multimedia file time, hear barrage content simultaneously.
Either suspend multimedia file and play the voice in the voice that barrage content is corresponding, or barrage content and many matchmakers again
The voice of body file is play together, all there is drawback more or less.To this end, in an alternative embodiment of the invention, Fig. 2
Step S204 in described embodiment may comprise steps of:
Detect described multimedia file the most to play.
When described multimedia file is play, the acoustical signal controlling described multimedia file is play in the first sound channel.
Generate the acoustical signal corresponding with described voice messaging, and the described acoustical signal when second sound channel is play.
In embodiments of the present invention, barrage content the is corresponding voice sound corresponding with multimedia file is respectively at different sound
When road is play, as a example by common earphone, can play in different earplugs respectively, and then both can realize simultaneously
Play, will not interfere with each other again.
The structural representation of a kind of Multi-media interactive device that Fig. 4 provides for the embodiment of the present invention.As shown in Figure 4, this dress
Put and may include that
Operation detection module 41, in multimedia file playing process, detects whether that receiving the input of voice barrage touches
Send out operation；
Play moment logging modle 42, for when receiving voice barrage input trigger action, recording described voice barrage defeated
Enter the broadcasting moment that trigger action is corresponding；
Voice messaging receiver module 43, for receiving the voice messaging that voice capture device collects；
Text message acquisition module 44, for obtaining the text message corresponding with described voice messaging；
Determine module 45, in described text message and voice messaging are determined the barrage corresponding with the described broadcasting moment
Hold；
Memory module 46, for storing described barrage content in server.
In this embodiment of the present invention one, text message acquisition module 44 may include that
First sound identification module, is used for utilizing speech recognition technology all to identify described voice messaging, obtain with
The full copy content that described voice messaging is corresponding；First determines submodule, and it is described for being used for described full copy content
Text message.
In this embodiment of the present invention one, text message acquisition module 44 may include that
Second sound identification module, is used for utilizing speech recognition technology all to identify described voice messaging, obtain with
The full copy content that described voice messaging is corresponding；Extract submodule, pluck for extracting the text of described full copy content
Want information；Second determines submodule, is used for described text snippet information as described text message.
In this embodiment of the present invention one, text message acquisition module 74 may include that
3rd sound identification module, is used for utilizing speech recognition technology that described voice messaging is carried out part identification, obtain with
The text snippet content that described voice messaging is corresponding；3rd determines submodule, for described text snippet content being defined as
Described text message.
The structural representation of a kind of Multi-media interactive device that Fig. 5 provides for the embodiment of the present invention.As it is shown in figure 5, this dress
Put and may include that
Barrage content obtaining module 51, is used in multimedia file playing process, when obtaining from server and be currently playing
Carving corresponding barrage content, described barrage content at least includes: voice messaging and the text corresponding with described voice messaging
Information；
Barrage display module 52, is used in the broadcast interface of described multimedia file showing speech play with the form of barrage
Control and described text message；
Touch control operation detection module 53, for detecting whether receive the touch-control behaviour operating described speech play control
Make；
Play control module 54, for when receiving the touch control operation that described speech play control is operated, play
The sound corresponding with described voice messaging.
In an embodiment of the invention, above-mentioned barrage display module 52 may include that
Control generates submodule, for generating the speech play control being associated with described voice messaging；
Control display sub-module, for showing institute in the broadcast interface of described multimedia file in the way of rolling or be static
Predicate sound play control；
Text display sub-module, shows described literary composition for the predeterminated position around the display position of described speech play control
This information all or part of.
In an embodiment of the invention, above-mentioned broadcasting control module 54 may include that
First plays detection sub-module, is used for detecting whether described multimedia file suspends broadcasting；
First signal generates submodule, for when described multimedia file suspends and plays, generating and described voice messaging pair
The acoustical signal answered；
First plays submodule, for playing the described acoustical signal of generation.
In an embodiment of the invention, above-mentioned broadcasting control module 54 may include that
Second plays detection sub-module, is used for detecting described multimedia file and the most plays；
Volume controls submodule, for when described multimedia file is play, controls the sound of described multimedia file
The volume of signal reduces；
Secondary signal generates submodule, for generating the acoustical signal corresponding with described voice messaging；
Second plays submodule, for playing the described acoustical signal of generation.
In an embodiment of the invention, above-mentioned broadcasting control module 54 may include that
3rd plays detection sub-module, is used for detecting described multimedia file and the most plays；
3rd plays submodule, for when described multimedia file is play, when multimedia file is play,
The acoustical signal controlling described multimedia file is play in the first sound channel；
3rd signal generates submodule, for generating the acoustical signal corresponding with described voice messaging；
4th plays submodule, for the described acoustical signal when second sound channel is play.
About the device in above-described embodiment, wherein modules performs the concrete mode of operation in relevant the method
Embodiment is described in detail, explanation will be not set forth in detail herein.
In embodiments of the present invention, also providing for a kind of digital video interactive, this system can include the most
Media interactive device and multimedia interactive device as shown in Figure 5.
Those skilled in the art, after considering description and putting into practice invention disclosed herein, will readily occur to other of the present invention
Embodiment.The application is intended to any modification, purposes or the adaptations of the present invention, these modification, purposes
Or adaptations follow the present invention general principle and include the disclosure undocumented in the art known often
Know or conventional techniques means.Description and embodiments is considered only as exemplary, true scope and spirit of the invention by under
The claim in face is pointed out.
It should be appreciated that the invention is not limited in precision architecture described above and illustrated in the accompanying drawings, and
Various modifications and changes can carried out without departing from the scope.The scope of the present invention is only limited by appended claim.
Claims (15)
1. a multimedia interaction method, it is characterised in that including:
In multimedia file playing process, obtain the barrage content corresponding with the currently playing moment, described bullet from server
Curtain content at least includes: voice messaging and the text message corresponding with described voice messaging；
In the broadcast interface of described multimedia file, the form with barrage shows speech play control and described text envelope
Breath；
Detect whether to receive the touch control operation that described speech play control is operated；
When receiving the touch control operation that described speech play control is operated, play corresponding with described voice messaging
Sound.
Multimedia interaction method the most according to claim 1, it is characterised in that described at described multimedia file
In broadcast interface, the form with barrage shows speech play control and described text message, including:
Generate the speech play control being associated with described voice messaging；
In the way of rolling or be static, described speech play control is shown in the broadcast interface of described multimedia file；
Predeterminated position around the display position of described speech play control shows all or part of of described text message.
Method the most according to claim 1, it is characterised in that the sound that described broadcasting is corresponding with described voice messaging,
Including:
Detect whether described multimedia file suspends broadcasting；
When described multimedia file suspends and plays, generate the acoustical signal corresponding with described voice messaging and play.
Method the most according to claim 1, it is characterised in that the sound that described broadcasting is corresponding with described voice messaging,
Including:
Detect described multimedia file the most to play；
When described multimedia file is play, the volume of the acoustical signal controlling described multimedia file reduces；
Generate the acoustical signal corresponding with described voice messaging and play.
Method the most according to claim 1, it is characterised in that the sound that described broadcasting is corresponding with described voice messaging,
Including:
Detect described multimedia file the most to play；
When described multimedia file is play, the acoustical signal controlling described multimedia file is play in the first sound channel；
Generate the acoustical signal corresponding with described voice messaging, and the described acoustical signal when second sound channel is play.
6. a multimedia interaction method, it is characterised in that including:
In multimedia file playing process, detect whether to receive voice barrage input trigger action；
When receiving voice barrage input trigger action, record the broadcasting moment that described voice barrage input trigger action is corresponding,
And receive the voice messaging that voice capture device collects；
Obtain the text message corresponding with described voice messaging；
Described text message and voice messaging are determined the barrage content corresponding with the described broadcasting moment and stores server
In.
Method the most according to claim 6, it is characterised in that described described voice messaging is carried out speech recognition,
Obtain the text message corresponding with described voice messaging, including:
Utilize speech recognition technology that described voice messaging is all identified, obtain corresponding with described voice messaging complete
Content of text is made, and described full copy content is defined as described text message；Or,
Utilize speech recognition technology that described voice messaging is all identified, obtain corresponding with described voice messaging complete
Content of text, extracts the text snippet information of described full copy content, and described text snippet information is defined as described literary composition
This information；Or,
Utilize speech recognition technology that described voice messaging is carried out part identification, obtain the text corresponding with described voice messaging
Clip Text；Described text snippet content is defined as described text message.
8. a Multi-media interactive device, it is characterised in that including:
Barrage content obtaining module, in multimedia file playing process, obtains and the currently playing moment from server
Corresponding barrage content, described barrage content at least includes: voice messaging and the text envelope corresponding with described voice messaging
Breath；
Barrage display module, is used in the broadcast interface of described multimedia file showing speech play control with the form of barrage
Part and described text message；
Touch control operation detection module, for detecting whether receive the touch control operation operating described speech play control；
Play control module, for when receiving the touch control operation that described speech play control is operated, play with
The sound that described voice messaging is corresponding.
Multi-media interactive device the most according to claim 8, it is characterised in that described barrage display module, including:
Control generates submodule, for generating the speech play control being associated with described voice messaging；
Control display sub-module, for showing institute in the broadcast interface of described multimedia file in the way of rolling or be static
Predicate sound play control；
Text display sub-module, shows described literary composition for the predeterminated position around the display position of described speech play control
This information all or part of.
Device the most according to claim 8, it is characterised in that described broadcasting control module, including:
First plays detection sub-module, is used for detecting whether described multimedia file suspends broadcasting；
First signal generates submodule, for when described multimedia file suspends and plays, generating and described voice messaging pair
The acoustical signal answered；
First plays submodule, for playing the described acoustical signal of generation.
11. devices according to claim 8, it is characterised in that described broadcasting control module, including:
Second plays detection sub-module, is used for detecting described multimedia file and the most plays；
Volume controls submodule, for when described multimedia file is play, controls the sound of described multimedia file
The volume of signal reduces；
Secondary signal generates submodule, for generating the acoustical signal corresponding with described voice messaging；
Second plays submodule, for playing the described acoustical signal of generation.
12. devices according to claim 8, it is characterised in that described broadcasting control module, including:
3rd plays detection sub-module, is used for detecting described multimedia file and the most plays；
3rd plays submodule, for when described multimedia file is play, when multimedia file is play,
The acoustical signal controlling described multimedia file is play in the first sound channel；
3rd signal generates submodule, for generating the acoustical signal corresponding with described voice messaging；
4th plays submodule, for the described acoustical signal when second sound channel is play.
13. 1 kinds of multimedia interactive devices, it is characterised in that including:
Operation detection module, in multimedia file playing process, detects whether that receiving the input of voice barrage triggers
Operation；
Play moment logging modle, for when receiving voice barrage input trigger action, recording the input of described voice barrage
The broadcasting moment that trigger action is corresponding；
Voice messaging receiver module, for receiving the voice messaging that voice capture device collects；
Text message acquisition module, for obtaining the text message corresponding with described voice messaging；
Determine module, for described text message and voice messaging being determined the barrage content corresponding with the described broadcasting moment；
Memory module, for storing described barrage content in server.
14. devices according to claim 13, it is characterised in that described text message acquisition module, including:
First sound identification module, is used for utilizing speech recognition technology all to identify described voice messaging, obtain with
The full copy content that described voice messaging is corresponding；First determines submodule, and it is described for being used for described full copy content
Text message；Or,
Second sound identification module, is used for utilizing speech recognition technology all to identify described voice messaging, obtain with
The full copy content that described voice messaging is corresponding；Extract submodule, pluck for extracting the text of described full copy content
Want information；Second determines submodule, is used for described text snippet information as described text message；Or,
3rd sound identification module, is used for utilizing speech recognition technology that described voice messaging is carried out part identification, obtain with
The text snippet content that described voice messaging is corresponding；3rd determines submodule, for described text snippet content being defined as
Described text message.
15. 1 kinds of multimedia interactive systems, it is characterised in that including:
Multi-media interactive device as described in claim 8-12 and the dress of the multimedia interaction as described in claim 13-14
Put.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510917973.6A CN105867718A (en) | 2015-12-10 | 2015-12-10 | Multimedia interaction method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510917973.6A CN105867718A (en) | 2015-12-10 | 2015-12-10 | Multimedia interaction method and apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105867718A true CN105867718A (en) | 2016-08-17 |
Family
ID=56624396
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510917973.6A Pending CN105867718A (en) | 2015-12-10 | 2015-12-10 | Multimedia interaction method and apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105867718A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107888937A (en) * | 2017-11-08 | 2018-04-06 | 维沃移动通信有限公司 | Barrage processing method, service end, client and computer-readable recording medium |
| CN109195016A (en) * | 2018-09-13 | 2019-01-11 | 苏州思必驰信息科技有限公司 | Voice interactive method, terminal system and the intelligent terminal of video barrage towards intelligent terminal |
| WO2019047850A1 (en) * | 2017-09-07 | 2019-03-14 | 腾讯科技（深圳）有限公司 | Identifier displaying method and device, request responding method and device |
| CN110062254A (en) * | 2019-04-19 | 2019-07-26 | 上海连尚网络科技有限公司 | A kind of method and apparatus of barrage publication |
| CN111863043A (en) * | 2020-07-29 | 2020-10-30 | 安徽听见科技有限公司 | Audio transfer file generation method, related equipment and readable storage medium |
| CN112232898A (en) * | 2020-09-25 | 2021-01-15 | 北京五八信息技术有限公司 | Space display method and device, electronic equipment and storage medium |
| CN113132785A (en) * | 2019-12-30 | 2021-07-16 | 阿里巴巴集团控股有限公司 | Multimedia data method, device, electronic equipment and computer storage medium |
| WO2021196617A1 (en) * | 2020-04-02 | 2021-10-07 | 深圳创维－Rgb电子有限公司 | Voice interaction method and apparatus, electronic device and storage medium |
| WO2023241360A1 (en) * | 2022-06-14 | 2023-12-21 | 北京新唐思创教育科技有限公司 | Online class voice interaction methods and apparatus, device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103517092A (en) * | 2012-06-29 | 2014-01-15 | 腾讯科技（深圳）有限公司 | Method and device for video displaying |
| US20140129221A1 (en) * | 2012-03-23 | 2014-05-08 | Dwango Co., Ltd. | Sound recognition device, non-transitory computer readable storage medium stored threreof sound recognition program, and sound recognition method |
| CN104125512A (en) * | 2014-07-07 | 2014-10-29 | 乐视网信息技术（北京）股份有限公司 | Method and system for playing voice comments |
| CN104133652A (en) * | 2014-06-10 | 2014-11-05 | 腾讯科技（深圳）有限公司 | Audio playing control method and terminal |
| CN104991922A (en) * | 2015-06-26 | 2015-10-21 | 努比亚技术有限公司 | Information output method and apparatus |
-
2015
- 2015-12-10 CN CN201510917973.6A patent/CN105867718A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140129221A1 (en) * | 2012-03-23 | 2014-05-08 | Dwango Co., Ltd. | Sound recognition device, non-transitory computer readable storage medium stored threreof sound recognition program, and sound recognition method |
| CN103517092A (en) * | 2012-06-29 | 2014-01-15 | 腾讯科技（深圳）有限公司 | Method and device for video displaying |
| CN104133652A (en) * | 2014-06-10 | 2014-11-05 | 腾讯科技（深圳）有限公司 | Audio playing control method and terminal |
| CN104125512A (en) * | 2014-07-07 | 2014-10-29 | 乐视网信息技术（北京）股份有限公司 | Method and system for playing voice comments |
| CN104991922A (en) * | 2015-06-26 | 2015-10-21 | 努比亚技术有限公司 | Information output method and apparatus |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019047850A1 (en) * | 2017-09-07 | 2019-03-14 | 腾讯科技（深圳）有限公司 | Identifier displaying method and device, request responding method and device |
| CN107888937A (en) * | 2017-11-08 | 2018-04-06 | 维沃移动通信有限公司 | Barrage processing method, service end, client and computer-readable recording medium |
| CN109195016A (en) * | 2018-09-13 | 2019-01-11 | 苏州思必驰信息科技有限公司 | Voice interactive method, terminal system and the intelligent terminal of video barrage towards intelligent terminal |
| CN109195016B (en) * | 2018-09-13 | 2020-12-15 | 苏州思必驰信息科技有限公司 | Intelligent terminal equipment-oriented voice interaction method and terminal system for video barrage and intelligent terminal equipment |
| CN110062254A (en) * | 2019-04-19 | 2019-07-26 | 上海连尚网络科技有限公司 | A kind of method and apparatus of barrage publication |
| CN113132785A (en) * | 2019-12-30 | 2021-07-16 | 阿里巴巴集团控股有限公司 | Multimedia data method, device, electronic equipment and computer storage medium |
| WO2021196617A1 (en) * | 2020-04-02 | 2021-10-07 | 深圳创维－Rgb电子有限公司 | Voice interaction method and apparatus, electronic device and storage medium |
| CN111863043A (en) * | 2020-07-29 | 2020-10-30 | 安徽听见科技有限公司 | Audio transfer file generation method, related equipment and readable storage medium |
| CN111863043B (en) * | 2020-07-29 | 2022-09-23 | 安徽听见科技有限公司 | Audio transfer file generation method, related equipment and readable storage medium |
| CN112232898A (en) * | 2020-09-25 | 2021-01-15 | 北京五八信息技术有限公司 | Space display method and device, electronic equipment and storage medium |
| WO2023241360A1 (en) * | 2022-06-14 | 2023-12-21 | 北京新唐思创教育科技有限公司 | Online class voice interaction methods and apparatus, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105867718A (en) | Multimedia interaction method and apparatus | |
| US9812028B1 (en) | Automated generation and presentation of lessons via digital media content extraction | |
| CN103853761B (en) | Comment demonstration, adding method and the device of web page contents | |
| CN105228013B (en) | Barrage information processing method, device and barrage video player | |
| JP6150405B2 (en) | System and method for captioning media | |
| US10192544B2 (en) | Method and system for constructing a language model | |
| KR20140091236A (en) | Electronic Device And Method Of Controlling The Same | |
| US10652592B2 (en) | Named entity disambiguation for providing TV content enrichment | |
| CA3012471A1 (en) | Digital media content extraction natural language processing system | |
| CN101998107B (en) | Information processing apparatus, conference system and information processing method | |
| CN110602516A (en) | Information interaction method and device based on live video and electronic equipment | |
| CN103984772A (en) | Method and device for generating text retrieval subtitle library and video retrieval method and device | |
| CN112399258A (en) | Live playback video generation playing method and device, storage medium and electronic equipment | |
| CN104270531A (en) | Method and device for continuously playing multiple messages | |
| CN111898388A (en) | Video subtitle translation editing method and device, electronic equipment and storage medium | |
| US20190213998A1 (en) | Method and device for processing data visualization information | |
| Peng et al. | Slidecho: Flexible non-visual exploration of presentation videos | |
| CN112230838A (en) | Article processing method, article processing device, article processing equipment and computer readable storage medium | |
| Zhu et al. | ViVo: Video-augmented dictionary for vocabulary learning | |
| Gleason et al. | Making GIFs Accessible | |
| CN104378692A (en) | Method and device for processing video captions | |
| Gower et al. | Leveraging pauses to improve video captions | |
| CN111523343B (en) | Reading interaction method, device, equipment, server and storage medium | |
| CN112116836A (en) | Online learning note and teaching multimedia linkage acquisition method and system | |
| WO2022131270A1 (en) | Viewing assistance system, viewing assistance method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160817 |
|
| WD01 | Invention patent application deemed withdrawn after publication |