CN108668152A - Audio/video interaction method and device - Google Patents

Audio/video interaction method and device Download PDF

Info

Publication number
CN108668152A
CN108668152A CN201710210887.0A CN201710210887A CN108668152A CN 108668152 A CN108668152 A CN 108668152A CN 201710210887 A CN201710210887 A CN 201710210887A CN 108668152 A CN108668152 A CN 108668152A
Authority
CN
China
Prior art keywords
audio
terminal
video
interaction
management equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710210887.0A
Other languages
Chinese (zh)
Other versions
CN108668152B (en
Inventor
薛笛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201710210887.0A priority Critical patent/CN108668152B/en
Publication of CN108668152A publication Critical patent/CN108668152A/en
Application granted granted Critical
Publication of CN108668152B publication Critical patent/CN108668152B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25816—Management of client data involving client authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a kind of audio/video interaction method and devices, belong to network technique field.The method includes：When the audio and video for receiving first terminal, which interact, exits request, according to first path information, determine that the second management equipment, first path information are used to indicate the audio, video data for forwarding first terminal to second terminal by the second management equipment；Remove first path information；Audio and video interaction is sent to the second management equipment and exits request, and second terminal is forwarded to by the second management equipment.It by first path information, sends audio and video interaction to the second management equipment and exits request so that first terminal can be had logged out current audio and video interaction notice to second terminal by the second management equipment.Moreover, the first management equipment can remove the first path information of second terminal in time so that the audio, video data of first terminal will not be subsequently transmitted to second terminal by the first management equipment, and that realizes audio and video interaction exits flow.

Description

Audio/video interaction method and device
Technical field
The present invention relates to network technique field, more particularly to a kind of audio/video interaction method and device.
Background technology
With the development of network technology, net cast has become a kind of network audio-video interactive form of prevalence, for example, Live broadcast system can be that the live streaming user for needing to be broadcast live distributes an audio and video mark, i.e., room number, other users can add Enter to come as spectators user to this " room " and be broadcast live user and carries out interaction.
Currently, during " live streaming room " interior main broadcaster user is broadcast live, terminal may where main broadcaster user Cause to be broadcast live due to network interruption etc. and interrupt, at this point, the equipment in " live streaming room " where management main broadcaster user can be to " directly Broadcast room " in spectators user notify the current state of main broadcaster user, for example be currently at non-live state etc. so that spectators Terminal where user can synchronize the state of main broadcaster user.And when carrying out audio and video interaction between the main broadcaster in multiple " rooms ", Since different " live streaming rooms " are by distinct device management, when the main broadcaster in a live streaming room exits audio and video interaction, management should Live streaming room management equipment only will can accordingly exit information and notify user in the live streaming room, and carry out audio and video interaction The user in other live streaming rooms can not know that this exits information, mistake occur so as to cause flow is exited, therefore, how one When a live streaming room exits audio and video interaction, ensures that each " live streaming room " can be known and exit information accordingly, and is smoothly complete It is problem to be solved at flow is exited accordingly.
Invention content
In order to solve problems in the prior art, an embodiment of the present invention provides a kind of audio/video interaction method and devices.Institute It is as follows to state technical solution：
In a first aspect, providing a kind of audio/video interaction method, it is applied to the first management equipment, the method includes：
When the audio and video for receiving first terminal, which interact, exits request, according to first path information, the second management is determined Equipment, the first path information is used to indicate forwards the first terminal by second management equipment to second terminal Audio, video data, the second terminal are that the terminal of audio and video interaction is carried out with the first terminal；
The first path information is removed, so that first management equipment subsequently stops to second management equipment Forward the audio, video data of the first terminal；
The audio and video interaction, which is sent, to second management equipment exits request, it will be described by second management equipment Audio and video interaction exits request and is forwarded to the second terminal, is handed over prompting the first terminal to have logged out current audio and video Mutually.
Second aspect provides a kind of audio/video interaction method, is applied to the second management equipment, the method includes：
When the audio and video for receiving first terminal from the first management equipment, which interact, exits request, determine with described first eventually End carries out the second terminal of audio and video interaction；
Remove storage the second routing information, second routing information be used to indicate by first management equipment to The first terminal forwards the audio, video data of the second terminal；
Audio and video interactive refreshing message is sent to terminal where the user associated by the second terminal, the audio and video are handed over Mutual new information is for prompting the first terminal to have logged out current audio and video interaction.
The third aspect provides a kind of audio/video interaction method, the method includes：
When request is exited in the audio and video interaction that the first management equipment receives first terminal, according to first path information, Determine the second management equipment, the first path information is used to indicate forwards institute by second management equipment to second terminal The audio, video data of first terminal is stated, the second terminal is that the terminal of audio and video interaction is carried out with the first terminal；
First management equipment removes the first path information so that first management equipment subsequently stop to Second management equipment forwards the audio, video data of the first terminal；
First management equipment sends the audio and video interaction to second management equipment and exits request；
When second management equipment receives audio and video interaction and exits request, the second terminal is determined；
Second management equipment removes the second routing information of storage, and second routing information, which is used to indicate, passes through institute State the audio, video data that the first management equipment forwards the second terminal to the first terminal；
Terminal sends audio and video interactive refreshing where second management equipment to the user associated by the second terminal Message, the audio and video interactive refreshing message is for prompting the first terminal to have logged out current audio and video interaction.
Fourth aspect provides a kind of audio and video interactive device, is applied to the first management equipment, and described device includes：
First determining module, for when receive first terminal audio and video interact exit request when, according to first path Information, determines the second management equipment, and the first path information is used to indicate through second management equipment to second terminal It is that the end of audio and video interaction is carried out with the first terminal to forward the audio, video data of the first terminal, the second terminal End；
Module is removed, for removing the first path information, so that first management equipment subsequently stops to institute State the audio, video data that the second management equipment forwards the first terminal；
First sending module exits request, by described for sending the audio and video interaction to second management equipment Audio and video interaction is exited request and is forwarded to the second terminal by the second management equipment, to have prompted the first terminal Exit current audio and video interaction.
5th aspect, provides a kind of audio and video interactive device, is applied to the second management equipment, and described device includes：
Determining module, for when received from the first management equipment first terminal audio and video interact exit request when, really The fixed second terminal that audio and video interaction is carried out with the first terminal；
Module is removed, the second routing information for removing storage, second routing information is used to indicate by described First management equipment forwards the audio, video data of the second terminal to the first terminal；
First sending module, for sending audio and video interactive refreshing to terminal where the user associated by the second terminal Message, the audio and video interactive refreshing message is for prompting the first terminal to have logged out current audio and video interaction.
6th aspect, provides a kind of video living transmission system, including the first management equipment, the second management equipment,
First management equipment is used to execute the method described in above-mentioned first aspect；
Second management equipment is used to execute the method described in above-mentioned second aspect.
The advantageous effect that technical solution provided in an embodiment of the present invention is brought is：
First management equipment, can be according to the path of storage when request is exited in the audio and video interaction for receiving first terminal Information, determine with associated second management equipment of second terminal, and send audio and video interaction to the second management equipment and exit and ask It asks so that first terminal can be had logged out current audio and video interaction notice to second terminal by the second management equipment.Moreover, the One management equipment can remove the first path information of second terminal in time so that the first management equipment subsequently will not be by first eventually The audio, video data at end is transmitted to second terminal, will not the audio, video data of second terminal be transmitted to first terminal, to So that each live streaming room for participating in audio and video interaction can smoothly complete and exit flow accordingly.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings Attached drawing.
Fig. 1 is a kind of Organization Chart for audio and video interactive system provided in an embodiment of the present invention；
Fig. 2 is a kind of flow chart of audio/video interaction method provided in an embodiment of the present invention；
Fig. 3 is the Signalling exchange schematic diagram that flow is exited in a kind of audio and video interaction provided in an embodiment of the present invention；
Fig. 4 is a kind of block diagram of audio and video interactive device provided in an embodiment of the present invention；
Fig. 5 is a kind of block diagram of audio and video interactive device provided in an embodiment of the present invention；
Fig. 6 is a kind of block diagram of audio and video interactive device provided in an embodiment of the present invention.
Specific implementation mode
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
Fig. 1 is a kind of Organization Chart for audio and video interactive system provided in an embodiment of the present invention, and referring to Fig. 1, which regards Frequency interactive system includes strategic server, multiple management equipments and multiple terminals.
Strategic server is used for when main broadcaster user asks to carry out net cast, and the terminal distribution sound where main broadcasting user regards Frequency marking is known, and audio and video mark can be used for one live streaming room of unique mark or direct broadcast band, and audio and video mark can be Room number (Room ID) or channel number (Channel ID), and according to the loading condition of multiple management equipments, for the live streaming room Allocate management of equipment.
Each management equipment is for being managed the net cast in one or more rooms, for example, being so that room is broadcast live Example, when a live streaming room creates, if the management equipment is distributed to the live streaming room, the management equipment by strategic server The audio and video mark in the live streaming room can be recorded, and during live streaming, the master in room will be broadcast live according to audio and video mark The audio, video data that terminal where broadcasting user uploads is sent to terminal where the spectators user in the live streaming room.
In practical application, different functional units may be used to realize the different function of management equipment, for example, one Management equipment may include flow control unit (Center) and one or more relay units (Access).Certainly, management equipment Institute is functional to be realized by a unit, and the present embodiment is not construed as limiting this.
Wherein, each management equipment can also provide the routing information for managing live streaming room, and the routing information is for referring to Local live streaming room can be forwarded to by the management equipment by the audio, video data of other live streaming room main broadcaster users by showing, with reality The audio and video interaction in existing different live streaming rooms.Wherein, which may include the address information of management equipment, when management is set When for including flow control unit and relay unit, the corresponding routing information in a live streaming room may include that the live streaming room corresponds to stream Control the address information of the address information and relay unit of unit.Wherein, the address information of flow control unit can be flow control unit IP address, the address information of relay unit can be the IP address of relay unit.
Wherein, flow control unit is used to manage the live information in one or more live streaming rooms, the live streaming in a live streaming room Information may include audio and video mark and the corresponding relay unit list in the live streaming room in the live streaming room etc..Wherein, one The relay unit list in a live streaming room be used to record the user identifier of main broadcaster user and spectators user in the live streaming room with And the address information of the relay unit of terminal access where terminal where main broadcaster user and spectators user.Wherein, the user of user Mark can be the user name of the user, registration phone number etc..Flow control unit can be also used between strategic server into The interaction of row signaling and message, for example, carrying out audio and video interacts the exit confirmation message for exiting request and audio and video interaction Interaction.In addition, flow control unit can be also used for regulating and controlling the network quality of user.
Wherein, a flow control unit can correspond to one or more relay units, and a relay unit can connect one Or multiple terminals.Terminal can be mobile terminal (such as mobile phone, tablet computer) or desktop computer etc..It needs to join in some user When the net cast in room is broadcast live with some, strategic server can be one relay unit of terminal distribution where the user, and will The relay unit is registered in flow control unit relay unit list corresponding with corresponding audio and video mark.Wherein, tactful Server can be according to relay unit of the geographical location near terminal distribution.Each relay unit can be used as terminal and flow control The bridge of unit, for transmitting signaling or message between terminal and flow control unit.Live streaming in one live streaming room is come It says, the audio, video data of main broadcaster user can be sent to corresponding to spectators user by the relay unit corresponding to main broadcaster user The audio, video data of main broadcaster user is forwarded to where spectators user eventually by relay unit by the relay unit corresponding to spectators user End.For the live streaming across room, it can also be led between the relay unit corresponding to difference live streaming room main broadcaster user The interaction of the audio, video data of broadcasting user.It that is to say, between the relay unit in the present embodiment corresponding to the same live streaming room Audio and video interaction can be carried out, audio and video interaction can also be carried out between the relay unit corresponding to difference live streaming room.For example, When the main broadcaster A of one live streaming room A and the main broadcaster B of another live streaming room B carry out audio and video interaction, the main broadcaster A of room A is broadcast live Corresponding relay unit is used to for the audio, video data of terminal where main broadcaster A to be sent to the transfer list corresponding to live streaming room B Member, and then the audio, video data of main broadcaster A is sent to main broadcaster B and live streaming room B by the relay unit corresponding to live streaming room B Spectators user where terminal.
In addition, video living transmission system further includes live information database, which provides live information Inquiry service, live information database are used to store the basic information in all online live streaming rooms in video living transmission system, the base Plinth information include be broadcast live room creation time, audio and video mark, manage the live streaming room flow control unit address information, with And the relay unit list in the live streaming room.For example, strategic server can be identified according to audio and video to live information database Inquiry flow control unit corresponding with audio and video mark and relay unit return to query result by the live information database.
In addition, can also include message elements and Signaling Access Unit in the video living transmission system, message elements are for managing Manage and forward the instant message, such as word, picture etc. interacted between each terminal.Terminal can by Signaling Access Unit with Message elements and strategic server interact.
It should be noted that Fig. 1 is only to exemplify with the framework of a management equipment, a management equipment can be erected at On one or more servers, multiple management equipments can also be set up on one server.Wherein, the stream of a management equipment Control unit and relay unit assume that on one server, can also be erected on multiple servers, and management equipment can be with For the entity device with corresponding function, or realize that the application program of corresponding function, the present embodiment do not limit this It is fixed.
Fig. 2 is a kind of flow chart of audio/video interaction method provided in an embodiment of the present invention, and referring to Fig. 2, the present invention is implemented Example provide method flow include：
201, when request is exited in the audio and video interaction that first-class control unit receives first terminal, believed according to first path Breath, determines the second flow control unit.
Wherein, second terminal is that the terminal of audio and video interaction is carried out with first terminal.The number of second terminal can be one It is a or multiple, correspondingly, the number for carrying out the live streaming room of audio and video interaction can be two or two with On, the embodiment of the present invention is not construed as limiting this.
Wherein, first path information is used to indicate forwards the sound of first terminal to regard by the second management equipment to second terminal Frequency evidence.For example, the audio, video data of first terminal is forwarded to second terminal by the second relay unit.The first path information It may include the address information of the address information and the second relay unit of the second flow control unit associated with second terminal.This Two relay units are and the second flow control unit and the corresponding relay unit of second terminal.
In embodiments of the present invention, first-class control unit receive first terminal audio and video interaction exit the process of request can Think：First terminal detects when exiting operation of user, is interacted to the first relay unit transmission audio and video and exits request, first Audio and video interaction is exited request and is forwarded to first-class control unit by relay unit, so that first-class control unit receives the Request is exited in the audio and video interaction of one terminal.
In the embodiment of the present invention, the user in difference live streaming room can carry out the interaction of audio, video data, and that is to say can The audio, video data of the user of the limit that is possessed of control power in different live streaming rooms to be interacted, the limit for example, this is possessed of control power User can be live streaming room main broadcaster user.Compared to the live streaming in live streaming room, the process of audio and video interaction can be with Regard as and carries out across room live streaming between different live streaming rooms.With the first live streaming room and the second live streaming two, room live streaming room For, which carries out audio and video interaction and refers to, by the audio and video number of the first main broadcaster user in the first live streaming room According to terminal where being sent to user associated by the second live streaming room；By the audio and video number of the second main broadcaster user in the second live streaming room According to terminal where being sent to user associated by the first live streaming room.User associated by room and the second live streaming room is broadcast live from first From the perspective of associated user, the audio, video data of the audio, video data of the first main broadcaster user and the second main broadcaster user will present In the same picture.Wherein, it includes the main broadcaster user and spectators user in the live streaming room that the user associated by room, which is broadcast live,.
It should be noted that described in the embodiment of the present invention audio and video interaction, in addition between different live streaming rooms to master Except the audio, video data of broadcasting user interacts, interactive audio, video data can also include the spectators user in live streaming room Audio, video data.For example, the audio, video data of interaction includes the first spectators user of the first main broadcaster user and the first live streaming room Audio, video data and the second main broadcaster user audio, video data.For another example, interactive audio, video data includes the first main broadcaster The audio, video data of the audio, video data of user and the second main broadcaster user and the second spectators user in the second live streaming room.Again For example, the audio, video data of interaction includes the audio, video data of the first main broadcaster user and the first spectators user, and, the second main broadcaster The audio, video data of user and the first spectators user.In embodiments of the present invention, it is the first master that room is broadcast live with first terminal Terminal where broadcasting user, second terminal are introduced for the main broadcaster user place terminal in room is broadcast live for second.
It should be noted that during first terminal and second terminal establish audio and video interaction, first-class control unit can To store the audio and video mark, the audio and video of second terminal mark, the user identifier of second terminal user and second of first terminal The correspondence of the routing information of terminal.First-class control unit can be determined by the correspondence and currently be carried out with first terminal The second terminal of audio and video interaction.In addition, since first-class control unit and the first relay unit are stored with the road of second terminal Diameter information, the second flow control unit and the second relay unit are stored with the routing information of first terminal, therefore, can pass through first Room and second is broadcast live in flow control unit, the first relay unit, the second flow control unit and the second relay unit where first terminal Live streaming room carries out data forwarding where terminal, for example, carrying out the forwarding of the audio, video data of audio and video interaction, or carries out sound The forwarding of video interactive signaling, for example exit the signaling of audio and video interaction (request is exited in such as audio and video interaction).
In embodiments of the present invention, first-class control unit determines that the second flow control unit can wrap according to first path information Include following two modes：
First way, first-class control unit exit the entrained audio and video of request according to audio and video interaction and interact mark, From stored routing information, determine that audio and video interaction identifies corresponding first path information；From first path information, carry Take the address information of the second management equipment.
The second way, first-class control unit exit the entrained audio and video of request according to audio and video interaction and interact mark, It determines and interacts the audio and video for identifying associated second terminal mark with audio and video；It is identified according to the audio and video of second terminal, from this In the stored routing information in ground, determine that the audio and video of second terminal know corresponding first path information, from first path information In, extract the address information of the second management equipment.Wherein, the audio and video mark of second terminal refers to that room is broadcast live belonging to second terminal Between audio and video mark.
It should be noted that being directed to above two mode, middle pitch video interactive of the embodiment of the present invention is exited in request and is carried Audio and video interaction mark, for audio and video interaction mark for uniquely determining an audio and video interaction, audio and video interaction mark can During audio and video are interacted and established, to be distributed by strategic server, be corresponded to by first-class control unit and the second flow control unit Audio and video interaction mark stores relevant routing information.For example, live streaming room carries out where main broadcaster user A and main broadcaster user B The audio and video interaction of audio and video interaction is identified as " 1001 ", and room progress audio and video are broadcast live where main broadcaster user A and main broadcaster user C Interactive audio and video interaction is identified as " 1002 ".It that is to say, in the present embodiment, a live streaming room can establish multiple sounds simultaneously Video interactive, and be the different audio and video interaction mark of different audio and video cross allocations.Certainly, main broadcaster user A, main broadcaster user Live streaming room where B and main broadcaster user C can establish an audio and video interaction, such as the audio and video interaction of distribution is identified as " 1003 ", main broadcaster user A, main broadcaster user B and main broadcaster user C can be seen simultaneously by participating in the user terminal of audio and video interaction at this time Video pictures.Wherein, since first-class control unit can manage multiple live streaming rooms, each live streaming room can be with other Audio and video interaction is established between live streaming room, therefore, first-class control unit can store multiple routing informations.
For above-mentioned first way, first-class control unit diaphone video interactive mark stores first path information, than Such as, when the live streaming room where first terminal and second terminal carries out audio and video interaction, audio and video interaction is identified as " 1000 ", First-class control unit can diaphone video interactive mark " 1000 " storage second terminal first path information, for example, management the The address information of the address information and the second relay unit of second flow control unit in live streaming room where two terminals.
For the above-mentioned second way, the audio and video of first-class control unit diaphone video interactive mark storage second terminal Mark, and the audio and video mark of the corresponding second terminal is stored with routing information, it should be corresponding with the audio and video of second terminal mark Routing information include with second terminal carry out audio and video interaction terminal routing information.
In embodiments of the present invention, in order to avoid malice reactive power optimization, it is ensured that the safety of audio and video interaction, first-class control The interaction of the audio and video of the first terminal can be exited request and be sent to strategic server by unit, eventually by strategic server pair first End carries out proof of identity, and process can be：The signature that first terminal is also carried in request is exited in the audio and video interaction of first terminal Information.Strategic server carries out authentication according to the signing messages to first terminal, for example, the signing messages can be by first Terminal is encrypted to obtain according to preset algorithm to the user identifier of first terminal, strategic server according to the preset algorithm The signing messages is decrypted in corresponding or identical algorithm, if successful decryption, it is determined that proof of identity success executes following Step 202 and subsequent step；Otherwise, it determines proof of identity fails, refusal first terminal exits current audio and video interaction, this reality The process flow for applying example terminates.
Below by taking first terminal initiates audio and video interaction as an example, to two live streamings corresponding to first terminal and second terminal The process that audio and video interaction is established between room is introduced, and may comprise steps of a to step j：
Step a：First terminal sends initial audio and video interaction request message to the first relay unit, and the first relay unit will The initial audio and video interaction request message received is sent to first-class control unit.
Wherein, initial audio and video interaction request message carries the use of the audio and video mark and second terminal user of second terminal Family identifies.When second terminal user is main broadcasting user, it can not also carry second terminal user's in initial joint request User identifier, but for each live streaming room, manage the live streaming room management equipment (such as flow control unit or in Turn unit) the audio and video mark indicated by the live streaming room and the corresponding pass between the user identifier of main broadcaster user can be recorded System, the user identifier of corresponding main broadcaster user is determined by management equipment according to audio and video mark.
Step b：First-class control unit added in the initial audio and video interaction request message first terminal routing information, The audio and video of first terminal identify and the user identifier of first terminal user, the audio and video interaction request for obtaining first terminal disappear Breath.
The routing information of the first terminal may include the ground of the address information and first-class control unit of the first relay unit Location information, the routing information of the first terminal is used to indicate can be whole to first by the first relay unit and first-class control unit End carries out data forwarding.
Step c：The audio and video interaction request message is sent to strategic server by first-class control unit.
Step d：Strategic server is identified according to the audio and video of the second terminal carried in the audio and video interaction request message, It determines the second flow control unit associated with second terminal, and the audio and video interaction request message is sent to the second flow control list Member.
Step e：Second flow control unit stores the audio and video mark of second terminal, the user identifier of second terminal user, the The audio and video mark of one terminal, the correspondence between the user identifier of first terminal user and the routing information of first terminal, And return to audio and video to strategic server and interact confirmation message, which interacts the path letter that confirmation message carries second terminal It ceases, the user identifier of the audio and video of second terminal mark and second terminal user.
Step f：The synchronizing information that second flow control unit carries the audio and video interaction request message to the second relay unit, And send audio and video interactive refreshing message to the second relay unit.
Step g：The audio and video interactive refreshing message is sent to the institute of the user associated by second terminal by the second relay unit In terminal, by the audio and video interaction request message informing of first terminal to the user in live streaming room where second terminal so that The audio and video of first terminal mark can be added to local sound and regarded by terminal where the user in live streaming room where second terminal In frequency interaction list, process is established in the audio and video interaction to complete second terminal side.
Step h：After step e, audio and video interaction confirmation message is sent to first-class control unit by strategic server.
Step i：First-class control unit stores the audio and video mark of first terminal, the user identifier of first terminal user, the The audio and video mark of two terminals, the correspondence between the user identifier of second terminal user and the routing information of second terminal, The audio and video are interacted into the synchronizing information entrained by confirmation message to the first relay unit, and sends sound to the first relay unit and regards Frequency interactive refreshing message.
Step j：The audio and video interactive refreshing message is sent to the institute of the user associated by first terminal by the first relay unit In terminal so that the audio and video of second terminal can be identified and are added to by terminal where the user in live streaming room where first terminal In local audio and video interaction list, process is established in the audio and video interaction to complete first terminal side.
202, first-class control unit removes first path information.
First-class control unit removes the first of second terminal after request is exited in the audio and video interaction for receiving first terminal Routing information is interacted with showing that first terminal is exited with the audio and video of second terminal.
In addition, in order to notify first terminal user to exit success in time, first-class control unit can also pass through the first transfer Unit exits success message to first terminal transmission, so that first terminal receives after this exits success message, prompt is exited Success.
203, first-class control unit notifies the first relay unit to remove the first path information of storage.
In the present embodiment, first-class control unit is also notified that the first relay unit removes the first path information of storage, example Such as, first-class control unit can be instructed to the first relay unit transmitting path erasing of information, be carried in routing information clearance order Audio and video interaction mark, so that the first relay unit determines the routing information for needing to remove.
204, the first relay unit removes the first path information of storage, and eventually to the user place associated by first terminal End sends audio and video interactive refreshing message, and terminal deletes the being locally broadcast live in list where user associated by first terminal The audio and video of two terminals identify.
First relay unit is removed first path corresponding with audio and video interaction mark and is believed from stored routing information Breath.After first relay unit removes first path information, subsequently just the audio, video data of first terminal will not be forwarded to again Second relay unit, that is to say, will not be forwarded to the audio, video data of first terminal with second eventually by the second relay unit Terminal where the associated user in end.For example, after request is exited in first terminal initiation audio and video interaction, the first relay unit is also The audio, video data that the second terminal of the second relay unit forwarding may be received, at this point, the first relay unit can detect The local routing information for whether being stored with second terminal, if local be not stored with the first path information, abandon this second The audio, video data of terminal, to ensure that the user in first terminal place live streaming room no longer receives the audio and video number of second terminal According to, it is ensured that exit the correctness of flow.
Wherein, which is used to indicate first terminal and has exited and the friendship of the audio and video of second terminal Mutually, the audio and video that audio and video interaction mark and second terminal can be carried in the audio and video interactive refreshing message identify, by first Terminal where user associated by terminal is identified according to the audio and video of audio and video interaction mark and second terminal, from local straight Broadcast the audio and video mark that second terminal is deleted in list.Wherein, the user associated by first terminal refers to straight belonging to first terminal The associated user of the audio and video mark in room is broadcast, that is to say all users in live streaming room belonging to first terminal.
It should be noted that in the present embodiment, for participating in either one or two of audio and video interaction live streaming room, the live streaming room Terminal where associated user can all be agreed to participate in audio and video interaction, naturally it is also possible to which refusal participates in audio and video interaction. Therefore, the process of terminal transmission audio and video interactive refreshing message can where the first relay unit to the user associated by first terminal To include following two situations：
The first situation, the user place terminal in acquiescence live streaming room are agreed to participate in audio and video interaction.
In the case of this kind, the first relay unit determines and the first user associated by first terminal；Where to the first user Terminal sends audio and video interactive refreshing message.
There is the user place terminal that refusal participates in audio and video interaction in the second situation.
In the case of this kind, the first relay unit determines and the first user associated by first terminal；By in the first user not User with specified label is determined as second user；Terminal sends audio and video interactive refreshing message where to second user, refers to Calibration label, which are used to indicate user, to be refused to participate in the audio and video interaction of second terminal.
It should be noted that during establishing audio and video interaction, when first terminal initiates audio and video to second terminal When interaction request, if first terminal user is main broadcasting user, then the spectators user in live streaming room can be with where first terminal Selection participates in audio and video interaction, can also refuse to participate in audio and video interaction.It is asked for example, first terminal initiates audio and video interaction When asking, audio and video can be sent to spectators user by the first relay unit and interact access request, for appointing in the first user One user can send refusal to the first relay unit by local terminal and connect if the user refuses to participate in audio and video interaction Enter message.If the refusal access message of terminal where the first relay unit receives the user, specified for user addition Label, so that during carrying out audio and video interaction with second terminal, the first relay unit is only to terminal hair where the user The audio, video data for sending first terminal, without terminal where the audio, video data of second terminal is sent to the user.This In the case of, terminal where the user only shows the audio, video data of first terminal, that is to say and only shows that the main broadcaster of first terminal uses The video pictures at family.Wherein, specified label can be pre-configured with by strategic server to the second relay unit or the second flow control list Member, the present embodiment are not construed as limiting this.
It should be noted that in audio and video interactive process, the local live streaming list of user terminal is in addition to storing currently just Other than the audio and video mark in room where the main broadcaster user in live streaming, the user identifier of main broadcaster user can also be stored, deletion is worked as Also the user identifier of corresponding main broadcaster user can be deleted while the audio and video mark in one live streaming room.
205, first-class control unit sends audio and video interaction to the second flow control unit and exits request.
First-class control unit exits request according to the address information of the second flow control unit, by audio and video interaction and is sent to the Two flow control units.
Above-mentioned steps 201 to step 205 be the first management equipment receive first terminal audio and video interaction exit request When, according to first path information, determine the second management equipment, and remove first path information, and send out to the second management equipment The process for sending audio and video interaction to exit request.It should be noted that above-mentioned steps 203 and step 205 are asynchronous execution, this hair Bright embodiment is not construed as limiting the execution sequence of the two.
206, when request is exited in the audio and video interaction that the second flow control unit receives first terminal, determining and first terminal Carry out the second terminal of audio and video interaction.
Second flow control unit determines that the process for the second terminal for carrying out audio and video interaction with first terminal can be：According to sound Video interactive exits the entrained audio and video interaction mark of request, determines that audio and video interaction identifies corresponding multiple audio and video marks Know；In multiple audio and video mark, the corresponding terminal of the audio and video for belonging to the second flow control Single Component Management mark is determined as Second terminal.
Wherein, the audio and video mark in one or more live streaming rooms of the second flow control Single Component Management is known as in the present embodiment Belong to the audio and video mark of the second flow control Single Component Management.In implementation process, the second flow control unit can be by determining multiple sounds Video identifier is compared with the audio and video of local management mark, the audio and video mark during multiple audio and video are identified with local management Know consistent audio and video mark, is determined as the audio and video mark corresponding to second terminal.
For example, when carrying out audio and video between main broadcaster user A, main broadcaster user B and the corresponding three live streaming rooms main broadcaster user C When interaction, audio and video interaction is identified as " 1003 ", and first-class control unit is used to manage the live streaming room where main broadcaster user A, pipe The flow control unit in the live streaming room where reason main broadcaster user B and main broadcaster user C is referred to as the second flow control unit.For managing main broadcaster Second flow control unit in live streaming room where user B, corresponding audio and video interaction mark " 1003 " are stored with main broadcaster user A, master The audio and video mark in live streaming room where broadcasting user B and main broadcaster user C.For example, the second flow control Single Component Management have main broadcaster user B and Room is broadcast live where main broadcaster user D, then by comparing it is found that the audio and video mark in live streaming room where main broadcaster user B is Audio and video mark corresponding to second terminal, the audio and video mark corresponding to second terminal can determine that second terminal is closed The user of connection.
207, the second flow control unit removes the second routing information of storage.
Wherein, the second routing information is used to indicate forwards the sound of second terminal to regard by the first management equipment to first terminal Frequency evidence, that is to say, whole by the corresponding user terminal forwarding second in live streaming room where the first relay unit to first terminal The audio, video data at end.Second routing information may include the address information of first-class control unit associated with first terminal With the address information of the first relay unit.First relay unit is and first-class control unit and the corresponding transfer of first terminal Unit.
In the embodiment of the present invention, the second flow control unit may be used following two modes and determine the second routing information：
First way, the second flow control unit exit the entrained audio and video of request according to audio and video interaction and interact mark, From stored routing information, the second routing information is determined.
For the first way, the second flow control unit diaphone video interactive mark stores the second routing information, for example, When the live streaming room where first terminal and second terminal carries out audio and video interaction, audio and video interaction is identified as " 1000 ", the Two flow control units meeting diaphone video interactive mark " 1000 " is stored with one or more routing informations, wherein with first terminal pair The routing information answered is the second routing information, for example, second routing information can be live streaming room where management first terminal First-class control unit address information and the first relay unit address information.
The second way, the second flow control unit according to audio and video interaction exit the entrained audio and video interaction mark of request and The audio and video of first terminal identify, and from locally stored routing information, determine the second routing information.
For the second way, the second flow control unit diaphone video interactive mark is stored with one or more audio and video Mark, and corresponding audio and video mark is stored with routing information, wherein path letter corresponding with the audio and video of first terminal mark Breath is the second routing information.
It should be noted that in step 201, the audio and video interaction of first terminal, which is exited request and can also be had, exits class Type, it includes unidirectional exit and the formula of dismissing exits that this, which exits type,.Wherein, it unidirectionally exits to be used to indicate only first terminal and exit and work as Preceding audio and video interaction, dismission formula, which exits to be used to indicate, terminates current audio and video interaction.For example, current, there are three main broadcaster user (masters Broadcasting user A, main broadcaster user B and main broadcaster user C) audio and video interaction is being carried out, main broadcaster user A initiates unidirectionally to exit audio and video friendship Mutually, then main broadcaster user B and main broadcaster user C still can keep audio and video to interact.The user in live streaming room is whole where main broadcaster user A From the point of view of end, by the video pictures of the three main broadcaster users shown originally on user terminal, become what main broadcaster user A was individually broadcast live Video pictures；Or the video pictures of three by showing originally main broadcasters, directly become that end picture is broadcast live.From main broadcaster user B Place is broadcast live where room and main broadcaster user C is broadcast live from the point of view of the user terminal in room, three shown by round face on user terminal The video pictures of main broadcaster, become only there are two main broadcaster user's audio and video interaction video pictures.
Correspondingly, when audio and video interaction exits request with type is exited, in the step 204, the second flow control unit exists The audio and video interaction of first terminal is received when exiting request, it is thus necessary to determine that request was exited in audio and video interaction exits type. It is exited in audio and video interaction and specific field may be used in request indicates to exit type, which can be communication protocol In reservation resource, or be the extended field etc. of communication protocol, the embodiment of the present invention is not construed as limiting this.
Wherein, can be divided into for the different processes for exiting the second flow control unit of type the second routing information of removing as follows Two kinds of situations：
The type that exits that the first situation, audio and video interaction exit request is unidirectionally to exit.
If the second flow control unit determines that the type that exits that request is exited in audio and video interaction is when unidirectionally exiting, according to this Audio and video interaction exits the entrained audio and video interaction mark of request and determines that audio and video interact from stored routing information Identify corresponding routing information group；Routing information corresponding with first terminal in the routing information group is determined as second path Information；Remove second routing information, based on the routing information in the routing information group in addition to the second routing information continue into Row audio and video interact.
For example, three live streaming rooms corresponding to main broadcaster user A, main broadcaster user B and main broadcaster user C carry out audio and video friendship Mutually, audio and video interaction is identified as " 1003 ".The flow control unit in live streaming room can correspond to audio and video friendship where management main broadcaster user B The mutually associated routing informations of mark " 1003 " storage main broadcaster user A and the associated routing informations of main broadcaster user C, if main broadcaster user A initiations are unidirectionally exited, then audio and video can only be interacted the corresponding main broadcaster of mark " 1003 " and used by the corresponding flow control units of main broadcaster user B A associated routing informations in family are removed, and the associated routing informations of main broadcaster user C are retained.Correspondingly, the stream corresponding to main broadcaster user C Audio and video can be interacted the associated routing information removings of the corresponding main broadcaster user A of mark " 1003 " by controlling unit also, retained main broadcaster and used The associated routing informations of family B.It that is to say, main broadcaster user B and the live streaming room where main broadcaster user C continue to carry out audio and video Interaction.
The type that exits that the second situation, audio and video interaction exit request is that dismission formula exits.
If the second flow control unit determines that the type that exits that request is exited in audio and video interaction is that dismission formula exits, regarded according to sound The entrained audio and video interaction mark of request is exited in frequency interaction, will be corresponding with audio and video interaction mark in stored routing information Routing information group in all routing informations be determined as the second routing information；The second routing information is removed, is regarded to terminate the sound The indicated audio and video interaction of frequency interaction mark.
Still by taking the audio and video interaction context of the first situation as an example, if what main broadcaster user A initiated is that the sound of dismission formula regards Request is exited in frequency interaction, and the corresponding flow control units of main broadcaster user B can will be interacted with audio and video identify " 1003 " corresponding all roads Diameter information (the associated routing informations of main broadcaster user A and the associated path new informations of main broadcaster user C) is all removed.Correspondingly, main The corresponding flow control units of broadcasting user C can will interact the corresponding all routing informations of mark " 1003 " with audio and video, and (main broadcaster user A is closed The associated path new information of routing information and main broadcaster user B of connection) all remove.That is to say, main broadcaster user A, main broadcaster user B and Live streaming room where main broadcaster user C all exits current audio and video interaction.After exiting, each be broadcast live inside room can continue The live streaming in a live streaming room is carried out, the live streaming being broadcast live in room can also be terminated, the present embodiment is not construed as limiting this.Its In, current audio and video interaction refers to the indicated audio and video interaction of audio and video mark.
It should be noted that when due to only carrying out audio and video interaction there are two live streaming room, a live streaming room is whether The unidirectional still dismission formula that exits exits, another live streaming room will also exit current audio and video interaction.Therefore, in a kind of implementation It, can be only to main broadcaster's user terminal in each live streaming room when only carrying out audio and video interaction there are two live streaming room in mode A kind of exit function is provided, for example, only having one kind exiting option in audio and video interactive interface, so that either party can only send out It plays one kind and exiting request, which, which exits request and be used to indicate, terminates current audio and video interaction.In another embodiment, when When only carrying out audio and video interaction there are two live streaming room, audio and video interaction one can also be carried out as more than two live streaming rooms Sample unidirectionally exits to main broadcaster's user terminal offer in each live streaming room and the formula of dismissing exits, two kinds of exit functions.And it receives The flow control unit that request is exited in audio and video interaction detects that the number of audio and video mark corresponding with audio and video interaction mark is 2 When, namely determine that only there are two when the progress audio and video interaction of live streaming room, determine that audio and video interaction is exited request instruction and terminated Audio and video interaction identifies corresponding audio and video interaction.
In addition, after the second flow control unit removes the second routing information, it can be fed back to first-class control unit and exit success Message, by first-class control unit by the first relay unit be sent to terminal where user associated by first terminal, to carry Live streaming room has learned that first terminal has exited current sound and regarded where showing the user terminal second terminal associated by first terminal Frequency interaction.
208, the second flow control unit notifies the second relay unit to remove the second routing information of storage.
In the present embodiment, the second flow control unit is also notified that the second relay unit removes the second routing information of storage, example Such as, the second flow control unit can be instructed to the second relay unit transmitting path erasing of information, be carried in routing information clearance order The audio and video of audio and video interaction mark and second terminal identify, so that the second relay unit determines the path letter for needing to remove Breath.
209, the second relay unit removes the second routing information of storage, to terminal where the user associated by second terminal Audio and video interactive refreshing message is sent, terminal deletes first in locally live streaming list where the user associated by second terminal The audio and video of terminal identify.
Second relay unit will interact the audio and video of mark and second terminal from stored routing information with audio and video It identifies corresponding routing information and is determined as the second routing information, and remove second routing information.Second relay unit removes the After two routing informations, subsequently just will not the audio, video data of second terminal be forwarded to the first relay unit again, that is to say, no Can by the audio, video data of second terminal by the first relay unit be forwarded to terminal where user associated by first terminal, For example, when the second relay unit receives the audio, video data of second terminal, whether detection is local is stored with first terminal Second routing information is refused to turn to the first relay unit if local the second routing information for not being stored with first terminal Send out the audio, video data of the second terminal.
Wherein, the audio and video interactive refreshing message is for prompting first terminal to have logged out current audio and video interaction.The sound The audio and video that audio and video interaction mark and first terminal can be carried in video interactive new information identify.Wherein, first terminal Audio and video mark refer to live streaming room belonging to first terminal audio and video mark.Where the user associated by second terminal eventually End is identified according to the audio and video of audio and video interaction mark and first terminal, and first terminal is deleted from local be broadcast live in list Audio and video identify.In order to distinguish the audio and video interactive refreshing message of step 204 and the step 209, the audio and video in step 204 are handed over Mutual new information is properly termed as the first audio and video interactive refreshing message, and the audio and video interactive refreshing message of step 209 is properly termed as Second audio and video interactive refreshing message.
It should be noted that in the present embodiment, for participating in either one or two of audio and video interaction live streaming room, the live streaming room Terminal where associated user can all be agreed to participate in audio and video interaction, naturally it is also possible to which refusal participates in audio and video interaction. Therefore, the process of terminal transmission audio and video interactive refreshing message can where the second relay unit to the user associated by second terminal To include following two situations：
The first situation, the user place terminal in acquiescence live streaming room are agreed to participate in audio and video interaction.
In the case of this kind, the second relay unit determines and the first user associated by second terminal；Where to the first user Terminal sends audio and video interactive refreshing message.
There is the user place terminal that refusal participates in audio and video interaction in the second situation.
In the case of this kind, the second relay unit determines and the first user associated by second terminal；By in the first user not User with specified label is determined as second user；Terminal sends audio and video interactive refreshing message where to second user, refers to Calibration label, which are used to indicate user, to be refused to participate in the audio and video interaction of second terminal.
It should be noted that during establishing audio and video interaction, when first terminal initiates audio and video to second terminal When interaction request, if second terminal user is main broadcasting user, then the spectators user in live streaming room can be with where second terminal Selection participates in audio and video interaction, can also refuse to participate in audio and video interaction.For example, after step g, for the first user In any user, if the user refuse participate in audio and video interaction, can be sent to the second relay unit by local terminal Refuse new information.If the refusal new information of terminal, adds for the user where the second relay unit receives the user Add specified label, so that during carrying out audio and video interaction with first terminal, the second relay unit is only to user place Terminal sends the audio, video data of second terminal, without terminal where the audio, video data of first terminal is sent to the user. In this case, terminal where the user only shows the audio, video data of second terminal, that is to say and only shows second terminal The video pictures of main broadcaster user.Wherein, specified label can be pre-configured with by strategic server to the second relay unit or second Flow control unit, the present embodiment are not construed as limiting this.
Above-mentioned steps 206 to step 209 be the second management equipment receive first terminal audio and video interaction exit request When, determine the second terminal that audio and video interaction is carried out with first terminal, and remove the second routing information of first terminal, and to Terminal sends the process of audio and video interactive refreshing message where user associated by second terminal.In order to preferably to above-mentioned steps 201 interact the process that exits to audio and video shown in step 209, and Fig. 3 gives the signaling that flow is exited in a kind of audio and video interaction Interaction schematic diagram.
It is emphasized that in the embodiment that above-mentioned Fig. 2 is provided, the number of second terminal can be one or more, It, can be to each second terminal institute for the first management equipment corresponding to first terminal when the number of second terminal is multiple Corresponding second management equipment sends audio and video interaction and exits request, that is to say and is performed both by step for each the second management equipment Rapid 205, for each the second management equipment, step 206 can be executed to step 209 to complete to exit flow accordingly.Its In, when audio and video interaction exit request for unidirectional exit when, multiple second management equipments after completing to exit flow accordingly, It still will continue to keep audio and video interaction between corresponding multiple second terminals；When it is that dismission formula exits to exit request, Duo Ge Two management equipments also no longer carry out the interaction of audio and video after completing to exit flow accordingly between multiple second terminals.
Method provided in an embodiment of the present invention, the first management equipment are exited in the audio and video interaction for receiving first terminal and are asked When asking, can according to the routing information of storage, determine with associated second management equipment of second terminal, and to the second management equipment It sends audio and video interaction and exits request so that first terminal can be had logged out current audio and video interaction by the second management equipment It notifies to second terminal.Moreover, the first management equipment can remove the first path information of second terminal in time so that the first pipe The audio, video data of first terminal will not be subsequently transmitted to second terminal by reason equipment, will not be by the audio and video number of second terminal According to first terminal is transmitted to, so that each live streaming room for participating in audio and video interaction can be smoothly completed and be exited accordingly Flow.
Fig. 4 is a kind of block diagram of audio and video interactive device provided in an embodiment of the present invention.With reference to Fig. 4, which includes the One determining module 401 removes module 402 and the first sending module 403.
Wherein, the first determining module 401, for when receive first terminal audio and video interact exit request when, according to First path information determines the second management equipment, which is used to indicate through second management equipment to second Terminal forwards the audio, video data of the first terminal, which is that the terminal of audio and video interaction is carried out with the first terminal； Module 402 is removed, for removing the first path information, so that first management equipment subsequently stops setting to second management The standby audio, video data for forwarding the first terminal；First sending module 403, for sending the audio and video to second management equipment Request is exited in interaction, and request is exited in audio and video interaction by second management equipment is forwarded to the second terminal, should with prompt First terminal has logged out current audio and video interaction.
In one possible implementation, which is used for：
The entrained audio and video of request, which are exited, according to audio and video interaction interacts mark, from stored routing information, Determine that audio and video interaction identifies the corresponding first path information；
From the first path information, the address information of second management equipment is extracted.
In one possible implementation, which is used for：
The entrained audio and video of request are exited according to audio and video interaction and interact mark, are determined and are interacted mark with the audio and video The associated second terminal；
From stored routing information, the corresponding first path information of the second terminal is determined；
From the first path information, the address information of second management equipment is extracted.
In one possible implementation, the type that exits that request is exited in audio and video interaction includes unidirectionally exiting reconciliation Scattered formula exits, this, which is unidirectionally exited, is used to indicate the only first terminal and exits the interaction of current audio and video, which, which exits, is used for Instruction terminates current audio and video interaction.
In one possible implementation, which further includes：
Second determining module, for determining and the first user associated by the first terminal；Where to first user eventually End sends audio and video interactive refreshing message, and the audio and video interactive refreshing message is current for prompting the first terminal to have logged out Audio and video interact；Or,
Third determining module, for determining and the first user associated by the first terminal；To not have in first user There is the user of specified label to be determined as second user；Terminal where to the second user sends the audio and video interactive refreshing message, The specified label, which is used to indicate user, to be refused to participate in the audio and video interaction of the second terminal.
In one possible implementation, which further includes：
Detection module, if the audio, video data for receiving the second terminal from second management equipment, detection is originally Whether ground is stored with the first path information of the second terminal；
Second sending module, if not being stored with the first path information for local, the sound for abandoning the second terminal regards Frequency evidence.
In one possible implementation, which further includes：
Third sending module, the audio and video interaction request message for sending the first terminal to strategic server, by this Strategic server determines second management equipment, and the audio and video interaction request message is sent to second management equipment, by Second management equipment returns to the first path information；
Wherein, which carries the second routing information, which, which is used to indicate, passes through First management equipment carries out the forwarding of audio, video data to the first terminal.
Device provided in an embodiment of the present invention, the first management equipment are exited in the audio and video interaction for receiving first terminal and are asked When asking, can according to the routing information of storage, determine with associated second management equipment of second terminal, and to the second management equipment It sends audio and video interaction and exits request so that first terminal can be had logged out current audio and video interaction by the second management equipment It notifies to second terminal.Moreover, the first management equipment can remove the first path information of second terminal in time so that the first pipe The audio, video data of first terminal will not be subsequently transmitted to second terminal by reason equipment, will not be by the audio and video number of second terminal According to first terminal is transmitted to, so that each live streaming room for participating in audio and video interaction can be smoothly completed and be exited accordingly Flow.
Fig. 5 is a kind of block diagram of audio and video interactive device provided in an embodiment of the present invention.With reference to Fig. 5, which includes true Cover half block 501 removes module 502 and the first sending module 503.
Determining module, for when received from the first management equipment first terminal audio and video interact exit request when, really The fixed and first terminal carries out the second terminal of audio and video interaction；
Remove module, for removes store the second routing information, second routing information be used to indicate by this first Management equipment forwards the audio, video data of the second terminal to the first terminal；
First sending module disappears for sending audio and video interactive refreshing to terminal where the user associated by the second terminal Breath, the audio and video interactive refreshing message is for prompting the first terminal to have logged out current audio and video interaction.
In one possible implementation, the determining module 501, is used for：
The entrained audio and video of request are exited according to audio and video interaction and interact mark, determine audio and video interaction mark pair The multiple audio and video mark answered；
In multiple audio and video mark, by the audio and video mark for belonging to the second management equipment management corresponding end End is determined as the second terminal.
In one possible implementation, which is used for：
Determine that audio and video interaction exited request exits type, it includes unidirectional exit and the formula of dismissing exits to exit type；
If the type that exits that request is exited in audio and video interaction is unidirectionally to exit, request is exited according to audio and video interaction Entrained audio and video interaction mark determines that audio and video interaction identifies corresponding path letter from stored routing information Breath group；
Routing information corresponding with the first terminal in the routing information group is determined as second routing information；
Remove second routing information, based on the routing information in routing information group in addition to the second routing information continue into Row audio and video interact.
In one possible implementation, which is characterized in that the removing module 502 is used for：
If the type that exits that request is exited in audio and video interaction is that dismission formula exits, is exited and asked according to audio and video interaction Entrained audio and video are asked to interact mark, by routing information corresponding with audio and video interaction mark in stored routing information All routing informations are determined as second routing information in group；
Second routing information is removed, is interacted with terminating the indicated audio and video of the audio and video interaction mark.
In one possible implementation, which further includes：
Detection module, for when receiving the audio, video data of the second terminal, detection is local whether be stored with this Two routing informations；
If second sending module is refused to forward to first management equipment for not being stored with second routing information The audio, video data of the second terminal.
In one possible implementation, which further includes：
Third sending module, for when the audio and video interaction request message for receiving the first terminal from strategic server When, send audio and video interactive refreshing message, audio and video interaction to terminal where the first user associated by the second terminal New information is used to indicate the second terminal and carries out audio and video interaction with the first terminal；
Add module, for for any user in first user, disappearing if the refusal for receiving the user updates Breath adds for the user and specifies label, which, which is used to indicate user, refuses to participate in the audio and video interaction of the first terminal；
4th sending module, for during being interacted with the first terminal audio and video, label to be specified to this Terminal where user sends the audio, video data of the second terminal.
Device provided in an embodiment of the present invention, the first management equipment are exited in the audio and video interaction for receiving first terminal and are asked When asking, can according to the routing information of storage, determine with associated second management equipment of second terminal, and to the second management equipment It sends audio and video interaction and exits request so that first terminal can be had logged out current audio and video interaction by the second management equipment It notifies to second terminal.Moreover, the first management equipment can remove the first path information of second terminal in time so that the first pipe The audio, video data of first terminal will not be subsequently transmitted to second terminal by reason equipment, will not be by the audio and video number of second terminal According to first terminal is transmitted to, so that each live streaming room for participating in audio and video interaction can be smoothly completed and be exited accordingly Flow.
It should be noted that：The audio and video interactive device that above-described embodiment provides is in live video, only with above-mentioned each work( Can module division progress for example, in practical application, can be as needed and by above-mentioned function distribution by different functions Module is completed, i.e., the internal structure of equipment is divided into different function modules, described above all or part of to complete Function.In addition, the audio and video interactive device that above-described embodiment provides belongs to same design with audio/video interaction method embodiment, Specific implementation process refers to embodiment of the method, and which is not described herein again.
The present embodiment additionally provides a kind of video living transmission system, which includes that the first management equipment and the second management are set It is standby,
First management equipment, for when receive first terminal audio and video interact exit request when, according to first path Information determines the second management equipment, which, which is used to indicate, is forwarded by second management equipment to second terminal The audio, video data of the first terminal, the second terminal are that the terminal of audio and video interaction is carried out with the first terminal；
First management equipment is additionally operable to remove the first path information, so that first management equipment subsequently stops The audio, video data of the first terminal is forwarded to second management equipment；
First management equipment, be additionally operable to second management equipment send the audio and video interaction exit request；
Second management equipment determines second terminal when exiting request for receiving audio and video interaction；
Second management equipment is additionally operable to remove the second routing information of storage, which is used to indicate logical Cross the audio, video data that first management equipment forwards the second terminal to the first terminal；
Second management equipment is additionally operable to terminal where to the user associated by the second terminal and sends audio and video interaction more New information, the audio and video interactive refreshing message is for prompting the first terminal to have logged out current audio and video interaction.
Fig. 6 is a kind of block diagram of audio and video interactive device provided in an embodiment of the present invention.For example, device 600 can be carried For for a server.With reference to Fig. 6, device 600 includes processing component 622, further comprises one or more processors, and It, can be by the instruction of the execution of processing component 622, such as using journey for storing by the memory resource representated by memory 632 Sequence.The application program stored in memory 632 may include it is one or more each correspond to one group of instruction mould Block.In addition, processing component 622 is configured as executing instruction, to execute policy service in above-mentioned audio/video interaction method embodiment Method performed by device, the first management equipment and the second management equipment.
Device 600 can also include the power management that a power supply module 626 is configured as executive device 600, and one has Line or radio network interface 650 are configured as device 600 being connected to network and input and output (I/O) interface 658.Dress Setting 600 can operate based on the operating system for being stored in memory 632, such as Windows ServerTM, Mac OS XTM, UnixTM,LinuxTM, FreeBSDTMOr it is similar.
In the exemplary embodiment, it includes the non-transitorycomputer readable storage medium instructed, example to additionally provide a kind of Such as include the memory of instruction, above-metioned instruction can be executed by the processor in server to complete the audio and video in above-described embodiment Exchange method.For example, the non-transitorycomputer readable storage medium can be ROM, random access memory (RAM), CD- ROM, tape, floppy disk and optical data storage devices etc..
One of ordinary skill in the art will appreciate that realizing that all or part of step of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can be stored in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all the present invention spirit and Within principle, any modification, equivalent replacement, improvement and so on should all be included in the protection scope of the present invention.

Claims (15)

1. a kind of audio/video interaction method, which is characterized in that it is applied to the first management equipment, the method includes：
When the audio and video for receiving first terminal, which interact, exits request, according to first path information, the second management equipment is determined, The first path information is used to indicate forwards the sound of the first terminal to regard by second management equipment to second terminal Frequency evidence, the second terminal are that the terminal of audio and video interaction is carried out with the first terminal；
The first path information is removed, so that first management equipment subsequently stops forwarding to second management equipment The audio, video data of the first terminal；
The audio and video interaction is sent to second management equipment and exits request, is regarded the sound by second management equipment Frequency interaction exits request and is forwarded to the second terminal, is interacted with prompting the first terminal to have logged out current audio and video.
2. according to the method described in claim 1, it is characterized in that, when request is exited in the audio and video interaction for receiving first terminal When, according to first path information, determine the second management equipment, including：
The entrained audio and video of request are exited according to audio and video interaction and interact mark, from stored routing information, really The fixed audio and video interaction identifies the corresponding first path information；From the first path information, extraction described second The address information of management equipment；Or,
The entrained audio and video of request are exited according to audio and video interaction and interact mark, are determined and are interacted mark with the audio and video The audio and video of the associated second terminal identify；It is identified according to the audio and video of the second terminal, is believed from stored path In breath, determine that the audio and video of the second terminal identify corresponding first path information；From the first path information, extraction The address information of second management equipment.
3. according to the method described in claim 1, it is characterized in that, the type that exits that request is exited in audio and video interaction includes It is unidirectional to exit and the formula of dismissing exits, it is described it is unidirectional exit to be used to indicate the only described first terminal and exit current audio and video interact, The dismission formula, which exits to be used to indicate, terminates current audio and video interaction.
4. according to the method described in claim 1, it is characterized in that, the method further includes：
It determines and the first user associated by the first terminal；Terminal where to first user sends audio and video interaction more New information, the audio and video interactive refreshing message are used to prompt the first terminal to have logged out current audio and video interaction；Or,
It determines and the first user associated by the first terminal；The user for not having specified label in first user is true It is set to second user；Terminal where to the second user sends the audio and video interactive refreshing message, and the specified label is used The audio and video for refusing to participate in the second terminal in instruction user interact.
5. according to the method described in claim 1, it is characterized in that, described send described first eventually to second management equipment The audio and video interaction at end is exited after request, and the method further includes：
If receiving the audio, video data of the second terminal from second management equipment, whether detection is local stores State the first path information of second terminal；
If local be not stored with the first path information, the audio, video data of the second terminal is abandoned.
6. according to the method described in claim 1, it is characterized in that, the method further includes：
The audio and video interaction request message that the first terminal is sent to strategic server, determined by the strategic server described in Second management equipment, and the audio and video interaction request message is sent to second management equipment, it is managed by described second Equipment returns to the first path information；
Wherein, the audio and video interaction request message carries the second routing information of the first terminal, the first terminal Second routing information is used to indicate the forwarding for carrying out audio, video data to the first terminal by first management equipment.
7. a kind of audio/video interaction method, which is characterized in that it is applied to the second management equipment, the method includes：
When received from the first management equipment first terminal audio and video interact exit request when, determine with the first terminal into The second terminal of row audio and video interaction；
The second routing information of storage is removed, second routing information is used to indicate through first management equipment to described First terminal forwards the audio, video data of the second terminal；
Audio and video interactive refreshing message is sent to terminal where the user associated by the second terminal, the audio and video interaction is more New information is for prompting the first terminal to have logged out current audio and video interaction.
8. the method according to the description of claim 7 is characterized in that when the sound for receiving first terminal from the first management equipment regards When request is exited in frequency interaction, the second terminal that audio and video interaction is carried out with the first terminal is determined, including：
The entrained audio and video of request are exited according to audio and video interaction and interact mark, determine the audio and video interaction mark pair The multiple audio and video mark answered；
In the multiple audio and video mark, by the audio and video mark for belonging to the second management equipment management corresponding end End is determined as the second terminal.
9. the method according to the description of claim 7 is characterized in that it is described remove storage the second routing information, including：
Determine that audio and video interaction exited request exits type, it includes unidirectional exit and the formula of dismissing exits to exit type；
If the type that exits that request is exited in the audio and video interaction is unidirectionally to exit, request is exited according to audio and video interaction Entrained audio and video interaction mark determines that the audio and video interaction identifies corresponding path from stored routing information Information group；Routing information corresponding with the first terminal in the routing information group is determined as second routing information； Second routing information is removed, is continued based on the routing information in the routing information group in addition to second routing information Carry out audio and video interaction；
If the type that exits that request is exited in the audio and video interaction is that dismission formula exits, is exited and asked according to audio and video interaction It asks entrained audio and video to interact mark, path corresponding with audio and video interaction mark in stored routing information is believed All routing informations are determined as second routing information in breath group；Second routing information is removed, is regarded with terminating the sound The indicated audio and video interaction of frequency interaction mark.
10. the method according to the description of claim 7 is characterized in that the method further includes：
When receiving the audio and video interaction request message of the first terminal from strategic server, to the second terminal institute Terminal sends audio and video interactive refreshing message where associated first user, and the audio and video interactive refreshing message is used to indicate institute It states second terminal and carries out audio and video interaction with the first terminal；
It is the user if receiving the refusal new information of the user for any user in first user Label is specified in addition, and the specified label, which is used to indicate user, to be refused to participate in the audio and video interaction of the first terminal；
During being interacted with the first terminal audio and video, institute is sent to terminal where the user with the specified label State the audio, video data of second terminal.
11. a kind of audio/video interaction method, which is characterized in that the method includes：
When request is exited in the audio and video interaction that the first management equipment receives first terminal, according to first path information, determine Second management equipment, the first path information is used to indicate forwards described the by second management equipment to second terminal The audio, video data of one terminal, the second terminal are that the terminal of audio and video interaction is carried out with the first terminal；
First management equipment removes the first path information, so that first management equipment subsequently stops to described Second management equipment forwards the audio, video data of the first terminal；
First management equipment sends the audio and video interaction to second management equipment and exits request；
When second management equipment receives audio and video interaction and exits request, the second terminal is determined；
Second management equipment removes the second routing information of storage, and second routing information is used to indicate by described the One management equipment forwards the audio, video data of the second terminal to the first terminal；
Terminal sends audio and video interactive refreshing message where second management equipment to the user associated by the second terminal, The audio and video interactive refreshing message is for prompting the first terminal to have logged out current audio and video interaction.
12. a kind of audio and video interactive device, which is characterized in that be applied to the first management equipment, described device includes：
First determining module, for when the audio and video for receiving first terminal interact and exit request, according to first path information, Determine the second management equipment, the first path information is used to indicate forwards institute by second management equipment to second terminal The audio, video data of first terminal is stated, the second terminal is that the terminal of audio and video interaction is carried out with the first terminal；
Module is removed, for removing the first path information, so that first management equipment subsequently stops to described the Two management equipments forward the audio, video data of the first terminal；
First sending module exits request, by described second for sending the audio and video interaction to second management equipment Audio and video interaction is exited request and is forwarded to the second terminal by management equipment, to prompt the first terminal to have logged out Current audio and video interaction.
13. device according to claim 12, which is characterized in that request was exited in audio and video interaction exits type packet Include it is unidirectional exit and the formula of dismissing exits, unidirectional exit is used to indicate the only described first terminal and exits current audio and video friendship Mutually, the dismission formula, which exits to be used to indicate, terminates current audio and video interaction.
14. a kind of audio and video interactive device, which is characterized in that be applied to the second management equipment, described device includes：
Determining module, for when received from the first management equipment first terminal audio and video interact exit request when, determine with The first terminal carries out the second terminal of audio and video interaction；
Module is removed, the second routing information for removing storage, second routing information is used to indicate by described first Management equipment forwards the audio, video data of the second terminal to the first terminal；
First sending module disappears for sending audio and video interactive refreshing to terminal where the user associated by the second terminal Breath, the audio and video interactive refreshing message is for prompting the first terminal to have logged out current audio and video interaction.
15. device according to claim 14, which is characterized in that the removing module is used for：
Determine that audio and video interaction exited request exits type, it includes unidirectional exit and the formula of dismissing exits to exit type；
If the type that exits that request is exited in the audio and video interaction is unidirectionally to exit, request is exited according to audio and video interaction Entrained audio and video interaction mark determines that the audio and video interaction identifies corresponding path from stored routing information Information group；Routing information corresponding with the first terminal in the routing information group is determined as second routing information； Second routing information is removed, is continued based on the routing information in the routing information group in addition to second routing information Carry out audio and video interaction；
If the type that exits that request is exited in the audio and video interaction is that dismission formula exits, is exited and asked according to audio and video interaction It asks entrained audio and video to interact mark, path corresponding with audio and video interaction mark in stored routing information is believed All routing informations are determined as second routing information in breath group；Second routing information is removed, the audio and video are terminated The indicated audio and video interaction of interaction mark.
CN201710210887.0A 2017-03-31 2017-03-31 Audio and video interaction method and device, management equipment and storage medium Active CN108668152B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710210887.0A CN108668152B (en) 2017-03-31 2017-03-31 Audio and video interaction method and device, management equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710210887.0A CN108668152B (en) 2017-03-31 2017-03-31 Audio and video interaction method and device, management equipment and storage medium

Publications (2)

Publication Number Publication Date
CN108668152A true CN108668152A (en) 2018-10-16
CN108668152B CN108668152B (en) 2020-08-11

Family

ID=63784583

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710210887.0A Active CN108668152B (en) 2017-03-31 2017-03-31 Audio and video interaction method and device, management equipment and storage medium

Country Status (1)

Country Link
CN (1) CN108668152B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102307294A (en) * 2011-08-25 2012-01-04 中兴通讯股份有限公司 Method for participation of intelligent mobile terminal in video conference, terminal and system
CN102625078A (en) * 2012-03-08 2012-08-01 华为技术有限公司 Teleconference control method, terminal device, MCU (Multipoint Control Unit) and video system
CN103841353A (en) * 2014-02-24 2014-06-04 广州华多网络科技有限公司 Video interaction method, terminal, server and system
US20150288925A1 (en) * 2014-04-04 2015-10-08 Electronics And Telecommunications Research Institute Method and system for supporting videoconfernce in distributed telepresence platform
US20160191991A1 (en) * 2014-12-31 2016-06-30 Echostar Technologies L.L.C. Systems and methods for automatic resumption of video stream following transient wifi disconnect
CN106027679A (en) * 2016-07-15 2016-10-12 中兴通讯股份有限公司 Implementing method, apparatus and system for video conference and cloud desktop terminal
CN106254899A (en) * 2016-08-16 2016-12-21 网宿科技股份有限公司 The control method of a kind of live even wheat and system
CN106454537A (en) * 2016-10-14 2017-02-22 广州华多网络科技有限公司 Live video streaming method and relevant equipment
CN106488335A (en) * 2016-09-20 2017-03-08 北京小米移动软件有限公司 Live-broadcast control method and device
CN106488169A (en) * 2015-08-28 2017-03-08 腾讯科技（深圳）有限公司 A kind of method of data transfer, system and relevant device

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102307294A (en) * 2011-08-25 2012-01-04 中兴通讯股份有限公司 Method for participation of intelligent mobile terminal in video conference, terminal and system
CN102625078A (en) * 2012-03-08 2012-08-01 华为技术有限公司 Teleconference control method, terminal device, MCU (Multipoint Control Unit) and video system
CN103841353A (en) * 2014-02-24 2014-06-04 广州华多网络科技有限公司 Video interaction method, terminal, server and system
US20150288925A1 (en) * 2014-04-04 2015-10-08 Electronics And Telecommunications Research Institute Method and system for supporting videoconfernce in distributed telepresence platform
US20160191991A1 (en) * 2014-12-31 2016-06-30 Echostar Technologies L.L.C. Systems and methods for automatic resumption of video stream following transient wifi disconnect
CN106488169A (en) * 2015-08-28 2017-03-08 腾讯科技（深圳）有限公司 A kind of method of data transfer, system and relevant device
CN106027679A (en) * 2016-07-15 2016-10-12 中兴通讯股份有限公司 Implementing method, apparatus and system for video conference and cloud desktop terminal
CN106254899A (en) * 2016-08-16 2016-12-21 网宿科技股份有限公司 The control method of a kind of live even wheat and system
CN106488335A (en) * 2016-09-20 2017-03-08 北京小米移动软件有限公司 Live-broadcast control method and device
CN106454537A (en) * 2016-10-14 2017-02-22 广州华多网络科技有限公司 Live video streaming method and relevant equipment

Also Published As

Publication number Publication date
CN108668152B (en) 2020-08-11

Similar Documents

Publication Publication Date Title
CN110366269B (en) Session establishment method and device
CN111565404B (en) Data distribution method and device
US7477617B2 (en) Multicast session management system
JP3524285B2 (en) Communication device and communication method thereof
CN109831548B (en) Virtual content delivery network vCDN node establishment method and server
CN108235042A (en) A kind of more people's live network broadcast methods, device, adding apparatus and system
CN108738082B (en) Session processing method, device and system
US8203989B2 (en) Distributing content in a communication network
KR20040076857A (en) Method, system, and data structure for multimedia communications
CN109413194B (en) User information cloud cooperative processing and transferring method for mobile communication system
JP2023522114A (en) Communication method, device, electronic device and computer program for multicast broadcast service
KR20120076444A (en) System for chatting service using embms and control method for user equipment, ebm-sc and service provider server of the system for chatting service using embms
TW200926682A (en) System and method for acquiring or distributing information related to one or more alternate ad hoc service providers
WO2012163076A1 (en) Conference reservation method and system
CN112087780B (en) IMS service providing method, system and network side service providing system
CN113993118A (en) Data distribution method, device, equipment, functional entity and storage medium
CN104254129B (en) Close on the resource allocation method and device of service discovering
CN112203149B (en) Video networking software updating method and device based on domestic password
CN108668151A (en) Audio/video interaction method and device
CN101325500A (en) Method, system and apparatus for implementing multicast load-bearing resource
US20210378032A1 (en) Method for establishing a connection of a mobile terminal to a mobile radio communication network and radio access network component
CN108668152A (en) Audio/video interaction method and device
WO2023045472A1 (en) Communication method, apparatus and system
CN108668140B (en) Audio and video interaction state synchronization method and device
CN114205819A (en) QoS calling method and device based on hybrid networking, and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant