CN112637627B - User interaction method, system, terminal, server and storage medium in live broadcast - Google Patents
User interaction method, system, terminal, server and storage medium in live broadcast Download PDFInfo
- Publication number
- CN112637627B CN112637627B CN202011507035.6A CN202011507035A CN112637627B CN 112637627 B CN112637627 B CN 112637627B CN 202011507035 A CN202011507035 A CN 202011507035A CN 112637627 B CN112637627 B CN 112637627B
- Authority
- CN
- China
- Prior art keywords
- terminal
- live broadcast
- terminals
- server
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 97
- 238000000034 method Methods 0.000 title claims abstract description 64
- 230000005540 biological transmission Effects 0.000 claims description 25
- 238000012550 audit Methods 0.000 claims description 18
- 230000008859 change Effects 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 13
- 230000005236 sound signal Effects 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 6
- 230000010365 information processing Effects 0.000 abstract description 10
- 238000004891 communication Methods 0.000 description 21
- 238000005070 sampling Methods 0.000 description 18
- 238000012545 processing Methods 0.000 description 13
- 238000007726 management method Methods 0.000 description 10
- 238000004364 calculation method Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001105 regulatory effect Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/18—Network architectures or network communication protocols for network security using different networks or channels, e.g. using out of band channels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1044—Group management mechanisms
- H04L67/1046—Joining mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
The embodiment of the application relates to the field of live broadcast, and discloses a user interaction method, a system, a terminal, a server and a storage medium in live broadcast. In the embodiment of the application, the user interaction method in live broadcast comprises the following steps: sending the identification of the terminal to a server for managing the current live room; the identifiers of the rest terminals except the terminal in the live broadcast room pushed by the server are obtained; respectively establishing point-to-point direct connection channels with the rest terminals through the identifiers of the rest terminals; and carrying out information interaction with the rest terminals by utilizing the direct connection channel. In the embodiment of the application, the information interaction efficiency in live broadcast is improved by establishing the user direct connection channel in live broadcast, and the information processing pressure of the server for managing the live broadcast room is reduced.
Description
Technical Field
The embodiment of the application relates to the field of live broadcasting, in particular to user interaction in live broadcasting.
Background
In some cases, when a user interacts in a live room, the user needs to upload the interaction to a server, and the server performs corresponding processing and then broadcasts the interaction to each user terminal in the current live room. For example, when the microphone is connected, the user voice stream needs to be uploaded to a server for managing the current live broadcast room, mixed stream is carried out at the server end, and then broadcast and distributed to all user terminals in the current live broadcast room.
Because the user voice streams in the room need to be pushed to the server first and then processed and forwarded by the server, the whole network transmission link is longer, the delay is higher and the packet is lost. Meanwhile, the server is intensively processed, so that the load of the server for managing the live broadcasting room is larger.
Disclosure of Invention
The embodiment of the application aims to provide a user interaction method, a system, a terminal, a server and a storage medium in live broadcasting, so that a user can construct a direct-connection channel with short link and low delay in the live broadcasting process, and the load of the server in a live broadcasting room is reduced.
In order to solve the technical problems, the embodiment of the application provides a user interaction method in live broadcast, which is applied to a terminal and comprises the following steps: sending the identification of the terminal to a server for managing the current live room; the method comprises the steps of obtaining identifiers of other terminals except the terminal in a live broadcast room pushed by a server; respectively establishing point-to-point direct connection channels with the rest terminals through the identifications of the rest terminals; and carrying out information interaction with other terminals by utilizing the direct communication channel.
The embodiment of the application provides a user interaction method in live broadcast, which is applied to a server and comprises the following steps:
receiving an identifier sent by a terminal joining a live room; and sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction and execute the information interaction.
The embodiment of the application also provides a user interaction system in live broadcast, which is applied to the server and the terminal, wherein: the terminal comprises:
the pushing module is used for sending the identification of the terminal to a server for managing the current live room;
the acquisition module is used for acquiring the identifiers of the other terminals except the terminal in the live broadcast room pushed by the server;
the connection module is used for respectively establishing point-to-point direct connection channels with the rest terminals through the identifications of the rest terminals;
and the interaction module is used for carrying out information interaction with other terminals by utilizing the direct communication channel.
A server, comprising:
the receiving module is used for receiving the identification sent by the terminal joining the live room;
and the sending module is used for sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals respectively establish a point-to-point direct connection channel for information interaction and execute the information interaction.
The embodiment of the application also provides a terminal, which comprises:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the live user interaction method for the terminal.
The embodiment of the application also provides a server, which comprises:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the on-air user interaction method for the server.
The embodiment of the application also provides a computer readable storage medium which stores a computer program, wherein the computer program is used for realizing the user interaction method applied to the live broadcast of the terminal or the user interaction method applied to the live broadcast of the server when being executed by a processor.
In the embodiment of the application, the information interaction among users is directly realized in live broadcast by the mode that the terminals in the live broadcast room respectively establish point-to-point direct communication channels; compared with the mode that a server of a management living broadcast room is used as an intermediate receiving-transmitting and processing node in some cases to indirectly realize information interaction among users, the embodiment of the application adopts a mode that all terminals are directly connected, so that the network transmission path is shorter and the delay is low; and simultaneously, the pressure of the server in the management living broadcast room on information processing is reduced.
In addition, sending the identity of the terminal to a server for managing the current live room comprises the following steps: sending a joining request to a server for managing the current live room, wherein the joining request carries the identifier of the terminal, and receiving the security audit of the server; through the identification of other terminals, respectively establishing point-to-point direct connection channels with the other terminals, including: and taking the other terminals as trusted terminals, and respectively establishing point-to-point direct connection channels with the other terminals by utilizing the identifications of the other terminals. The embodiment of the application finally needs to establish a point-to-point direct connection channel, no transit equipment is arranged in the direct connection channel to ensure the information security, and the security of the information transmission can be effectively improved by carrying out security check on the terminal.
In addition, utilize the direct communication way to carry out information interaction with other terminals, include: if the audio signal is received in the information interaction process, the audio signal is played after being locally subjected to audio mixing processing. The mixed sound is regulated and output in a floating way along with the real-time change trend of the input sound, so that the problem of unobvious sound change of the traditional sound averaging is avoided.
Drawings
One or more embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements, and in which the figures of the drawings are not to be taken in a limiting sense, unless otherwise indicated.
Fig. 1 is a flowchart of a user interaction method in live broadcast provided according to a first embodiment of the present application;
fig. 2 is a schematic diagram of a user interaction method in live broadcast applied to a game live broadcast according to a first embodiment of the present application;
fig. 3 is a schematic diagram of the present terminal establishing a direct connection channel with the rest of terminals in the first embodiment of the present application;
fig. 4 is a schematic diagram of information interaction between the terminal and the rest of terminals through a direct communication channel according to the first embodiment of the present application;
fig. 5 is a schematic diagram of a mixing process after receiving an audio signal according to a first embodiment of the present application;
fig. 6 is a flowchart of a user interaction method in live broadcast provided according to a second embodiment of the present application;
fig. 7 is a flowchart of a user interaction method in live broadcast provided according to a third embodiment of the present application;
fig. 8 is a flowchart of a user interaction method in live broadcast provided according to a fourth embodiment of the present application;
fig. 9 is a schematic diagram of an in-live user interaction system provided according to a fifth embodiment of the present application;
fig. 10 is a schematic view of a terminal provided according to a sixth embodiment of the present application;
fig. 11 is a schematic view of a server provided according to a seventh embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the following detailed description of the embodiments of the present application will be given with reference to the accompanying drawings. However, those of ordinary skill in the art will understand that in various embodiments of the present application, numerous technical details have been set forth in order to provide a better understanding of the present application. However, the claimed application may be practiced without these specific details and with various changes and modifications based on the following embodiments. The following embodiments are divided for convenience of description, and should not be construed as limiting the specific implementation of the present application, and the embodiments can be mutually combined and referred to without contradiction.
The first embodiment of the application relates to a user interaction method in live broadcast, which is applied to a terminal, and a specific flow is shown in fig. 1.
Step 101, sending the identification of the terminal to a server for managing the current live room;
step 102, obtaining the identifiers of the rest terminals except the terminal in the live broadcast room pushed by the server;
step 103, respectively establishing point-to-point direct connection channels for the rest terminals through the identifications of the rest terminals;
and 104, performing information interaction with other terminals by using the direct communication channel.
In this embodiment, the point-to-point communication architecture is utilized to realize the instant information exchange of the user in the live broadcast process, so as to reduce the pressure of the server for completing the information processing and the information transfer. The server of the current live broadcasting room is used as an intermediate node to finish the identification transmission of the terminal in the current live broadcasting room, a point-to-point direct connection channel between the terminals is established through the identification, and the information interaction between the terminals is carried out in the direct connection channel; the communication between users is faster, and meanwhile, the information processing pressure of the server side is reduced. An example of using this embodiment for a game live process is shown in fig. 2.
The implementation details of the user interaction method in live broadcast of the present embodiment are specifically described below, and the following details are provided only for facilitating understanding, and are not necessary to implement the present embodiment.
In step 101, an identifier of the terminal is sent to a server for managing the current live broadcasting room, where the identifier of the terminal is used to establish a connection channel with other terminals in the current live broadcasting room. It will be appreciated that the characteristic information identified as specific to the terminal and capable of distinguishing the terminal from other terminals in the current room, includes, but is not limited to: the address of the terminal, the ID of the terminal and the account information of the live broadcast login of the terminal.
In step 102, after the identifier of the terminal is sent to the server for managing the current live room, the identifiers of the other terminals in the current live room except the terminal are required to be obtained through the server for managing the current live room, and the identifiers of the other terminals are important basis for establishing connection between the terminal and the other terminals.
Optionally, when the terminal obtains the identifiers of the other terminals, the other terminals obtain the identifiers of the terminal through the server, so that a faster processing rate can be achieved when the direct communication channel request is established in the post-processing.
In step 103, the received identifiers of the other terminals are used to send a request for establishing a point-to-point channel, so as to establish a point-to-point direct channel, and the establishment process of the direct channel is shown in fig. 3. The terminal and other terminals in the current live broadcast room are respectively provided with a point-to-point direct connection channel, the point-to-point direct connection channels are independent of the transmission channels of live broadcast data in the current live broadcast room, namely, the point-to-point direct connection channels are used for carrying out information interaction among users, and the live broadcast transmission channels are used for broadcasting the live broadcast data in the current live broadcast room and are not mutually influenced.
In step 104, the information interaction between the terminal and the rest of the terminals is implemented by using the point-to-point direct connection channel, as shown in fig. 4. Because the direct connection channel is a point-to-point bidirectional channel, the information receiving and transmitting between the terminals can be completed in real time, and the information transmission efficiency between the user terminals is improved; the short transmission path can also effectively reduce the packet loss rate of the data; meanwhile, the information transmission in the direct communication channel does not need to be subjected to data forwarding processing of a server, so that the information processing pressure of the server side is effectively reduced.
In order to facilitate understanding of the present embodiment, the execution of the present embodiment will be described by taking an audio signal as an example. If multiple paths of audio signals are received in the information interaction process, the audio signals are locally mixed and then played, and the local audio mixing flow is shown in fig. 5. The calculation formula of the mixing sound is as follows:the gradation factor is used to express the sound variation tendency. Specifically, the gradient factor may be obtained by the following formula:
wherein the calculation parameters of the volume value include: audio sampling rate, audio sampling period, number of direct-connection channels needing to be mixed, and data sum of the direct-connection channels needing to be mixed. The audio sampling rate is: the number of sampling the sound signal in the terminal 1s is higher, the higher the sampling rate is, the higher the sound reduction degree is, and the different device performances of each terminal are combined to be divided into 5 grades: this value is 11025Hz, 22050Hz, 24000Hz, 44100Hz, 48000Hz, determined by the different performance of each terminal. Before executing the mixing calculation formula, the terminal is required to execute preprocessing on the received audio signal transmitted by the direct communication channel, including: the method comprises the steps of obtaining an audio sampling rate, sorting and summing data of each direct-connection channel needing to be mixed, converting data to be calculated into program identifiable data and the like. Before the terminal plays, the terminal processing is needed to be executed, namely, the data stream obtained by the mixing calculation formula is converted into the executable data of the player, and the result of the conversion process is determined by the type of the player which is played by the terminal.
For example, the audio sampling rate lambda, the audio sampling period t, the number N of direct channels to be mixed, the gradual factor epsilon n The sum of the data of the direct-connection channels needing mixing is expressed as A+B+, thenGradual change factor epsilon n ：The fade factor is a parameter that characterizes the trend of the output volume change, as exemplified below.
In the 1 st sampling, the direct-connection channel to be mixed is 1 channel, n=1, t=1s, and the sampled data is x 1 Unit bit. Because of the first sampling, no last result is used as a reference, so parameters related to the last result in the formula are ignored; and because the current sampling is the initial reference value of the subsequent calculation, the calculation is different from the rest gradual change factors, so the gradual change factor of the first sampling is obtainedI.e. the output sound remains unchanged.
When the 2 nd sampling is performed, for example, the number of direct channels currently required to mix is 2, i.e. n=2, the sampling time t=1s of this time, and the sound data sampled by each direct channel is x1, x2, and unit bit respectively. Combining the first sampling calculation data to obtain the current gradual change factor according to a formulaFrom the result, if the sampling data of the number 2 direct connection channel and the number 1 direct connection channel are equal, the current gradual change factor is still 1, the output volume is kept unchanged, and if the newly added number 2 sound channel is much larger than the number 1 sound channel, the larger the current gradual change factor is, and the larger the volume change is.
When the nth sampling is performed, for example, the direct-connection channel of the current device requiring mixing is 10 channels, that is, the sampling time t=1s of the current time of n=10, and the sampled sound data of each path of stream is x1, x2 … x10, and the unit bit. The gradual change factor is obtained according to the formula:it can be seen that the gradient factor is obtained by multiplying the average value of the gradient factors of the previous n-1 times by the proportional trend of the current and last sound values, so that the gradient factor is a parameter obtained based on the sound variation trend, and the gradient factor can enable the mixed sound to be regulated and output in a floating manner along with the real-time variation trend of the input sound, so that the problem of unobvious sound variation of the traditional sound-averaged mixing is avoided.
In the embodiment of the application, the information interaction among users is directly realized in live broadcast by the mode that the terminals in the live broadcast room respectively establish point-to-point direct communication channels; compared with the mode that a server of a management living broadcast room is used as an intermediate receiving-transmitting and processing node in some cases, the method indirectly realizes information interaction among users, has a shorter network transmission path and low delay; and simultaneously, the pressure of the server in the management living broadcast room on information processing is reduced.
The second embodiment of the application relates to a user interaction method in live broadcast, which is applied to a terminal, and the specific flow is shown in fig. 6.
Step 201, a joining request is sent to a server for managing a current live room, the joining request carries an identifier of the terminal, and security audit of the server is received;
step 202, obtaining the identifiers of the rest terminals except the terminal in the live broadcast room pushed by the server;
step 203, using other terminals as trusted terminals, and respectively establishing point-to-point direct connection channels with the other terminals by using the identifications of the other terminals;
and 204, performing information interaction with other terminals by using the direct communication channel.
The steps 202 and 204 are substantially the same as those of the first embodiment, and are mainly different from each other in the steps 201 and 204, and are described below.
For step 201, a join request is sent to a server managing the current live room, the join request carries the identity of the terminal, and the security audit of the server is accepted. The security audit of the receiving server can improve the security of the current broadcasting room information, the receiving server is identified as a trusted terminal after the security audit is passed, and the security audit mode comprises: symmetric encryption, asymmetric encryption, signature encryption, etc. The embodiment of the application finally needs to establish a point-to-point direct connection channel, no transit equipment is arranged in the direct connection channel to ensure the information security, and the security of the information transmission can be effectively improved by carrying out security check on the terminal.
And for step 203, taking the rest terminals as trusted terminals, and respectively establishing point-to-point direct connection channels with the rest terminals by using the identifications of the rest terminals. After passing the security audit of the server, the terminal is identified as a trusted terminal, and the rest terminals in the current live broadcast room are subjected to the security audit, namely the rest terminals can be used as the trusted terminal. The point-to-point direct connection channel between the instant terminal and the trusted terminal is established through the identifications of the other terminals, and the direct connection channel is a trusted terminal, so that encryption and decryption steps are not needed to be carried out on the interaction information in the information interaction process, the information interaction time delay is lower, and the user experience is improved.
And the security audit is accepted before the transmission channel is established, the security verification times of information interaction in the transmission channel is reduced, and the instantaneity of user interaction in live broadcast is further improved on the basis of the first embodiment.
If the audio signal transmitted by the direct communication channel is received in the interaction process, the audio signal is locally processed by adopting a sound mixing algorithm and then played,
further, it will be understood by those skilled in the art that the present embodiment does not conflict with the first embodiment, and can be freely combined to achieve the object of the application.
The above steps of the methods are divided, for clarity of description, and may be combined into one step or split into multiple steps when implemented, so long as they include the same logic relationship, and they are all within the protection scope of this patent; it is within the scope of this patent to add insignificant modifications to the algorithm or flow or introduce insignificant designs, but not to alter the core design of its algorithm and flow.
The third embodiment of the present application relates to a user interaction method in live broadcast, which is applied to a server, as shown in fig. 7, and includes:
step 301, receiving an identifier sent by a terminal joining a live room;
and 302, sending the identifications of the other terminals except the terminal in the current live room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction and execute the information interaction.
The following implementation details are provided to facilitate understanding and are not necessary to practice the present embodiments.
In step 301, a server managing a current live room is used as an intermediate node, receives an identifier sent by a terminal joining the live room, and uses the identifier as a feature basis for establishing point-to-point direct connection with other terminals in the current live room.
In step 302, the server managing the current live room sends the identities of the remaining terminals except the terminal in the current live room to the terminal according to the current database. The server sends the identifications of the other terminals to the terminal, and the identifications are used as the basis for establishing a point-to-point direct connection channel between the terminal and the other terminals. The task of the server about user interaction in live broadcast is completed after the identification of the double ends is forwarded, and further information processing in a direct connection channel is not needed.
Optionally, the received identifier of the terminal is sent to other terminals, which is equivalent to sending a prompt for establishing a direct connection channel to the other terminals, so that a faster processing rate can be achieved when a request for establishing the direct connection channel is processed in a later period.
For example, the identifier of the terminal M joining the live room is M, the identifier of the terminal N in the current live room is N, and the server managing the current live room receives the identifier M sent by the terminal M joining the live room and sends the identifier N to the terminal M, so that the terminal M and the terminal N can establish a point-to-point direct connection channel mn.
When the user interaction method in live broadcasting is realized, the server for managing the live broadcasting room only needs to forward the identification of each terminal, so that the terminals can establish a point-to-point direct connection channel for information interaction. The server is not required to perform data processing on the information transmission process, so that the information processing pressure of the server is greatly reduced.
The fourth embodiment of the present application relates to a user interaction method in live broadcast, which is applied to a server, as shown in fig. 8, and includes:
step 401, receiving a joining request sent by a terminal joining a live room, wherein the joining request carries an identifier of the terminal joining the live room, and carrying out security audit on the terminal;
and step 402, sending the identifications of the other terminals except the terminal in the current live room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction and execute the information interaction.
The step 402 is substantially the same as the third embodiment, and the main difference is the step 401, which is described in detail below, to avoid redundancy.
The method for carrying out the security audit on the terminal joining the live broadcast room comprises the following steps: the terminal is identified as a trusted terminal after the security audit is passed, so that the security of information transmission in the current live broadcast room can be improved, and as the security audit is carried out before the channel is established, the two ends of the point-to-point direct-connection channel are trusted terminals with high security, the connection channel is established between the trusted terminals for information interaction, the times of security verification when the direct-connection channel is interacted are effectively reduced, and the interaction efficiency between users in live broadcast is ensured.
A fifth embodiment of the present application relates to a user interaction system in live broadcast, applied to a terminal and a server, as shown in fig. 9,
the terminal comprises:
the pushing module 501 is configured to send an identifier of the terminal to a server that manages a current live room;
the acquiring module 502 is configured to acquire identifiers of other terminals except the terminal in the live room pushed by the server;
a connection module 503, configured to establish point-to-point direct connection channels with the rest terminals respectively through the identifiers of the rest terminals;
and the interaction module 504 is used for carrying out information interaction with other terminals by utilizing the direct communication channel.
The server comprises:
the receiving module 505: receiving an identifier sent by a terminal joining a live room;
the sending module 506: and sending the identifications of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction and execute the information interaction.
For the push module 501, the terminal sends an identifier for identifying the terminal to the server, including: the address of the terminal, the ID of the terminal and the account information of the live broadcast login of the terminal.
Optionally, when the terminal sends the identifier for identifying the terminal to the server, a joining request is sent to the server for managing the current live room, the identifier of the terminal is carried in the request, the security audit of the server is received, and the terminal is recorded as a trusted terminal after passing the security audit.
For the acquisition module 502, the terminal acquires the marks of the rest of terminals in the current live room pushed by the server, so that the terminals can complete the point-to-point direct connection channel, and the sending and receiving marks are the necessary conditions for establishing the point-to-point direct connection channel between the terminals.
For the connection module 503, a request for establishing a point-to-point channel is sent through the identifier of each terminal, and the establishment of a point-to-point direct connection channel is completed, where the channel is independent of a transmission channel of live broadcast data in a live broadcast room.
Optionally, the other terminals are used as trusted terminals, and point-to-point direct connection channels are respectively established with the other terminals by using the identifications of the other terminals. Because both direct communication channels are trusted terminals, the information encryption operation in the information interaction process can be effectively reduced and the user interaction efficiency is improved on the premise of ensuring the information transmission safety.
For the interaction module 504, the point-to-point direct communication channel is used to perform user interaction in live broadcast, and if a voice signal is received through the direct communication channel, the voice signal is played after local audio mixing.
In the embodiment of the application, the terminal directly realizes the information interaction among users in live broadcast in a mode that the terminal in the live broadcast room respectively establishes point-to-point direct communication channels; compared with the mode that a server of a management living broadcast room is used as an intermediate receiving-transmitting and processing node in some cases, the method indirectly realizes information interaction among users, has a shorter network transmission path and low delay; and simultaneously, the pressure of the server in the management living broadcast room on information processing is reduced.
For the receiving module 505, the server receives the identifier sent by the terminal joining the live room, where the identifier is specific to the terminal, and can distinguish the terminal from other terminals in the current room, including but not limited to: the address of the terminal, the ID of the terminal and the account information of the live broadcast login of the terminal.
Optionally, the terminal that receives the joining live room sends a joining request, the joining request carries the identifier of the terminal that joins the live room, and carries out security audit on the terminal. The security auditing method comprises the following steps: symmetric encryption, asymmetric encryption, signature encryption and the like, and after the security audit is passed, the terminal is identified as a trusted terminal after the terminal passes, so that the security of information transmission in the current live broadcast room can be improved, and the security verification operation in the subsequent user interaction process through the direct communication channel is reduced.
For the sending module 506, the server managing the current live room sends the identifiers of the other terminals except the terminal in the current live room to the terminal according to the current database, and the identifiers are used as a basis for the terminal and the other terminals to respectively establish point-to-point direct communication channels for information interaction to execute information interaction.
When the user interaction method in live broadcast is realized, the server for managing the live broadcast room only needs to forward the identification of each terminal, so that the terminals can establish a point-to-point direct connection channel for information interaction. The server is not required to perform data processing on the information transmission process, so that the information processing pressure of the server is greatly reduced.
It is to be noted that this embodiment is a system example corresponding to the above embodiment, and can be implemented in cooperation with the above embodiment. The related technical details mentioned in the above embodiments are still valid in this embodiment, and in order to reduce repetition, they are not repeated here. Accordingly, the related technical details mentioned in the present embodiment can also be applied to the above-described embodiments.
It should be noted that each module in this embodiment is a logic module, and in practical application, one logic unit may be one physical unit, or may be a part of one physical unit, or may be implemented by a combination of multiple physical units. In addition, in order to highlight the innovative part of the present application, units that are not so close to solving the technical problem presented by the present application are not introduced in the present embodiment, but this does not indicate that other units are not present in the present embodiment.
A sixth embodiment of the application relates to a terminal, as shown in fig. 10, comprising at least one processor 601; the method comprises the steps of,
a memory 602 communicatively coupled to the at least one processor; wherein,,
the memory 602 stores instructions executable by the at least one processor to enable the at least one processor to perform the live user interaction method applied to the terminal.
Where the memory and the processor are connected by a bus, the bus may comprise any number of interconnected buses and bridges, the buses connecting the various circuits of the one or more processors and the memory together. The bus may also connect various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or may be a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor is transmitted over the wireless medium via the antenna, which further receives the data and transmits the data to the processor.
The processor is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And memory may be used to store data used by the processor in performing operations.
A seventh embodiment of the application relates to a server, as shown in fig. 11, comprising at least one processor 701; the method comprises the steps of,
a memory 702 communicatively coupled to the at least one processor; wherein,,
the memory 702 stores instructions executable by the at least one processor to enable the at least one processor to perform the on-air user interaction method for a server.
Where the memory and the processor are connected by a bus, the bus may comprise any number of interconnected buses and bridges, the buses connecting the various circuits of the one or more processors and the memory together. The bus may also connect various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or may be a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor is transmitted over the wireless medium via the antenna, which further receives the data and transmits the data to the processor.
The processor is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And memory may be used to store data used by the processor in performing operations.
An eighth embodiment of the present application relates to a computer-readable storage medium storing a computer program. The computer program implements the above-described method embodiments when executed by a processor.
That is, it will be understood by those skilled in the art that all or part of the steps in implementing the methods of the embodiments described above may be implemented by a program stored in a storage medium, where the program includes several instructions for causing a device (which may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps in the methods of the embodiments of the application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
It will be understood by those of ordinary skill in the art that the foregoing embodiments are specific examples of carrying out the application and that various changes in form and details may be made therein without departing from the spirit and scope of the application.
Claims (9)
1. The user interaction method in live broadcast is characterized by being applied to a terminal and comprising the following steps:
sending the identification of the terminal to a server for managing the current live room;
the identifiers of the rest terminals except the terminal in the live broadcast room pushed by the server are obtained;
respectively establishing point-to-point direct connection channels with the rest terminals through the identifiers of the rest terminals;
information interaction is carried out between the direct connection channel and the rest terminals;
the terminal and the rest terminals are user terminals for watching live broadcast in the live broadcast room, and a live broadcast data transmission channel of the live broadcast room is independent of the point-to-point direct connection channel.
2. The in-live user interaction method of claim 1, further comprising:
if the audio signal is received in the information interaction process, the audio signal is locally mixed and played.
3. The method for user interaction in live broadcast according to claim 2, wherein the locally mixing comprises: and mixing the received audio signals according to the following formula:
wherein the gradual change factor is used for expressing the sound change trend.
4. A method for user interaction in live broadcast, which is applied to a server, comprising:
receiving an identifier sent by a terminal joining a live room;
the method comprises the steps of sending identifiers of other terminals except the terminal in a current live broadcast room to the terminal, and respectively establishing point-to-point direct connection channels for information interaction between the terminal and the other terminals;
the terminal and the rest terminals are user terminals for watching live broadcast in the live broadcast room, and a live broadcast data transmission channel of the live broadcast room is independent of the point-to-point direct connection channel.
5. The method for user interaction in live broadcast according to claim 4, wherein the receiving the identifier sent by the terminal joining the live broadcast room comprises: and receiving a joining request sent by the terminal joining the live broadcast room, wherein the joining request carries the identification of the terminal joining the live broadcast room, and carrying out security audit on the terminal.
6. A user interaction system in live broadcast is applied to a terminal and a server, and is characterized in that:
the terminal comprises:
the pushing module is used for sending the identification of the terminal to a server for managing the current live room;
the acquisition module is used for acquiring the identifiers of the rest terminals except the terminal in the live broadcast room pushed by the server;
the connection module is used for respectively establishing point-to-point direct connection channels with the other terminals through the identifiers of the other terminals;
the interaction module is used for carrying out information interaction with the rest terminals by utilizing the direct connection channel;
the server includes:
the receiving module is used for receiving the identification sent by the terminal joining the live room;
the sending module is used for sending the identifiers of the other terminals except the terminal in the current live broadcast room to the terminal, so that the terminal and the other terminals respectively establish point-to-point direct connection channels for information interaction;
the terminal and the rest terminals are user terminals for watching live broadcast in the live broadcast room, and a live broadcast data transmission channel of the live broadcast room is independent of the point-to-point direct connection channel.
7. A terminal, comprising:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the in-live user interaction method of any of claims 1 to 3.
8. A server, comprising:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the in-live user interaction method of any of claims 4 to 5.
9. A computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the method for user interaction in live broadcast applied to a terminal according to any one of claims 1 to 3 or the method for user interaction in live broadcast applied to a server according to any one of claims 4 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011507035.6A CN112637627B (en) | 2020-12-18 | 2020-12-18 | User interaction method, system, terminal, server and storage medium in live broadcast |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011507035.6A CN112637627B (en) | 2020-12-18 | 2020-12-18 | User interaction method, system, terminal, server and storage medium in live broadcast |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112637627A CN112637627A (en) | 2021-04-09 |
| CN112637627B true CN112637627B (en) | 2023-09-05 |
Family
ID=75317501
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011507035.6A Active CN112637627B (en) | 2020-12-18 | 2020-12-18 | User interaction method, system, terminal, server and storage medium in live broadcast |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112637627B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114286189B (en) * | 2021-12-16 | 2023-12-05 | 康佳集团股份有限公司 | Ultrahigh-definition multi-path live broadcast display processing method, system, intelligent terminal and medium |
| CN117560358A (en) * | 2023-11-30 | 2024-02-13 | 北京流金岁月科技有限公司 | Method, device and system for universal live broadcast voice intercom |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1909509A (en) * | 2006-07-19 | 2007-02-07 | 华为技术有限公司 | System, method and user terminal for realizing video live broadcast in media distributing network |
| CN101690270A (en) * | 2006-05-04 | 2010-03-31 | Lg电子株式会社 | Enhancing audio with remixing capability |
| CN101763458A (en) * | 2008-12-24 | 2010-06-30 | ***通信集团公司 | Method and device for realizing online game |
| CN102005206A (en) * | 2010-11-16 | 2011-04-06 | 上海华平信息技术股份有限公司 | Audio mixing method of multiple-channel audio frequency |
| CN102543087A (en) * | 2011-12-28 | 2012-07-04 | 中兴长天信息技术（南昌）有限公司 | Audio mixing method applied to multi-point mobile audio communication system |
| CN102610235A (en) * | 2011-12-22 | 2012-07-25 | 深圳市万兴软件有限公司 | Sound mixing processing method, device and intelligent equipment |
| CN107027048A (en) * | 2017-05-17 | 2017-08-08 | 广州市千钧网络科技有限公司 | A kind of live even wheat and the method and device of information displaying |
| CN107734349A (en) * | 2017-09-01 | 2018-02-23 | 合肥迅大信息技术有限公司 | Based on P2P net cast team teaching systems |
| CN108965428A (en) * | 2018-07-13 | 2018-12-07 | 广州虎牙信息科技有限公司 | The transmission method of live data, device, electronic equipment, system |
| CN109361856A (en) * | 2018-10-26 | 2019-02-19 | 广州虎牙信息科技有限公司 | A kind of panorama live broadcasting method, device, terminal device and storage medium |
| CN109474684A (en) * | 2018-11-14 | 2019-03-15 | 广州虎牙信息科技有限公司 | A kind of method, apparatus, terminal device and storage medium obtaining live video stream |
| CN111654713A (en) * | 2020-04-20 | 2020-09-11 | 视联动力信息技术股份有限公司 | Live broadcast interaction method and device |
| CN111696515A (en) * | 2020-06-15 | 2020-09-22 | 杭州艾力特数字科技有限公司 | Audio mixing method for teaching recording and broadcasting |
-
2020
- 2020-12-18 CN CN202011507035.6A patent/CN112637627B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101690270A (en) * | 2006-05-04 | 2010-03-31 | Lg电子株式会社 | Enhancing audio with remixing capability |
| CN1909509A (en) * | 2006-07-19 | 2007-02-07 | 华为技术有限公司 | System, method and user terminal for realizing video live broadcast in media distributing network |
| CN101763458A (en) * | 2008-12-24 | 2010-06-30 | ***通信集团公司 | Method and device for realizing online game |
| CN102005206A (en) * | 2010-11-16 | 2011-04-06 | 上海华平信息技术股份有限公司 | Audio mixing method of multiple-channel audio frequency |
| CN102610235A (en) * | 2011-12-22 | 2012-07-25 | 深圳市万兴软件有限公司 | Sound mixing processing method, device and intelligent equipment |
| CN102543087A (en) * | 2011-12-28 | 2012-07-04 | 中兴长天信息技术（南昌）有限公司 | Audio mixing method applied to multi-point mobile audio communication system |
| CN107027048A (en) * | 2017-05-17 | 2017-08-08 | 广州市千钧网络科技有限公司 | A kind of live even wheat and the method and device of information displaying |
| CN107734349A (en) * | 2017-09-01 | 2018-02-23 | 合肥迅大信息技术有限公司 | Based on P2P net cast team teaching systems |
| CN108965428A (en) * | 2018-07-13 | 2018-12-07 | 广州虎牙信息科技有限公司 | The transmission method of live data, device, electronic equipment, system |
| CN109361856A (en) * | 2018-10-26 | 2019-02-19 | 广州虎牙信息科技有限公司 | A kind of panorama live broadcasting method, device, terminal device and storage medium |
| CN109474684A (en) * | 2018-11-14 | 2019-03-15 | 广州虎牙信息科技有限公司 | A kind of method, apparatus, terminal device and storage medium obtaining live video stream |
| CN111654713A (en) * | 2020-04-20 | 2020-09-11 | 视联动力信息技术股份有限公司 | Live broadcast interaction method and device |
| CN111696515A (en) * | 2020-06-15 | 2020-09-22 | 杭州艾力特数字科技有限公司 | Audio mixing method for teaching recording and broadcasting |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112637627A (en) | 2021-04-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112637627B (en) | User interaction method, system, terminal, server and storage medium in live broadcast | |
| US10484445B2 (en) | Apparatus and method for transmitting multimedia data in a broadcast system | |
| US20130064387A1 (en) | Audio processing method, system, and control server | |
| CN103220258B (en) | Meeting sound mixing method, terminal and Media Resource Server | |
| CN102833582A (en) | Method for searching audio and video resources via voice | |
| CN105119900A (en) | Information secure transmission method, network access method and corresponding terminals | |
| US8910226B2 (en) | Transmitting apparatus, transmitting method, receiving apparatus, receiving method, program, and content distribution system | |
| CN105120454A (en) | Information transmission method, network access method and corresponding terminals | |
| CN105764145A (en) | Power optimization distribution method based on symbol error rate in increment dual-relay system | |
| CN106134207A (en) | Dispensing device, sending method, reception device and method of reseptance | |
| CN104394165A (en) | Emergency broadcast terminal device and information safety certificate method thereof | |
| CN105657672B (en) | Multimedia communication cooperation multicast transmission method in cognitive radio networks | |
| CN102082624A (en) | WiFi coding optimization method and system thereof | |
| CN106412767B (en) | Sound mixing method and sound mixing circuit | |
| US20100042836A1 (en) | Method for securely transmitting device management message via broadcast channel and server and terminal thereof | |
| US20090185562A1 (en) | Methods and apparatus for an efficient multicast file distribution system | |
| CN102006516A (en) | Digital household content service transmission method based on cable television two-way access | |
| CN114928791A (en) | Multipoint-to-point wireless audio transmission method, system and readable storage medium | |
| CN115240369A (en) | Internet of things loudspeaker voice broadcasting system based on earthquake early warning | |
| CN208739395U (en) | Audio board and digital sound console | |
| CN101317216A (en) | Signal processing method and device | |
| CN113453084A (en) | Program playing method and device | |
| Wyrembelski et al. | Bidirectional broadcast channels with common and confidential messages | |
| CN104753690B (en) | A kind of information processing method and electronic equipment | |
| CN108667849A (en) | One kind being based on single connection multichannel streaming media and control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |