CN111787269B - Multimedia information generation method and device, electronic equipment and storage medium - Google Patents
Multimedia information generation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111787269B CN111787269B CN202010696797.9A CN202010696797A CN111787269B CN 111787269 B CN111787269 B CN 111787269B CN 202010696797 A CN202010696797 A CN 202010696797A CN 111787269 B CN111787269 B CN 111787269B
- Authority
- CN
- China
- Prior art keywords
- information
- user terminal
- target
- target user
- communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000012163 sequencing technique Methods 0.000 claims abstract description 38
- 238000004891 communication Methods 0.000 claims description 166
- 230000015654 memory Effects 0.000 claims description 13
- 238000012544 monitoring process Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 3
- 238000012216 screening Methods 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application provides a multimedia information generation method, a multimedia information generation device, electronic equipment and a storage medium, wherein the multimedia information generation method comprises the following steps: acquiring a target user terminal in a target group, wherein the target user terminal is a user terminal for providing multimedia information for a cloud server; the multimedia information comprises audio information and video information; selecting target video information from the video information provided by the target user terminal according to the sequencing information corresponding to the target user terminal; and determining the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group. According to the method and the device, the storage space of the multimedia information to be pushed is reduced by screening the multimedia information provided by the user terminal, the fluency of playing the multimedia information to be pushed is improved, and the efficiency of the cloud video conference is improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for generating multimedia information, an electronic device, and a storage medium.
Background
Compared with the traditional conference form, the cloud video conference can realize cross-region multi-terminal video communication through the existing network, and is a convenient and efficient communication mode.
Generally, when a cloud video conference is performed, a server pulls audio and video information of each user terminal entering the cloud video conference, integrates a plurality of pieces of pulled dispersed audio and video information into one piece of integral audio and video information, and pushes the integral audio and video information to each user terminal entering the cloud video conference, so as to realize information sharing.
However, when a large number of user terminals enter the cloud video conference, the storage space occupied by the whole audio/video information generated by the server is large, so that when the user terminals play the whole audio information, a video pause phenomenon is easy to occur, and the conference efficiency is low.
Disclosure of Invention
In view of this, an embodiment of the present application aims to provide a method and an apparatus for generating multimedia information, an electronic device, and a storage medium, which can reduce a storage space of multimedia information to be pushed, improve fluency of playing the multimedia information to be pushed, and improve efficiency of a cloud video conference by screening the multimedia information provided by a user terminal.
In a first aspect, an embodiment of the present application provides a method for generating multimedia information, where the method includes:
acquiring a target user terminal in a target group, wherein the target user terminal is a user terminal for providing multimedia information for a cloud server; the multimedia information comprises audio information and video information;
selecting target video information from the video information provided by the target user terminal according to the sequencing information corresponding to the target user terminal;
and determining the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group.
In a possible implementation manner, the acquiring a target ue in a target group includes:
monitoring communication state information corresponding to candidate user terminals in a target group;
determining the candidate user terminal with the communication state information as the target communication state information as a target user terminal; wherein the target communication state information is one of the following information: camera opening information, microphone opening information, camera opening and microphone opening information.
In a possible implementation, the generating method further includes:
and when monitoring that the communication state information corresponding to the candidate user terminal is updated, updating the target user terminal in the target group according to the updated communication state information.
In a possible implementation manner, the ranking information corresponding to the target ue is determined as follows:
determining a communication score corresponding to each target user terminal according to the communication characteristic information corresponding to each target user terminal based on the corresponding relation between the communication characteristic information and the communication score; wherein the communication feature information includes: communication state information, communication role information and screen sharing information;
and determining the sequencing information corresponding to the target user terminal according to the communication score corresponding to each target user terminal.
In a possible implementation, the generating method further includes:
when monitoring that the communication characteristic information corresponding to the target user terminal is updated, updating a communication score corresponding to the target user terminal according to the updated communication characteristic information;
and updating the sequencing information corresponding to the target user terminal according to the updated communication score corresponding to the target user terminal.
In a possible implementation manner, the selecting, according to the sorting information corresponding to the target user terminal, target video information from video information provided by the target user terminal includes:
and determining the video information provided by the target user terminal with the sequencing information in the target sequencing information range as the target video information.
In a possible implementation, the generating method further includes:
and pushing the multimedia information to be pushed to each candidate user terminal in the target group.
In a second aspect, an embodiment of the present application provides a multimedia information generating apparatus, where the generating apparatus includes:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring a target user terminal in a target group, and the target user terminal is a user terminal for providing multimedia information for a cloud server; the multimedia information comprises audio information and video information;
the selecting module is used for selecting target video information from the video information provided by the target user terminal according to the sequencing information corresponding to the target user terminal;
and the determining module is used for determining the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group.
In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, when the electronic device runs, the processor and the memory communicate through the bus, and the processor executes the machine-readable instructions to execute the steps of the method for generating multimedia information according to any one of the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the multimedia information generating method according to any one of the first aspect.
The method, the device, the electronic equipment and the storage medium for generating the multimedia information provided by the embodiment of the application acquire a target user terminal in a target group, wherein the target user terminal is a user terminal for providing the multimedia information to a cloud server; the multimedia information comprises audio information and video information; selecting target video information from the video information provided by the target user terminal according to the sequencing information corresponding to the target user terminal; and determining the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group. Through the screening of the multimedia information provided by the user terminal, the storage space of the multimedia information to be pushed is reduced, the fluency of playing the multimedia information to be pushed is improved, and the efficiency of the cloud video conference is improved.
Further, the method, the apparatus, the electronic device and the storage medium for generating multimedia information provided in the embodiment of the present application may also monitor communication state information corresponding to candidate user terminals located in the target group; and determining the candidate user terminal with the communication state information as the target communication state information as a target user terminal, and further acquiring the multimedia information provided by the target user terminal in the target group, so that invalid multimedia information pulling operation of the cloud server is reduced, and the working efficiency of the cloud server is improved.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a flowchart illustrating a method for generating multimedia information according to an embodiment of the present application;
fig. 2 is a flowchart illustrating another multimedia information generating method provided in an embodiment of the present application;
fig. 3 is a flowchart illustrating another multimedia information generating method provided in an embodiment of the present application;
fig. 4 is a flowchart illustrating another multimedia information generating method provided in an embodiment of the present application;
fig. 5 is a schematic structural diagram illustrating an apparatus for generating multimedia information according to an embodiment of the present application;
fig. 6 shows a schematic diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
At present, when a cloud video conference is performed, a server pulls audio and video information of each user terminal entering the cloud video conference, integrates the pulled multiple dispersed audio and video information into one integral audio and video information, and sends the integral audio and video information to each user terminal entering the cloud video conference, so as to realize information sharing. However, when a large number of user terminals enter the cloud video conference, the storage space occupied by the whole audio/video information generated by the server is large, so that when the user terminals play the whole audio information, a video pause phenomenon is easy to occur, and the conference efficiency is low.
Based on the above problems, embodiments of the present application provide a method and an apparatus for generating multimedia information, an electronic device, and a storage medium, to obtain a target user terminal in a target group, where the target user terminal is a user terminal that provides multimedia information to a cloud server; the multimedia information comprises audio information and video information; selecting target video information from the video information provided by the target user terminal according to the sequencing information corresponding to the target user terminal; and determining the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group. Through the screening of the multimedia information provided by the user terminal, the storage space of the multimedia information to be pushed is reduced, the fluency of playing the multimedia information to be pushed is improved, and the efficiency of the cloud video conference is improved.
The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solution proposed by the present application to the above-mentioned problems in the following should be the contribution of the inventor to the present application in the process of the present application.
The technical solutions in the present application will be described clearly and completely with reference to the drawings in the present application, and it should be understood that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the present application, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
To facilitate understanding of the present embodiment, a method for generating multimedia information disclosed in the embodiments of the present application will be described in detail first.
Referring to fig. 1, fig. 1 is a flowchart of a method for generating multimedia information according to an embodiment of the present application, where the method for generating multimedia information includes the following steps:
s101, acquiring a target user terminal in a target group, wherein the target user terminal is a user terminal for providing multimedia information for a cloud server; the multimedia information includes audio information and video information.
In the embodiment of the application, the target group is a cloud group generated by a cloud server, and the plurality of user terminals perform information interaction and information sharing based on the target group, optionally, the target group is a cloud video conference. According to whether each user terminal in the target group provides multimedia information for the cloud server or not, the user terminals in the target group are divided into two types, specifically comprising: the system comprises a target user terminal for providing multimedia information to the cloud server and other user terminals which do not provide the multimedia information to the cloud server. Here, the multimedia information includes audio information and video information.
Specifically, the user terminal that provides audio information, video information, audio information, and video information to the cloud server is determined as the target user terminal. And determining the user terminal which does not provide audio information or video information to the cloud server as other user terminals.
And S102, selecting target video information from the video information provided by the target user terminal according to the sequencing information corresponding to the target user terminal.
In the embodiment of the application, the ordering information corresponding to the target user terminals in the target group is obtained, the target user terminals of which the ordering information meets the preset ordering condition are determined as the video providing terminals corresponding to the target group, and the video information provided by the video providing terminals is determined as the target video information.
For example, the ranking information corresponding to the target ue in the target group is respectively: the user terminal 1, the user terminal 2 and the user terminal 3 preset the sorting condition that the user terminal ranked at the first position is determined as the video providing terminal, and then the video information provided by the user terminal 1 is determined as the target video information.
S103, determining the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group.
In the embodiment of the application, the audio information provided by each target user terminal in the target group and the target video information provided by each video providing terminal are determined as the multimedia information to be pushed corresponding to the target group. When the user terminal displays the multimedia information to be pushed, the player of the user terminal plays the audio information provided by each target user terminal, the display screen of the user terminal displays the target video information provided by each video providing terminal, in practice, the display screen is divided into a plurality of small areas, one target video information provided by one video providing terminal is displayed in each small area, and a user can watch a plurality of target video information provided by a plurality of video providing terminals through one display screen, wherein the number of the small areas in the display screen is consistent with the number of the video providing terminals.
According to the method for generating the multimedia information, the storage space of the multimedia information to be pushed can be reduced through screening of the multimedia information provided by the user terminal, the fluency of playing the multimedia information to be pushed is improved, and the efficiency of a cloud video conference is improved.
Further, referring to fig. 2, in the method for generating multimedia information provided in the embodiment of the present application, acquiring a target user terminal in a target group includes:
s201, monitoring communication state information corresponding to candidate user terminals in the target group.
In the embodiment of the present application, the candidate user terminal is any user terminal in the target group, the communication state information is microphone state information and camera state information of the candidate user terminal, and the communication state information specifically includes: camera opening information, microphone opening information, camera opening and microphone opening information, camera closing and microphone closing information.
S202, determining the communication state information as a candidate user terminal of the target communication state information as a target user terminal; wherein the target communication state information is one of the following information: camera opening information, microphone opening information, camera opening and microphone opening information.
In the embodiment of the application, the communication state information of each candidate user terminal is compared with the target communication state information, and if the communication state information of the candidate user terminal is any target communication state information, the candidate user terminal is determined as the target user terminal. The target communication state information is one of the following information: camera opening information, microphone opening information, camera opening and microphone opening information.
Correspondingly, in step 102, selecting target video information from the video information provided by the target user terminal according to the sorting information corresponding to the target user terminal includes: and selecting target video information from the video information provided by the target user terminal according to the sequencing information and the communication state information corresponding to the target user terminal. Specifically, a target user terminal whose sequencing information meets a preset sequencing condition and whose communication state information is first communication state information is determined as a video providing terminal corresponding to a target group, and video information provided by the video providing terminal is determined as target video information. Wherein, the first communication state information is one of the following information: camera turn-on information, camera turn-on and microphone turn-on information.
Step 103, determining the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group, including: and determining the target user terminal with the communication state information as the second communication state information as an audio providing terminal corresponding to the target group, acquiring the audio information provided by the audio providing terminal, and determining the audio information provided by the audio providing terminal and the video information provided by the video providing terminal as the multimedia information to be pushed corresponding to the target group. Wherein, the second communication status information is one of the following information: microphone opening information, camera opening and microphone opening information.
Further, the communication state information of the candidate user terminal in the target group is changed in real time, and when the communication state information of the candidate user terminal is changed, the target user terminal in the target group may also be changed correspondingly, in the method for generating multimedia information provided in the embodiment of the present application, the target user terminal is updated in the following manner:
and when monitoring that the communication state information corresponding to the candidate user terminal is updated, updating the target user terminal in the target group according to the updated communication state information.
In the embodiment of the application, the cloud server monitors the communication state information corresponding to each candidate user terminal in the target group in real time, when the communication state information corresponding to the candidate user terminal changes, the target user terminal corresponding to the target group is updated according to the current communication state information of each candidate user terminal in the target group, and specifically, a new target user terminal is selected from the candidate user terminals according to the current communication state information of each candidate user terminal in the target group.
Further, referring to fig. 3, in the method for generating multimedia information provided in the embodiment of the present application, the ranking information corresponding to the target ue is determined in the following manner:
s301, determining a communication score corresponding to each target user terminal according to the communication characteristic information corresponding to each target user terminal based on the corresponding relation between the communication characteristic information and the communication score; wherein the communication feature information includes: communication state information, communication role information and screen sharing information.
In this embodiment of the present application, each candidate user terminal in the target group corresponds to communication characteristic information, and correspondingly, the communication characteristic information corresponding to each target user terminal determines a communication score of the target user terminal according to the communication characteristic information corresponding to each target user terminal, where the communication characteristic information includes: communication state information, communication role information and screen sharing information, specifically, the communication state information specifically includes: camera opening information, microphone opening information, camera opening and microphone opening information, camera closing and microphone closing information; the communication role information specifically includes: moderator, joint moderator, speaker, screen sharer, other participants. Based on the preset corresponding relationship between the communication characteristic information and the communication score, according to the multi-dimension communication characteristic information (including communication state information dimension, communication role information dimension and screen sharing information dimension) corresponding to each target user terminal, finding the characteristic score corresponding to the communication characteristic information of each dimension, and according to the multi-dimension characteristic scores corresponding to the target user terminals, determining the target communication score corresponding to the target user terminals, optionally, taking the sum, average, maximum, minimum and the like of the multi-dimension characteristic scores as the target communication score corresponding to the target user terminals.
As an optional implementation manner, after the communication feature information corresponding to each candidate user terminal is obtained, based on a preset correspondence between the communication feature information and the communication score, according to the multi-dimensional communication feature information corresponding to each candidate user terminal, a feature score corresponding to the communication feature information of each dimension is searched, and according to the multi-dimensional feature scores corresponding to the candidate user terminals, a target communication score corresponding to the candidate user terminal is determined.
S302, determining the sequencing information corresponding to the target user terminal according to the communication score corresponding to each target user terminal.
In the embodiment of the application, the target user terminals are arranged according to the communication scores from large to small based on the communication scores corresponding to each target user terminal, and the sequencing information corresponding to the target user terminals is obtained.
As an optional implementation manner, based on the communication score corresponding to each candidate user terminal, the candidate user terminals are arranged in the order of communication scores from large to small, so as to obtain the ranking information corresponding to the candidate user terminals.
In practice, when a cloud video conference is performed, the ranking information corresponding to the candidate user terminal is as follows: host screen sharing > allies oneself with seat host screen sharing > other participants screen sharing > host (open camera and microphone) > host (open camera or microphone) > allies oneself with the seat host (open microphone and camera) > allies oneself with the seat host (open camera or microphone) > other participants (open camera and microphone) > other participants (only open camera) > the seat (close microphone and camera) > allies oneself with the seat host (close microphone and camera) > other participants (close camera and microphone).
And selecting first target video information from the video information provided by the target user terminal based on the sorting information corresponding to the target user terminal, and selecting second target video information from the video information provided by the target user terminal based on the sorting information corresponding to the candidate user terminal, wherein the first target video information is consistent with the second target video information.
Further, referring to fig. 4, the communication characteristic information of the target user terminal in the target group is changed in real time, and when the communication characteristic information of the target user terminal is changed, the ranking information corresponding to the target user terminal may also be changed correspondingly, in the method for generating multimedia information provided in the embodiment of the present application, the ranking information corresponding to the target user terminal is updated in the following manner:
s401, when the communication characteristic information corresponding to the target user terminal is monitored to be updated, updating the communication score corresponding to the target user terminal according to the updated communication characteristic information.
In the embodiment of the application, the cloud server monitors communication characteristic information corresponding to each target user terminal in a target group in real time, when the communication characteristic information corresponding to the target user terminal changes, the communication score corresponding to the target user terminal is updated according to the current communication characteristic information of the target user terminal, and specifically, based on the corresponding relation between the communication characteristic information and the communication score, the new communication score corresponding to the target user terminal is determined according to the new communication characteristic information corresponding to the target user terminal.
As an optional implementation manner, the cloud server monitors communication feature information corresponding to each candidate user terminal in the target group in real time, and updates a communication score corresponding to the candidate user terminal according to current communication feature information of the candidate user terminal when the communication feature information corresponding to the candidate user terminal changes.
S402, updating the sequencing information corresponding to the target user terminal according to the updated communication score corresponding to the target user terminal.
In the embodiment of the application, if the communication score of the target user terminal changes, the ranking information corresponding to the target user terminal in the target group is updated, and specifically, the target user terminals are ranked according to the sequence of the new communication scores from large to small based on the new communication score corresponding to each target user terminal, so as to obtain the new ranking information corresponding to the target user terminal.
As an optional implementation manner, if there is a change in the communication score of the candidate ue, the ranking information corresponding to the candidate ue in the target group is updated. And selecting first target video information from the video information provided by the target user terminal based on the sorting information corresponding to the target user terminal, and selecting second target video information from the video information provided by the target user terminal based on the sorting information corresponding to the candidate user terminal, wherein the first target video information is consistent with the second target video information.
Further, in the method for generating multimedia information provided in the embodiment of the present application, the selecting, according to the sorting information corresponding to the target user terminal, target video information from video information provided by the target user terminal includes:
and determining the video information provided by the target user terminal with the sequencing information in the target sequencing information range as the target video information.
In the embodiment of the application, a target ordering information range, for example, the first to fourth bits, is prestored in the cloud server, and a target user terminal whose ordering information is located in the target ordering information range is determined as a video providing terminal, and video information provided by the video providing terminal is target video information.
In practice, the display screen is divided into a plurality of small areas, each small area displays the target video information provided by one video providing terminal, the target sorting information range is determined according to the number of the small areas divided by the display screen, for example, the display screen is divided into eight small areas, the target sorting information range is from the first bit to the eighth bit, and the target user terminals arranged in the first eight bits are determined as the video providing terminals.
Further, in the method for generating multimedia information provided in the embodiment of the present application, after the cloud server generates the multimedia information to be pushed, the multimedia information to be pushed is pushed to each candidate user terminal in the target group.
In the embodiment of the application, the candidate user terminals realize the sharing of the multimedia information based on the target group, and the cloud server pushes the determined multimedia information to be pushed to each candidate user terminal in the target group, so that each candidate user terminal displays the multimedia information to be pushed.
Based on the same inventive concept, the embodiment of the present application further provides a device for generating multimedia information corresponding to the method for generating multimedia information, and because the principle of solving the problem of the device in the embodiment of the present application is similar to that of the method for generating multimedia information in the embodiment of the present application, the implementation of the device may refer to the implementation of the method, and repeated details are not repeated.
Referring to fig. 5, fig. 5 is a schematic structural diagram of a multimedia information generating apparatus according to an embodiment of the present application, where the multimedia information generating apparatus includes:
an obtaining module 501, configured to obtain a target user terminal in a target group, where the target user terminal is a user terminal that provides multimedia information to a cloud server; the multimedia information comprises audio information and video information;
a selecting module 502, configured to select target video information from the video information provided by the target user terminal according to the sorting information corresponding to the target user terminal;
the determining module 503 is configured to determine the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group.
In a possible implementation manner, the obtaining module 501, when obtaining the target ue in the target group, includes:
monitoring communication state information corresponding to candidate user terminals in a target group;
determining the candidate user terminal with the communication state information as the target communication state information as a target user terminal; wherein the target communication state information is one of the following information: camera opening information, microphone opening information, camera opening and microphone opening information.
In a possible implementation manner, the multimedia information generating apparatus 500 further includes:
and the first updating module is used for updating the target user terminal in the target group according to the updated communication state information when the communication state information corresponding to the candidate user terminal is monitored to be updated.
In a possible implementation manner, the multimedia information generating apparatus 500 further includes:
the first determining module is used for determining the communication score corresponding to each target user terminal according to the communication characteristic information corresponding to each target user terminal based on the corresponding relation between the communication characteristic information and the communication score; wherein the communication feature information includes: communication state information, communication role information and screen sharing information;
and the second determining module is used for determining the sequencing information corresponding to the target user terminal according to the communication score corresponding to each target user terminal.
In a possible implementation manner, the multimedia information generating apparatus 500 further includes:
the second updating module is used for updating the communication score corresponding to the target user terminal according to the updated communication characteristic information when the communication characteristic information corresponding to the target user terminal is monitored to be updated;
and the third updating module is used for updating the sequencing information corresponding to the target user terminal according to the updated communication score corresponding to the target user terminal.
In a possible implementation manner, when selecting the target video information from the video information provided by the target user terminal according to the sorting information corresponding to the target user terminal, the selecting module 502 includes:
and determining the video information provided by the target user terminal with the sequencing information in the target sequencing information range as the target video information.
In a possible implementation manner, the multimedia information generating apparatus 500 further includes:
and the pushing module is used for pushing the multimedia information to be pushed to each candidate user terminal in the target group.
The multimedia information generation device provided by the embodiment of the application can reduce the storage space of the multimedia information to be pushed through screening the multimedia information provided by the user terminal, improve the fluency of playing the multimedia information to be pushed, and improve the efficiency of a cloud video conference.
Referring to fig. 6, fig. 6 is an electronic device 600 provided in an embodiment of the present application, where the electronic device 600 includes: a processor 601, a memory 602 and a bus, wherein the memory 602 stores machine-readable instructions executable by the processor 601, when the electronic device runs, the processor 601 and the memory 602 communicate with each other through the bus, and the processor 601 executes the machine-readable instructions to execute the steps of the method for generating multimedia information.
Specifically, the memory 602 and the processor 601 can be general-purpose memories and processors, which are not limited to specific ones, and the processor 601 can execute the multimedia information generating method when executing the computer program stored in the memory 602.
Corresponding to the method for generating multimedia information, an embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program is executed by a processor to perform the steps of the method for generating multimedia information.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and there may be other divisions in actual implementation, and for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or modules through some communication interfaces, and may be in an electrical, mechanical or other form.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the spirit and scope of the exemplary embodiments of the present application, and are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (9)
1. A method for generating multimedia information, the method comprising:
acquiring a target user terminal in a target group, wherein the target user terminal is a user terminal for providing multimedia information for a cloud server; the multimedia information comprises audio information and video information;
selecting target video information from the video information provided by the target user terminal according to the sequencing information corresponding to the target user terminal;
determining the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group;
the selecting target video information from the video information provided by the target user terminal comprises: selecting target video information from the video information provided by the target user terminal according to the sequencing information and the communication state information corresponding to the target user terminal;
the selecting target video information from the video information provided by the target user terminal according to the sequencing information and the communication state information corresponding to the target user terminal includes:
determining a target user terminal with the communication state information being the first communication state information and the sequencing information meeting the preset sequencing condition as a video providing terminal corresponding to the target group, and determining the video information provided by the video providing terminal as the target video information; wherein, the first communication state information is one of the following information: camera opening information, camera opening and microphone opening information;
the acquiring of the target user terminal in the target group includes:
determining the candidate user terminal with the communication state information as the target communication state information as a target user terminal; wherein the target communication state information is one of the following information: camera opening information, microphone opening information, camera opening and microphone opening information; determining the sequencing information corresponding to the target user terminal by the following method:
determining a communication score corresponding to each target user terminal according to the communication characteristic information corresponding to each target user terminal based on the corresponding relation between the communication characteristic information and the communication score; wherein the communication feature information includes: communication state information, communication role information and screen sharing information;
and determining the sequencing information corresponding to the target user terminal according to the communication score corresponding to each target user terminal.
2. The method of claim 1, wherein the obtaining the target ues in the target group comprises:
and monitoring communication state information corresponding to the candidate user terminals in the target group.
3. The method of generating multimedia information according to claim 2, wherein the method further comprises:
and when monitoring that the communication state information corresponding to the candidate user terminal is updated, updating the target user terminal in the target group according to the updated communication state information.
4. The method of generating multimedia information according to claim 1, wherein the method further comprises:
when monitoring that the communication characteristic information corresponding to the target user terminal is updated, updating a communication score corresponding to the target user terminal according to the updated communication characteristic information;
and updating the sequencing information corresponding to the target user terminal according to the updated communication score corresponding to the target user terminal.
5. The method according to claim 1, wherein the selecting the target video information from the video information provided by the target user terminal according to the sorting information corresponding to the target user terminal comprises:
and determining the video information provided by the target user terminal with the sequencing information in the target sequencing information range as the target video information.
6. The method of generating multimedia information according to claim 1, wherein the method further comprises:
and pushing the multimedia information to be pushed to each candidate user terminal in the target group.
7. An apparatus for generating multimedia information, the apparatus comprising:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring a target user terminal in a target group, and the target user terminal is a user terminal for providing multimedia information for a cloud server; the multimedia information comprises audio information and video information;
the selecting module is used for selecting target video information from the video information provided by the target user terminal according to the sequencing information corresponding to the target user terminal;
the determining module is used for determining the audio information provided by the target user terminal and the selected target video information as the multimedia information to be pushed corresponding to the target group;
the selecting module is further configured to: selecting target video information from the video information provided by the target user terminal according to the sequencing information and the communication state information corresponding to the target user terminal;
when the selecting module is used for selecting the target video information from the video information provided by the target user terminal according to the sequencing information and the communication state information corresponding to the target user terminal, the selecting module is used for:
determining a target user terminal with the communication state information being the first communication state information and the sequencing information meeting the preset sequencing condition as a video providing terminal corresponding to the target group, and determining the video information provided by the video providing terminal as the target video information; wherein, the first communication state information is one of the following information: camera opening information, camera opening and microphone opening information;
when the obtaining module is used for obtaining the target user terminal in the target group, the obtaining module is used for:
determining the candidate user terminal with the communication state information as the target communication state information as a target user terminal; wherein the target communication state information is one of the following information: camera opening information, microphone opening information, camera opening and microphone opening information;
the generating means further comprises:
the first determining module is used for determining the communication score corresponding to each target user terminal according to the communication characteristic information corresponding to each target user terminal based on the corresponding relation between the communication characteristic information and the communication score; wherein the communication feature information includes: communication state information, communication role information and screen sharing information;
and the second determining module is used for determining the sequencing information corresponding to the target user terminal according to the communication score corresponding to each target user terminal.
8. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is operating, the processor executing the machine-readable instructions to perform the steps of the method for generating multimedia information according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, performs the steps of the method of generating multimedia information according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010696797.9A CN111787269B (en) | 2020-07-20 | 2020-07-20 | Multimedia information generation method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010696797.9A CN111787269B (en) | 2020-07-20 | 2020-07-20 | Multimedia information generation method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111787269A CN111787269A (en) | 2020-10-16 |
| CN111787269B true CN111787269B (en) | 2021-10-26 |
Family
ID=72763630
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010696797.9A Active CN111787269B (en) | 2020-07-20 | 2020-07-20 | Multimedia information generation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111787269B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115695387B (en) * | 2021-07-30 | 2024-06-25 | 腾讯科技（深圳）有限公司 | Audio and video conference implementation method, audio and video conference system and related devices |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101370114A (en) * | 2008-09-28 | 2009-02-18 | 深圳华为通信技术有限公司 | Video and audio processing method, multi-point control unit and video conference system |
| CN101483701A (en) * | 2008-01-07 | 2009-07-15 | 阿瓦雅技术有限公司 | Method and signal for multimedia meeting |
| JP2010154206A (en) * | 2008-12-25 | 2010-07-08 | Oki Electric Ind Co Ltd | Video conference management system |
| CN102377982A (en) * | 2010-08-25 | 2012-03-14 | 深圳市捷视飞通科技有限公司 | Online video system and video image collecting method thereof |
| CN102547212A (en) * | 2011-12-13 | 2012-07-04 | 浙江元亨通信技术股份有限公司 | Splicing method of multiple paths of video images |
| JP6152961B1 (en) * | 2016-09-28 | 2017-06-28 | パナソニックＩｐマネジメント株式会社 | Video conferencing equipment |
| CN107872683A (en) * | 2017-11-21 | 2018-04-03 | 广州视源电子科技股份有限公司 | Video data processing method, device, equipment and storage medium |
| CN110933359A (en) * | 2020-01-02 | 2020-03-27 | 随锐科技集团股份有限公司 | Intelligent video conference layout method and device and computer readable storage medium |
-
2020
- 2020-07-20 CN CN202010696797.9A patent/CN111787269B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101483701A (en) * | 2008-01-07 | 2009-07-15 | 阿瓦雅技术有限公司 | Method and signal for multimedia meeting |
| CN101370114A (en) * | 2008-09-28 | 2009-02-18 | 深圳华为通信技术有限公司 | Video and audio processing method, multi-point control unit and video conference system |
| JP2010154206A (en) * | 2008-12-25 | 2010-07-08 | Oki Electric Ind Co Ltd | Video conference management system |
| CN102377982A (en) * | 2010-08-25 | 2012-03-14 | 深圳市捷视飞通科技有限公司 | Online video system and video image collecting method thereof |
| CN102547212A (en) * | 2011-12-13 | 2012-07-04 | 浙江元亨通信技术股份有限公司 | Splicing method of multiple paths of video images |
| JP6152961B1 (en) * | 2016-09-28 | 2017-06-28 | パナソニックＩｐマネジメント株式会社 | Video conferencing equipment |
| CN107872683A (en) * | 2017-11-21 | 2018-04-03 | 广州视源电子科技股份有限公司 | Video data processing method, device, equipment and storage medium |
| CN110933359A (en) * | 2020-01-02 | 2020-03-27 | 随锐科技集团股份有限公司 | Intelligent video conference layout method and device and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111787269A (en) | 2020-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2880737C (en) | A user recommendation method and a user recommendation system using the same | |
| US11256865B2 (en) | Method and apparatus for sending sticker image during chat session | |
| WO2015120789A1 (en) | Information processing method and game server | |
| CN110772796B (en) | Team forming method and device and electronic equipment | |
| WO2014014853A2 (en) | Dynamic focus for conversation visualization environments | |
| CN108197210B (en) | User interactive reading method based on friend relationship and computing equipment | |
| CN111787269B (en) | Multimedia information generation method and device, electronic equipment and storage medium | |
| CN114860919A (en) | Topic recommendation method and device, computer equipment and storage medium | |
| CN115967691A (en) | Message processing method, message processing device, electronic equipment, storage medium and program product | |
| CN112447073A (en) | Explanation video generation method, explanation video display method and device | |
| CN114095793A (en) | Video playing method and device, computer equipment and storage medium | |
| CN108847948B (en) | Method and device for creating activity group, medium and computing equipment | |
| JP2021510431A (en) | Methods and equipment for visualization of public welfare activities | |
| CN112587922B (en) | Model display method and device | |
| CN111491195B (en) | Method and device for online video display | |
| CN111135580B (en) | Game character standby animation generation method and device | |
| CN110764676B (en) | Information resource display method and device, electronic equipment and storage medium | |
| CN111311456B (en) | Auxiliary learning method, auxiliary learning device, computer readable storage medium and electronic equipment | |
| CN114745594A (en) | Method and device for generating live playback video, electronic equipment and storage medium | |
| CN109729413B (en) | Method and terminal for sending bullet screen | |
| CN109842546B (en) | Conversation expression processing method and device | |
| CN112819313A (en) | Target image generation method and device | |
| CN111178936A (en) | Advertisement display testing method and device, electronic equipment and storage medium | |
| CN112084352B (en) | Data processing method, data display method and device | |
| CN111291538A (en) | Prompting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |