CN106789914B - Multimedia conference control method and system - Google Patents

Multimedia conference control method and system Download PDF

Info

Publication number
CN106789914B
CN106789914B CN201611051135.6A CN201611051135A CN106789914B CN 106789914 B CN106789914 B CN 106789914B CN 201611051135 A CN201611051135 A CN 201611051135A CN 106789914 B CN106789914 B CN 106789914B
Authority
CN
China
Prior art keywords
conference
server
meeting
control terminal
message
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611051135.6A
Other languages
Chinese (zh)
Other versions
CN106789914A (en
Inventor
陈亚强
杨坚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bangyan Technology Co ltd
Original Assignee
Bangyan Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bangyan Technology Co ltd filed Critical Bangyan Technology Co ltd
Priority to CN201611051135.6A priority Critical patent/CN106789914B/en
Priority to PCT/CN2016/110366 priority patent/WO2018094791A1/en
Publication of CN106789914A publication Critical patent/CN106789914A/en
Application granted granted Critical
Publication of CN106789914B publication Critical patent/CN106789914B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1069Session establishment or de-establishment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention discloses a multimedia conference control method and a multimedia conference control system, wherein the system comprises a conference control terminal, a server module and an external resource module, wherein the server module comprises a soft switch server, resource access equipment, a conference server, a media server and an on-demand server; the conference control terminal is accessed to the soft switch server through an SIP protocol, and the soft switch server, the on-demand server and the media server are respectively accessed to the conference server through the SIP protocol. The invention provides a multimedia conference control method and a multimedia conference control system, which can simulate a real conference scene to initiate a conference, can also cascade a plurality of conference rooms to participate in the conference, can meet the conference requirements of various complex types, and avoids implementing different conference schemes according to different conference types; while controlling members and conference resources in different environments. The method is widely applied to the field of multimedia conferences.

Description

Multimedia conference control method and system
Technical Field
The invention relates to the field of multimedia conferences, in particular to a multimedia conference control method and a multimedia conference control system.
Background
Multimedia conferencing systems generally refer to the integration of audio, optical, electrical devices and software that are interrelated with a conference. In the multimedia conference room, no matter whether reporting, summarizing, reporting, introducing products and the like are carried out, the picture, the text, the sound, the shadow and the picture are displayed by the interactive operation of the computer, the sensory perception of the participants is fully aroused, and the conference effect is greatly improved. Multimedia is also becoming more and more advantageous in the office field. The multimedia conference is held mainly by the following modes: 1. the conference is realized by inviting conference members to join the conference in real time on line under the multimedia condition. Such conferences are generally suitable for instant discussion conferences where conference members may speak at will. The conference chairman can not control the conference flow in real time through software, the conference end members are dismissed, and the conference is re-invited when the conference is started next time, so that the time waste and the rhythm of the conference are caused, and the complicated and changeable conference form can not be met. 2. And a conference template, wherein the conference is realized by grouping conference members into a group before the conference and informing the conference members needing to participate in advance. The members are ready online before the conference begins, and the chairman initiates the conference through the conference template. The conference mode can reduce the time for inviting the members before the conference begins, can simply carry out operation control on the conference members, and can repeatedly use the conference template. However, when a large conference or multiple conference resources are merged, the conference template cannot execute related actions according to a preset conference flow, cannot accurately master conference time, is easy to miss conference items, and lacks a real conference scene.
There is therefore a need for improvement.
Disclosure of Invention
In order to solve the above technical problems, an object of the present invention is to provide a multimedia conference control method and system.
The technical scheme adopted by the invention is as follows:
a multimedia conference control method, the method comprising the steps of:
s1, the main conference place conference control terminal and each resource access device in the conference room send registration information to the soft switch server and complete registration;
s2, the conference control terminal of the main conference place sends the basic information of the conference room and the information of the resource access equipment to the conference server to create the conference room;
s3, the main meeting place meeting server receives the meeting room resource information sent by the application party and configures a meeting plan;
s4, the main meeting place meeting control terminal sends a meeting request opening message to a meeting server, and the meeting server applies for media resources from a media server; the conference server calls the conference control terminal into the conference and joins the media server; the conference server adds each resource into the media server and establishes a media channel; the conference is started successfully;
s5, the conference control terminal of the main conference place sends a message to the conference server to inquire the configured plan action information; the conference server and the media server interactively establish a media channel and push a video stream to the conference control terminal;
s6, the main meeting place conference control terminal sends a sub meeting place adding message to the main meeting place conference server, the main meeting place conference server adds the sub meeting place into the main meeting place media server, and the sub meeting place and the main meeting place media server establish a media channel;
s7, the conference control terminal sends the speaker seat information to the conference server to realize the switching of speakers in the entity conference room;
s8, the conference control terminal uploads an audio and video file to the on-demand server, and the conference server adds the audio and video file into a conference place and pushes the file to a display screen;
and S9, the conference control terminal sends the ending information to the conference server to end the conference.
Further, the step S1 includes:
the resource access equipment sends a registration message to the soft switch server without authentication; the soft switch server responds and sends a command needing authentication to the resource access equipment; the resource access equipment sends a registration message to a soft switch server, and carries authentication information; and the soft switch server performs authentication.
Further, the step S2 includes: the conference control terminal receives the command to set the conference room basic information and the resource access equipment information and sends a request to store the conference room basic information and the resource access equipment information to the conference server.
Further, the step S3 includes that the approver receives and approves the user to apply for the meeting room resource information, and then sends the application meeting room resource information to the meeting server, and the meeting server determines that if there is no conflict in the application time period, returns a message of successful application and stores the application information; the approving party informs the user of the application result, sends a message to the guaranteeing party and informs the conference guaranteeing task; the support side sends a message to the conference server to configure a conference plan; the conference server saves the conference protocol and returns a response.
Further, the step S4 includes: the conference control terminal sends a message requesting to start a conference to a conference server, and the conference server sends a request for applying a media resource to a media server; the conference server calls the conference control terminal and each resource access device into a conference and establishes a media channel with the media server; and the conference server sends information of successful start of the conference to the conference control terminal.
Further, the step S5 includes: the conference control terminal sends a message to a conference server, inquires configured plan action information, and the conference server returns a response;
the conference control terminal sends the information in the conference session to a conference server to preview the action; the conference server and the media server interactively establish a media channel and push a video stream to the conference control terminal; and the conference control terminal sends a message to the conference server to execute the action or stop the execution of the action.
Further, the step S6 includes: the main meeting place meeting control terminal sends a message of adding the branch meeting places to a main meeting place meeting server; the main meeting place conference server sends an application message to a main meeting place media server; the main meeting place conference server sends a request message to the meeting server of the branch meeting place according to the bandwidth parameter of the branch meeting place; a conference server of the branch meeting place sends a message to a media server of the branch meeting place to reserve media resources; the conference server of the branch conference site returns a response to the conference server of the main conference site; a conference server of the branch conference place sends a message for establishing the conference place to a media server of the branch conference place, and resources of a conference room of the branch conference place are accessed into a conference; the main meeting place conference server adds the branch meeting places into the main meeting place media server, and the branch meeting places and the main meeting place media server establish a media channel.
Further, the step S7 includes: the conference control terminal receives the seat request message of the speaker and sends the message to the conference server; the conference server controls the camera to enter a corresponding preset point and aims at the speaker; and the conference control terminal sends a command to the conference server and pushes the current camera to a corresponding display screen.
Further, the step S8 includes uploading, by the conference control terminal, the audio/video file to the on-demand server; the conference control terminal sends a command to control the conference server to add the audio and video to the conference place; the conference server applies for a media channel for playing audio and video resources; the conference server calls an on-demand server, adds the audio and video file into a meeting place and pushes the audio and video file to a display screen; and after the playing is finished, the conference server deletes the audio and video file.
Further, the step S9 includes: the conference control terminal sends an ending message to the conference server; the conference server sends an end message to the media server and releases all media resources; the conference server sends an ending message to each conference member and conference room resource; and the conference server of the branch conference place receives the ending message of the main conference place, releases the media resources of the conference place and hangs up the resources of the local conference room.
On the other hand, the invention also provides a multimedia conference control system, which comprises a conference control terminal, a server module and an external resource module, wherein the server module comprises a soft switch server, resource access equipment, a conference server, a media server and an on-demand server; the conference control terminal is accessed to the soft switch server through an SIP protocol, wherein the external resource module comprises a camera resource, a display screen resource and a microphone resource, and the camera resource, the display screen resource and the microphone resource are all accessed to the server module through resource access equipment; the soft switch server, the on-demand server and the media server are respectively accessed to the conference server through an SIP protocol.
The invention has the beneficial effects that: the invention provides a multimedia conference control method and a multimedia conference control system, which can simulate a real conference scene to initiate a conference, can also cascade a plurality of conference rooms to participate in the conference, can meet the conference requirements of various complex types, and avoids implementing different conference schemes according to different conference types; while controlling members and conference resources in different environments.
The scheme can solve various simple and complex conferences and integrates functions of conference discussion, large screen, member control, data sharing and the like. The invention executes the conference by setting the conference plan, is convenient for the next use, can flexibly modify the conference plan and avoids repeated conference creation work. The method can more visually display the current conference progress state and improve the efficiency in the conference process.
Drawings
The following further describes embodiments of the present invention with reference to the accompanying drawings:
FIG. 1 is a system control diagram of an embodiment of the present invention;
FIG. 2 is a control flow diagram of a second embodiment of the present invention;
FIG. 3 is a control flow diagram of a third embodiment of the present invention;
FIG. 4 is a control flow diagram of a fourth embodiment of the present invention;
FIG. 5 is a control flow diagram of a fifth embodiment of the present invention;
FIG. 6 is a control flow diagram of a sixth embodiment of the present invention;
FIG. 7 is a control flow diagram of a seventh embodiment of the present invention;
FIG. 8 is a control flow diagram of the eighth embodiment of the present invention;
FIG. 9 is a control flow diagram of the ninth embodiment of the present invention;
fig. 10 is a control flow diagram of the tenth embodiment of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
When a meeting is started in a single meeting room, the meeting room is provided with three large screens (one or more cameras are arranged according to needs), one or more cameras and a set of sound system. One large screen is used for displaying a speaker video, one large screen is used for displaying a PPT, and the other large screen is used for displaying a panoramic image of a meeting place. All resources must be registered on the system and meeting room resources are created to associate the resources in the meeting room together for ease of operation. Before the conference is started, a conference room is required to be applied for use, and whether a support staff is needed or not can be selected in the conference room. The support personnel can configure the scheduled plan to be executed for the meeting, such as playing music, video, pushing, picture splicing and the like, when receiving the meeting supporting task.
When a plurality of meeting rooms are in a combined meeting, a main meeting place is arranged, other meeting places are all branch meeting places, and each meeting place is provided with one to three display screens. The conference room can be a conference room and can also be a common SIP terminal. The three display screens respectively display: a speaker video, PPT and jigsaw videos of all meeting places. When the main meeting place speaks, all the branch meeting place display screens display the speaker and the PPT of the main meeting place, and similarly, when the branch meeting places speak, all the branch meeting place display screens display the speaker and the PPT of the branch meeting places, and which meeting place speaks under the control of the chairman.
The invention provides a multimedia conference control system, which comprises a conference control terminal, a server module and an external resource module, wherein the server module comprises a soft switch server, resource access equipment, a conference server, a media server and an on-demand server; the conference control terminal is accessed to the soft switch server through an SIP protocol, wherein the external resource module comprises a camera resource, a display screen resource and a microphone resource, and the camera resource, the display screen resource and the microphone resource are all accessed to the server module through resource access equipment; the soft switch server, the on-demand server and the media server are respectively accessed to the conference server through an SIP protocol.
Fig. 1 is a schematic diagram of system control according to an embodiment of the present invention. The method describes a multimedia conference realization method based on IMS framework, the server part comprises a soft switch server, a conference server and a media server, a conference control terminal is accessed to the server through SIP protocol, and camera resources, display screen resources and microphone resources are accessed to the server through resource access equipment. The control signaling is SIP protocol inside the server and the media is RTP bearer. In the method, a soft switch server is responsible for registering conference control terminals and various resources in a conference room, calling routing and the like; the conference server is the core and is responsible for controlling and managing conference services; the media server is responsible for processing audio and video, such as audio mixing, video splicing and the like. The video and audio collected by a camera and a microphone of a conference room are input to a media server, the media server is controlled by the conference server to carry out audio and video processing, and then the media server is controlled to send the processed audio and video to a display screen and sound equipment of a conference room for output through RTP. The load of the resource access equipment accesses the display screen, the camera, the microphone and the sound equipment in the conference room into the video conference system.
The following explains the interface flow design in the video conference system, and describes the implementation flow of the method in detail:
a multimedia conference control method, the method comprising the steps of:
s1, the main conference place conference control terminal and each resource access device in the conference room send registration information to the soft switch server and complete registration;
s2, the conference control terminal of the main conference place sends the basic information of the conference room and the information of the resource access equipment to the conference server to create the conference room;
s3, the main meeting place meeting server receives the meeting room resource information sent by the application party and configures a meeting plan;
s4, the main meeting place meeting control terminal sends a meeting request opening message to a meeting server, and the meeting server applies for media resources from a media server; the conference server calls the conference control terminal into the conference and joins the media server; the conference server adds each resource into the media server and establishes a media channel; the conference is started successfully;
s5, the conference control terminal of the main conference place sends a message to the conference server to inquire the configured plan action information; the conference server and the media server interactively establish a media channel and push a video stream to the conference control terminal;
s6, the main meeting place conference control terminal sends a sub meeting place adding message to the main meeting place conference server, the main meeting place conference server adds the sub meeting place into the main meeting place media server, and the sub meeting place and the main meeting place media server establish a media channel;
s7, the conference control terminal sends the speaker seat information to the conference server to realize the switching of speakers in the entity conference room;
s8, the conference control terminal uploads an audio and video file to the on-demand server, and the conference server adds the audio and video file into a conference place and pushes the file to a display screen;
and S9, the conference control terminal sends the ending information to the conference server to end the conference.
Further, the step S1 includes:
the resource access equipment sends a registration message to the soft switch server without authentication; the soft switch server responds and sends a command needing authentication to the resource access equipment; the resource access equipment sends a registration message to a soft switch server, and carries authentication information; and the soft switch server performs authentication.
Further, the step S2 includes: the conference control terminal receives the command to set the conference room basic information and the resource access equipment information and sends a request to store the conference room basic information and the resource access equipment information to the conference server.
Further, the step S3 includes that the approver receives and approves the user to apply for the meeting room resource information, and then sends the application meeting room resource information to the meeting server, and the meeting server determines that if there is no conflict in the application time period, returns a message of successful application and stores the application information; the approving party informs the user of the application result, sends a message to the guaranteeing party and informs the conference guaranteeing task; the support side sends a message to the conference server to configure a conference plan; the conference server saves the conference protocol and returns a response.
Further, the step S4 includes: the conference control terminal sends a message requesting to start a conference to a conference server, and the conference server sends a request for applying a media resource to a media server; the conference server calls the conference control terminal and each resource access device into a conference and establishes a media channel with the media server; and the conference server sends information of successful start of the conference to the conference control terminal.
Further, the step S5 includes: the conference control terminal sends a message to a conference server, inquires configured plan action information, and the conference server returns a response;
the conference control terminal sends the information in the conference session to a conference server to preview the action; the conference server and the media server interactively establish a media channel and push a video stream to the conference control terminal; and the conference control terminal sends a message to the conference server to execute the action or stop the execution of the action.
Further, the step S6 includes: the main meeting place meeting control terminal sends a message of adding the branch meeting places to a main meeting place meeting server; the main meeting place conference server sends an application message to a main meeting place media server; the main meeting place conference server sends a request message to the meeting server of the branch meeting place according to the bandwidth parameter of the branch meeting place; a conference server of the branch meeting place sends a message to a media server of the branch meeting place to reserve media resources; the conference server of the branch conference site returns a response to the conference server of the main conference site; a conference server of the branch conference place sends a message for establishing the conference place to a media server of the branch conference place, and resources of a conference room of the branch conference place are accessed into a conference; the main meeting place conference server adds the branch meeting places into the main meeting place media server, and the branch meeting places and the main meeting place media server establish a media channel.
Further, the step S7 includes: the conference control terminal receives the seat request message of the speaker and sends the message to the conference server; the conference server controls the camera to enter a corresponding preset point and aims at the speaker; and the conference control terminal sends a command to the conference server and pushes the current camera to a corresponding display screen.
Further, the step S8 includes uploading, by the conference control terminal, the audio/video file to the on-demand server; the conference control terminal sends a command to control the conference server to add the audio and video to the conference place; the conference server applies for a media channel for playing audio and video resources; the conference server calls an on-demand server, adds the audio and video file into a meeting place and pushes the audio and video file to a display screen; and after the playing is finished, the conference server deletes the audio and video file.
Further, the step S9 includes: the conference control terminal sends an ending message to the conference server; the conference server sends an end message to the media server and releases all media resources; the conference server sends an ending message to each conference member and conference room resource; and the conference server of the branch conference place receives the ending message of the main conference place, releases the media resources of the conference place and hangs up the resources of the local conference room.
1. And (4) a resource registration interface. Fig. 2 is a control flow diagram of the second embodiment of the present invention.
1) Interface protocol: SIP protocol
2) Message flow
Scheme 1: the resource access device sends a registration message to the soft switch server without authentication.
And (2) a flow scheme: the softswitch server responds 401 back to tell the resource access device that authentication is required.
And (3) a flow path: the resource access equipment sends a registration message to the soft switch server, and carries authentication information.
And (4) a flow chart: the softswitch server authenticates and successfully returns 200 OK.
Fig. 3 is a control flow diagram of a third embodiment of the present invention.
2. Creating meeting room interfaces
1) Interface protocol: SIP protocol
2) Message flow
1-8: and filling meeting room information on the conference control terminal: conference room name, number of seats, conference room identification and the like, and the conference control terminal sends a MESSAGE MESSAGE to store the basic information of the conference room in the conference server.
And (9) a process of 16: the conference control terminal is provided with a camera, a display screen, a microphone, a sound resource and the like of the conference room, and the conference control terminal sends a MESSAGE MESSAGE to store the resource information in the conference server.
The process is 17-24: and the conference control terminal sets camera preset point information and sends a MESSAGE to store the preset point information in the conference server.
And 3, applying for a conference configuration plan interface. With reference to figure 4 of the drawings,
1) interface protocol: SIP protocol
2) Message flow
1-2: and the user selects information such as a meeting room, a meeting time period, an off-site member and the like to apply, and sends the MESSAGE application MESSAGE to the approver.
3-6: and the approver agrees to send a MESSAGE to the conference server to apply for the conference room resources, and if the application time interval has no conflict, the application is successful. The conference server saves the application information.
7-8: and the approver sends a MESSAGE to inform the user of the meeting application result.
And (9-10): and the approver sends a MESSAGE to the support and notifies the meeting support task.
The process 11-14: and the sponsor sends a MESSAGE to the conference server to configure a conference plan, and the conference server stores the conference plan and returns a response.
4. And starting a conference interface. Refer to fig. 5.
1) Interface protocol: SIP protocol
2) Message flow
1-4: the conference control terminal logs in the system;
5-8: and the conference control terminal sends a MESSAGE request MESSAGE to the conference server to request for starting the conference.
And (9) a process of 11: the conference server applies for media resources from the media server and reserves media resources required by the conference.
And (2) flow 12-17: and the conference server calls the conference control terminal into the conference.
The process is 18-19: the conference server adds the conference control terminal into the media server, and the media server establishes a media channel with the conference control terminal.
20-22: and the conference server applies for resources for the camera.
The process is as follows: and the conference server calls the camera resource into the conference.
The process is 29-30: the conference server adds the camera resources into the media server, and the media server and the camera resources establish a media channel. And repeating the processes of 20-30 by using resources such as a display screen, a microphone, a sound and the like, adding into the conference, and establishing a media channel with the media server.
Flow 31-32: and the conference server controls the media server to push the camera video to the display screen for display.
Flow 33-36: and the conference server sends back a response of successful conference opening to the conference control terminal.
5. A plan action is performed, referring to figure 6,
1) interface protocol: SIP protocol
2) Message flow
1-4: the conference control terminal sends a MESSAGE to the conference server to inquire the configured plan action information, and the server returns a response from the data inquiry.
5-17: the conference terminal sends an in-conference session message (REINVITE/info) to the conference server to preview the action. And when the preview stream is not opened, transmitting the reInvite + xml to negotiate to open the preview stream, and otherwise, transmitting the info + xml. And the conference server and the media server interactively establish a media channel and push a video stream to the conference control terminal.
The process is 17-28: the conference control terminal sends an info message to the conference server to execute the action, and can send the info to stop the action execution.
6. The meeting mid invitation breakout site interface, see fig. 7.
1) Interface protocol: SIP protocol
2) Message flow
Scheme 1: and adding a branch meeting place on the conference control terminal, and sending a REFER message to the conference server.
And (2) flow 2-4: the conference server sends a message to the main conference room media server (media server 1) to apply for 4 streams (1 audio stream and 3 video streams).
And (5) a flow chart: and the conference server sets the bandwidth parameters in the SDP according to the configured bandwidth of the conference hall, and sends the INVITE message to the conference server of the conference hall.
6-8: and the conference server (the conference server 2) of the branch meeting place sends a message to the media server (the media server 2) of the branch meeting place to reserve the media resources.
And (9-10): the conference server (conference server 2) in the branch conference place responds back to the conference server (conference server 1) in the main conference place.
The process is as follows: the conference server (conference server 2) of the branch conference place sends a message to the media server (media server 2) of the branch conference place to establish the conference place, and the camera, the display screen, the sound and the microphone resources of the conference room are added into the conference.
The process 13-14: the main meeting place conference server (conference server 1) adds the branch meeting places into the main meeting place media server (media server 1), and the branch meeting places and the main meeting place media server (media server 1) establish a media channel.
7. The physical conference room switches the talker interface, see fig. 8.
1) Interface protocol: SIP protocol
2) Message flow
1-6: the chairman clicks the seat of the speaker on the conference control terminal, the conference control terminal sends an INFO message to the conference server, and the conference server controls the camera to enter a corresponding preset point and aim at the speaker.
7-10: and the conference control terminal sends an INFO command to the conference server and pushes the current camera to a corresponding display screen.
8. A local audio/video file interface is played in the meeting, see fig. 9.
1) Interface protocol: SIP protocol
2) Message flow
1-2: the conference control terminal selects a local audio and video file to be played to a conference place, and the local audio and video file is uploaded to the on-demand server.
3-4: and the conference control terminal sends an INFO command to control the conference server to add the audio and video which are just uploaded to the on-demand server into the conference place.
5-7: the conference server applies for a media channel for playing the video resource.
And 8-10: and the conference server calls the on-demand server and adds the audio and video files uploaded by the conference control terminal into the conference place.
The process is as follows: the conference server adds the audio and video file on the on-demand server into a meeting place, and the media server is communicated with a direct media channel of the on-demand server.
The process 13-14: the video stream is pushed to the display screen.
15-16: and after the playing is finished, deleting the uploaded file.
9. The conference interface is ended, refer to fig. 10.
1) Interface protocol: SIP protocol
2) Message flow
1-2: and the conference terminal sends BYE to the conference server to finish the conference.
3-4: and the main meeting place conference server sends BYE to the main meeting place media server to release all media resources.
5-6: the main meeting place conference server sends BYE to each meeting member and meeting room resources (cameras, display screens, microphones and sound equipment).
7-8: and after receiving the BYE message of the main meeting place, the conference server of the branch meeting place releases the media resources of the local meeting place and hangs up the resources of the local meeting room.
By adopting the scheme, a real conference scene can be simulated to initiate a conference, and a plurality of conference rooms can be cascaded to participate in the conference. Meeting requirements of various complex types can be met only by one set of meeting scheme, and different meeting schemes are avoided being implemented according to different meeting types; while controlling members and conference resources in different environments.
The scheme can finish the preparation of the conference flow before the conference, prepare before the conference by technical support personnel, and simulate the conference scene to prepare a plan. Automatic or manual execution of the conference schedules is set, while the execution time of each schedule can be set.
Before the conference begins, the conference chairman and the technical support staff can simulate the conference travel, proficient the conference flow and the conference operation according to the established conference plan. Avoiding misoperation and omission of conference content in the conference process.
During the meeting, the technical support staff can execute the meeting according to a meeting plan prepared before the meeting. The complex operation of the chairman of the conference in the conference process is not needed, the conference efficiency of the chairman and the discipline in the conference are improved, and a large amount of conference time is saved. And the conference members can also know the whole conference flow and progress according to the conference plan and participate in the roles played in the conference.
After the meeting is finished, the meeting plan is stored in the plan list as a template, so that the meeting plan can be conveniently reused later. And the conference plan can be flexibly modified, and repeated conference creation work is avoided.
The invention provides a multimedia conference control method and a multimedia conference control system, which can simulate a real conference scene to initiate a conference, can also cascade a plurality of conference rooms to participate in the conference, can meet the conference requirements of various complex types, and avoids implementing different conference schemes according to different conference types; while controlling members and conference resources in different environments.
The scheme can solve various simple and complex conferences and integrates functions of conference discussion, large screen, member control, data sharing and the like. The invention executes the conference by setting the conference plan, is convenient for the next use, can flexibly modify the conference plan and avoids repeated conference creation work. The method can more visually display the current conference progress state and improve the efficiency in the conference process.
While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (11)

1. A multimedia conference control method, characterized in that the method comprises the steps of:
s1, the main conference place conference control terminal and each resource access device in the conference room send registration information to the soft switch server and complete registration;
s2, the main meeting place meeting control terminal sends the meeting room basic information and the resource access equipment information to the meeting server to create a meeting room;
s3, the main meeting place conference server receives the meeting room resource information sent by the applicant and configures the meeting plan;
s4, the main meeting place meeting control terminal sends a meeting request opening message to a meeting server, and the meeting server applies for media resources from a media server; the conference server calls the conference control terminal into the conference and joins the media server; the conference server adds each resource into the media server and establishes a media channel; the conference is started successfully;
s5, the conference control terminal of the main conference place sends a message to the conference server to inquire the configured plan action information; the conference server and the media server interactively establish a media channel and push a video stream to the conference control terminal;
s6, the main meeting place conference control terminal sends a sub meeting place adding message to the main meeting place conference server, the main meeting place conference server adds the sub meeting place into the main meeting place media server, and the sub meeting place and the main meeting place media server establish a media channel;
s7, the conference control terminal sends the speaker seat information to the conference server to realize the switching of speakers in the entity conference room;
s8, the conference control terminal uploads an audio and video file to the on-demand server, and the conference server adds the audio and video file into a conference place and pushes the file to a display screen;
and S9, the conference control terminal sends the ending information to the conference server to end the conference.
2. The multimedia conference control method according to claim 1, wherein the step S1 includes:
the resource access equipment sends a registration message to the soft switch server without authentication;
the soft switch server responds and sends a command needing authentication to the resource access equipment; the resource access equipment sends a registration message to a soft switch server, and carries authentication information; and the soft switch server performs authentication.
3. The multimedia conference control method according to claim 1, wherein the step S2 includes: the conference control terminal receives the command to set the conference room basic information and the resource access equipment information and sends a request to store the conference room basic information and the resource access equipment information to the conference server.
4. The method as claimed in claim 1, wherein the step S3 includes the examining and approving party receiving and agreeing the user to apply for the meeting room resource information, and then sending the meeting room resource information to the meeting server, and the meeting server determining if there is no conflict in the application period, returning a message of successful application and saving the application information; the approving party informs the user of the application result, sends a message to the guaranteeing party and informs the conference guaranteeing task; the support side sends a message to the conference server to configure a conference plan; the conference server saves the conference protocol and returns a response.
5. The multimedia conference control method according to claim 1, wherein the step S4 includes: the conference control terminal sends a message requesting to start a conference to a conference server, and the conference server sends a request for applying a media resource to a media server; the conference server calls the conference control terminal and each resource access device into a conference and establishes a media channel with the media server; and the conference server sends information of successful start of the conference to the conference control terminal.
6. The multimedia conference control method according to claim 1, wherein the step S5 includes: the conference control terminal sends a message to a conference server, inquires configured plan action information, and the conference server returns a response;
the conference control terminal sends a conference session message to a conference server to preview the action; the conference server and the media server interactively establish a media channel and push a video stream to the conference control terminal; and the conference control terminal sends a message to the conference server to execute the action or stop the execution of the action.
7. The multimedia conference control method according to claim 1, wherein the step S6 includes: the main meeting place meeting control terminal sends a message of adding the branch meeting places to a main meeting place meeting server; the main meeting place conference server sends an application message to a main meeting place media server; the main meeting place conference server sends a request message to the meeting server of the branch meeting place according to the bandwidth parameter of the branch meeting place; a conference server of the branch meeting place sends a message to a media server of the branch meeting place to reserve media resources; the conference server of the branch conference site returns a response to the conference server of the main conference site; a conference server of the branch conference place sends a message for establishing the conference place to a media server of the branch conference place, and resources of a conference room of the branch conference place are accessed into a conference; the main meeting place conference server adds the branch meeting places into the main meeting place media server, and the branch meeting places and the main meeting place media server establish a media channel.
8. The multimedia conference control method according to claim 1, wherein the step S7 includes: the conference control terminal receives the seat request message of the speaker and sends the message to the conference server; the conference server controls the camera to enter a corresponding preset point and aims at the speaker; and the conference control terminal sends a command to the conference server and pushes the current camera to a corresponding display screen.
9. The multimedia conference control method according to claim 1, wherein the step S8 includes the conference control terminal uploading an audio/video file to the on-demand server; the conference control terminal sends a command to control the conference server to add the audio and video to the conference place; the conference server applies for a media channel for playing audio and video resources; the conference server calls an on-demand server, adds the audio and video file into a meeting place and pushes the audio and video file to a display screen; and after the playing is finished, the conference server deletes the audio and video file.
10. The multimedia conference control method according to claim 1, wherein the step S9 includes: the conference control terminal sends an ending message to the conference server; the conference server sends an end message to the media server and releases all media resources; the conference server sends an ending message to each conference member and conference room resource; and the conference server of the branch conference place receives the ending message of the main conference place, releases the media resources of the conference place and hangs up the resources of the local conference room.
11. A multimedia conference control system for performing the control method according to any one of claims 1 to 10, comprising a conference terminal, a server module and an external resource module, wherein the server module comprises a softswitch server, a resource access device, a conference server, a media server and an on-demand server; the conference control terminal is accessed to the soft switch server through an SIP protocol, wherein the external resource module comprises a camera resource, a display screen resource and a microphone resource, and the camera resource, the display screen resource and the microphone resource are all accessed to the server module through resource access equipment; the soft switch server, the on-demand server and the media server are respectively accessed to the conference server through an SIP protocol.
CN201611051135.6A 2016-11-24 2016-11-24 Multimedia conference control method and system Active CN106789914B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201611051135.6A CN106789914B (en) 2016-11-24 2016-11-24 Multimedia conference control method and system
PCT/CN2016/110366 WO2018094791A1 (en) 2016-11-24 2016-12-16 Multimedia conferencing control method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611051135.6A CN106789914B (en) 2016-11-24 2016-11-24 Multimedia conference control method and system

Publications (2)

Publication Number Publication Date
CN106789914A CN106789914A (en) 2017-05-31
CN106789914B true CN106789914B (en) 2020-04-14

Family

ID=58912356

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611051135.6A Active CN106789914B (en) 2016-11-24 2016-11-24 Multimedia conference control method and system

Country Status (2)

Country Link
CN (1) CN106789914B (en)
WO (1) WO2018094791A1 (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108932168A (en) * 2017-05-27 2018-12-04 湖南云控科技有限公司 A kind of PPT field management method
CN109005141B (en) * 2017-06-06 2021-04-23 展讯通信(天津)有限公司 IMS-based session processing method and device and electronic equipment
CN109246383B (en) * 2017-07-11 2022-03-29 中兴通讯股份有限公司 Control method of multimedia conference terminal and multimedia conference server
CN107333094A (en) * 2017-08-07 2017-11-07 西安万像电子科技有限公司 Conference system and display processing method, device
CN107682381A (en) * 2017-11-22 2018-02-09 云智汇(深圳)高新科技服务有限公司 Multipartite voice conference system and method
CN108965782B (en) * 2017-12-12 2020-06-23 视联动力信息技术股份有限公司 Conference processing method and device
CN108259814A (en) * 2018-02-06 2018-07-06 苏州必捷网络有限公司 A kind of method that monitoring camera holder is controlled in video conference
CN110505430A (en) * 2018-05-17 2019-11-26 视联动力信息技术股份有限公司 A kind of method and apparatus of Conference control
CN110708174B (en) * 2018-07-10 2021-09-24 陈立新 Third party conference equipment control system
TWI671634B (en) 2018-07-10 2019-09-11 立新 陳 Third party conference equipment control system
CN109714561A (en) * 2019-01-07 2019-05-03 福建星网智慧科技股份有限公司 A kind of SIP conference control method based on INFO message
CN110099242A (en) * 2019-04-02 2019-08-06 视联动力信息技术股份有限公司 A kind of remote living broadcast method and device
CN113014792A (en) * 2019-12-20 2021-06-22 青岛海信移动通信技术股份有限公司 Terminal equipment and camera resource sharing method
CN112073672A (en) * 2020-08-03 2020-12-11 视联动力信息技术股份有限公司 Video networking conference control method and device
CN112954257B (en) * 2021-02-08 2022-06-14 福建天晴数码有限公司 Automatic verification method and system for video conference
CN113784082A (en) * 2021-06-22 2021-12-10 珠海华发新科技投资控股有限公司 Multifunctional video conference platform and system thereof
CN114615461B (en) * 2022-05-12 2022-09-06 广州市保伦电子有限公司 Video conference remote interaction system with coexistence of multiple conferences

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101060415A (en) * 2006-06-06 2007-10-24 华为技术有限公司 A method for effective using the conference resources in the conference system
CN103875232A (en) * 2011-10-13 2014-06-18 瑞典爱立信有限公司 Apparatus and method for conferencing
CN104519307A (en) * 2014-12-12 2015-04-15 华为软件技术有限公司 Conference management system, multi-image synthesis equipment, session equipment, video conference implementing method and system
CN105812717A (en) * 2016-04-21 2016-07-27 邦彦技术股份有限公司 Multimedia conference control method and server

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7298930B1 (en) * 2002-11-29 2007-11-20 Ricoh Company, Ltd. Multimodal access of meeting recordings
US8355040B2 (en) * 2008-10-16 2013-01-15 Teliris, Inc. Telepresence conference room layout, dynamic scenario manager, diagnostics and control system and method
CN101710962B (en) * 2009-12-22 2012-07-18 中兴通讯股份有限公司 Method and device for distributing video conference resources
CN101848221B (en) * 2010-05-20 2014-10-29 创想空间软件技术(北京)有限公司 Question answering system of large multimedia conference publishing system
CN102123154B (en) * 2011-03-17 2015-07-08 北京邮电大学 Session initiation protocol (SIP) terminal and session processing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101060415A (en) * 2006-06-06 2007-10-24 华为技术有限公司 A method for effective using the conference resources in the conference system
CN103875232A (en) * 2011-10-13 2014-06-18 瑞典爱立信有限公司 Apparatus and method for conferencing
CN104519307A (en) * 2014-12-12 2015-04-15 华为软件技术有限公司 Conference management system, multi-image synthesis equipment, session equipment, video conference implementing method and system
CN105812717A (en) * 2016-04-21 2016-07-27 邦彦技术股份有限公司 Multimedia conference control method and server

Also Published As

Publication number Publication date
WO2018094791A1 (en) 2018-05-31
CN106789914A (en) 2017-05-31

Similar Documents

Publication Publication Date Title
CN106789914B (en) Multimedia conference control method and system
CN101483749B (en) Video meeting implementing method and system based on media server
KR101243065B1 (en) Conference terminal, conference server, conference system and data processing method
US11805158B2 (en) Method and system for elevating a phone call into a video conferencing session
US8572183B2 (en) Panoramic video in a live meeting client
US20120017149A1 (en) Video whisper sessions during online collaborative computing sessions
US10715344B2 (en) Method of establishing a video call using multiple mobile communication devices
KR101149987B1 (en) Efficient routing of real―time multimedia information
CN113489687B (en) Audio and video information intercommunication method and client across multiple networks
US20160344780A1 (en) Method and system for controlling communications for video/audio-conferencing
CN104980686A (en) Method for controlling scenes in video conference
CN111405229B (en) Video conference processing method, system, client, electronic equipment and storage medium
CN113411538B (en) Video session processing method and device and electronic equipment
WO2016019775A1 (en) Conference migration method, device and system
CN112616066B (en) Group discussion system and method based on live broadcast
KR20140098573A (en) Apparatus and Methd for Providing Video Conference
JP7463552B2 (en) SESSION CREATION METHOD, ELECTRONIC DEVICE, AND READABLE STORAGE MEDIUM
CN105556980B (en) For integrating the method and system of content viewing and communication in immersion social activity center session
WO2014161326A1 (en) Video communication method and device
JP2007201916A (en) PoC DATA TRANSMISSION METHOD AND PoC CALL SYSTEM AND DEVICE
CN113949596B (en) Device connection method, device and storage medium
WO2016206471A1 (en) Multimedia service processing method, system and device
CN111314647A (en) Electronic whiteboard control method, mobile terminal and electronic whiteboard system
CN101719903A (en) Method and system for realizing multi-point control unit cascading of IP multimedia subsystem
CN116193062A (en) Conference interconnection method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP02 Change in the address of a patent holder
CP02 Change in the address of a patent holder

Address after: 518000 2101, No. 100, Zhihe Road, Dakang community, Yuanshan street, Longgang District, Shenzhen, Guangdong

Patentee after: BANGYAN TECHNOLOGY Co.,Ltd.

Address before: 9 / F, block B, building 5, Shenzhen software industry base, No.13, Haitian 1st Road, Nanshan District, Shenzhen, Guangdong 518000

Patentee before: BANGYAN TECHNOLOGY Co.,Ltd.