CN113612964A - Interactive teaching processing method and device, computer equipment and storage medium - Google Patents
Interactive teaching processing method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113612964A CN113612964A CN202110862740.6A CN202110862740A CN113612964A CN 113612964 A CN113612964 A CN 113612964A CN 202110862740 A CN202110862740 A CN 202110862740A CN 113612964 A CN113612964 A CN 113612964A
- Authority
- CN
- China
- Prior art keywords
- listening
- speaking terminal
- terminal
- main
- speaking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 77
- 238000003672 processing method Methods 0.000 title abstract description 14
- 230000011664 signaling Effects 0.000 claims abstract description 144
- 230000004044 response Effects 0.000 claims abstract description 94
- 230000003993 interaction Effects 0.000 claims abstract description 83
- 238000000034 method Methods 0.000 claims abstract description 61
- 230000006854 communication Effects 0.000 claims abstract description 52
- 238000004891 communication Methods 0.000 claims abstract description 52
- 238000012545 processing Methods 0.000 claims abstract description 46
- 238000012790 confirmation Methods 0.000 claims description 31
- 230000000977 initiatory effect Effects 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 15
- 230000008569 process Effects 0.000 description 26
- 238000010586 diagram Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 8
- 230000002457 bidirectional effect Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 230000015572 biosynthetic process Effects 0.000 description 6
- 238000003786 synthesis reaction Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 5
- 238000013475 authorization Methods 0.000 description 4
- 230000008676 import Effects 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 239000004248 saffron Substances 0.000 description 2
- 230000007175 bidirectional communication Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Telephonic Communication Services (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The application relates to a processing method and device for interactive teaching, computer equipment and a storage medium. The method comprises the following steps: the main speaking terminal sends a permission request signaling to the gateway according to the listening terminal identification contained in the class schedule information under the condition of judging the class time; the main speaking terminal receives a response message sent by the network gate, initiates a calling request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and carries out information interaction with the listening and speaking terminal according to the calling request, wherein the response message is generated by a judgment result that the network gate judges whether the communication between the main speaking terminal and the listening and speaking terminal crosses a public and private network or not according to the permission request signaling. By adopting the method, the processing efficiency of interactive teaching can be effectively improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a processing method and apparatus for interactive teaching, a computer device, and a storage medium.
Background
With the development of computer technology, network interaction, live broadcast and recorded broadcast teaching based on video conference and recorded broadcast technology are more and more widely applied. For interactive teaching, the interactive teaching mode mainly adopts network interaction, live broadcast and on-demand teaching modes to develop, wherein the interactive teaching mode of a listening and speaking school is driven by a central school to be more common, the effect is better, and the approval of most users is obtained.
However, in the current processing mode of interactive teaching, a standard hardware video conference system is usually adopted, which is composed of conference terminals and an MCU (Multipoint Control Unit), and the MCU is required to process video and audio data of each terminal in a centralized manner, especially when a plurality of interactive courses are performed simultaneously, the video and audio data are processed in a centralized manner on the MCU in the central machine room, the requirement on the number of courses processed by the MCU in the central machine room simultaneously is very high, and the requirement on the network uplink and downlink bandwidth of the central machine room is also very high, which easily results in low processing efficiency of interactive teaching.
Disclosure of Invention
In view of the above, it is necessary to provide a processing method, an apparatus, a computer device, and a storage medium for interactive teaching, which can improve the processing efficiency of interactive teaching.
A method of processing interactive instruction, the method comprising:
the main speaking terminal sends a permission request signaling to the gateway according to the listening terminal identification contained in the class schedule information under the condition of judging the class time;
the main speaking terminal receives a response message sent by the network gate, initiates a calling request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and carries out information interaction with the listening and speaking terminal according to the calling request, wherein the response message is generated by a judgment result that the network gate judges whether the communication between the main speaking terminal and the listening and speaking terminal crosses a public and private network or not according to the permission request signaling.
In one embodiment, the receiving, by the master terminal, the response message sent by the gatekeeper, initiating a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identifier, and performing information interaction with the listening and speaking terminal according to the call request includes:
the main speaking terminal receives the permission confirmation signaling responded by the gatekeeper; the admission confirmation signaling is generated by the gatekeeper judging not to cross public and private networks; the permission confirmation signaling carries the IP address of the listening and speaking terminal; the IP address and the IP address of the main speaking terminal belong to the same local area network address;
the main speaking terminal initiates a call request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal, and establishes communication connection with the listening and speaking terminal to perform information interaction.
In one embodiment, the receiving, by the master terminal, the response message sent by the gatekeeper, initiating a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identifier, and performing information interaction with the listening and speaking terminal according to the call request includes:
the said main speaking terminal receives the said gateway response permission rejection signaling, and receives the said gateway sent notification message; the permission rejection signaling is generated by the gatekeeper decision across a public and private network;
the main speaking terminal starts a public calling private strategy according to the notification message, initiates a calling request to a multipoint control unit, and carries out information interaction with the listening and speaking terminal through the multipoint control unit.
In one embodiment, the method further comprises:
the main speaking terminal sends multimedia data to the multipoint control unit so that the multipoint control unit forwards the multimedia data to the listening and speaking terminal;
and/or the main speaking terminal receives the multimedia data transmitted by the listening and speaking terminal forwarded by the multipoint control unit.
A processing apparatus for interactive instruction, the apparatus comprising:
the sending module is used for sending a permission request signaling to the gateway according to the listening terminal identification contained in the class schedule information under the condition of judging the class time;
the receiving module is used for receiving a response message sent by the gatekeeper;
and the information interaction module is used for initiating a calling request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and carrying out information interaction with the listening and speaking terminal according to the calling request, wherein the response message is generated by a judgment result of judging whether the communication between the main speaking terminal and the listening and speaking terminal crosses a public and private network or not by the gateway according to the permission request signaling.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
the main speaking terminal sends a permission request signaling to the gateway according to the listening terminal identification contained in the class schedule information under the condition of judging the class time;
the main speaking terminal receives a response message sent by the network gate, initiates a calling request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and carries out information interaction with the listening and speaking terminal according to the calling request, wherein the response message is generated by a judgment result that the network gate judges whether the communication between the main speaking terminal and the listening and speaking terminal crosses a public and private network or not according to the permission request signaling.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
the main speaking terminal sends a permission request signaling to the gateway according to the listening terminal identification contained in the class schedule information under the condition of judging the class time;
the main speaking terminal receives a response message sent by the network gate, initiates a calling request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and carries out information interaction with the listening and speaking terminal according to the calling request, wherein the response message is generated by a judgment result that the network gate judges whether the communication between the main speaking terminal and the listening and speaking terminal crosses a public and private network or not according to the permission request signaling.
According to the processing method, the device, the computer equipment and the storage medium for interactive teaching, the main speaking terminal sends a permission request signaling to the gateway according to the listening terminal identification contained in the class schedule information under the condition of judging the class time, the main speaking terminal receives a response message sent by the gateway, initiates a calling request to the listening terminal corresponding to the listening terminal identification according to the response message, and carries out information interaction with the listening terminal according to the calling request, and the response message is generated by a judgment result that whether the communication between the main speaking terminal and the listening terminal crosses a public and private network or not is judged by the gateway according to the permission request signaling. Therefore, the built-in MiniMCU function of the main speaking terminal is utilized, the video and audio code stream of the interactive class is processed on the main speaking terminal, the concurrent interactive class on the whole system is decentralized, multiple classes developed at the same time are distributed in each region of the system instead of being concentrated in a central machine room, the centralized processing is not limited by a central node, the centralization is realized, most of the classes use a local area network to open classes, a small number of classes cross a public and private network to open classes, the service efficiency of the local area network is improved, the bandwidth requirements of the central machine room for entrance and exit are reduced, the comprehensive utilization efficiency of the network is improved, and the processing efficiency of interactive teaching is effectively improved.
A method of processing interactive instruction, the method comprising:
the gateway receives an admission request signaling sent by a main speaking terminal, judges whether the communication between the main speaking terminal and a listening and speaking terminal crosses a public and private network or not according to the admission request signaling, and generates a corresponding response message according to a judgment result;
and the gateway sends the response message to the main speaking terminal to indicate the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request.
In one embodiment, the generating a corresponding response message according to the determination result includes:
if the communication between the main speaking terminal and the listening and speaking terminal is judged not to cross the public and private network, a permission confirmation signaling is generated;
the gateway sends the response message to the main speaking terminal to instruct the main speaking terminal to initiate a call request to a listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request, including:
and the gateway sends the permission confirmation signaling to the main speaking terminal to indicate the main speaking terminal to initiate a calling request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal according to the IP address of the listening and speaking terminal carried in the permission confirmation signaling, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the calling request.
In one embodiment, the generating a corresponding response message according to the determination result includes:
if the communication between the main speaking terminal and the listening and speaking terminal is judged to be across the public and private network, an approval rejection signaling is generated;
the method further comprises the following steps:
the network gate informs the multipoint control unit of holding the conference through a signaling; the signaling carries identification information of the main speaking terminal and identification information of the listening and speaking terminal;
the gateway receives the permission request signaling sent by the multipoint control unit, returns a permission rejection signaling to the multipoint control unit, and sends notification information to the main speaking terminal and the listening and speaking terminal corresponding to the identification information of the listening and speaking terminal; the notification message contains a call policy; the notification message is used for indicating the main speaking terminal and the listening and speaking terminal to initiate a calling request to a multipoint control unit according to the calling strategy, and the main speaking terminal and the listening and speaking terminal carry out information interaction through the multipoint control unit.
A processing apparatus for interactive instruction, the apparatus comprising:
a receiving module, configured to receive a permission request signaling sent by a main terminal;
the judging module is used for judging whether the communication between the main speaking terminal and the listening and speaking terminal crosses a public and private network or not according to the permission request signaling;
the generating module is used for generating a corresponding response message according to the judgment result;
and the sending module is used for sending the response message to the main speaking terminal so as to instruct the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
the gateway receives an admission request signaling sent by a main speaking terminal, judges whether the communication between the main speaking terminal and a listening and speaking terminal crosses a public and private network or not according to the admission request signaling, and generates a corresponding response message according to a judgment result;
and the gateway sends the response message to the main speaking terminal to indicate the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
the gateway receives an admission request signaling sent by a main speaking terminal, judges whether the communication between the main speaking terminal and a listening and speaking terminal crosses a public and private network or not according to the admission request signaling, and generates a corresponding response message according to a judgment result;
and the gateway sends the response message to the main speaking terminal to indicate the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request.
According to the processing method, the device, the computer equipment and the storage medium for interactive teaching, the gatekeeper receives an approval request signaling sent by the main speaking terminal, judges whether communication between the main speaking terminal and the listening and speaking terminal crosses a public and private network or not according to the approval request signaling, generates a corresponding response message according to a judgment result, sends the response message to the main speaking terminal so as to instruct the main speaking terminal to initiate a calling request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the calling request. Therefore, public and private network crossing judgment is carried out through network gate matching, interactive classes under most local area networks in daily use do not need to occupy public network bandwidth resources, centralization is achieved, local area networks are used for opening classes for most classes, a small number of classes cross the public and private networks for opening classes, the service efficiency of the local area networks is improved, the bandwidth requirements of the central machine room for import and export are reduced, the network comprehensive utilization efficiency is improved, and the processing efficiency of interactive teaching is effectively improved.
Drawings
FIG. 1 is a diagram of an exemplary environment in which a method for interactive instruction processing may be implemented;
FIG. 2 is a flow diagram illustrating a processing method for interactive instruction in one embodiment;
fig. 3A is a schematic flow chart illustrating a step of receiving a response message sent by a gatekeeper, initiating a call request to a listening and speaking terminal corresponding to a listening and speaking terminal identifier, and performing information interaction with the listening and speaking terminal according to the call request in one embodiment;
FIG. 3B is a diagram illustrating an interaction between class signaling and media on a LAN according to an embodiment;
FIG. 3C is a flowchart of interactive instruction processing within a local area network, according to an embodiment;
fig. 4A is a schematic flow chart illustrating a step in which the main speaking terminal receives a response message sent by the gatekeeper, initiates a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identifier, and performs information interaction with the listening and speaking terminal according to the call request in another embodiment;
FIG. 4B is a schematic diagram illustrating class signaling and media interaction across public and private networks in an embodiment;
FIG. 4C is a flowchart of an embodiment of interactive tutoring across a public/private network;
FIG. 4D is a flow diagram of a back-to-back conference call across public and private networks in an embodiment;
FIG. 5 is a flowchart illustrating real-time information interaction across public and private network courses in one embodiment;
FIG. 6 is a flowchart illustrating a processing method for interactive instruction according to another embodiment;
FIG. 7 is a diagram illustrating system networking and applications in accordance with an embodiment;
FIG. 8 is a block diagram showing the structure of a processing apparatus for interactive teaching according to an embodiment;
FIG. 9 is a block diagram showing a configuration of a processing apparatus for interactive teaching according to another embodiment;
FIG. 10 is a diagram showing an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The processing method for interactive teaching provided by the application can be applied to the application environment shown in fig. 1. The application environment includes a main speaking terminal 102, a gatekeeper 104, and a listening terminal 106. The main terminal 102, the listening terminal 106 and the gatekeeper 104 communicate with each other through a network. The main speaking terminal 102 sends an admission request signaling to the gateway 104 according to the listening terminal identification contained in the schedule information under the condition of judging the class time, the main speaking terminal 102 receives a response message sent by the gateway 104, the main speaking terminal 102 initiates a call request to the listening terminal 106 corresponding to the listening terminal identification according to the response message, the main speaking terminal 102 performs information interaction with the listening terminal 106 according to the call request, and the response message is generated by a judgment result that the gateway 104 judges whether the communication between the main speaking terminal 102 and the listening terminal 106 crosses the public and private network or not according to the admission request signaling.
The main speaking terminal 102 and the listening and speaking terminal 106 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the gatekeeper 104 may be a solid-state switch read-write medium with multiple control functions, and is connected to information security devices of two independent host systems.
In an embodiment, as shown in fig. 2, a processing method for interactive teaching is provided, which is described by taking the example that the method is applied to the main speaking terminal in fig. 1, and includes the following steps:
The teaching terminal is a hardware device which is deployed in a classroom (or a machine room), is applied to network teaching, and can be used for developing network interactive teaching, live broadcasting teaching, recorded broadcasting teaching and the like. The main speaking terminal is a teaching terminal used in a main speaking classroom, and shows a teaching scene of the main speaking classroom through means of audio and video acquisition, encoding and decoding, playing and the like, so as to provide a teaching auxiliary device for other students (staff) in different physical spaces to study and participate. For example, the main terminal can collect video and audio information in a local classroom, encode, record and stream audio and video data, and send the data to a remote end, or release the data to a Web platform, and can perform real-time audio and video bidirectional interaction with other remote classroom equipment.
The interactive teaching system may include an h.323 terminal, a Gatekeeper (GK), a Multipoint Control Unit (MCU), and a cloud platform. The H.323 terminal is an H.323 entity on the network, and performs real-time and bidirectional communication with other H.323 terminals, gateways or MCUs. All terminals, interactive terminals, teaching terminals, main speaking terminals, listening and speaking terminals and the like related in the application can be H.323 terminals. Gatekeeper (GK) refers to an h.323 entity on the network that provides address translation, control of network access, bandwidth management, and location of gateways for h.323 terminals, gateways, and MCUs. Mcu (multipoint Control unit): i.e. a multipoint control unit, for controlling a multipoint conference, and also for a point-to-point conference connecting two terminals. The MCU in the application can not relate to processing work such as coding and decoding, multi-picture splicing, sound mixing and the like, and only forwards audio and video data as a code stream transmission channel between the main speaking terminal and the listening and speaking terminal. For example, after the listening terminal M (the value of M is 1 to N), the audio/video data collected locally is encoded and then forwarded to the main speaking terminal via the MCU, and after the audio/video data of the listening terminal M is received by the main speaking terminal, the main speaking terminal processes (may be multi-picture splicing, audio mixing, etc.) the received audio/video data of the listening terminal M and the audio/video data collected locally by the main speaking terminal, and then sends the encoded data to the listening terminal via the MCU (when there are a plurality of listening terminals, it needs to send the encoded data to the corresponding listening terminals, respectively). The cloud platform is an educational interactive recording and live broadcasting service cloud platform and provides management and application of comprehensive services such as interaction, live broadcasting, recording, on-demand, class patrol, teaching and research and the like.
Specifically, the explanation will be given by taking the main speech terminal as an example. And the main speaking terminal sends a permission request signaling to the gateway according to the listening terminal identification contained in the class schedule information under the condition of judging the class time. The lesson time refers to the time for starting interactive teaching lessons in the unified lesson information issued by the platform. The listening and speaking terminal identification is used for identifying the unique listening and speaking terminal. In this embodiment, the functions of the platform may include: 1) the system is responsible for uniformly arranging courses and automatically sending the current-day class schedule information of each terminal to the corresponding terminal; 2) synchronizing course information and status; 3) simple course control is performed as required. Gatekeepers, GKs, can be used for: 1) and the MCU and the E.164 number of the terminal are uniformly distributed. 2) And the MCU and the terminal are responsible for registration. 3) And the main talking terminal is responsible for initiating the conference and registering the MCU back-to-back conference. 4) And judging the calling public and private network, and triggering the MCU to start a public and private network crossing conference when finding that the calling access which can be realized only by using the public and private network crossing is required. The MCU function may include 1) registering with the GK using the E.164 number allocated by the GK, and accepting the GK unified management. 2) And when needed, starting a public-private network crossing back-to-back conference for the main speaking terminal and each listening and speaking terminal. 3) The conference realizes the signaling call between the MCU and the main talking terminal and the listening and speaking terminal. 4) The conference realizes the media stream interchange forwarding of the main speaking terminal and the listening and speaking terminal. The functions of the terminal may include: 1) the terminal registers to the GK using the uniformly assigned e.164 number of the GK. 2) And receiving and storing the courseware information issued by the platform. 3) And judging whether the lessons need to be taken according to the nearest course information in the school timetable, and carrying out corresponding processing. When the terminal is a main speaking terminal, a listening terminal which automatically calls the participants to the class enters the class when the class time is up; when the terminal is a talking terminal, the current service needs to be terminated when the class time is up, and the class calling of the talking terminal is automatically accepted. 4) And reporting the course state to the platform.
It can be understood that the main speaker terminal in the present application may have a MiniMCU function built therein to provide a small-point processing capability. The basic capability of the built-in MCU is realized on each main terminal, including the capability of MC (multipoint controller) and MP (multipoint processor), so that the main terminal has the basic 1+ N (N is less than or equal to 5 or N is less than or equal to 7) conference capability, the management and simple control of multi-path calling can be carried out, the coding and decoding of multi-path audio and video can be carried out, the capability of splicing and coding of multi-picture of less than 7 split screens (or 9 split screens) is provided, and the capability of point sound mixing of less than 1+ N is provided. The main speaker terminal is essentially a small MCU, which can be used as a terminal and also as an MCU when needed.
And 204, the main speaking terminal receives a response message sent by the gateway, initiates a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and performs information interaction with the listening and speaking terminal according to the call request, wherein the response message is generated by a judgment result of judging whether the communication between the main speaking terminal and the listening and speaking terminal crosses the public and private network or not according to the permission request signaling by the gateway.
And under the condition that the main speaking terminal judges the class time, after sending an admission request signaling to the gateway according to the listening terminal identification contained in the class schedule information, the main speaking terminal receives a response message sent by the gateway, initiates a call request to the listening terminal corresponding to the listening terminal identification according to the response message, and performs information interaction with the listening terminal according to the call request, wherein the response message is generated by a judgment result that whether the communication between the main speaking terminal and the listening terminal crosses a public and private network or not is judged by the gateway according to the admission request signaling. The response message is generated by the gatekeeper according to the result of determining whether the communication between the main speaking terminal and the listening speaking terminal crosses the public and private network according to the received permission request signaling, for example, the response message may include a permission confirmation signaling responded by the gatekeeper and a permission rejection signaling responded by the gatekeeper.
After the call is established, bidirectional media interaction is carried out between the terminals. The listening and speaking terminal collects local video and audio information, codes and sends the information to the main speaking terminal; the main speaking terminal collects local video and audio information, receives media streams of all listening and speaking terminals, decodes the media streams, and locally performs corresponding operations of multi-picture synthesis, audio mixing, local playing and the like on the video and audio information of all listening and speaking terminals and the main speaking local according to the requirements of teaching scenes; then coding is carried out and sent to each listening and speaking terminal; and the listening and speaking terminal decodes and plays the media stream received by the main speaking terminal. Therefore, the main speaking end and the listening end can listen to the voice of each participant and see the wanted picture.
Among them, GK is a gatekeeper in the h.323 hierarchy, and the most central one to solve is the addressing problem when calling in different networks. In the application, public and private network judgment is added to the protocol interaction process. The public and private network judgment can be simply made according to the original IP addresses of the calling party and the called party, for example: when the public network is not available, the local area network IP address masks are the same, the local area networks can be identified as the same local area network, and the public network call is not performed; the public and private network judgment can also be carried out according to the exit address, for example, when the public network exits, the exit public network addresses are different and can be identified as different local area networks; when the public network is exported, the public network addresses of the exports are the same, the IP address masks of the corresponding local area networks are the same, the local area networks can be identified as the same local area network, and the local area networks are different under other conditions. In addition, public and private network judgment can be performed through a preset rule strategy, for example: according to the E.164 number used in calling. When the GK performs e.164 number assignment, according to the established numbering rules, for example, it is specified that the e.164 number is composed of at least 5 digits, the first 4 digits represent the domain number, the terminal domain numbers of the same local area network must be the same, and the terminal domain numbers of different local area networks must be different, so that the GK can directly perform the public and private network judgment of the call according to the e.164 number of the calling party and the called party. For example, the first 4 bits of e.164 are the same, and a call in the private network is determined; e.164 the first 4 bits are different, and the call is judged to be a call across private networks. It is understood that, the manner of determining whether the communication between the main speaking terminal and the listening and speaking terminal crosses the public and private network in the present application includes, but is not limited to, the above manner, and the determination manner is not particularly limited.
The e.164 number is identification information in the h.323 hierarchy, and it can be understood that the e.164 number is a unique identity of a device on the network, that is, the e.164 number is used to identify a unique device. There are a number of implementations possible with respect to making e.164 calls. For example: 1) automatic number allocation: when the device (including MCU and terminal) registers to the GK, the GK automatically generates the E.164 number of the device according to the information in the registration signaling, the information of the source IP, the outlet IP and the like and a preset certain rule. The method has the characteristics of simplicity, quickness, no need of manually planning the E.164 number and simpler configuration. 2) Manual number allocation: the corresponding e.164 numbers are assigned to the respective devices by manual operation instead of the automatic assignment process. The method has the characteristics that the E.164 number of the equipment needs to be manually planned, the configuration information is relatively more, but the method is more flexible, and the appointed E.164 number can be distributed to the appointed equipment. The method for generating the identification information of the device includes, but is not limited to, the above method, and may support a plurality of methods for generating the e.164 number of the device.
In this embodiment, when the lecture session is determined, the master terminal sends an admission request signaling to the gatekeeper according to the listening terminal identifier included in the schedule information, the master terminal receives a response message sent by the gatekeeper, initiates a call request to the listening terminal corresponding to the listening terminal identifier according to the response message, and performs information interaction with the listening terminal according to the call request, and the response message is generated by a determination result that the gatekeeper determines whether the communication between the master terminal and the listening terminal crosses the public and private network according to the admission request signaling. Therefore, the built-in MiniMCU function of the main speaking terminal is utilized, the video and audio code stream of the interactive class is processed on the main speaking terminal, the concurrent interactive class on the whole system is decentralized, multiple classes developed at the same time are distributed in each region of the system instead of being concentrated in a central machine room, the centralized processing is not limited by a central node, the centralization is realized, most of the classes use a local area network to open classes, a small number of classes cross a public and private network to open classes, the service efficiency of the local area network is improved, the bandwidth requirements of the central machine room for entrance and exit are reduced, the comprehensive utilization efficiency of the network is improved, and the processing efficiency of interactive teaching is effectively improved.
In an embodiment, as shown in fig. 3A, the step of receiving a response message sent by the gatekeeper, initiating a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identifier, and performing information interaction with the listening and speaking terminal according to the call request includes:
step 302, receiving a permission confirmation signaling responded by the gatekeeper, wherein the permission confirmation signaling is generated by the gatekeeper judging that the gatekeeper does not cross the public and private networks, the permission confirmation signaling carries the IP address of the listening and speaking terminal, and the IP address of the main speaking terminal belong to the same local area network address.
And step 304, initiating a call request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal, and establishing communication connection with the listening and speaking terminal to perform information interaction.
Fig. 3B is a schematic diagram illustrating class signaling and media interaction on a lan. When the terminals participating in the interactive class are in the same local area network, the main speaking terminal initiates a back-to-back conference for each listening terminal for multiple times, and the signaling and media flow directions are as shown in fig. 3B.
Specifically, as shown in fig. 3C, a flowchart of interactive teaching processing in the lan is shown. And if the talkback terminal judges that the class time of a certain interactive class is up, automatically initiating an interactive class call. And the main speaking terminal sends an ARQ (authorization Request) signaling Request to the GK to call the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the listening and speaking terminal identification contained in the class schedule information. And the GK receives an ARQ signaling sent by the main terminal and carries out public and private network crossing judgment, namely the GK judges whether the call needs to cross the public and private network, if the GK judges that the communication between the main terminal and the listening and speaking terminal does not cross the public and private network according to the ARQ signaling, the GK responds ACF (Admission confirmation) signaling confirmation to the main terminal to enable the call, and carries an address (an IP address of the listening and speaking terminal) and a port (the address belongs to a local area network with the main terminal) along with the ACF signaling. Further, the main speaking terminal can initiate a call request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal carried in the ACF signaling, and establish communication connection with the listening and speaking terminal to perform information interaction. For example, the main speaking terminal may initiate a point-to-point call to the listening and speaking terminal corresponding to the IP address according to a call flow of a preset protocol (H323, q.931), and the listening and speaking terminal receives the call request and then automatically answers the call to establish a connection. This process follows the point-to-point call flow between the H323 terminals without the MCU. After the call is established, media streams are mutually transmitted according to needs, and the process of establishing the bidirectional media interaction follows the bidirectional media interaction establishing process when the two terminals of the H323 do not pass through the MCU.
As shown in fig. 3C, steps 2 to 4 are call-type signaling in h.225ras signaling, step 5 includes q.931 call, and actually the whole call flow may further include flows of h.245 protocols such as master-slave decision, capability negotiation, and switching logic channels. The process shown in fig. 3C is a call process in the same lan, a public-private network decision is added on the basis of a standard process, when the GK decides that the call is the same lan call, the call is directly confirmed, a point-to-point IP address call is initiated by a main speaking terminal, the IP address of a listening terminal is directly called, the main speaking terminal and the listening terminal establish a communication connection for information interaction, so that the public-private network crossing decision is performed through GK cooperation, most of interactive lessons under the lan in daily use do not occupy public network bandwidth resources any more, decentralization is realized, most of lessons use the lan to open lessons, a small number of lessons cross the public-private network to open lessons, the utilization efficiency of the lan is improved, the bandwidth requirements of the central machine room for import and export are reduced, the comprehensive utilization efficiency of the network is improved, and the processing efficiency of interactive teaching is effectively improved.
In another embodiment, as shown in fig. 4A, the step of receiving a response message sent by the gatekeeper, initiating a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identifier, and performing information interaction with the listening and speaking terminal according to the call request includes:
Fig. 4B is a schematic diagram of class signaling and media interaction across public and private networks. When the terminals participating in the interactive class are not in the same local area network, the main speaking terminal initiates a back-to-back conference to each listening and speaking terminal through the GK and the MCU for multiple times, and the flow of signaling and media is as shown in fig. 4B.
Specifically, as shown in fig. 4C, a flowchart of interactive teaching processing across public and private networks is shown. And if the talkback terminal judges that the class time of a certain interactive class is up, automatically initiating an interactive class call. And the main speaking terminal sends an ARQ (authorization Request) signaling Request to the GK to call the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the listening and speaking terminal identification contained in the class schedule information. And the GK receives an ARQ signaling sent by the main speaking terminal, performs public and private network crossing judgment, namely the GK judges whether the call needs to cross the public and private network, if the GK judges that the communication between the main speaking terminal and the listening and speaking terminal is the cross-public and private network according to the ARQ signaling, namely after the GK receives the ARQ request, performs public and private network policy judgment according to the network structures of the main speaking terminal and the listening and speaking terminal, judges that the main speaking terminal and the listening and speaking terminal are accessed into different local area networks and need to start the public and private network crossing, and responds ARJ (Admission Reject, give up permission) signaling to the main speaking terminal to Reject the access call by the GK. Further, the GK carries the information of the numbers of the calling party (the conference number of the calling terminal) and the called party (the number of the listening and speaking terminal E164) through a private signaling, and notifies the MCU to hold the private network to pass through the back-to-back conference, where the conference number is the called number + # + the calling number; after receiving the notification, the MCU calls the conference and invites the main and listening and speaking terminal terminals to enter the conference through the GK; the MCU initiates ARQ access to the main and listening and speaking terminals to the GK; the GK replies ARJ to the MCU and informs the master and the listening and speaking terminals to start public and private calling strategies to enter the conference; the main and listening terminal sends a call request to the MCU and completes the subsequent call interaction. After the call is established, the MCU starts a back-to-back mode, media interchange of the main listening terminal and the listening terminal is set, and the main listening terminal and the listening terminal perform bidirectional media interaction with the MCU until the conference is finished. It can be understood that the MCU in this embodiment mainly plays a role of a code stream transmission channel when the public and private networks pass through, and as shown in fig. 4C, the MCU is required to participate in interaction in the call flow across the public and private networks, and is responsible for getting through the back-to-back call and establishing a media transmission channel across the public and private networks.
In this embodiment, the MCU of the central node is released from the heavy media processing operations with high performance, such as video and audio decoding, multi-picture synthesis, audio mixing, video and audio encoding, of all courses, and the main terminal is responsible for the media processing operations with high performance, such as video and audio decoding, multi-picture synthesis, audio mixing, video and audio encoding, of the course in the current course, and the MCU only needs to provide a path through which the public and private networks pass, and the code streams are exchanged and forwarded on the path, thereby greatly improving the processing capacity of a single MCU server of the central node. Because the MCU of the processing center does not need to carry out heavy media processing work any more, more selectivity can be realized on hardware, a special embedded hardware server is not needed, and a general X86 architecture server with lower cost can be used. Meanwhile, the media processing work of distributed interactive classes within 1+5 is carried out by utilizing the main speaking terminal, so that the MCU of the central machine room can support the access of more nodes, each class occupies 6 access points on the basis of the most common 1+3 interactive classes, and nearly 70 classes can be borne simultaneously; convert with biggest 1+5 interactive class, every class occupies 10 access points, can bear 40 classes simultaneously for MCU bears the great improvement of the ability of course, originally needs the demand of opening a lesson that ten more MCUs just can support, only needs a MCU now to support. In this embodiment, the main speaking terminal has a built-in MiniMCU function within 1+5, and the video/audio code stream of the interactive lesson is processed on the main speaking terminal, so that the concurrent interactive lesson in the whole system is decentralized, and multiple lessons developed at the same time are distributed in each region of the system, rather than being concentrated in a central machine room, and are no longer limited by a central node, thereby improving the stability of the system.
In one embodiment, the master terminal starts a public call private policy according to receiving a notification message sent by the GK, initiates a call request to the multipoint control unit, and performs information interaction with the listening and speaking terminal through the MCU. The main speaking terminal and the listening and speaking terminal carry out back-to-back calling flow through the multipoint control unit. Fig. 4D shows a back-to-back conference call flow diagram across public and private networks. Specifically, the steps in the back-to-back conference call flow in fig. 4D are described as follows: 1. a lecture room initiates a call request to the MCU; 2. a listening and speaking classroom initiates a call request to the MCU; the MCU sends a corresponding call request to a lecture room; the MCU sends a corresponding call request to a listening and speaking classroom; 5. a lecture classroom requests a capability negotiation from an MCU and carries a capability A; 6. the listening and speaking classroom requests the MCU for capability negotiation and carries capability B; the MCU returns a corresponding response message to the lecture room; 8, the MCU returns a corresponding response message to a listening and speaking classroom; MCU requests capability negotiation from the lecture classroom and carries capability B, the process depends on the completion of process 6; the MCU requests capability negotiation from the listening and speaking classroom and carries capability A, and the process depends on the completion of the process 5; 11. the lecture classroom returns a response message of corresponding capability negotiation to the MCU; 12. the listening and speaking classroom returns a corresponding response message of capability negotiation to the MCU; 13. a main classroom requests an MCU to open a logic channel and carries channel capacity A; the MCU requests to listen and talk the classroom to open the logic channel and carry the channel ability A, the process depends on the completion of the process 13; the MCU returns a corresponding response message to the lecture room; 16. the listening and speaking classroom returns a corresponding response message to the MCU; 17. the listening and speaking classroom requests the MCU to open a logic channel and carries channel capability B; the MCU requests to open a logic channel from the main lecture room and carries channel capability B, and the process depends on the completion of the process 17; the MCU returns corresponding response messages to the listening and speaking classroom; 20. the lecture room returns a corresponding response message to the MCU; 21. the lecture room and the listening and speaking room carry out bidirectional media information interaction.
In the traditional processing mode of interactive teaching, the MCU needs to process media information with high performance such as video and audio decoding, multi-picture synthesis, audio mixing, video and audio coding, etc. for all courses, in this embodiment, the MCU of the processing center does not need to perform heavy media processing work any more, and the MCU mainly plays a role of a code stream transmission channel when a public and private network passes through, i.e., the MCU only needs to provide a path through which the public and private network passes through, and exchange and forward the code stream on the path, thereby greatly improving the processing capacity of a single MCU server of the processing center node, reducing the overall construction cost of the system, and improving the product competitiveness.
In one embodiment, the method further comprises:
the main speaking terminal sends the multimedia data to the multi-point control unit so that the multi-point control unit forwards the multimedia data to the listening and speaking terminal;
and/or the main speaking terminal receives the multimedia data transmitted by the listening and speaking terminal forwarded by the multipoint control unit.
After the main speaking terminal establishes call connection with the listening and speaking terminal through the multipoint control unit, the main speaking terminal can send the multimedia data to the multipoint control unit so that the multipoint control unit forwards the multimedia data to the listening and speaking terminal; meanwhile, the main speaking terminal can also receive the multimedia data request transmitted by the listening and speaking terminal forwarded by the multipoint control unit. For example, during a back-to-back conference call, a real-time request such as an I-frame request needs to be made, and at this time, signaling needs to be relayed through the MCU. The real-time video transmission technology relates to the image motion coding technology, and the I frame is a key frame in the real-time image motion coding technology and contains complete video image information, and an image can be directly restored after the decoding of a decoder. The B, P frames are encoded based on the data of the image motion difference part on the basis of the I frame, and the image cannot be restored (shown as a screen splash, a ghost shadow and the like) after being directly decoded, and the image can be restored based on the associated I frame. Therefore, in real-time image transmission, it is necessary to ensure that the first frame is an I-frame, otherwise, the image before the next I-frame data is received cannot be restored. The I frame request initiated by the listening and speaking classroom refers to that a request sending party (a main speaking terminal in the present case) re-encodes an I frame and sends the I frame, so that the problem that an image cannot be decoded and viewed normally when the I frame is not received for a long time is solved.
Fig. 5 is a flow chart of real-time information interaction across public and private networks. The key process of the real-time information interaction process in the back-to-back conference call process in fig. 5 is described as follows: and 1-4, forwarding an I-frame request initiated by a meeting place of a main classroom and a listening classroom to the main classroom through an MCU. And 5-16, forwarding the auxiliary stream related signaling initiated by the main speaking classroom to the listening and speaking classroom through the MCU. The MCU in this embodiment is mainly used as a code stream transmission channel, and is different from a standard h.323mcu. In the embodiment, the class is across public and private networks, all audio and video data are transmitted through a public and private network crossing channel established by the MCU, and the MCU does not perform data processing but only performs data forwarding. The I frame in the standard H.323 system can be coded by the MCU, but the MCU does not undertake the coding function here, only does the data forwarding, the I frame must be coded by the terminal station of the main speech. Therefore, system services are decentralized, and multiple courses developed at the same time are distributed in all regions of the system instead of being concentrated in a central machine room, so that the system is not limited by a central node, and the stability of the system is improved.
In one embodiment, as shown in fig. 6, a processing method for interactive teaching is provided, which is described by taking the method as an example applied to the gatekeeper in fig. 1, and includes the following steps:
And step 604, the gatekeeper sends the response message to the main speaking terminal to instruct the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request.
Specifically, a network gate will be described as an example. The gatekeeper receives an admission request signaling sent by the main speaking terminal, judges whether the communication between the main speaking terminal and the listening terminal crosses the public and private network or not according to the admission request signaling, and generates a corresponding response message according to a judgment result. Further, the gatekeeper sends the response message to the main speaking terminal to instruct the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identifier according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request. In this embodiment, because the main speaking terminal has a MiniMCU built-in function, the video/audio code stream of the interactive lesson is processed on the main speaking terminal, so that the concurrent interactive lessons on the whole system are decentralized. Meanwhile, the GK is matched to carry out public and private network crossing judgment, interactive classes under most local area networks in daily use do not need to occupy public network bandwidth resources any more, centralization is achieved, most of the classes use the local area networks to open classes, a small number of the classes cross the public and private networks to open classes, the use efficiency of the local area networks is improved, the bandwidth requirements of the central machine room for entrance and exit are reduced, the comprehensive utilization efficiency of the network is improved, and the processing efficiency of interactive teaching is effectively improved.
In one embodiment, the method further comprises:
if the communication between the main speaking terminal and the listening and speaking terminal is judged not to cross the public and private network, a permission confirmation signaling is generated;
and sending the permission confirmation signaling to the main speaking terminal to indicate the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal according to the IP address of the listening and speaking terminal carried in the permission confirmation signaling, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request.
And the gateway receives the permission request signaling sent by the main speaking terminal, judges whether the communication between the main speaking terminal and the listening and speaking terminal crosses the public and private network or not according to the permission request signaling, and generates a permission confirmation signaling if the gateway judges that the communication between the main speaking terminal and the listening and speaking terminal does not cross the public and private network. Further, the gatekeeper sends the permission confirmation signaling to the main speaking terminal to instruct the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal according to the IP address of the listening and speaking terminal carried in the permission confirmation signaling, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request. Therefore, the public and private network crossing judgment is carried out through GK cooperation, interactive classes under most local area networks in daily use do not need to occupy public network bandwidth resources any more, the centralization is achieved, most of the courses use the local area networks to open classes, a small number of courses cross the public and private networks to open classes, the service efficiency of the local area networks is improved, the bandwidth requirements of the central machine room for entrance and exit are reduced, the comprehensive utilization efficiency of the network is improved, and the processing efficiency of interactive teaching is effectively improved.
In one embodiment, the method further comprises:
if the communication between the main speaking terminal and the listening and speaking terminal is judged to be across the public and private network, an approval rejection signaling is generated;
the multipoint control unit is informed of holding the conference through signaling; the signaling carries identification information of a main speaking terminal and identification information of a listening and speaking terminal;
receiving an admission request signaling sent by a multipoint control unit, returning an admission rejection signaling to the multipoint control unit, and sending notification information to a main talking terminal and a listening and speaking terminal corresponding to the identification information of the listening and speaking terminal; the notification message contains a call policy; the notification message is used for indicating the main speaking terminal and the listening and speaking terminal to initiate a calling request to the multipoint control unit according to the calling strategy, and the main speaking terminal and the listening and speaking terminal carry out information interaction through the multipoint control unit.
The gateway receives an approval request signaling sent by the main speaking terminal, judges whether the communication between the main speaking terminal and the listening and speaking terminal crosses the public and private network according to the approval request signaling, and generates an approval rejection signaling if the gateway judges that the communication between the main speaking terminal and the listening and speaking terminal crosses the public and private network, further, the gateway informs the multipoint control unit to hold the conference through the private signaling, and the private signaling carries the identification information of the main speaking terminal and the identification information of the listening and speaking terminal. The network brake receives the permission request signaling sent by the multipoint control unit, returns a permission rejection signaling to the multipoint control unit, and sends notification information to the main speaking terminal and the listening and speaking terminal corresponding to the identification information of the listening and speaking terminal, wherein the notification information comprises a calling strategy, the notification information is used for indicating the main speaking terminal and the listening and speaking terminal to initiate a calling request to the multipoint control unit according to the calling strategy, and the main speaking terminal and the listening and speaking terminal perform information interaction through the multipoint control unit. Therefore, the MCU of the central node is liberated from the media processing work of video and audio decoding, multi-picture synthesis, audio mixing, video and audio coding and other high-consumption performances of all heavy courses, the main speaking terminal is used for the media processing work of the video and audio decoding, the multi-picture synthesis, the audio mixing, the video and audio coding and the like of the current course, the MCU only needs to provide a passage through which a public and private network passes, code streams are exchanged and forwarded on the passage, and the processing capacity of a single MCU server of the processing central node is greatly improved.
In one embodiment, all terminals and MCUs in the system use the uniformly allocated e.164 number of the GK to register with the GK. Meanwhile, all terminals register to the platform, receive the management of the platform, synchronize time from the platform to ensure that the time in the whole system is consistent, receive the terminal current class schedule information that the platform automatically and synchronously pushes and saves to the local, report the service state information to the platform, etc. Wherein, the schedule information contains: course information (comprising a main class, a main subject, a course name, a class time and a class time), main information (comprising a main school, a main class, a main teacher, a main classroom, a main terminal E.164 number and a main terminal IP), listening and speaking classroom information (comprising a listening and speaking school, a listening and speaking class, an assistant teacher, a listening and speaking classroom, a listening and speaking terminal E.164 number and a listening and speaking terminal IP) (which can be limited to at most 5), video parameters (comprising a video protocol, a format, a frame rate and a code rate), auxiliary stream parameters (same video parameters), audio parameters (comprising an audio protocol and a sampling rate) and the like.
For example, as shown in fig. 7, a system networking and application diagram is shown. For interactive lessons (such as course 1, course 2 and course 3 in fig. 7) between a central school and a listening-to-speaking school in a certain region, the interactive lessons are developed in the local region network, and video and audio code streams only flow among participating terminals of the class in the local region and are not transferred through an MCU (microprogrammed control unit) in a central machine room; for an interaction class between schools across regions (for example, the class 4 in fig. 7), the interaction class needs to be developed across public and private networks in most cases, and the video and audio code streams need to be transferred to each terminal participating in the class through the MCU in the central machine room. The MCU in fig. 7 is only used as a transmission channel in the interworking between the public and private networks.
Specifically, the main speaking terminal can traverse the class schedule information according to the received class schedule information of the day sent by the platform, find the class schedule closest to the class time, and configure the local video, auxiliary stream and audio related media parameters of the main speaking terminal to be consistent with those in the class schedule. The main speaking terminal automatically starts to call each participating terminal (namely, listening terminal) of the class to join the class in class. The process of summoning is actually the process of initiating an h.323 back-to-back call. That is, when the main speaking terminal determines the class time, it sends an ARQ (Admission Request) signaling Request to the GK to call the listening and speaking terminal corresponding to the listening and speaking terminal identifier according to the listening and speaking terminal identifier included in the class schedule information. And the GK receives an ARQ signaling sent by the main terminal, performs public and private network crossing judgment, responds ACF (authorization Confirm) signaling confirmation to the main terminal to call if the GK judges that the communication between the main terminal and the listening terminal does not cross the public and private network according to the ARQ signaling, and carries the IP address of the listening terminal (the address belongs to a local area network with the main terminal) along with the ACF signaling. Further, the main speaking terminal can initiate a call request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal carried in the ACF signaling, and establish communication connection with the listening and speaking terminal to perform information interaction.
If the GK judges that the communication between the main speaking terminal and the listening and speaking terminal is a cross public and private network according to the ARQ signaling, namely after the GK receives the ARQ request, the GK judges the public and private network policy according to the network structures of the main speaking terminal and the listening and speaking terminal, judges that the main speaking terminal and the listening and speaking terminal are different local area network accesses and need to start public and private network crossing, and responds ARJ (permission Reject) signaling to the main speaking terminal to Reject the access call. Further, the GK carries the information of the numbers of the calling party (the conference number of the calling terminal) and the called party (the number of the listening and speaking terminal E164) through a private signaling, and notifies the MCU to hold the private network to pass through the back-to-back conference, where the conference number is the called number + # + the calling number; after receiving the notification, the MCU calls the conference and invites the main and listening and speaking terminal terminals to enter the conference through the GK; the MCU initiates ARQ access to the main and listening and speaking terminals to the GK; the GK replies ARJ to the MCU and informs the master and the listening and speaking terminals to start public and private calling strategies to enter the conference; the main and listening terminal sends a call request to the MCU and completes the subsequent call interaction. After the call is established, the MCU starts a back-to-back mode, media interchange of the main listening terminal and the listening terminal is set, and the main listening terminal and the listening terminal perform bidirectional media interaction with the MCU until the conference is finished. Therefore, the public and private network crossing judgment is carried out through GK cooperation, interactive classes under most local area networks in daily use do not need to occupy public network bandwidth resources any more, the centralization is achieved, most of the courses use the local area networks to open classes, a small number of courses cross the public and private networks to open classes, the service efficiency of the local area networks is improved, the bandwidth requirements of the central machine room for entrance and exit are reduced, the comprehensive utilization efficiency of the network is improved, and the processing efficiency of interactive teaching is effectively improved.
It should be understood that although the various steps in the flow charts of fig. 1-7 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1-7 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 8, there is provided a processing device for interactive teaching, including: a sending module 802, a receiving module 804 and an information interaction module 806, wherein:
a sending module 802, configured to send a permission request signaling to the gatekeeper according to the identifier of the listening terminal included in the schedule information when the class time is determined.
The receiving module 804 is configured to receive a response message sent by the gatekeeper.
And the information interaction module 806 is configured to initiate a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identifier according to a response message, and perform information interaction with the listening and speaking terminal according to the call request, where the response message is generated by a judgment result of the gatekeeper judging whether communication between the main speaking terminal and the listening and speaking terminal crosses a public/private network according to the permission request signaling.
In one embodiment, the receiving module is further configured to receive an admission confirmation signaling responded by the gatekeeper, where the admission confirmation signaling is generated by the gatekeeper judging that no public/private network exists, the admission confirmation signaling carries an IP address of the listening/speaking terminal, and the IP address and an IP address where the calling/speaking terminal is located belong to the same local area network address. The information interaction module is also used for initiating a call request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal and establishing communication connection with the listening and speaking terminal for information interaction.
In one embodiment, the receiving module is further configured to receive an admission rejection signaling responded by the gatekeeper, and receive a notification message sent by the gatekeeper; the admission rejection signaling is generated across the public and private network by the gatekeeper decision. The information interaction module is also used for starting a public call private strategy according to the notification message, initiating a call request to the multipoint control unit and carrying out information interaction with the listening and speaking terminal through the multipoint control unit.
In one embodiment, the sending module is further configured to send the multimedia data to the multipoint control unit, so that the multipoint control unit forwards the multimedia data to the listening and speaking terminal. The receiving module is also used for receiving the multimedia data transmitted by the listening and speaking terminal forwarded by the multipoint control unit.
In one embodiment, as shown in fig. 9, there is provided a processing device for interactive teaching, including: a receiving module 902, a determining module 904, a generating module 906, and a sending module 908, wherein:
a receiving module 902, configured to receive a permission request signaling sent by a main terminal.
And the judging module 904 is configured to judge whether the communication between the speaker terminal and the intercom terminal crosses the public-private network according to the permission request signaling.
A generating module 906, configured to generate a corresponding response message according to the determination result.
The sending module 908 is configured to send the response message to the intercom terminal, so as to instruct the intercom terminal to initiate a call request to the intercom terminal corresponding to the intercom terminal identifier according to the response message, and the intercom terminal performs information interaction with the intercom terminal according to the call request.
In one embodiment, the generating module is further configured to generate the permission confirmation signaling if it is determined that the communication between the main speaking terminal and the listening and speaking terminal does not cross the public-private network. The sending module is further used for sending the permission confirmation signaling to the main speaking terminal so as to indicate the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal according to the IP address of the listening and speaking terminal carried in the permission confirmation signaling, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request.
In one embodiment, the generating module is further configured to generate an authorization rejection signaling if it is determined that communication between the main speaking terminal and the listening and speaking terminal is across a public and private network. The sending module is also used for informing the multipoint control unit of holding the conference through signaling; the signaling carries the identification information of the main talking terminal and the identification information of the listening and speaking terminal. The receiving module is further configured to receive an admission request signaling sent by the multipoint control unit. The sending module is also used for returning an allowance rejection signaling to the multipoint control unit and sending notification information to the main speaking terminal and the listening and speaking terminal corresponding to the identification information of the listening and speaking terminal; the notification message contains a call policy; the notification message is used for indicating the main speaking terminal and the listening and speaking terminal to initiate a calling request to the multipoint control unit according to the calling strategy, and the main speaking terminal and the listening and speaking terminal carry out information interaction through the multipoint control unit.
For specific limitations of the processing device for interactive teaching, reference may be made to the above limitations of the processing method for interactive teaching, which are not described herein again. All or part of each module in the processing device for interactive teaching can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 10. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a processing method of interactive teaching. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 10 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the steps of the above-described method embodiments being implemented when the computer program is executed by the processor.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A method of processing interactive instruction, the method comprising:
the main speaking terminal sends a permission request signaling to the gateway according to the listening terminal identification contained in the class schedule information under the condition of judging the class time;
the main speaking terminal receives a response message sent by the network gate, initiates a calling request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and carries out information interaction with the listening and speaking terminal according to the calling request, wherein the response message is generated by a judgment result that the network gate judges whether the communication between the main speaking terminal and the listening and speaking terminal crosses a public and private network or not according to the permission request signaling.
2. The method according to claim 1, wherein the step of the main speaking terminal receiving the response message sent by the gatekeeper, initiating a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identifier, and performing information interaction with the listening and speaking terminal according to the call request comprises:
the main speaking terminal receives the permission confirmation signaling responded by the gatekeeper; the admission confirmation signaling is generated by the gatekeeper judging not to cross public and private networks; the permission confirmation signaling carries the IP address of the listening and speaking terminal; the IP address and the IP address of the main speaking terminal belong to the same local area network address;
the main speaking terminal initiates a call request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal, and establishes communication connection with the listening and speaking terminal to perform information interaction.
3. The method according to claim 1, wherein the step of the main speaking terminal receiving the response message sent by the gatekeeper, initiating a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identifier, and performing information interaction with the listening and speaking terminal according to the call request comprises:
the said main speaking terminal receives the said gateway response permission rejection signaling, and receives the said gateway sent notification message; the permission rejection signaling is generated by the gatekeeper decision across a public and private network;
the main speaking terminal starts a public calling private strategy according to the notification message, initiates a calling request to a multipoint control unit, and carries out information interaction with the listening and speaking terminal through the multipoint control unit.
4. The method of claim 3, further comprising:
the main speaking terminal sends multimedia data to the multipoint control unit so that the multipoint control unit forwards the multimedia data to the listening and speaking terminal;
and/or the main speaking terminal receives the multimedia data transmitted by the listening and speaking terminal forwarded by the multipoint control unit.
5. A method of processing interactive instruction, the method comprising:
the gateway receives an admission request signaling sent by a main speaking terminal, judges whether the communication between the main speaking terminal and a listening and speaking terminal crosses a public and private network or not according to the admission request signaling, and generates a corresponding response message according to a judgment result;
and the gateway sends the response message to the main speaking terminal to indicate the main speaking terminal to initiate a call request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request.
6. The method according to claim 5, wherein the generating the corresponding response message according to the determination result comprises:
if the communication between the main speaking terminal and the listening and speaking terminal is judged not to cross the public and private network, a permission confirmation signaling is generated;
the gateway sends the response message to the main speaking terminal to instruct the main speaking terminal to initiate a call request to a listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the call request, including:
and the gateway sends the permission confirmation signaling to the main speaking terminal to indicate the main speaking terminal to initiate a calling request to the listening and speaking terminal corresponding to the IP address of the listening and speaking terminal according to the IP address of the listening and speaking terminal carried in the permission confirmation signaling, and the main speaking terminal performs information interaction with the listening and speaking terminal according to the calling request.
7. The method according to claim 5, wherein the generating the corresponding response message according to the determination result comprises:
if the communication between the main speaking terminal and the listening and speaking terminal is judged to be across the public and private network, an approval rejection signaling is generated;
the method further comprises the following steps:
the network gate informs the multipoint control unit of holding the conference through a signaling; the signaling carries identification information of the main speaking terminal and identification information of the listening and speaking terminal;
the gateway receives the permission request signaling sent by the multipoint control unit, returns a permission rejection signaling to the multipoint control unit, and sends notification information to the main speaking terminal and the listening and speaking terminal corresponding to the identification information of the listening and speaking terminal; the notification message contains a call policy; the notification message is used for indicating the main speaking terminal and the listening and speaking terminal to initiate a calling request to a multipoint control unit according to the calling strategy, and the main speaking terminal and the listening and speaking terminal carry out information interaction through the multipoint control unit.
8. A processing apparatus for interactive teaching, the apparatus comprising:
the sending module is used for sending a permission request signaling to the gateway according to the listening terminal identification contained in the class schedule information under the condition of judging the class time;
the receiving module is used for receiving a response message sent by the gatekeeper;
and the information interaction module is used for initiating a calling request to the listening and speaking terminal corresponding to the listening and speaking terminal identification according to the response message, and carrying out information interaction with the listening and speaking terminal according to the calling request, wherein the response message is generated by a judgment result of judging whether the communication between the main speaking terminal and the listening and speaking terminal crosses a public and private network or not by the gateway according to the permission request signaling.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110862740.6A CN113612964A (en) | 2021-07-29 | 2021-07-29 | Interactive teaching processing method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110862740.6A CN113612964A (en) | 2021-07-29 | 2021-07-29 | Interactive teaching processing method and device, computer equipment and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN113612964A true CN113612964A (en) | 2021-11-05 |
Family
ID=78305972
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110862740.6A Pending CN113612964A (en) | 2021-07-29 | 2021-07-29 | Interactive teaching processing method and device, computer equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113612964A (en) |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1893426A (en) * | 2005-07-08 | 2007-01-10 | 中国电信股份有限公司 | Method and system for realizing pass-through of fier-wall at personal network video signals |
WO2007012233A1 (en) * | 2005-07-24 | 2007-02-01 | Zte Corporation | A method for multi-media services travel through nat |
CN101179491A (en) * | 2007-11-24 | 2008-05-14 | 华为技术有限公司 | Method, equipment, device and system for privately using communication between network inside terminals |
CN101753399A (en) * | 2008-12-02 | 2010-06-23 | 中兴通讯股份有限公司 | Method for implementing interworking of video conference terminals and gatekeeper therefor |
CN105262847A (en) * | 2014-07-18 | 2016-01-20 | 中国电信股份有限公司 | Communication method and system between terminal devices |
WO2016177056A1 (en) * | 2015-07-24 | 2016-11-10 | 中兴通讯股份有限公司 | Data transmission method, device and system for video conference |
WO2016180189A1 (en) * | 2015-09-09 | 2016-11-17 | 中兴通讯股份有限公司 | Method and apparatus for accessing multimedia conference system |
CN111131911A (en) * | 2019-12-26 | 2020-05-08 | 视联动力信息技术股份有限公司 | Multicast method and device |
CN112995567A (en) * | 2021-02-03 | 2021-06-18 | 游密科技(深圳)有限公司 | Video call method, device, server and storage medium |
-
2021
- 2021-07-29 CN CN202110862740.6A patent/CN113612964A/en active Pending
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1893426A (en) * | 2005-07-08 | 2007-01-10 | 中国电信股份有限公司 | Method and system for realizing pass-through of fier-wall at personal network video signals |
WO2007012233A1 (en) * | 2005-07-24 | 2007-02-01 | Zte Corporation | A method for multi-media services travel through nat |
CN101179491A (en) * | 2007-11-24 | 2008-05-14 | 华为技术有限公司 | Method, equipment, device and system for privately using communication between network inside terminals |
CN101753399A (en) * | 2008-12-02 | 2010-06-23 | 中兴通讯股份有限公司 | Method for implementing interworking of video conference terminals and gatekeeper therefor |
CN105262847A (en) * | 2014-07-18 | 2016-01-20 | 中国电信股份有限公司 | Communication method and system between terminal devices |
WO2016177056A1 (en) * | 2015-07-24 | 2016-11-10 | 中兴通讯股份有限公司 | Data transmission method, device and system for video conference |
WO2016180189A1 (en) * | 2015-09-09 | 2016-11-17 | 中兴通讯股份有限公司 | Method and apparatus for accessing multimedia conference system |
CN111131911A (en) * | 2019-12-26 | 2020-05-08 | 视联动力信息技术股份有限公司 | Multicast method and device |
CN112995567A (en) * | 2021-02-03 | 2021-06-18 | 游密科技(深圳)有限公司 | Video call method, device, server and storage medium |
Non-Patent Citations (1)
Title |
---|
高扬;肖继民;: "NAT穿越技术研究", 江苏通信技术, no. 05 * |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101710962B (en) | Method and device for distributing video conference resources | |
US20070273755A1 (en) | Multi-point video conference system and media processing method thereof | |
CN110062191B (en) | Multi-party group meeting method and server based on video network | |
CN109618120B (en) | Video conference processing method and device | |
JP2005516557A (en) | Video conferencing system and operation method | |
CN110620896B (en) | Conference establishing method, system and device | |
JP2002524983A (en) | H. For switching a call to a multipoint conference call in a H.323 communication compliant environment | |
CN110475094B (en) | Video conference processing method and device and readable storage medium | |
CN110493554B (en) | Method and system for switching speaking terminal | |
CN111131752B (en) | Video conference control method, device, equipment and medium based on video networking | |
CN110572607A (en) | Video conference method, system and device and storage medium | |
WO2016019775A1 (en) | Conference migration method, device and system | |
CN109743522B (en) | Communication method and device based on video networking | |
WO2016082577A1 (en) | Video conference processing method and device | |
CN104283857A (en) | Method, device and system for creating multimedia conference | |
CN109819199B (en) | Method and device for starting conference appointment | |
US9013537B2 (en) | Method, device, and network systems for controlling multiple auxiliary streams | |
CN108156413B (en) | Video conference transmission method and device and MCU | |
WO2016206471A1 (en) | Multimedia service processing method, system and device | |
CN107666396B (en) | Multi-terminal conference processing method and device | |
CN112422880A (en) | Video conference method, terminal device and readable storage medium | |
CN113612964A (en) | Interactive teaching processing method and device, computer equipment and storage medium | |
CN101287094A (en) | Method and system for implementing media operation of multimedia meetings | |
WO2015000303A1 (en) | Method for call processing and gateway | |
CN1893626B (en) | Method for autonomous sponsoring meeting-gathering by user terminal in inband mode |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |