CN111385312A - Comprehensive communication platform and method integrating multiple modes - Google Patents
Comprehensive communication platform and method integrating multiple modes Download PDFInfo
- Publication number
- CN111385312A CN111385312A CN202010316137.3A CN202010316137A CN111385312A CN 111385312 A CN111385312 A CN 111385312A CN 202010316137 A CN202010316137 A CN 202010316137A CN 111385312 A CN111385312 A CN 111385312A
- Authority
- CN
- China
- Prior art keywords
- communication
- module
- audio
- video
- multiple modes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 126
- 238000000034 method Methods 0.000 title claims abstract description 21
- 230000005540 biological transmission Effects 0.000 claims abstract description 4
- 238000013475 authorization Methods 0.000 claims description 17
- 238000004806 packaging method and process Methods 0.000 claims description 13
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 4
- 239000006185 dispersion Substances 0.000 claims description 3
- 238000003780 insertion Methods 0.000 claims description 3
- 230000037431 insertion Effects 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 238000012952 Resampling Methods 0.000 claims description 2
- 238000010168 coupling process Methods 0.000 claims description 2
- 238000005859 coupling reaction Methods 0.000 claims description 2
- 230000003993 interaction Effects 0.000 claims description 2
- 230000002688 persistence Effects 0.000 claims description 2
- 238000004080 punching Methods 0.000 claims description 2
- 238000005070 sampling Methods 0.000 claims description 2
- 238000000926 separation method Methods 0.000 claims description 2
- 230000035515 penetration Effects 0.000 claims 1
- 230000006835 compression Effects 0.000 abstract 1
- 238000007906 compression Methods 0.000 abstract 1
- 230000006872 improvement Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/42—Mailbox-related aspects, e.g. synchronisation of mailboxes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/12—Messaging; Mailboxes; Announcements
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a comprehensive communication platform and a method integrating multiple modes, which relate to the technical field of industrial Internet of things communication, support audio and video mutual communication among PC desktop applications, among mobile terminals and between the PC desktop applications and the mobile terminals, realize the functions of camera and microphone audio and video acquisition, coding and decoding, compression, transmission and playing, watermark addition and the like, and realize IP telephone communication, communication between an IP telephone and an analog telephone and the like; the system can realize the functions of point-to-point audio and video communication, group communication, video conference, command scheduling and the like in the aspect of application.
Description
Technical Field
The invention relates to a comprehensive communication platform and method integrating multiple modes in the technical field of industrial Internet of things communication.
Background
The existing communication system is only based on audio and video communication between 4G/wifi or only communication between independent IP phones/analog phones in practical application, and under the application scene that the system is required to support both audio and video communication between 4G/wifi and communication between IP phones/analog phones, the two can only be used alternately at present and cannot be combined well and smoothly.
Disclosure of Invention
The invention aims to provide a comprehensive communication platform and a method integrating multiple modes, which solve the technical problems of timely information sharing, communication efficiency improvement and convenient use and perfect a communication management system, and have the following specific functions:
function 1: the method realizes the most media packaging formats in the current multimedia field, including packaging and de-packaging, such as file packaging formats like MP4, FLV, KV and TS, and network protocol packaging formats like RTMP, RTSP, MMS and HLS. The media packaging format can be expanded according to actual requirements, and the customized packaging format and the processing module are added;
function 2: the method realizes most common coding and decoding formats in the current multimedia field, and supports both coding and decoding. The system supports common media coding and decoding formats such as MPEG4, AAC, MJPEG and the like, and also supports coding formats such as H.264 (AVC) coding, H.265, MP3 and the like;
function 3: a universal filter processing frame for audio, video, caption, etc. is provided, and the filter frame can have a plurality of input persons and a plurality of output persons;
function 4: a high level image conversion API is provided, which for example allows image scaling and pixel format conversion, commonly scaling for converting an image from 1080p to 720p or 480p, etc., or image format conversion for converting image data from YUV420P to YUYV, or YUV to RGB, etc.;
function 5: a high-level audio resampling API is provided, allowing for operating audio sampling, audio channel layout conversion and layout adjustment;
function 6: the method supports the audio and video recording and playing functions, and supports the video recording of various formats, such as MP4, flv, rmvb and the like;
function 7: the voice frequency communication under the SIP protocol is supported, and the mutual communication can be realized through the IP telephone;
function 8: the intercommunication between the IP telephone and the analog telephone is supported;
function 9: mail sending is supported, and mutual communication among mails can be realized.
In order to achieve the purpose, the invention adopts the following technical scheme:
a comprehensive communication platform integrating multiple modes comprises a distributed application server, a distributed storage server cluster, a platform authorization authentication server, network storage equipment, an NAT (network Address translation) penetrating server, a firewall, a voice gateway and other server side equipment. Each server program is connected with the platform authorization authentication service, and the authorization mode adopts an authorization code mode based on OAuth 2.0.
A comprehensive communication platform integrating multiple modes realizes the functions of point-to-point direct communication, group communication, video conference, screen sharing, whiteboard interaction, audio and video recording and the like among systems based on P2P, UDP hole punching and other related technologies. The communication modes among the systems comprise mutual communication among PC desktop applications, mutual communication among mobile terminals and mutual communication between the PC desktop applications and the mobile terminals; based on SIP protocol, voice gateway, etc., the communication between the system and each telecom operator handset and telephone is realized.
A comprehensive communication platform integrating multiple modes is based on an own mail server and realizes the functions of mail sending, mail information persistence, mail information management and the like.
A comprehensive communication method fusing multiple modes comprises the following steps:
step 1: establishing a comprehensive communication platform fusing multiple modes;
step 2: an instant message module, an audio and video communication module, an SIP service module, a data query and retrieval module, a system management module, an authorization authentication module, a mail management module, user information and other modules are established in an integrated communication platform application service cluster; establishing an instant message database, a voice scheduling database, a system management database, a user information database, a system log management database and other databases in a distributed database server cluster;
and step 3: each terminal device sends audio and video stream, text information and the like to an application platform server through a communication network, and the application server displays or stores data or transmission into a corresponding database after the application server is authenticated by an OAuth2.0 authorization code;
and 4, step 4: after the communication of each terminal device is established, voice scheduling can be realized through the instant communication module, the SIP service module and the user information module, and the operations of single call, group call, forced release, forced insertion, alternative connection, monitoring, recording and the like are supported, wherein the communication mode comprises mutual communication between IP telephones and communication between the IP telephones and analog telephones;
and 5: after the communication of each terminal device is established, one-to-one audio and video communication and group communication can be realized through the instant communication module, the audio and video communication module and the user information module, and a group administrator can invite to enter a group, play people and perform audio and video control on the people in the group;
step 6: after the communication of each terminal device is established, a voice/video conference can be realized through the instant communication module, the audio/video communication module and the user information module, and through the permission setting, a host can relieve the services of conference, conference pull, conference kicker and conference state updating, speech banning, still listening and the like; each conference member can freely speak, press keys to speak and the like;
and 7: after the communication of each terminal device is established, one-to-one group communication including characters, pictures and file messages can be realized through the instant communication module and the user information module;
and 8: after the communication of each terminal device is established, the functions of sending and receiving mails and the like can be realized through the user information module and the mail management module;
and step 9: the operation logs are generated by the modules, the log information is uniformly centralized in the database corresponding to the log module through a log uniform acquisition technology, the logs comprise warning logs, error logs, general operation logs and the like, the log uniform management is realized, and the problems of log information dispersion and difficult collection and analysis are solved.
Drawings
Fig. 1 is an overall topology diagram of a comprehensive communication platform integrating multiple modes.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Example 1:
as shown in the figure, the comprehensive communication platform integrating multiple modes comprises a comprehensive communication application server cluster, a comprehensive communication database server cluster, a voice gateway, a switch, an IP telephone, an analog telephone, a mobile terminal and the like, wherein each server-side program is connected with a platform authorization authentication service, and an authorization mode adopts an authorization code mode based on OAuth 2.0. The communication network comprises an IP network, a mobile communication network, a virtual private network, a WiFi network and a user-defined networking, and the system can flexibly network according to actual requirements to realize comprehensive communication in different areas. Different levels of permissions, including data permissions and functional permissions, may be assigned in the system depending on the user.
Example 2:
the integrated communication method with multiple modes in embodiment 2 is implemented on the basis of the integrated communication platform with multiple modes in embodiment 1, and includes the following steps:
step 1: establishing a comprehensive communication platform fusing multiple modes;
step 2: an instant message module, an audio and video communication module, an SIP service module, a data query and retrieval module, a system management module, an authorization authentication module, a mail management module, user information and other modules are established in an integrated communication platform application service cluster; establishing an instant message database, a voice scheduling database, a system management database, a user information database, a system log management database and other databases in a distributed database server cluster;
and step 3: each terminal device sends audio and video stream, text information and the like to an application platform server through a communication network, and the application server displays or stores data or transmission into a corresponding database after the application server is authenticated by an OAuth2.0 authorization code;
and 4, step 4: after the communication of each terminal device is established, voice scheduling can be realized through the instant communication module, the SIP service module and the user information module, and the operations of single call, group call, forced release, forced insertion, alternative connection, monitoring, recording and the like are supported, wherein the communication mode comprises mutual communication between IP telephones and communication between the IP telephones and analog telephones;
and 5: after the communication of each terminal device is established, one-to-one audio and video communication and group communication can be realized through the instant communication module, the audio and video communication module and the user information module, and a group administrator can invite to enter a group, play people and perform audio and video control on the people in the group;
step 6: after the communication of each terminal device is established, a voice/video conference can be realized through the instant communication module, the audio/video communication module and the user information module, and through the permission setting, a host can relieve the services of conference, conference pull, conference kicker and conference state updating, speech banning, still listening and the like; each conference member can freely speak, press keys to speak and the like;
and 7: after the communication of each terminal device is established, one-to-one group communication including characters, pictures and file messages can be realized through the instant communication module and the user information module;
and 8: after the communication of each terminal device is established, the functions of sending and receiving mails and the like can be realized through the user information module and the mail management module;
and step 9: the operation logs are generated by the modules, the log information is uniformly centralized in the database corresponding to the log module through a log uniform acquisition technology, the logs comprise warning logs, error logs, general operation logs and the like, the log uniform management is realized, and the problems of log information dispersion and difficult collection and analysis are solved.
The comprehensive communication platform integrating multiple modes adopts a B/S mode, and develops a system front-end and back-end separation scheme which adopts a java system and is based on Spring Cloud micro-service and Vue architecture. Each service in the micro-service architecture is a unit with independent service logic and accords with a high-cohesion and low-coupling principle and a single-duty principle, and different services are flexibly combined in a pipeline mode, so that a huge system is constructed.
The invention aims to provide a comprehensive communication platform and a method integrating multiple modes, which solve the technical problems of timely information sharing, communication efficiency improvement and convenient use and perfect a communication management system.
Claims (8)
1. A comprehensive communication platform and method fusing multiple modes are characterized in that: the system comprises server-side equipment such as a distributed application server, a distributed storage server cluster, a platform authorization authentication server, network storage equipment, an NAT penetration server, a firewall, a voice gateway and the like, wherein each server-side program is connected with the platform authorization authentication service, and an authorization mode adopts an authorization code mode based on OAuth 2.0.
2. A comprehensive communication platform and method integrating multiple modes as claimed in claim 1, wherein: the system realizes the functions of point-to-point direct communication, group communication, video conference, screen sharing, whiteboard interaction, audio and video recording and the like among systems based on P2P, UDP hole punching and other related technologies.
3. A comprehensive communication platform and method integrating multiple modes as claimed in claim 1, wherein: the communication modes between the systems comprise mutual communication between PC desktop applications, mutual communication between mobile terminals and mutual communication between the PC desktop applications and the mobile terminals.
4. A comprehensive communication platform and method integrating multiple modes as claimed in claim 1, wherein: based on SIP protocol, voice gateway, etc., the communication between the system and each telecom operator handset and telephone is realized.
5. A comprehensive communication platform and method integrating multiple modes as claimed in claim 1, wherein: based on the own mail server, the functions of mail sending, mail information persistence, mail information management and the like are realized.
6. A comprehensive communication method fusing multiple modes comprises the following functions:
function 1: the method realizes most media packaging formats in the current multimedia field, including packaging and decapsulation, such as file packaging formats like MP4, FLV, KV and TS, and network protocol packaging formats like RTMP, RTSP, MMS and HLS, and can expand the media packaging formats according to actual requirements and add customized packaging formats and processing modules;
function 2: the method realizes most common coding and decoding formats in the current multimedia field, supports both coding and decoding, supports common media coding and decoding formats such as MPEG4, AAC, MJPEG and the like, and supports coding formats such as H.264 (AVC) coding, H.265, MP3 and the like;
function 3: a universal filter processing frame for audio, video, caption, etc. is provided, and the filter frame can have a plurality of input persons and a plurality of output persons;
function 4: a high level image conversion API is provided, which for example allows image scaling and pixel format conversion, commonly scaling for converting an image from 1080p to 720p or 480p, etc., or image format conversion for converting image data from YUV420P to YUYV, or YUV to RGB, etc.;
function 5: a high-level audio resampling API is provided, allowing for operating audio sampling, audio channel layout conversion and layout adjustment;
function 6: the method supports the audio and video recording and playing functions, and supports the video recording of various formats, such as MP4, flv, rmvb and the like;
function 7: the voice frequency communication under the SIP protocol is supported, and the mutual communication can be realized through the IP telephone;
function 8: the intercommunication between the IP telephone and the analog telephone is supported;
function 9: mail sending is supported, and mutual communication among mails can be realized.
7. A comprehensive communication method fusing multiple modes comprises the following steps:
step 1: establishing a comprehensive communication platform fusing multiple modes;
step 2: an instant message module, an audio and video communication module, an SIP service module, a data query and retrieval module, a system management module, an authorization authentication module, a mail management module, user information and other modules are established in an integrated communication platform application service cluster; establishing an instant message database, a voice scheduling database, a system management database, a user information database, a system log management database and other databases in a distributed database server cluster;
and step 3: each terminal device sends audio and video stream, text information and the like to an application platform server through a communication network, and the application server displays or stores data or transmission into a corresponding database after the application server is authenticated by an OAuth2.0 authorization code;
and 4, step 4: after the communication of each terminal device is established, voice scheduling can be realized through the instant communication module, the SIP service module and the user information module, and the operations of single call, group call, forced release, forced insertion, alternative connection, monitoring, recording and the like are supported, wherein the communication mode comprises mutual communication between IP telephones and communication between the IP telephones and analog telephones;
and 5: after the communication of each terminal device is established, one-to-one audio and video communication and group communication can be realized through the instant communication module, the audio and video communication module and the user information module, and a group administrator can invite to enter a group, play people and perform audio and video control on the people in the group;
step 6: after the communication of each terminal device is established, a voice/video conference can be realized through the instant communication module, the audio/video communication module and the user information module, and through the permission setting, a host can relieve the services of conference, conference pull, conference kicker and conference state updating, speech banning, still listening and the like; each conference member can freely speak, press keys to speak and the like;
and 7: after the communication of each terminal device is established, one-to-one group communication including characters, pictures and file messages can be realized through the instant communication module and the user information module;
and 8: after the communication of each terminal device is established, the functions of sending and receiving mails and the like can be realized through the user information module and the mail management module;
and step 9: the operation logs are generated by the modules, the log information is uniformly centralized in the database corresponding to the log module through a log uniform acquisition technology, the logs comprise warning logs, error logs, general operation logs and the like, the log uniform management is realized, and the problems of log information dispersion and difficult collection and analysis are solved.
8. A comprehensive communication platform integrating multiple modes adopts a B/S mode, a system front-end and back-end separation scheme which adopts a java system and is based on Spring Cloud micro-services and an Vue framework is developed, each service in the micro-service framework is a unit with independent service logic and accords with a high-cohesion and low-coupling principle and a single responsibility principle, and different services are flexibly combined in a pipeline mode, so that a huge system is constructed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010316137.3A CN111385312A (en) | 2020-04-22 | 2020-04-22 | Comprehensive communication platform and method integrating multiple modes |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010316137.3A CN111385312A (en) | 2020-04-22 | 2020-04-22 | Comprehensive communication platform and method integrating multiple modes |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111385312A true CN111385312A (en) | 2020-07-07 |
Family
ID=71222089
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010316137.3A Pending CN111385312A (en) | 2020-04-22 | 2020-04-22 | Comprehensive communication platform and method integrating multiple modes |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111385312A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113099155A (en) * | 2021-02-22 | 2021-07-09 | 广州佰锐网络科技有限公司 | Video conference system suitable for multiple scenes |
-
2020
- 2020-04-22 CN CN202010316137.3A patent/CN111385312A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113099155A (en) * | 2021-02-22 | 2021-07-09 | 广州佰锐网络科技有限公司 | Video conference system suitable for multiple scenes |
| CN113099155B (en) * | 2021-02-22 | 2023-11-03 | 广州佰锐网络科技有限公司 | Video conference system suitable for multiple scenes |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106331581B (en) | Method and device for communication between mobile terminal and video network terminal | |
| CN108055496B (en) | Live broadcasting method and system for video conference | |
| WO2013183970A1 (en) | Multiple channel communication using multiple cameras | |
| US6732368B1 (en) | Method and apparatus for providing voice/unified messaging services using CATV terminals | |
| CN101156374B (en) | System and method for monitoring video call | |
| US20070011710A1 (en) | Interactive news gathering and media production control system | |
| EP2658232A1 (en) | Method and system for an optimized multimedia communications system | |
| CN109495713B (en) | Video conference control method and device based on video networking | |
| WO2018006573A1 (en) | Device implementing video conference screen sharing | |
| DE112007000380T5 (en) | Home Communications Server | |
| CN110943909A (en) | Audio and video fusion communication server | |
| GB2428529A (en) | Interactive news gathering and media production control system | |
| CN101677388A (en) | Visual communication system, terminal gateway, video gateway and visual communication method | |
| CN101554051A (en) | Digital communications adaptor | |
| CN102307211A (en) | Method for realizing full-screen synchronization of whiteboard | |
| CN101146272A (en) | PTT system, PTT communication realization method, PTT management server and terminal device | |
| CN107592429B (en) | Multi-seat multimedia scheduling system | |
| EP0723730B1 (en) | Multimedia enabled network | |
| CN101540870A (en) | Realization method of video call service | |
| CN102395025A (en) | Video scheduling system with electronic whiteboard function and method for realizing electronic whiteboard function | |
| CN102404547A (en) | Method and terminal for realizing video conference cascade | |
| EP2884750A1 (en) | Monitoring method and internet protocol television set top box | |
| CN112422583A (en) | Method and system for fusion and intercommunication of multi-protocol video application | |
| CN100561963C (en) | A kind of system that realizes that content of multimedia is shared | |
| CN111147789B (en) | Method, device and equipment for recording audio and video stream and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200707 |