CN115706812A - Program processing system, method, device, equipment and storage medium - Google Patents

Program processing system, method, device, equipment and storage medium Download PDF

Info

Publication number
CN115706812A
CN115706812A CN202110903851.7A CN202110903851A CN115706812A CN 115706812 A CN115706812 A CN 115706812A CN 202110903851 A CN202110903851 A CN 202110903851A CN 115706812 A CN115706812 A CN 115706812A
Authority
CN
China
Prior art keywords
program
resource
network
scheduling
resource pool
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110903851.7A
Other languages
Chinese (zh)
Inventor
常树磊
赵东玮
王月
郑旭东
孙健
闻天扬
沈昭
满春刚
李伟
刘颖
李祥熙
朱羽
彭帅
冯玮
岳名山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Beijing Co Ltd
Original Assignee
Tencent Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Beijing Co Ltd filed Critical Tencent Technology Beijing Co Ltd
Priority to CN202110903851.7A priority Critical patent/CN115706812A/en
Publication of CN115706812A publication Critical patent/CN115706812A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The application provides a program processing system, a program processing method, a program processing device, an electronic device and a computer readable storage medium; the system comprises: the system comprises a content switching network, an integrated service mixing network, a scheduling controller and a plurality of terminals comprising resource pools; the integrated service hybrid network is used for collecting program production data; the scheduling controller is used for acquiring program production data from the integrated service mixed network and scheduling the program production data to obtain a program scheduling signal; the content switching network is used for carrying out signal switching based on the scheduling signals of the programs to obtain program resource signals required by a plurality of resource pools and respectively sending the program resource signals required by the resource pools to the corresponding terminals containing the resource pools; and the terminal containing the resource pool is used for carrying out program making processing based on the received program resource signals required by the resource pool and the source data of the programs to obtain programs for broadcasting and sending the programs for broadcasting to the user terminal.

Description

Program processing system, method, device, equipment and storage medium
Technical Field
The present application relates to internet technologies, and in particular, to a program processing system, a program processing method, an apparatus, an electronic device, and a computer-readable storage medium.
Background
The broadcasting technology center serves all departments, bears the whole flow production and broadcasting of program contents such as comprehensive art, sports, information, games and the like, closely fits the program contents, and strives to create a complete and professional live broadcast or rebroadcast technology platform with an industry leading position and output a production technical scheme with high cost performance.
At present, a production domain, a master control system, a broadcasting system and a transmission system are mutually isolated by a broadcasting technology center, a uniform signal domain and a management domain cannot be formed, and the information transmission logic is complex, so that the program production, broadcasting and transmission efficiency is low.
Disclosure of Invention
The embodiment of the application provides a program processing system, a program processing method, a program processing device, an electronic device and a computer readable storage medium, which can form a uniform signal domain and a uniform management domain and improve the program production, playing and transmission efficiency.
The technical scheme of the embodiment of the application is realized as follows:
an embodiment of the present application provides a program processing system, including:
the system comprises a content switching network, an integrated service mixing network, a scheduling controller and a plurality of terminals comprising resource pools; wherein the content of the first and second substances,
the integrated service hybrid network is used for collecting program production data;
the scheduling controller is used for acquiring the program production data from the integrated service hybrid network and scheduling the program production data to obtain a scheduling signal of the program;
the content switching network is used for performing signal switching based on the scheduling signals of the programs to obtain program resource signals required by a plurality of resource pools, and respectively sending the program resource signals required by the resource pools to the corresponding terminals comprising the resource pools;
and the terminal comprising the resource pool is used for carrying out program making processing based on the received program resource signals required by the resource pool and the source data of the programs to obtain programs for broadcasting and sending the programs for broadcasting to the user terminal.
The embodiment of the application provides a program processing method, which is applied to a program processing system, wherein the program processing system comprises: the system comprises a content switching network, an integrated service mixing network, a scheduling controller and a plurality of terminals comprising resource pools;
the method comprises the following steps:
the scheduling controller acquires program production data from the integrated service hybrid network and performs scheduling processing on the program production data to obtain a scheduling signal of the program;
the content switching network performs signal switching based on the scheduling signals of the programs to obtain program resource signals required by a plurality of resource pools, and respectively sends the program resource signals required by the resource pools to corresponding terminals containing the resource pools, so that the program resource signals required by the resource pools are enabled to be respectively sent to the terminals containing the resource pools
And the terminal containing the resource pool performs program making processing based on the received program resource signals required by the resource pool and the source data of the program to obtain a program for broadcasting and sends the program for broadcasting to the user terminal.
An embodiment of the present application provides a program processing apparatus, where the apparatus includes:
the integrated service mixing module is used for collecting the program production data;
the scheduling control module is used for acquiring the program production data from the integrated service mixing module and scheduling the program production data to obtain a scheduling signal of the program;
the content exchange module is used for carrying out signal exchange based on the scheduling signals of the programs to obtain program resource signals required by a plurality of resource pools and respectively sending the program resource signals required by the resource pools to the corresponding resource modules containing the resource pools;
and the resource module containing the resource pool is used for carrying out program making processing based on the received program resource signals required by the resource pool and the source data of the program to obtain a program for broadcasting and sending the program for broadcasting to the user terminal.
An embodiment of the present application provides an electronic device for program processing, where the electronic device includes:
a memory for storing executable instructions;
and the processor is used for realizing the program processing method provided by the embodiment of the application when executing the executable instructions stored in the memory.
The embodiment of the present application provides a computer-readable storage medium, which stores executable instructions for causing a processor to implement the program processing method provided by the embodiment of the present application when the processor executes the executable instructions.
The embodiment of the application has the following beneficial effects:
the program resource signals required by a plurality of resource pools are respectively sent to corresponding terminals containing the resource pools, so that a unified signal domain and a management domain are formed, information transmission logic is simplified, and the program making, playing and spreading efficiency is improved.
Drawings
Fig. 1A to fig. 1C are schematic structural diagrams of a program processing system according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of an electronic device for program-on-demand processing according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a program processing method according to an embodiment of the present application;
FIG. 4 is a diagram of a technical architecture provided by the related art;
5-6 are schematic diagrams of production flows of a program production and distribution system provided by an embodiment of the present application;
FIG. 7 is a schematic diagram of a program production distribution system topology provided by an embodiment of the present application;
fig. 8 is a schematic diagram of network congestion provided by an embodiment of the present application;
fig. 9 is a schematic diagram of path load balancing provided by an embodiment of the present application;
FIG. 10 is a schematic diagram of a high precision time synchronization protocol (PTP) delivery hierarchy provided by an embodiment of the present application;
fig. 11 is a schematic service flow diagram of a media asset system provided in an embodiment of the present application;
FIG. 12 is a schematic diagram of audio cross-layer networking provided by an embodiment of the present application;
FIG. 13 is a schematic diagram of an audio PTP network provided by an embodiment of the present application;
fig. 14 is a schematic flow chart of an audio call making domain provided in an embodiment of the present application;
fig. 15 is a schematic diagram of an out-of-band integrated services hybrid network topology provided by an embodiment of the present application;
fig. 16 is a schematic diagram of an out-of-band integrated services hybrid network application architecture provided by an embodiment of the present application;
fig. 17 is a schematic diagram of an IP system scheduling control logic provided in an embodiment of the present application;
fig. 18 is a schematic distribution diagram of a content distribution network provided in an embodiment of the present application.
Detailed Description
In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the attached drawings, the described embodiments should not be considered as limiting the present application, and all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
In the following description, references to the terms "first", "second", and the like are only used for distinguishing similar objects and do not denote a particular order or importance, but rather the terms "first", "second", and the like may be used interchangeably with the order of priority or the order in which they are expressed, where permissible, to enable embodiments of the present application described herein to be practiced otherwise than as specifically illustrated and described herein.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the application.
Before further detailed description of the embodiments of the present application, terms and expressions referred to in the embodiments of the present application will be described, and the terms and expressions referred to in the embodiments of the present application will be used for the following explanation.
1) In response to the condition or state on which the performed operation depends, one or more of the performed operations may be in real-time or may have a set delay when the dependent condition or state is satisfied; there is no restriction on the order of execution of the operations performed unless otherwise specified.
2) Internet Protocol (IP, internet Protocol): an Internet Protocol (IP) in the TCP (Transmission Control Protocol) system or the IP system. The IP can improve the scalability of the network: firstly, the problem of the internet is solved, and interconnection and intercommunication of large-scale and heterogeneous networks are realized; and secondly, dividing the coupling relation between the top network application and the bottom network technology so as to be beneficial to the independent development of the top network application and the bottom network technology. IP can provide a connectionless, unreliable, best-effort packet delivery service to hosts based on end-to-end design principles.
IP is the core of the entire TCP/IP suite of protocols and also forms the basis of the Internet. IP is located at the network layer of the TCP/IP model, and can provide information of various protocols such as TCP, UDP and the like to the transmission layer; the IP packets may be placed at the link layer and transmitted via various technologies such as ethernet, token ring, etc.
3) Commercial Off-The-Shelf (COTS): a software or hardware product with an open standard defined interface.
4) Making data: data used for programming, such as program data obtained from a data back-end, real-time instructions of studio or turnkey platform operators, scheduling of programs obtained from a predictive system, etc., for example, for live sporting events, program data including event scores, athlete presence order, audience size, event host information, etc., and program data may be various types of data, such as text data, picture data, audio data, etc.
5) Source data: the raw data of the program collected by the collecting device, which is not processed, may be various types of data, such as text data, picture data, audio data, and the like. For example, for a live sporting event, the source data includes live audio data and video data captured by a capture device such as a camera.
The embodiment of the application provides a program processing system, a program processing method, a program processing device, an electronic device and a computer readable storage medium, which can form a uniform signal domain and a uniform management domain and improve program making, playing and spreading efficiency.
The program processing system provided by the embodiment of the application is realized by a distributed machine learning system. The integrated service hybrid Network, the scheduling controller and the Content exchange Network in the distributed machine learning system may be independent physical servers, may also be a server cluster or a distributed system formed by a plurality of physical servers, and may also be cloud servers providing basic cloud computing services such as cloud services, a cloud database, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, a Content Delivery Network (CDN), and a big data and artificial intelligence platform.
In some embodiments, the electronic device in the program processing system may implement the program processing method provided in the embodiments of the present application by running a computer program. For example, the computer program may be a native program or a software module in an operating system; can be a local (Native) application program (APP), i.e. a program that needs to be installed in an operating system to run; or may be an applet, i.e. a program that can be run only by downloading it to the browser environment; but also an applet that can be embedded into any APP. In general, the computer programs described above may be any form of application, module or plug-in.
Referring to fig. 1A, fig. 1A is a schematic structural diagram of a program processing system 10 provided in an embodiment of the present application, where the program processing system includes an integrated service hybrid network 100, a scheduling controller 200, a content switching network 300, and a terminal 400 including a resource pool; the integrated services hybrid network 100, the scheduling controller 200, the content switching network 300, the terminals 400 including the resource pool, and the user terminal 500 are connected via a network 600, and the network 600 may be a wide area network or a local area network, or a combination of the two.
An integrated services hybrid network 100 for collecting production data of programs;
a scheduling controller 200, configured to obtain program production data from the integrated service hybrid network 100, and perform scheduling processing on the program production data to obtain a program scheduling signal;
the content switching network 300 is configured to perform signal switching based on the scheduling signal of the program to obtain program resource signals required by multiple resource pools, and send the program resource signals required by the multiple resource pools to the corresponding terminals 400 including the resource pools respectively;
the terminal 400 including the resource pool is configured to perform program production processing based on the received program resource signal required by the resource pool and the source data of the program, obtain a program for broadcasting, and send the program for broadcasting to the user terminal 500.
In some embodiments, the scheduling controller includes an upper scheduling controller and a plurality of lower sub-controllers, wherein the plurality of lower sub-controllers respectively correspond to different resource pools, and the upper scheduling controller is connected with the plurality of lower sub-controllers through an internet protocol; the upper-layer scheduling controller is used for acquiring the program production data from the integrated service hybrid network, mapping the program production data to the lower-layer sub-controllers to obtain mapping data corresponding to the lower-layer sub-controllers respectively, and sending the mapping data corresponding to the lower-layer sub-controllers to the corresponding lower-layer sub-controllers respectively; and the lower-layer sub-controller is used for updating the data of the received mapping data to obtain a scheduling signal of the program and sending the scheduling signal of the program to the content switching network.
As shown in fig. 1B, the upper scheduling controller is used as a main control of the whole program processing system (i.e., a program production and propagation system), and may obtain production data of a program from the integrated service hybrid network, perform mapping processing on the production data of the program with respect to a plurality of lower sub-controllers (i.e., controllers to which signal transceiving terminals in a resource pool belong, corresponding to the resource pool) based on a matrix cross-point form, obtain mapping data corresponding to each of the plurality of lower sub-controllers, and send the mapping data corresponding to each of the plurality of lower sub-controllers to the corresponding lower sub-controllers, the lower sub-controllers fill data such as addresses and formats of signals required by each terminal into a signal request list, so as to perform data updating processing, obtain scheduling signals of the program, and send the scheduling signals of the program to a content switching network.
In some embodiments, the scheduling controller is further configured to perform real-time monitoring processing on the content switching network, the integrated service hybrid network, and the plurality of terminals including the resource pool to obtain monitoring data, and display the monitoring data through a control interface; wherein the dimension of the real-time monitoring process comprises at least one of: topology of the network, device ports, routing flow, traffic state, system events.
As shown in fig. 1C, a monitoring mechanism is implemented by the scheduling controller, which can monitor network node devices (i.e., a content switching network, an integrated service hybrid network, and a plurality of terminals including a resource pool) in real time, and can also monitor the overall network traffic and bandwidth performance comprehensively. The system availability, equipment state, link state and other monitoring data can be monitored from multiple dimensions of a network, such as a topological structure, equipment ports, routing flow direction, service state, system events and the like through the scheduling controller.
In order to solve the problem of unified control among different control systems of products of different brands in the system, the different control systems are gathered together through the scheduling controller, various protocols are considered at the same time, and a unified control interface is formed through the standardized design of a control interface, so that a user can control the control interface conveniently.
It should be noted that the scheduling controller is connected in series with a bottom-layer independent control system or a single-machine controller from top to bottom through an IP control protocol to form a unified operation interface for operators. The method is widely supported in an NMOS protocol cluster, each protocol (including NMOS, generic X-Switch, nVision, LRC, TS L, ember +, pro-bel and the like) has respective supported array, and the scheduling controller realizes complex logic application in a simplified control system through internal logic source, logic triggering, one-key following, system snapshot, layering and the like.
In some embodiments, the scheduling controller is further configured to write a scheduling signal of the program into the signal request list; the terminal comprises a resource pool and is also used for carrying out signal switching based on the signal request list to obtain a group management protocol request of a program and sending the group management protocol request of the program to a content switching network; and the content switching network is also used for analyzing the group management protocol request of the program to obtain program resource signals required by the resource pools and respectively sending the program resource signals required by the resource pools to the corresponding terminals containing the resource pools.
As shown in fig. 1B, the scheduling controller writes the scheduling signal of the program into the signal request list, the terminal including the resource pool performs signal switching based on the signal request list to obtain a group management protocol (IGMP) request of the program, and sends the group management protocol request of the program to the content switching network, the content switching network obtains program resource signals (i.e., multicast signals corresponding to the resource pool) required by the plurality of resource pools based on the group management protocol request of the program and according to multicast routing addressing, and sends the program resource signals required by the plurality of resource pools to the interfaces of the corresponding terminals including the resource pools.
In some embodiments, the content-switching network includes a main-domain spine switch, an auxiliary-domain spine switch, a plurality of first leaf switches, and a plurality of second leaf switches, and the main-domain spine switch, the auxiliary-domain spine switch, the plurality of first leaf switches, and the plurality of second leaf switches all employ ports of a three-layer domain structure. The content switching network is also used for enabling multicast routing by using the connection relation between the main domain ridge switch and the plurality of first leaf switches, the connection relation between the standby domain ridge switch and the plurality of second leaf switches and a multicast protocol which is not related to the routing; performing signal exchange on scheduling signals of the programs based on the multicast routing to obtain program resource signals required by a plurality of resource pools; and performing three-layer addressing processing on the program resource signals required by the plurality of resource pools based on the three-layer domain structure to obtain a forwarding address of each program resource signal, and transmitting the program resource signals to the corresponding terminals containing the resource pools based on the forwarding addresses of the program resource signals.
For example, the content-switching network core exceeds 200T (terabyte) total switching throughput, and includes active and standby dual-spine switches (i.e., main domain spine switch, standby domain spine switch), each spine exceeds 100T, and manages 44 leaf switches, and covers a full-set studio process including 8 studios, 4 sets of secure broadcasting units, 8 commentary rooms, and 1 studio.
The embodiment of the application adopts a full three-layer routing architecture design, each switch is connected with all the switches of the next stage under the She Jijia architecture, and the connection with fixed hop count is adopted to resolve the uncertainty of time delay and reduce the jitter range. Wherein, the leaf switch who is connected with main domain spine switch is first leaf switch, and the leaf switch who is connected with reserve domain spine switch is the second leaf switch. The whole set of network of the embodiment of the application adopts a three-layer routing design, each switch port is set to be a three-layer domain, and each three-layer domain is an independent error domain, so that a minimum three-layer domain is formed among the ports (the IP on each port and the terminal adopts a 30-bit mask and is intercommunicated with other IPs by a routing protocol), errors among different terminals cannot be transmitted through the domains, meanwhile, different ports on the same equipment are mutually isolated, only three-layer intercommunicating is realized, and the possibility of data flooding is reduced to the maximum extent.
Meanwhile, in the embodiment of the present application, a Multicast routing is enabled in a network by using a Protocol independent Multicast Protocol (PIM), a unicast routing is enabled by using an Open Shortest Path First (OSPF) Protocol or a Border Gateway Protocol (BGP), and a routing state can be automatically notified, so that three-layer addressing can be performed in the entire network in cooperation with PIM, and deterministic forwarding is achieved.
In some embodiments, the physical link between the first leaf switch and the main domain spine switch and the physical link between the second leaf switch and the standby domain spine switch both adopt a peer-to-peer structure; a content-switching network further operable to: determining the data bandwidth of a physical link through a professional media network architecture and non-blocking multicast to obtain the used bandwidth and the residual bandwidth of the physical link; and distributing the program resource signals required by the plurality of resource pools to the corresponding terminals comprising the resource pools based on the used bandwidth and the residual bandwidth of the physical link.
For example, if the sum of the bandwidths of the terminal interfaces hung under the leaf switch is greater than the bandwidth of the uplink from the leaf switch to the spine switch, the problems of network congestion and packet loss will inevitably occur. In order to solve the problem of network congestion, in the embodiments of the present application, a fully peer-to-peer design is performed on uplink and downlink physical links from a leaf switch to a spine switch (i.e., a physical link between a first leaf switch and a main domain spine switch and a physical link between a second leaf switch and a standby domain spine switch), so as to ensure that no bandwidth bottleneck is generated. And a link has the capability of sensing data bandwidth by using a professional media network architecture (PMN) and a non-blocking multicast (NBM) mode, so that all services can be equally distributed to the existing path (namely, a terminal containing a resource pool) as far as possible according to the used bandwidth and the residual bandwidth, and simultaneously the bearing bandwidth of each path is basically kept balanced.
In some embodiments, the physical link between the first leaf switch and the main domain spine switch and the physical link between the second leaf switch and the standby domain spine switch both adopt a peer-to-peer structure; a content-switching network further operable to: determining the data bandwidth of a physical link through a border gateway protocol and a routing map to obtain the used bandwidth and the residual bandwidth of the physical link; and distributing the program resource signals required by the plurality of resource pools to the corresponding terminals containing the resource pools based on the used bandwidth and the residual bandwidth of the physical link.
For example, if the sum of the bandwidths of the terminal interfaces hung under the leaf switch is greater than the bandwidth of the uplink from the leaf switch to the spine switch, the problems of network congestion and packet loss will inevitably occur. In order to solve the problem of network congestion, in the embodiments of the present application, a fully peer-to-peer design is performed on uplink and downlink physical links from a leaf switch to a spine switch (i.e., a physical link between a first leaf switch and a main domain spine switch and a physical link between a second leaf switch and a standby domain spine switch), so as to ensure that no bandwidth bottleneck is generated. And the link has the capability of sensing the data bandwidth by using a Border Gateway Protocol (BGP) and a Route Map (Route Map), so that all services can be equally distributed to the existing path (i.e., a terminal including a resource pool) as much as possible according to the used bandwidth and the residual bandwidth, and simultaneously, the bearer bandwidths of the paths are basically balanced.
In some embodiments, the program processing system further comprises: and the clock system is used for carrying out clock synchronization on the content switching network so that the content switching network sends program resource signals required by the plurality of resource pools based on the synchronized clock.
It should be noted that a uniform and stable clock is an important basis for a set of system to work normally and for signal synchronization between nodes. The content switching network is subjected to clock synchronization so that the content switching network sends program resource signals required by a plurality of resource pools based on the synchronized clocks, and therefore the program resource signals received by terminals comprising the resource pools can be kept synchronous.
In some embodiments, a clock system includes a master clock and a slave clock; and the clock system is also used for carrying out clock synchronization on the content switching network based on the application that the main and standby clocks are matched with the boundary clock, so that the content switching network sends program resource signals required by a plurality of resource pools to corresponding terminals containing the resource pools based on the synchronized clocks, and clock references recovered by the terminals containing the resource pools are kept synchronous.
For example, in the program processing system in the embodiment of the present application, GB/T25931 (IEEE 1588v 2) is used as a Clock transfer and synchronization standard, st.2059-2 is a video synchronization configuration file, a system Clock is elected according to an optimal Master Clock Algorithm (bma, best Master Clock Algorithm), a Master Clock and a slave Clock are determined, and based on application of the Master Clock and the slave Clock in cooperation with a boundary Clock, stable continuation of a system reference cannot be affected by breakdown of any Clock distribution node, and a unique effective Clock (a synchronized Clock) is used for distribution in the entire network, so that Clock references recovered from each terminal are ensured to be completely consistent, thereby ensuring synchronization of video and audio. ST.2022-7 provides a new reference standard for link redundancy design, and the design of the ratio of 1:1, the redundant network supports the splicing processing of multipath sources from a terminal to the terminal and seamless switching.
In some embodiments, the category of the resource pool includes at least one of: the system comprises an external signal resource pool, a studio camera resource pool, a codec resource pool, a switching and manufacturing resource pool, a virtual resource pool, a picture and text packaging resource pool, a video playing resource pool, an audio resource pool, a media resource storage resource pool and a picture division resource pool; the terminal comprises a media asset storage resource pool and is also used for transcoding the recorded original media asset materials to obtain a transcoding file; and carrying out intelligent cataloguing processing on the transcoding file, and carrying out cloud storage on an obtained cataloguing result.
For example, on the content exchange network, various types of signals and terminals with different signal types and different application scenarios are virtually classified by using resource pools, and independent resource pool systems can smoothly interact under unified standards such as st.2110-20 and st.2110-30 through the content exchange network, so as to realize sharing among the resource pools.
The external signal resource pool comprises more than 140 external signals from a satellite, a private line and a public network pull stream, wherein channels without ST.2110 encapsulation output are communicated through a Digital Serial Interface (SDI) network and are encapsulated by SDI-IP gateway equipment in a unified manner. Wherein, the studio camera resource pool comprises more than 60 camera channels distributed in each studio/public area, and delivers the video to the IP network through the protocol S T.2110-20. The encoder resource pool comprises more than 40 channels of opposite transmission channels and more than 120 channels of live encoding channels, can support ST.2110-20/30 input, and finally distributes content to a video transcoding middling station and a content distribution network to reach end users. The switching resource pool comprises 2 large-scale IP Ultra High Definition (UHD) switching stations, all input and output channels support ST.2110-20/30/40, and all studios can be flexibly allocated according to program requirements, and signals can be switched through two panels, namely an entity panel and a virtual panel. Wherein, the virtual or graphics and text package or video playing resource pool comprises a server cluster with more than 110 input channels and 50 output channels, and all carry out signal interaction through ST.2110-20/30. The audio resource pool includes 100 wireless pickup channels, 512 × 512 audio matrices of not less than 2, 64 × 64 call matrices of not less than 4, audio call transceiving streams of not less than 160 channels, and 128 channels with the maximum audio call system cascade capacity (transceiving stream mode). The media asset storage resource pool covers the online storage space 500TB, the near-line management storage space 2PB (beat bytes), and the offline backup storage space 2PB. The drawing resource pool comprises a drawing cluster supporting more than 800 paths of ST.2110-20/30 signal acquisition, and IP monitoring is comprehensively realized. The converter resource pool comprises more than 30 High-density integrated processing gateway devices, is responsible for IP encapsulation and has functions of up-down conversion, rotation control, high-Dynamic Range image (HDR) conversion and the like.
It should be noted that the media asset storage resource pool in the related art has a problem of local storage capacity limitation. In order to solve the above problems, in the embodiment of the present application, a terminal including a media asset storage resource pool performs transcoding processing on recorded original media asset materials to obtain a transcoding file; and carrying out intelligent cataloging processing on the transcoding file, carrying out cloud storage on the obtained cataloging result, and realizing a cloud function on the media asset part so as to solve the problem of local storage capacity limitation.
In some embodiments, the program processing system further comprises: the content distribution network is used for sending the source data of the program acquired from the acquisition equipment to a terminal containing a resource pool; sending the program for broadcasting acquired from the terminal containing the resource pool to the user terminal; the format supported by data transmission performed by the content distribution network comprises at least one of an advanced video coding format and a high-efficiency video coding format, and the protocol supported by data transmission comprises at least one of a secure and reliable transmission protocol, a hypertext transmission protocol, a real-time message transmission protocol and a reliable internet transmission protocol.
As shown in fig. 1B, the content distribution network is an extension of the content switching network and is also an extension of the program processing system, and is a necessary path for source data and a unique pipeline for broadcasting programs to the user side. The program production and transmission system provided by the embodiment of the application is beneficial to the addition of a cloud Internet Data Center (IDC) in the links of external receiving and external distribution, and can smoothly receive, distribute and deliver real-time streams.
In a Real-Time Stream receiving link (source data transmission link), the embodiment of the present invention supports compression modes such as an Advanced Video Coding format (AVC), a High Efficiency Video Coding (HEVC), and the like, supports access to various network Transport protocols such as a Secure Reliable Transport Protocol (SRT), a hypertext Transport Protocol (HTTP), a Real Time Messaging Protocol (RTMP), and a Reliable Internet Transport Protocol (RIST), and injects source data into a terminal including a resource pool through an SDI and a decoding device supporting st.2110-20/30.
In a program delivery link (a program playing link), a multi-screen encoder supporting ST.2110-20/30 input can realize free selection of a source under the scheduling of a scheduling controller through an NMOS protocol, and then is distributed and delivered to a content distribution network through an AVC and HEVC compression mode and network protocols such as RTMP, HLS, FLV and the like.
In summary, the embodiment of the present application has the following beneficial effects: the program resource signals required by a plurality of resource pools are respectively sent to corresponding terminals containing the resource pools, so that a unified signal domain and a management domain are formed, information transmission logic is simplified, and the program making, playing and spreading efficiency is improved.
It should be noted that, in the embodiment of the present application, the integrated service mixing network, the scheduling controller, the content switching network, and the terminal including the resource pool may be implemented in a software manner (for example, in the form of an application program, software, a software module, a script, or code, and the like), and are deployed in an electronic device (i.e., the server in the above various forms) to implement the program processing method. The following describes a structure of an electronic device for program processing provided in an embodiment of the present application, referring to fig. 2, fig. 2 is a schematic structural diagram of an electronic device 500 for program processing provided in an embodiment of the present application, and taking the electronic device 500 as an example of a server, where the electronic device 500 for program processing shown in fig. 2 includes: at least one processor 510, memory 550, at least one network interface 520, and a user interface 530. The various components in the electronic device 500 are coupled together by a bus system 540. It is understood that the bus system 540 is used to enable communications among the components of the connection. The bus system 540 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 540 in FIG. 2.
The Processor 510 may be an integrated circuit chip having Signal processing capabilities, such as a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like, wherein the general purpose Processor may be a microprocessor or any conventional Processor, or the like.
The memory 550 may comprise volatile memory or nonvolatile memory, and may also comprise both volatile and nonvolatile memory. The non-volatile Memory may be a Read Only Memory (ROM), and the volatile Memory may be a Random Access Memory (RAM). The memory 550 described in embodiments herein is intended to comprise any suitable type of memory. Memory 550 optionally includes one or more storage devices physically located remote from processor 510.
In some embodiments, memory 550 may be capable of storing data to support various operations, examples of which include programs, modules, and data structures, or subsets or supersets thereof, as exemplified below.
An operating system 551 including system programs for processing various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks;
a network communication module 552 for communicating to other computing devices via one or more (wired or wireless) network interfaces 520, exemplary network interfaces 520 including: bluetooth, wireless compatibility authentication (WiFi), and Universal Serial Bus (USB), etc.;
in some embodiments, the program processing apparatus provided in this embodiment of the present application may be implemented in software, and may be, for example, an application program, a module, or a plug-in the server. Of course, without being limited thereto, the program processing apparatus provided in the embodiments of the present application may be provided as various software embodiments, including various forms of applications, software modules, scripts, or codes.
Fig. 2 shows a program processing means 555 stored in the memory 550, which may be software in the form of programs and plug-ins etc. and comprises a series of modules including an integrated services mixing module 5551, a scheduling control module 5552, a content exchange module 5553, a resource module 5554 containing a resource pool. When the integrated service mixing module 5551 is deployed in a network, the corresponding network may be referred to as an integrated service mixing network, and when the scheduling control module 5552 is deployed in a network, the corresponding network may be referred to as a scheduling control network, and similarly, the network in which the content switching module 5553 is deployed is implemented as a content switching network, and the terminal in which the resource module 5554 including a resource pool is deployed is implemented as a terminal including a resource pool.
The following describes a program processing method provided by the embodiment of the present application, applied to a program processing system, with reference to an exemplary application and implementation of the program processing system provided by the embodiment of the present application. Referring to fig. 3, fig. 3 is a schematic flowchart of a program processing method according to an embodiment of the present application, and is described with reference to the steps shown in fig. 3.
In the following steps, a program processing system includes: the system comprises a content switching network, an integrated service mixing network, a scheduling controller and a plurality of terminals comprising resource pools.
In step 101, the scheduling controller obtains program production data from the integrated services hybrid network, and performs scheduling processing on the program production data to obtain a program scheduling signal.
In some embodiments, the scheduling controller includes an upper layer scheduling controller and a plurality of lower layer sub-controllers, wherein the plurality of lower layer sub-controllers respectively correspond to different resource pools, and the upper layer scheduling controller is connected with the plurality of lower layer sub-controllers through an internet interconnection protocol; the upper-layer scheduling controller acquires program production data from the integrated service hybrid network, performs mapping processing on the program production data aiming at the lower-layer sub-controllers to obtain mapping data respectively corresponding to the lower-layer sub-controllers, and sends the mapping data respectively corresponding to the lower-layer sub-controllers to the corresponding lower-layer sub-controllers; and the lower sub-controller performs data updating processing on the received mapping data to obtain a scheduling signal of the program and sends the scheduling signal of the program to the content switching network.
For example, the upper-layer scheduling controller, serving as a master of the entire program processing system, may obtain production data of a program from the integrated service hybrid network, perform mapping processing on the production data of the program in a matrix cross point form for a plurality of lower-layer sub-controllers to obtain mapping data corresponding to the plurality of lower-layer sub-controllers, send the mapping data corresponding to the plurality of lower-layer sub-controllers to the corresponding lower-layer sub-controllers, and fill data such as addresses and formats of signals required by terminals into the signal request list by the lower-layer sub-controllers to perform data updating processing, obtain scheduling signals of the program, and send the scheduling signals of the program to the content switching network.
In some embodiments, the scheduling controller performs real-time monitoring processing on a content switching network, an integrated service hybrid network and a plurality of terminals including a resource pool to obtain monitoring data, and displays the monitoring data through a control interface; wherein the dimension of the real-time monitoring process comprises at least one of: topology of the network, device ports, routing flow, traffic state, system events.
For example, a monitoring mechanism is realized by a scheduling controller, which can monitor a content switching network, an integrated service hybrid network, a plurality of terminals including a resource pool in real time, and can also monitor the whole network flow and bandwidth performance comprehensively. The system availability, equipment state, link state and other monitoring data can be monitored from multiple dimensions of a network, such as a topological structure, equipment ports, routing flow direction, service state, system events and the like through the scheduling controller.
In step 102, the content switching network performs signal switching based on the scheduling signal of the program to obtain program resource signals required by a plurality of resource pools, and sends the program resource signals required by the plurality of resource pools to corresponding terminals including the resource pools respectively.
In some embodiments, the scheduling controller writes a scheduling signal for the program in the signal request list; the terminal comprising the resource pool performs signal switching based on the signal request list to obtain a group management protocol request of the program and sends the group management protocol request of the program to the content switching network; the content switching network analyzes the group management protocol request of the program to obtain program resource signals required by a plurality of resource pools, and respectively sends the program resource signals required by the resource pools to the corresponding terminals containing the resource pools.
For example, the scheduling controller writes a scheduling signal of a program into a signal request list, a terminal including a resource pool performs signal switching based on the signal request list to obtain a group management protocol (IGMP) request of the program, and sends the group management protocol request of the program to a content-switched network, the content-switched network obtains program resource signals (i.e., multicast signals corresponding to the resource pool) required by a plurality of resource pools based on the group management protocol request of the program and addresses according to a multicast route, and sends the program resource signals required by the plurality of resource pools to interfaces of the corresponding terminals including the resource pools respectively.
In some embodiments, the content-switching network includes a main domain spine switch, an auxiliary domain spine switch, a plurality of first leaf switches, and a plurality of second leaf switches, and the main domain spine switch, the auxiliary domain spine switch, the plurality of first leaf switches, and the plurality of second leaf switches all employ ports of a three-layer domain structure; the content switching network enables multicast routing by using the connection relation between a main domain ridge switch and a plurality of first leaf switches, the connection relation between a standby domain ridge switch and a plurality of second leaf switches and a multicast protocol irrelevant to the routing; performing signal exchange on scheduling signals of the programs based on the multicast routing to obtain program resource signals required by a plurality of resource pools; and performing three-layer addressing processing on the program resource signals required by the plurality of resource pools based on the three-layer domain structure to obtain a forwarding address of each program resource signal, and transmitting the program resource signals to the corresponding terminals containing the resource pools based on the forwarding addresses of the program resource signals.
In some embodiments, the physical link between the first leaf switch and the main domain spine switch and the physical link between the second leaf switch and the standby domain spine switch both adopt a peer-to-peer structure; the content switching network determines the data bandwidth of a physical link through a professional media network architecture and non-blocking multicast to obtain the used bandwidth and the residual bandwidth of the physical link; and distributing the program resource signals required by the plurality of resource pools to the corresponding terminals containing the resource pools based on the used bandwidth and the residual bandwidth of the physical link.
For example, in order to solve the problem of network congestion, in the embodiment of the present application, a physical link between a first leaf switch and a main domain spine switch and a physical link between a second leaf switch and a standby domain spine switch are designed in a fully peer-to-peer manner, so that it is ensured that no bandwidth bottleneck is generated. And a link has the capability of sensing data bandwidth by using a professional media network architecture (PMN) and a non-blocking multicast (NBM) mode, so that all services can be equally distributed to the existing path (namely, a terminal containing a resource pool) as far as possible according to the used bandwidth and the residual bandwidth, and simultaneously the bearing bandwidth of each path is basically kept balanced.
In some embodiments, the physical link between the first leaf switch and the main domain spine switch and the physical link between the second leaf switch and the standby domain spine switch both adopt a peer-to-peer structure; the content switching network determines the data bandwidth of a physical link through a border gateway protocol and a routing map to obtain the used bandwidth and the residual bandwidth of the physical link; and distributing the program resource signals required by the plurality of resource pools to the corresponding terminals comprising the resource pools based on the used bandwidth and the residual bandwidth of the physical link.
For example, by using a Border Gateway Protocol (BGP) and a Route Map (Route Map), a link has a capability of sensing a data bandwidth, so that all services can be equally distributed to an existing path (i.e., a terminal including a resource pool) as much as possible according to a used bandwidth and a remaining bandwidth, and simultaneously, bearer bandwidths of the paths are basically balanced.
In some embodiments, a clock system clocks the content switching network such that the content switching network transmits program resource signals required by the plurality of resource pools based on the synchronized clocks.
The clock system comprises a main clock, a standby clock and a boundary clock; the clock system performs clock synchronization on the content switching network based on the application of matching the main clock and the standby clock with the boundary clock, the content switching network sends program resource signals required by a plurality of resource pools to corresponding terminals containing the resource pools based on the synchronized clocks, and clock references recovered by the terminals containing the resource pools are kept synchronous.
In step 103, the terminal including the resource pool performs program production processing based on the received program resource signal required by the resource pool and the source data of the program to obtain a program for broadcasting, and sends the program for broadcasting to the user terminal.
Wherein the resource pool category includes at least one of: the system comprises an external signal resource pool, a studio camera resource pool, a codec resource pool, a switching and manufacturing resource pool, a virtual resource pool, a picture and text packaging resource pool, a video playing resource pool, an audio resource pool, a media resource storage resource pool and a picture division resource pool; a terminal comprising a media asset storage resource pool transcodes the recorded original media asset materials to obtain a transcoded file; and carrying out intelligent cataloguing processing on the transcoding file, and carrying out cloud storage on an obtained cataloguing result.
In some embodiments, the content distribution network sends the source data of the program obtained from the acquisition device to a terminal containing a resource pool; sending the program for broadcasting acquired from the terminal containing the resource pool to the user terminal; the format supported by data transmission performed by the content distribution network comprises at least one of an advanced video coding format and a high-efficiency video coding format, and the protocol supported by data transmission comprises at least one of a secure and reliable transmission protocol, a hypertext transmission protocol, a real-time message transmission protocol and a reliable internet transmission protocol.
For example, in a Real-Time Stream receiving link (source data transmission link), the embodiment of the present application supports compression modes such as an Advanced Video Coding format (AVC), a High Efficiency Video Coding (HEVC), and the like, supports access of multiple network Transport protocols such as a Secure Reliable Transport Protocol (SRT), a hypertext Transport Protocol (HTTP), a Real Time Messaging Protocol (RTMP), and a Reliable Internet Transport Protocol (RIST), and injects source data into a terminal including a resource pool through a decoding device such as an SDI and a support st.2110-20/30.
In a program delivery link (a program playing link), a multi-screen encoder supporting ST.2110-20/30 input can realize free selection of a source under the scheduling of a scheduling controller through an NMOS protocol, and then is distributed and delivered to a content distribution network through an AVC and HEVC compression mode and network protocols such as RTMP, HLS, FLV and the like.
In summary, the embodiment of the present application has the following beneficial effects: the program resource signals required by a plurality of resource pools are respectively sent to corresponding terminals containing the resource pools, so that a unified signal domain and a management domain are formed, information transmission logic is simplified, and the program making, playing and spreading efficiency is improved.
In the following, an exemplary application of the embodiments of the present application in a practical application scenario will be described.
As shown in fig. 4, in the system architecture in the related art, a domain manufacturing system, a master control system, a broadcasting system, and a transmission system are isolated from each other, the capacity of a core matrix between the systems is only responsible for signal routing of corresponding parts, each system also works under different clock systems, and upstream and downstream signal transmission is performed through cross-domain transmission and intercommunication of baseband signals. Secondly, in the audio production domain of each department, the clock synchronization is usually provided by a baseband word clock, and the audio and video addition and de-embedding also uses a baseband addition and de-embedding device. The management and monitoring parts are also independent of each other.
The related technical scheme has the following technical problems: because the manufacturing domain system, the master control system, the broadcasting system and the transmission system are isolated from each other, a uniform signal domain, a clock domain and a management domain cannot be formed, the signal transmission logic is complex, and the efficiency is low; the capacity of a baseband system is limited, and the bandwidth and the interface of a large amount of signal interaction cannot be correspondingly expanded aiming at the occurrence of standards such as a high frame rate, a high dynamic range and the like; a barrier exists in the sharing of resource pools, and the packaging part and the media resource part can only provide baseband signal interaction and are both local applications which cannot go to the cloud; upstream and downstream traffic cannot be put through in series within the same domain.
In order to solve the above problem, an embodiment of the present invention provides a program production and distribution system, which fundamentally changes such a state from the architecture, and integrates each department and each subsystem in the same content exchange system, and performs unified management and control on the management and monitoring of each terminal node and each exchange node under a scheduling controller, so as to implement a cloud function on a packaging and media resource part, thereby solving the problem of local storage capacity limitation.
The following describes the program production and distribution system provided in the embodiment of the present application in detail:
as shown in fig. 5, the program production and distribution system includes a production and distribution integrated switching network (i.e., content switching network, IP Fabric), resource pool subsystems, and an out-of-band integrated service hybrid network (i.e., integrated service hybrid network).
It should be noted that the production and transmission integrated content switching network covers network infrastructures such as a content core spine switch and a leaf switch.
Each resource pool subsystem comprises an external signal resource pool, an Internet Protocol Gateway (IPG) and Converter (Converter) resource pool, a studio camera resource pool, a codec resource pool, a switching manufacturing resource pool, a virtual (AR) resource pool, a graphic and text packaging (CG) resource pool, a video playing (PLAY OUT) resource pool, an IP picture division resource pool, a media resource storage resource pool, an IP audio and conversation resource pool and other various sending and receiving terminals and the like.
The out-of-band integrated service hybrid network covers an information distribution system network, a picture-adjusting light network, a file transmission network, an intelligent camera control network, a switch and video control network, a monitoring equipment network, IP network monitoring and the like, and related network safety deployment.
It should be noted that the production and broadcast integrated content switching network is the bottom foundation of the program production and transmission system, and through network architecture design, routing design, transmission and encapsulation protocol design, main and standby domain redundancy design, and clock transmission design, basic conditions are created for overall signal scheduling and interaction, and negotiation and transmission standards are established. Each resource pool is divided according to different signal sources, signal types and using methods, and each sub-resource pool can realize unimpeded interaction on a network level. The out-of-band integrated service hybrid network is independent of a content switching network, and is self-integrated into a network by utilizing the out-of-band management interfaces of all the switching cores and the signal terminals, so that the top-down unified scheduling and monitoring management of all the switching cores and the signal terminals are realized.
The program production and transmission system provided by the embodiment of the application is focused on the whole process, is newly in full IP (Internet protocol), and aims at ultra high definition to serve the whole process manufacturing of manufacturing, broadcasting and transmitting. According to the application scene and the actual function of the studio, the system, the broadcast and the transmission system are combined in one domain (clock domain), all nodes share resources, the resource pool is divided by taking the function of equipment as a boundary, the resources required by each studio can be randomly allocated according to the actual requirement of a program, and the channel or the input and output scale of each studio is not fixed.
As shown in fig. 6, a program presentation scene is taken as an example to introduce a full IP program production and transmission system which takes st.2110-20/30/40 protocol as a signal interaction standard, HD/UHD SDR/HDR as a signal production standard, and GB/T25931 (IEE E1588v 2) as a clock transfer and synchronization standard:
1. the upper layer scheduling controller is used as the main control of the whole production and propagation system, and can receive a scheduling plan from a reservation system, a real-time instruction from an operator of a studio or a main control platform, program data shared by a data background, and a signal switching/receiving instruction (namely a scheduling signal) sent to each level of lower layer sub-scheduling controllers.
2. The lower layer controller (i.e. the controller to which the signal transceiver terminal belongs in each resource pool) immediately sends updated address information and the like to various terminals under the lower layer controller after receiving the scheduling signal, and simultaneously returns updated information of the matrix cross point to the upper layer controller.
3. And the signal receiving and transmitting terminals in each resource pool update the receiving address lists in the respective channels according to the signals sent by the lower layer controllers in the respective domains so as to realize signal switching.
4. The content switching network is used as a basic framework of signal transmission, is positioned under the signal transceiving terminals in each resource pool, receives a Group Management Protocol (IGMP) request from each terminal, and forwards the multicast signals in the corresponding resource pool to the corresponding terminal interface according to multicast routing addressing.
5. The Clock system is used as a unique and effective synchronization source in the whole content switching network, and a Master Clock (Grand Master) is matched with a Boundary Clock (Boundary Clock) to use the unique and effective Clock for distribution, so that Clock references recovered from each terminal are ensured to be completely consistent, and the synchronization of video and audio is ensured.
6. The out-of-band integrated service hybrid network is not only a basic framework for realizing all network management and monitoring, but also an important link for connecting an information issuing system, a data background and a reservation system in series.
7. The content distribution network is an extension of a content switching network and an extension of a program production and propagation platform, is a necessary path for external signals and is a unique pipeline for broadcasting the signals to a user side.
The following describes in detail a content switching network, a clock system, a resource pooling, an out-of-band integrated service mixing network, an upper layer scheduling controller, and a content distribution network, which are involved in the program production and distribution system:
1) Content exchange network (over 200T scale whole process ST.2110 standard production and transmission integrated exchange network)
As shown in fig. 7, the studio-to-broadcaster integrated switching network core exceeds 200T total switching throughput, and includes master and slave dual-spine switches (master-domain spine switch and slave-domain spine switch), each spine exceeds 100T, and 44 leaf switches under jurisdiction cover a complete studio process including 8 studios, 4 sets of secure broadcasting units, 8 commentaries, and 1 sound studio, for example, the leaf switches under jurisdiction are respectively connected to an encoder (encoder), a decoder (decoder), a receiver, a camera (camera), a multi-viewer (multiviewer), an interphone (interphone), a replay (replay) device, a computer animation device, a recording device, an editing device, an archive device, a mixer, an audio node, a gateway, and the like.
The embodiment of the application adopts a full three-layer routing architecture design, each switching unit (namely a switch) is connected with all the switching units of the next stage under the She Jijia architecture, and the connection with fixed hop count is adopted to resolve the uncertainty of time delay and reduce the jitter range.
Although the two-layer network is simple in design and implementation, the whole two-layer domain becomes a very large error domain when a fault occurs, and any misbehavior from the terminal may cause a broadcast storm of the whole network. Also, when there is multicast traffic in the layer two domain, even if the traffic does not have an actual recipient, the multicast queries, queues, and flooding may compromise any switching nodes in the network, eventually causing congestion and even breakdown.
Therefore, the whole set of network in the embodiment of the present application adopts a three-layer routing design, each switch port is set as a three-layer domain, and each three-layer domain is an independent error domain, so that a minimum three-layer domain is formed between the ports (each port and the IP on the terminal adopt a 30-bit mask, and communicate with other IPs by means of a routing protocol), not only errors between different terminals cannot be transmitted through the domain, but also different ports on the same device are isolated from each other, and only three-layer communication is performed, thereby reducing the possibility of data flooding to the maximum extent.
Meanwhile, in the embodiment of the present application, a Multicast Protocol (PIM) that is not related to a route is used to enable a Multicast route in a network, and an Open Shortest Path First (OSPF) Protocol or a Border Gateway Protocol (BGP) Protocol is used to enable a unicast route and automatically notify a route state, so that three-layer addressing can be performed in the entire network in cooperation with the PIM, and deterministic forwarding is implemented. And the application of Group Management Protocol (IGMP) ensures that the receiver's request and leave for a specific multicast join can be responded correctly by the switch, and is compatible with IGMPv2/v3 at the same time.
Since the program production and transmission system carries a single-stream ultra-large bandwidth forwarding and routing which are mostly multicast domains, it can be known from the above description that the error domain is isolated to the greatest extent by means of three-layer forwarding, and accurate forwarding for a specific receiving device and compatible support for IGMP v2 and v3 are ensured by means of PIM and three-layer routing design. As shown in fig. 8, the sum of the bandwidths of the terminals hung under the leaf (video, audio, LINK (LINK), analog Network Coding (ANC)) is larger than the bandwidth of the uplink from the leaf to the spine, which inevitably causes network congestion and packet loss.
Therefore, as shown in fig. 9, the fully peer-to-peer design of the leaf-to-spine upstream and downstream physical links ensures that no bandwidth bottleneck is generated. Meanwhile, a link has the capacity of sensing data bandwidth by using a professional media network architecture (PMN), a non-blocking multicast (NBM), or a Border Gateway Protocol (BGP) and a Route Map (Route Map), so that all services can be equally distributed to the existing path as far as possible according to the used bandwidth and the residual bandwidth, and meanwhile, the bearing bandwidth of each path is basically balanced.
In the system, an operation terminal and a display interface for a user are distributed in each guide control room and each shooting area, and other equipment is deployed in a core machine room. Due to the adoption of the oversized core, the connection with a spine switch or a leaf switch can be determined according to the type of the terminal interface and the convergence rule. Most terminals with 100G interfaces in the system are direct-connection spine switches, so that the deployment of a large number of leaves and the connection between the spines are saved.
2) Clock system PTP and 2022-7 redundancy design
It should be noted that a uniform and stable clock is an important basis for a set of systems to work properly and for signal synchronization between nodes.
In the program production and propagation system in the embodiment of the application, GB/T25931 (IEEE 1588v 2) is used as a Clock transmission and synchronization standard, ST.2059-2 is used as a video synchronization configuration file, a system Clock is elected according to a Best Master Clock Algorithm (BMCA), and the breakdown of any Clock distribution node cannot influence the stable continuation of the system reference by matching with the application of a boundary Clock, and the whole network uses a unique effective Clock for issuing, so that the Clock references recovered from each terminal are ensured to be completely consistent, and the synchronization of video and audio is ensured. ST.2022-7 provides a new reference standard for link redundancy design, and the design of 1:1, the redundant network supports the splicing processing of multipath sources from a terminal to the terminal and seamless switching.
As shown in fig. 10, the Master Clock (GM) is the most important time reference source in the same Clock domain, and the Clock signals are all derived from the Global Positioning System (GPS). The main and standby clocks are connected with the 1G ports of the main and standby domain spines or leaves, and the spines or leaves connected with the main and standby domains are configured with ONLY a high-precision time synchronization protocol (PTP ONLY), so that the mode of ONLY allowing PTP intercommunication is most efficient. When any node or line in the system is broken, the output stability of each terminal (Host) and the system operation are not influenced. The key role of this is the priority calculation rule of BMCA. The priorities of the GM and the Boundary Clock (BC) in the system are correspondingly set according to the rule, P1 is ensured to be the same and P2 is ensured to be different among clocks in the same hierarchy, meanwhile, the related parameters of the PTP on the GM, including the AnnounceInterval (0), the Sync Interval (-3), the Delay-req Interval (-3), the AnnounceTimeout (3) and the like, are ensured to be the same as those of the BC and the Host, and finally, whether the GPS, the GM or one of a certain link fails, the system Clock and the clocks on each BC and the terminal Host can be ensured to realize stable transition, and the use of the system is not influenced.
The PTP clock transmission sequence is as follows: GM → spine → terminal of leaf/direct spine → terminal of direct leaf (all terminal access ports are forced to PTP Slave). Wherein the ridges and She Dou are locked as BC with the previous stage master clock, respectively.
The PTP transferring process after the main domain GPS antenna is disconnected comprises the following steps: the clock grade of GM A is reduced from the highest to GPS retention → the clock grade is transited from GM A to a main domain ridge, a standby domain ridge and GM B in sequence → GM B determines that the clock grade is the global optimal clock through BMCA calculation, GM B is transited from passive to active → standby domain ridge to determine the optimal clock from GM B, an interface facing GM B is immediately transited to a Slave interface, an interface facing main domain ridge is transited to a Master interface, GM ID in the system is also transited to GM B at the same time, GM ID in the direction facing standby domain ridge is determined to be transited to GM B on a terminal, the optimal clock from standby domain ridge is determined on main domain ridge, GM ID of the clock grade is updated, and GM ID in the direction facing main domain ridge is determined to be transited to GM B on a Slave corresponding port → terminal.
3) Resource pooling
On the content exchange network, the resource pool is used to virtually classify various signals and terminals of different signal types and different application scenes, and independent resource pool systems can smoothly interact under the unified standards such as ST.2110-20 and ST.2110-30 through the content exchange network.
The external signal resource pool comprises more than 140 external signals respectively coming from a satellite, a private line and a public network pull stream, wherein channels without ST.2110 packaging output are subjected to SDI-IP gateway equipment for unified packaging through a Digital Serial Interface (SDI) network; the converter resource pool comprises more than 30 high-density integrated processing gateway devices, is responsible for IP encapsulation and has the functions of up-down conversion, modulation conversion, HDR conversion and the like; the studio camera resource pool comprises more than 60 paths of camera channels distributed in each studio/public area, and delivers videos to an IP network through an ST.2110-20 protocol; the IP drawing resource pool comprises a drawing cluster supporting more than 800 paths of ST.2110-20/30 signal acquisition, and IP monitoring is comprehensively realized; the switching and manufacturing resource pool comprises 2 large-scale IP UHD switching stations, all input and output channels support ST.2110-20/30/40, and each studio can flexibly allocate according to program requirements, and signals can be switched through an entity panel and a virtual panel; the virtual or image-text packaging or video playing resource pool comprises a server cluster with more than 110 paths of input and 50 paths of output, and signal interaction is carried out through ST.2110-20/30; the audio resource pool comprises 100 wireless sound pickup channels, 512x512 audio matrixes which are not less than 2, 64x64 call matrixes which are not less than 4, audio call receiving and sending stream numbers which are not less than 160 channels, and 128 channels with the maximum audio call system cascade capacity (receiving and sending stream mode); the media resource storage resource pool covers an online storage space 500TB, a near-line management storage space 2PB and an offline backup storage space 2PB; the codec resource pool comprises more than 40 channels of opposite transmission and more than 120 channels of live coding channels, can support ST.2110-20/30 input, and finally distributes content to a video transcoding middlebox and a CDN to reach an end user.
The following describes the fusion design of the packaging rendering and storage resource pool specifically:
among a plurality of resource pools, the full ST.2110IP design of the packaging rendering and storage resource pool and the application architecture combined with the cloud break the barrier that packaging and storage equipment are difficult to IP and form the cloud model of heavy resources.
As shown in fig. 11, in the file delivery link, the full IP media system transcodes the original material recorded in st.2110-20/30 to form a file, and enters the media system through cataloguing for subsequent program editing, the video material can also access the existing material in the APP manner, the original film can be accessed through the encrypted link, and the original film material can be protected by real-time watermarking during the film examination process.
The Augmented Reality (AR), the packaging (CG) and the video server are based on ST.2110-20/30, and are connected with the leaf switch through the SFP25G module of the IP board card on the engine to provide IP input and output. And the tracking data of the AR realizes the communication between the engine and the tracker through the out-of-band switch. Similarly, the holder control also realizes the single-person control of all studio machine positions through an out-of-band switch. In order to realize the free switching of the input signals of the AR or the CG, the NAT (address translation) channels of partial IPGs are specially designed for use, so the AR or the CG only needs to fixedly pull the IP multicast sent by one IPG, and the actual switching can be realized by controlling the static switching of the IPG by a scheduling controller.
The IP audio and communication system of the cross-layer networking is specifically described as follows:
even in other IP-based systems, the pool of audio and telephony resources is still based on the Dante protocol in the local area as the main interaction means, and is usually converted to baseband form whenever the domain is crossed. And the embodiment of the application adopts ST.2110-30 to construct an IP production cluster system for a core protocol, and a program production and transmission system simultaneously covers the audio use function and the call use function of the areas. Although some audio and call devices in the program production and transmission system do not conform to a-30 audio protocol and do not support a standard IEEE 1588-2008 synchronization protocol, data communication across network segments cannot be realized, and only PTP V1 can be supported.
In order to enable the device to have the capability of meeting the standard, the embodiment of the application is realized by using a Leaf sub-Leaf switch architecture mode in series under the Leaf. A set of two-layer switch network capable of exchanging data is established for the equipment which does not support the-30 standard, a ridge leaf framework is established in the two-layer network, and finally the two-layer ridge is accessed into the three-layer ridge (total ridge), so that the whole framework standardization of audio data and synchronous data is realized. And the equipment with the control interface connects all the control ports to the out-of-band integrated service network to complete centralized control. By utilizing the special network architecture, the system successfully realizes the IP networking of the two audio communication systems. Finally, system debugging, signal scheduling and monitoring of the whole manufacturing cluster can be realized at any position of a production area, and any position of a system interface has the input and output capacity of-30 protocol signals.
As shown in fig. 12-fig. 13, the IP audio matrix is divided into two groups of modules for use, each core is connected to a layer 2 network and a layer 3 network at the same time, the module located on the layer 3 network (pulling and sending editable multicast streams) is responsible for realizing the functions of embedding and de-embedding of the bound video devices and the function of the networking call system, and the module located on the layer 2 network (unicast and automatic multicast routes) solves the cross-production area networking of each audio device. The two modules are interconnected through audio signals, only the audio signals are transmitted, synchronous information (PTP) is not needed, and the modules are interconnected without any setting.
In addition to core-making devices and audio peripheral devices, all products supporting IP conversion have been used for the type selection of sound pickup devices. The antenna system is also distributed over the whole production area, and the wireless sound pickup equipment is also subjected to networking processing.
As shown in fig. 14, the flow architecture is very clear for each fabrication region. Under the IP network architecture, the application mode of the call system is also expanded, and the PROD and ENG calls of all CCUs in the system are also completed in a mode of receiving and sending multicast streams by a call matrix. Meanwhile, the intercommunication of the IP audio and the internal communication system not only can transmit the internal communication interruptible monitoring (IFB) function by depending on an audio system (such as an audio optical fiber), but also can quickly realize the temporary requirements of programs, such as monitoring of a certain station on certain audio signals, giving of conversation contents to a certain point of the audio system and the like. These functions are not limited by specific locations, and each point location of the production system within the cluster can be implemented.
4) Equipment full-coverage integrated service hybrid network
As shown in fig. 15, the integrated service hybrid network is used as a network basis for implementing monitorable and controllable of all nodes in the system, and it carries monitoring and management of thousands of terminals and 40 types of devices, including access of control terminals such as information distribution system stream transmission, light console, and intelligent pan-tilt. Forming all kinds of equipment into an exclusive resource pool, and communicating all the resource pools through a Switch Virtual Interface (SVI) to meet the necessary cross-domain intercommunication and the centralized management of upper-layer equipment such as a scheduling controller and the like on bottom-layer equipment; secondly, virtual Port Channel (VPC) technology and Hot Standby Router Protocol (HSRP) technology are used to implement the main and Standby redundancy of the core switch, link Aggregation Control Protocol (LACP) is used to implement the Link redundancy, and finally, the security of the Access terminal and the stability of the network are ensured by the physical address (MAC address) binding, access Control List (ACL), and other related technologies.
As shown in fig. 16, a dedicated platform suitable for a workflow is deployed in the entire service network, and the reservation, approval, data linkage, resource allocation, task execution, device detection, and alarm pushing are integrated together, so that a large amount of daily program production work is completed with a small amount of manpower, for example, a service department initiates a flow online, a central studio takes charge of completing the approval, automatically allocates studio device resources, automatically schedules signals according to rules, and synchronizes program parameters to a video background, a sports background, and the like in real time, so that hundreds of millions of users can timely see program information, and complete program production. During the period, the master control platform carries out full-coverage monitoring on the equipment, if the equipment gives an alarm, the equipment immediately informs, and the master control platform is linked with the asset management system to ensure that any equipment can trace the root and the source, realize the data synchronization of sports and videos, ensure the accuracy and the integrity of program information, complete the related functions of task issuing, equipment monitoring and the like, save a large amount of labor cost and operation and maintenance cost, and avoid unnecessary errors caused by human factors.
It should be noted that, the outband integrated services hybrid network, the production domain network, the Internet Data Center (IDC, internet Data Center), and the public Internet need to be isolated, but some devices, such as the package server, the multi-screen encoder, and the information distribution system server, need to access multiple types of the above four networks simultaneously to acquire or push Data using multiple network cards according to program requirements. In order to solve the potential safety hazard of the problem, the equipment is subjected to domain entering operation and self-research monitoring software is installed, and the equipment can only access internet resources through an agent and a firewall strictly. Meanwhile, all external services must be accessed into a security gateway system, and all applications are guaranteed to be protected by a firewall. For example, when people work remotely or equipment is debugged, the intelligent gateway system is required to be used by using self-developed software and the embedded springboard function, so that all login traces can be ensured.
5) IP network monitoring and upper layer scheduling controller design
Such a huge production network involves various links of production, broadcasting and transmission, and can move the whole body by pulling one time. Therefore, a complete monitoring mechanism is necessary for the set of brand new architecture, so that the network node equipment can be monitored in real time, and the overall network flow and bandwidth performance can be comprehensively monitored. By the network monitoring platform based on the out-of-band integrated service hybrid network, the availability of the system, the equipment state and the link state can be monitored from multiple dimensions of a network, such as a topological structure, an equipment port, a routing flow direction, a service state and a system event.
In order to solve the problem of unified control among different control systems of products of different brands in the system, the embodiment of the application gathers different control systems together through an upper-layer scheduling controller (namely, a scheduling controller), and simultaneously takes into account various protocols, and forms a unified control interface through the standardized design of a control interface.
As shown in fig. 17, a dispatch Controller (Broadcast Controller) is connected in series with a bottom-layer independent control system or a stand-alone Controller from top to bottom through an IP control protocol to form a unified operation interface for operators. The method is widely supported in an NMOS protocol cluster, each protocol (including NMOS, generic X-Switch, nVision, LRC, TSL, ember +, pro-bel and the like) has respective supported array, and the scheduling controller realizes complex logic application in a simplified control system through internal logic source, logic triggering, one-key following, system snapshot, layering and the like.
As examples, camera physical and logical correspondence assignment, media disc (UMD) source name transfer across systems, unswitched station triggered TALLY system display, audio-video follow-up or co-cut, etc. Originally, need realize through the independent controller of each subsystem of extra general purpose input/output port (GPIO) equipment, extra TALLY controller cooperation, this application embodiment all can realize through the dispatch controller of upper strata, even only lean on the function that can't be solved to the IP audio frequency of non-hierarchy level and inlay and carry out the control to can also realize through the dispatch controller.
6) Transmission platform design for Content Delivery Network (CDN)
The program production and transmission system provided by the embodiment of the application benefits from the support of the cloud IDC in the links of external receiving and external distribution, and smoothly receives, distributes and delivers files and real-time streams.
As shown in fig. 18, in the real-time stream receiving link, the embodiment of the present invention supports compression methods such as AVC and HEVC, supports access to multiple network transmission protocols such as SRT, HTTP, RTMP, RIST, and WebRTC, and injects a source signal (i.e., source data) into an alien signal resource pool through an SDI and a decoding device supporting st.2110-20/30.
In a program delivery link, a multi-screen encoder supporting ST.2110-20/30 input can realize free selection of a source under the scheduling of a scheduling controller through an NMOS protocol, and then, the multi-screen encoder is distributed and delivered to a transcoding relay station or a CDN through a compression mode of AVC and HEVC and network protocols such as RTMP, HLS, FLV and the like.
In summary, the embodiment of the present application provides an ultra-large (more than 200T core throughput) full-flow signal and data interaction fusion IP-based ultra-high definition program production and propagation system based on COTS switch architecture full IP networking. The broadcasting technology center applies a resource pool concept, overlaps a distributed network, and forms a standardized open system which has extremely high integration degree by point and surface deployment and can easily allocate any resource at any node. The whole system takes GB/T25931 (IEEE 1588v 2) as a clock transmission and synchronization standard, ST.2059-2 is a video synchronization configuration file, and an ST.2110 protocol (the video adopts ST.2110-20, the audio adopts ST.2110-30 and the auxiliary data adopts ST.2110-40) is adopted for interconnection and intercommunication, so that the explosive growth of core bandwidth and efficient bidirectional communication are realized. The SDI cable connection system spans from one step to optical fiber full IP interconnection from signal receiving, signal acquisition, camera communication, signal scheduling, switching station manufacturing, audio frequency manufacturing, packaging, playback, recording, editing, monitoring and distribution. The system which is designed according to the rules of ST.2022-7, CLOS (multi-stage switching network) architecture and the like simultaneously ensures that the safety and the reliability are also enough to be guaranteed. The resource pooling and distributed leaf architecture furthest ensures the convergence ratio of resources at all levels, simultaneously reserves the possibility of transverse expansion of the system, and greatly reduces the maintenance and expansion cost of the whole system due to the advantages brought by a COTS (common use type) architecture. The signal exchange network, the clock system and the management control plane which integrate the manufacturing, the master control, the broadcasting and the transmission into a whole ensure that the whole platform has more openness and more flexibility when facing the technical standard updating and the scale expansion.
Compared with the related technology, the embodiments of the application have great advantages in bearing the production requirements of mass ultra-high definition programs, breaking communication barriers among several departments or modules of production, transmission and broadcasting, improving the production standards (high frame rate and high dynamic range) of the programs, and greatly improving the operation efficiency of the system.
The problems that are not solved in the baseband domain in the related art, such as making, broadcasting and transmitting resources shared in a set of resource pools, whether the communication exists or not, centralized placement and centralized management of all core devices and centralized presentation of operation interfaces, are all realized under the IP process of the embodiment of the application. Moreover, the working interface of the embodiment of the application is clearer, the links of intermediate conversion and cascade lines are fewer, the system flow is greatly simplified, and the working efficiency is improved. The network not only can be satisfactory in the aspect of interaction of signals with ultrahigh resolution of 4K/8K, ultrahigh resolution of 100/120fps and high dynamic range of HDR, but also can be upgraded to a line card supporting a 400G module in the future, and the throughput can be doubled.
Therefore, by reforming and optimizing the program production and transmission system architecture, the new system and standard are used for coping with the mass program production and broadcasting requirements, the internal and external communication efficiency is improved, the throughput bandwidth of the whole system is expanded, the management and monitoring means is optimized, the space of a machine room rack is saved, the program production standard is improved while the operation habits of program producers and system operation and maintenance personnel are not changed, the signal interaction flow is simplified, and the system maintenance and expansion are convenient.
The program processing method provided by the embodiment of the present application has been described in conjunction with exemplary applications and implementations of the electronic device provided by the embodiment of the present application. In practical applications, each functional module in the program processing apparatus may be cooperatively implemented by hardware resources of an electronic device (such as a terminal, a server, or a server cluster), such as computing resources like a processor, communication resources (such as for supporting communications in various manners like optical cables and cells), and a memory. Fig. 2 shows a program processing means 555 stored in the memory 550, which may be software in the form of programs and plug-ins, for example, software modules designed by programming languages such as C/C + +, java, application software designed by programming languages such as C/C + +, java, or dedicated software modules in large software systems, application program interfaces, plug-ins, cloud services, etc., and different implementations are exemplified below.
The program processing apparatus 555 includes a series of modules, including an integrated service mixing module 5551, a scheduling control module 5552, a content exchange module 5553, and a resource module 5554 including a resource pool. Next, the program processing scheme implemented by cooperation of the modules in the program processing apparatus 555 provided in this embodiment is described.
An integrated services mixing module 5551 for collecting production data of a program; the scheduling control module 5552 is configured to obtain the production data of the program from the integrated service mixing module, and perform scheduling processing on the production data of the program to obtain a scheduling signal of the program; the content exchange module 5553 is configured to perform signal exchange based on the scheduling signal of the program to obtain program resource signals required by multiple resource pools, and send the program resource signals required by the multiple resource pools to corresponding resource modules including the resource pools respectively; the resource module 5554 including the resource pool is configured to perform program production processing based on the received program resource signal required by the resource pool and the source data of the program, obtain a program for broadcasting, and send the program for broadcasting to the user terminal.
In some embodiments, the scheduling control module includes an upper scheduling control module and a plurality of lower sub-controllers, wherein the plurality of lower sub-controllers respectively correspond to different resource pools, and the upper scheduling control module is connected with the plurality of lower sub-controllers through an internet protocol; the upper-layer scheduling control module is configured to obtain production data of the program from the integrated service mixing module 5551, perform mapping processing on the production data of the program for the plurality of lower-layer sub-controllers to obtain mapping data corresponding to each of the plurality of lower-layer sub-controllers, and send the mapping data corresponding to each of the plurality of lower-layer sub-controllers to the corresponding lower-layer sub-controller; and the lower sub-controller is configured to perform data update processing on the received mapping data to obtain a scheduling signal of the program, and send the scheduling signal of the program to the content exchange module 5553.
In some embodiments, the scheduling control module 5552 is further configured to perform real-time monitoring processing on the content exchange module, the integrated service mixing module, and the resource modules including the resource pool, to obtain monitoring data, and display the monitoring data through a control interface; wherein the dimension of the real-time monitoring process comprises at least one of: topology of the network, device ports, routing flow, traffic state, system events.
In some embodiments, the scheduling control module 5552 is further configured to write a scheduling signal of the program into a signal request list; the resource module 5554 including the resource pool is further configured to perform signal switching based on the signal request list, obtain a group management protocol request of the program, and send the group management protocol request of the program to the content exchange module 5553; the content exchange module 5553 is further configured to analyze the group management protocol request of the program, obtain a plurality of program resource signals required by the resource pool, and send the plurality of program resource signals required by the resource pool to the corresponding resource modules 5554 including the resource pool, respectively.
In some embodiments, the content switching module 5553 includes a main domain spine switch, a standby domain spine switch, a plurality of first leaf switches, and a plurality of second leaf switches, and the main domain spine switch, the standby domain spine switch, the plurality of first leaf switches, and the plurality of second leaf switches all employ ports of a three-layer domain structure; the content exchange module 5553 is further configured to: enabling multicast routing by using the connection relationship between the main domain spine switch and the first leaf switches, the connection relationship between the standby domain spine switch and the second leaf switches and a routing-independent multicast protocol; performing signal exchange on the scheduling signals of the programs based on the multicast routing to obtain program resource signals required by a plurality of resource pools; and performing three-layer addressing processing on the program resource signals required by the plurality of resource pools based on the three-layer domain structure to obtain a forwarding address of each program resource signal, and sending the program resource signals to the corresponding resource module 5554 containing the resource pools based on the forwarding address of each program resource signal.
In some embodiments, the physical link between the first leaf switch and the main domain spine switch and the physical link between the second leaf switch and the standby domain spine switch are in a peer-to-peer structure; the content exchange module 5553 is further configured to: determining the data bandwidth of the physical link through a professional media network architecture and non-blocking multicast to obtain the used bandwidth and the residual bandwidth of the physical link; based on the used bandwidth and the remaining bandwidth of the physical link, program resource signals required by a plurality of the resource pools are allocated to corresponding resource modules 5554 containing resource pools.
In some embodiments, the physical link between the first leaf switch and the main domain spine switch and the physical link between the second leaf switch and the standby domain spine switch both adopt a peer-to-peer structure; the content exchange module 5553 is further configured to: determining the data bandwidth of the physical link through a border gateway protocol and a routing map to obtain the used bandwidth and the residual bandwidth of the physical link; based on the used bandwidth and the remaining bandwidth of the physical link, program resource signals required by a plurality of the resource pools are allocated to corresponding resource modules 5554 containing resource pools.
In some embodiments, the system further comprises: a clock module, configured to perform clock synchronization on the content exchange module 5553, so that the content exchange module 5553 sends program resource signals required by multiple resource pools based on the synchronized clocks.
In some embodiments, the clock module includes a master clock and a slave clock; the clock module is further configured to perform clock synchronization on the content exchange module 5553 based on application of the active and standby clocks in cooperation with the boundary clock, so that the content exchange module 5553 sends program resource signals required by a plurality of resource pools to the corresponding resource modules 5554 including the resource pools based on the synchronized clocks, so as to keep synchronization of clock references recovered by the resource modules 5554 including the resource pools.
In some embodiments, the categories of the resource pool include at least one of: the system comprises an external signal resource pool, a studio camera resource pool, a codec resource pool, a switching and manufacturing resource pool, a virtual resource pool, a picture and text packaging resource pool, a video playing resource pool, an audio resource pool, a media resource storage resource pool and a picture division resource pool; the resource module comprising the media resource storage resource pool is further configured to: transcoding the recorded original media asset materials to obtain a transcoding file; and carrying out intelligent cataloguing processing on the transcoding file, and carrying out cloud storage on an obtained cataloguing result.
In some embodiments, the apparatus further comprises: a content distribution module to: sending the source data of the program acquired from the acquisition device to the resource module 5554 containing the resource pool; sending the program for broadcasting acquired from the resource module 5554 containing the resource pool to the user terminal; the format supported by data transmission performed by the content distribution network comprises at least one of an advanced video coding format and a high-efficiency video coding format, and the protocol supported by data transmission comprises at least one of a secure and reliable transmission protocol, a hypertext transmission protocol, a real-time message transmission protocol and a reliable internet transmission protocol.
In summary, the embodiment of the present application has the following beneficial effects: the program scheduling method comprises the steps of uniformly scheduling program production data through a scheduling control module to achieve uniform management and control of the scheduling control module on the data, and processing scheduling signals of programs through a content exchange module in a centralized mode to send program resource signals required by a plurality of resource pools to corresponding resource modules containing the resource pools respectively, so that a uniform signal domain and a management domain are formed, information transmission logic is simplified, and program production, playing and transmission efficiency is improved.
Embodiments of the present application provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the program processing method described in the embodiment of the present application.
Embodiments of the present application provide a computer-readable storage medium storing executable instructions, which when executed by a processor, will cause the processor to execute a program processing method provided by embodiments of the present application, for example, the program processing method shown in fig. 3.
In some embodiments, the computer-readable storage medium may be memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories.
In some embodiments, executable instructions may be written in any form of programming language (including compiled or interpreted languages), in the form of programs, software modules, scripts or code, and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
By way of example, executable instructions may correspond, but do not necessarily have to correspond, to files in a file system, and may be stored in a portion of a file that holds other programs or data, such as in one or more scripts in a hypertext Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub-programs, or portions of code).
As an example, executable instructions may be deployed to be executed on one electronic device or on multiple electronic devices located at one site or distributed across multiple sites and interconnected by a communication network.
The above description is only an example of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, and improvement made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims (15)

1. A program processing system, comprising:
the system comprises a content switching network, an integrated service mixing network, a scheduling controller and a plurality of terminals comprising resource pools; wherein the content of the first and second substances,
the integrated service hybrid network is used for collecting program production data;
the scheduling controller is used for acquiring the program production data from the integrated service hybrid network and scheduling the program production data to obtain a scheduling signal of the program;
the content switching network is used for performing signal switching based on the scheduling signals of the programs to obtain program resource signals required by a plurality of resource pools, and respectively sending the program resource signals required by the resource pools to corresponding terminals containing the resource pools;
and the terminal comprising the resource pool is used for carrying out program making processing based on the received program resource signals required by the resource pool and the source data of the programs to obtain programs for broadcasting and sending the programs for broadcasting to the user terminal.
2. The system of claim 1,
the scheduling controller comprises an upper-layer scheduling controller and a plurality of lower-layer sub-controllers, wherein the lower-layer sub-controllers respectively correspond to different resource pools, and the upper-layer scheduling controller is connected with the lower-layer sub-controllers through an Internet interconnection protocol;
the upper layer scheduling controller is used for acquiring the program production data from the integrated service mixed network and obtaining the program production data from the integrated service mixed network
Mapping processing is carried out on the program production data aiming at the lower-layer sub-controllers, mapping data corresponding to the lower-layer sub-controllers are obtained, and the mapping data corresponding to the lower-layer sub-controllers are sent to the corresponding lower-layer sub-controllers;
and the lower-layer sub-controller is used for updating the data of the received mapping data to obtain a scheduling signal of the program and sending the scheduling signal of the program to the content switching network.
3. The system of claim 1,
the scheduling controller is further configured to perform real-time monitoring processing on the content switching network, the integrated service hybrid network, and the plurality of terminals including the resource pool to obtain monitoring data, and display the monitoring data through a control interface;
wherein the dimension of the real-time monitoring process comprises at least one of: topology of the network, device ports, routing flow, traffic state, system events.
4. The system of claim 1,
the scheduling controller is further configured to write a scheduling signal of the program into a signal request list;
the terminal including the resource pool is further configured to perform signal switching based on the signal request list to obtain a group management protocol request of the program, and send the group management protocol request of the program to the content switching network;
the content switching network is further configured to analyze the group management protocol request of the program to obtain program resource signals required by the resource pools, and send the program resource signals required by the resource pools to corresponding terminals including the resource pools.
5. The system of claim 1,
the content switching network comprises a main domain spine switch, an auxiliary domain spine switch, a plurality of first leaf switches and a plurality of second leaf switches, and the main domain spine switch, the auxiliary domain spine switch, the plurality of first leaf switches and the plurality of second leaf switches all adopt ports of a three-layer domain structure;
the content-switching network is further configured to:
enabling multicast routing by using the connection relationship between the main domain spine switch and the first leaf switches, the connection relationship between the standby domain spine switch and the second leaf switches and a routing-independent multicast protocol;
performing signal exchange on the scheduling signals of the programs based on the multicast routing to obtain program resource signals required by a plurality of resource pools;
and carrying out three-layer addressing processing on the program resource signals required by the plurality of resource pools based on the three-layer domain structure to obtain the forwarding address of each program resource signal, and sending the program resource signals to the corresponding terminal containing the resource pools based on the forwarding addresses of the program resource signals.
6. The system of claim 5,
the physical link between the first leaf switch and the main domain ridge switch and the physical link between the second leaf switch and the standby domain ridge switch both adopt a peer-to-peer structure;
the content-switching network is further configured to:
determining the data bandwidth of the physical link through a professional media network architecture and non-blocking multicast to obtain the used bandwidth and the residual bandwidth of the physical link;
and distributing the program resource signals required by the resource pools to the corresponding terminals containing the resource pools based on the used bandwidth and the residual bandwidth of the physical link.
7. The system of claim 5,
the physical link between the first leaf switch and the main domain spine switch and the physical link between the second leaf switch and the standby domain spine switch both adopt a peer-to-peer structure;
the content-switching network is further configured to:
determining the data bandwidth of the physical link through a border gateway protocol and a routing map to obtain the used bandwidth and the residual bandwidth of the physical link;
and distributing the program resource signals required by the resource pools to the corresponding terminals containing the resource pools based on the used bandwidth and the residual bandwidth of the physical link.
8. The system of claim 1, further comprising:
and the clock system is used for carrying out clock synchronization on the content switching network so as to enable the content switching network to send program resource signals required by a plurality of resource pools based on the synchronized clock.
9. The system of claim 8,
the clock system comprises a main clock, a standby clock and a boundary clock;
the clock system is further configured to perform clock synchronization on the content switching network based on the application of the master and standby clocks in cooperation with the boundary clock, so that the content switching network is enabled to perform clock synchronization
And the content switching network sends program resource signals required by a plurality of resource pools to the corresponding terminals containing the resource pools based on the synchronized clocks so as to keep the clock references recovered by the terminals containing the resource pools synchronous.
10. The system of claim 1,
the categories of the resource pool include at least one of: the system comprises an external signal resource pool, a studio camera resource pool, a codec resource pool, a switching and manufacturing resource pool, a virtual resource pool, a picture and text packaging resource pool, a video playing resource pool, an audio resource pool, a media resource storage resource pool and a picture division resource pool;
the terminal comprising the media resource storage resource pool is further used for:
transcoding the recorded original media asset materials to obtain a transcoding file;
and carrying out intelligent cataloguing processing on the transcoding file, and carrying out cloud storage on an obtained cataloguing result.
11. The system of claim 1, further comprising:
a content distribution network for:
sending the source data of the program acquired from the acquisition equipment to the terminal containing the resource pool;
sending the program for broadcasting acquired from the terminal containing the resource pool to the user terminal;
the format supported by data transmission performed by the content distribution network comprises at least one of an advanced video coding format and a high-efficiency video coding format, and the protocol supported by data transmission comprises at least one of a secure and reliable transmission protocol, a hypertext transmission protocol, a real-time message transmission protocol and a reliable internet transmission protocol.
12. A program processing method applied to a program processing system, the program processing system comprising: the system comprises a content switching network, an integrated service mixing network, a scheduling controller and a plurality of terminals comprising resource pools;
the method comprises the following steps:
the integrated service hybrid network collects program production data;
the scheduling controller acquires the program production data from the integrated service hybrid network and performs scheduling processing on the program production data to obtain a scheduling signal of the program;
the content switching network carries out signal switching based on the scheduling signals of the programs to obtain program resource signals required by a plurality of resource pools, and respectively sends the program resource signals required by the resource pools to corresponding terminals comprising the resource pools so as to ensure that the program resource signals required by the resource pools are transmitted to the terminals comprising the resource pools
And the terminal containing the resource pool performs program making processing based on the received program resource signals required by the resource pool and the source data of the programs to obtain programs for broadcasting, and sends the programs for broadcasting to the user terminal.
13. A program processing apparatus, characterized in that the apparatus comprises:
the integrated service mixing module is used for collecting the program production data;
the scheduling control module is used for acquiring the program production data from the integrated service mixing module and scheduling the program production data to obtain a scheduling signal of the program;
the content exchange module is used for carrying out signal exchange based on the scheduling signals of the programs to obtain program resource signals required by a plurality of resource pools and respectively sending the program resource signals required by the resource pools to the corresponding resource modules containing the resource pools;
and the resource module containing the resource pool is used for carrying out program making processing based on the received program resource signals required by the resource pool and the source data of the program to obtain a program for broadcasting and sending the program for broadcasting to the user terminal.
14. An electronic device, characterized in that the electronic device comprises:
a memory for storing executable instructions;
a processor, configured to execute the executable instructions stored in the memory, to implement the program processing method of claim 12.
15. A computer-readable storage medium storing executable instructions for implementing the program processing method of claim 12 when executed by a processor.
CN202110903851.7A 2021-08-06 2021-08-06 Program processing system, method, device, equipment and storage medium Pending CN115706812A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110903851.7A CN115706812A (en) 2021-08-06 2021-08-06 Program processing system, method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110903851.7A CN115706812A (en) 2021-08-06 2021-08-06 Program processing system, method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN115706812A true CN115706812A (en) 2023-02-17

Family

ID=85178454

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110903851.7A Pending CN115706812A (en) 2021-08-06 2021-08-06 Program processing system, method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115706812A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116916054A (en) * 2023-09-14 2023-10-20 美冠(北京)科技有限公司 Digital media content distribution system based on cloud broadcasting control

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116916054A (en) * 2023-09-14 2023-10-20 美冠(北京)科技有限公司 Digital media content distribution system based on cloud broadcasting control
CN116916054B (en) * 2023-09-14 2023-12-05 美冠(北京)科技有限公司 Digital media content distribution system based on cloud broadcasting control

Similar Documents

Publication Publication Date Title
CN109120946B (en) Method and device for watching live broadcast
CN109640029B (en) Method and device for displaying video stream on wall
CN109672856B (en) Resource synchronization method and device
CN101753963B (en) Authority control method and system of video monitoring system
CN103096042A (en) Video monitoring system
CN110493351B (en) Video networking access method, device, equipment and storage medium
CN109660816B (en) Information processing method and device
CN109672857B (en) Information processing method and device for monitoring resources
CN110381030B (en) Method and device for processing synchronization request
CN108965220B (en) Method and system for synchronizing conference control right
CN109922351B (en) Method and device for releasing live broadcast service
CN107959602B (en) A kind of method of network entry and device
CN108574816B (en) Video networking terminal and communication method and device based on video networking terminal
CN111131760B (en) Video recording method and device
Colman-Meixner et al. 5G city: A novel 5G-enabled architecture for ultra-high definition and immersive media on city infrastructure
CN115706812A (en) Program processing system, method, device, equipment and storage medium
CN110213334A (en) A kind of transmission method and device of shared file
CN110769179B (en) Audio and video data stream processing method and system
KR20150083891A (en) Networking method and networking device
JP7377352B2 (en) Multi-member instant messaging method, system, device, electronic device, and computer program
CN111212255B (en) Monitoring resource obtaining method and device and computer readable storage medium
CN110392225B (en) Control method and video networking video conference system
CN116668606A (en) Virtual rebroadcasting system based on micro-service architecture
CN111147795B (en) Resource scheduling method, server, terminal, electronic device, and storage medium
CN112383833B (en) Virtual IP broadcasting system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40081292

Country of ref document: HK