CN116916051B - Method and device for updating layout scene in cloud director client - Google Patents

Method and device for updating layout scene in cloud director client Download PDF

Info

Publication number
CN116916051B
CN116916051B CN202310685296.4A CN202310685296A CN116916051B CN 116916051 B CN116916051 B CN 116916051B CN 202310685296 A CN202310685296 A CN 202310685296A CN 116916051 B CN116916051 B CN 116916051B
Authority
CN
China
Prior art keywords
layout
scene
input source
platform
editing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310685296.4A
Other languages
Chinese (zh)
Other versions
CN116916051A (en
Inventor
郭鹿鸣
王晓维
郭丽
范文新
张国伟
曲坛
高剑飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Yibaijuzhi Technology Co ltd
Beijing Yibai Technology Co ltd
Original Assignee
Jiangsu Yibaijuzhi Technology Co ltd
Beijing Yibai Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Yibaijuzhi Technology Co ltd, Beijing Yibai Technology Co ltd filed Critical Jiangsu Yibaijuzhi Technology Co ltd
Priority to CN202310685296.4A priority Critical patent/CN116916051B/en
Publication of CN116916051A publication Critical patent/CN116916051A/en
Application granted granted Critical
Publication of CN116916051B publication Critical patent/CN116916051B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application relates to a method and a device for updating a layout scene in a cloud guide platform client, wherein the method comprises the following steps: responding to an instruction for editing a layout scene of a PVW pre-monitor window, and generating an edit list on an interface where a PGM main monitor window is located, wherein the edit list contains information of one or more layers contained in the layout scene and edit items corresponding to the one or more layers; generating layout template information in response to confirmation of editing of the one or more layers according to the edit list; the layout template information is sent to a cloud broadcasting guiding platform, so that the cloud broadcasting guiding platform updates the layout scene according to the layout template information, and the updated layout scene is pushed to an RTC conference platform; and pulling the updated layout scene from the RTC conference platform. According to the scheme of the application, the monitoring of live signals of the PGM main monitoring window is considered, the operation threshold is reduced, and the execution failure rate can be greatly reduced.

Description

Method and device for updating layout scene in cloud director client
Technical Field
The application relates to the field of live video streaming, in particular to a method and a device for updating a layout scene in a cloud streaming platform client.
Background
At present, in a live video broadcasting guide platform, live broadcasting, guide broadcasting and push streaming software are core components. Existing multicast station software is broadly divided into two types: a hardware director and a cloud director (in the form of a Web-side). The platform is a cloud broadcasting guide table of a client, and the client comprises a Web end.
In general, the basic modules in the cloud director console mainly cover the following parts: list management of a broadcasting guiding table, input signal sources, mixed stream layout, caption materials, transition switching, PVW (pre-monitoring) pre-monitoring, PGM (program, main monitoring) main monitoring, a sound mixing table, signal output (conference output and live broadcast output), a program list and image matting. The application focuses on the mixed flow layout and PVW pre-monitoring module in the cloud broadcasting guide platform.
Layout scenes (generally, a mixed-flow superposition of one or more layers of pictures, wherein the layers can be any input signal source or layout), PVW are used for previewing the input signal source and the layout scene pictures on which the subtitle materials are superimposed in real time.
At present, in a cloud director, both layout scene editing and updating of a layout layer signal source are performed on a window to which a layout belongs, that is, if the layout scene needs to be edited and updated, the layout scene needs to be performed on a preset secondary window. Powerful client-side broadcasting software such as vmix can only edit or update signal sources of the top layer of the current layout scene in PVW, but cannot edit or update signal sources of other layers.
Disclosure of Invention
In the prior art, the operation on a preset secondary window is required for editing the layout scene and updating the signal source of the layout layer, so that when the layout scene is edited and updated, the PGM main monitoring picture cannot be checked in real time, and execution faults are easy to occur. According to the scheme of the application, the layout scene is directly edited and updated on the primary interface where the current PGM master monitor is located, so that the monitoring of live broadcast signals of the PGM master monitor window is considered, the operation threshold is reduced, and the execution failure rate can be greatly reduced. When the input sources are more and the complex items are arranged, the editing and updating operations of each layout are frequent, and the direct selection of the appointed input source signals for layer updating in the PVW window is very beneficial.
According to a first aspect of the present application, there is provided a method for updating a layout scene in a cloud multicast platform client, which is characterized by comprising:
Responding to an instruction for editing a layout scene of a PVW pre-monitor window, and generating an edit list on an interface where a PGM main monitor window is located, wherein the edit list contains information of one or more layers contained in the layout scene and edit items corresponding to the one or more layers;
generating layout template information in response to confirmation of editing of the one or more layers according to the edit list;
the layout template information is sent to a cloud broadcasting guiding platform, so that the cloud broadcasting guiding platform updates the layout scene according to the layout template information, and the updated layout scene is pushed to an RTC conference platform; and
And pulling the updated layout scene from the RTC conference platform.
According to a second aspect of the present application, there is provided an apparatus for updating a layout scene in a cloud multicast platform client, the apparatus comprising:
The first generation module is used for responding to an instruction for editing the layout scene of the PVW pre-monitor window, and generating an editing list on the interface where the PGM main monitor window is located, wherein the editing list contains information of one or more layers contained in the layout scene and editing items corresponding to the one or more layers;
A second generation module, configured to generate layout template information in response to confirmation of editing the one or more layers according to the edit list;
The sending module is used for sending the layout template information to the cloud broadcasting guide platform, so that the cloud broadcasting guide platform updates the layout scene according to the layout template information and pushes the updated layout scene to the RTC conference platform; and
And the pulling module is used for pulling the updated layout scene from the RTC conference platform.
According to a third aspect of the present application, there is provided an electronic device comprising:
A processor; and
A memory storing computer instructions that, when executed by the processor, cause the processor to perform the method of the first aspect.
According to a fourth aspect of the present application there is provided a non-transitory computer storage medium storing a computer program which, when executed by a plurality of processors, causes the processors to perform the method of the first aspect.
According to the method and the device for updating the layout scene in the cloud guide platform client, under the condition that the layout scene of the PVW pre-monitor window is determined to be edited, the layout scene can be directly edited on the primary interface without being edited on a specific secondary interface. Therefore, the monitoring of live signals of the PGM master monitoring window is considered, the operation threshold is reduced, and the execution failure rate can be greatly reduced. And when the layout scene of the PVW pre-monitor window is determined to be edited, the PVW pre-monitor window enters a layout editing mode, so that a pilot broadcast executive personnel can acquire the current mode of the PVW pre-monitor window in real time.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it will be apparent that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings by those skilled in the art without departing from the scope of the claimed application.
Fig. 1 is a schematic diagram of a system for updating a layout scene according to an embodiment of the application.
Fig. 2 is a flowchart of a method for updating a layout scene in a cloud podcast client according to an embodiment of the application.
Fig. 3 is a schematic diagram comparing a method for updating a layout scene in a cloud multicast platform client of the present application with a method for updating a layout scene in the prior art.
Fig. 4 is a schematic diagram of an apparatus for updating a layout scene in a cloud podcast client according to an embodiment of the application.
Fig. 5 is a block diagram of an electronic device according to the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Fig. 1 is a schematic diagram of a system for switching subtitle contents according to an embodiment of the present application. As shown in fig. 1, the system includes a cloud director client, an RTC (Real Time Communication, real-time communication) conference platform and a cloud director platform, where the RTC conference platform may include a 100RTC conference platform, and the RTC conference platform includes a signaling server (RTC-signal-server) and a media server (RTC-media-server); the cloud director platform may be a 100mix cloud director platform, which includes a signaling server (switcher-signal-server) and an underlying server (switcher-engine-server). In the system shown in fig. 1, the client establishes long connections with the RTC conference platform, signaling servers of the client and the cloud director platform, and the cloud director platform establishes long connections with the RTC conference platform, respectively, where the long connections may include WebSocket connections.
As shown in fig. 1, according to some embodiments, the cloud director platform is a componentized platform for online audio and video production, and mainly processes signal input, mixed flow, subtitle superposition, transition and composite picture output of the cloud director platform. The RTC conference platform is a real-time audio and video communication platform, and after the cloud broadcasting platform processes the audio and video signals, the synthesized picture is pushed to the RTC conference platform, and the cloud broadcasting platform client subscribes RTC streams from the RTC conference platform, so that real-time preview of the synthesized picture is realized. The cloud director platform is a componentized system, and each input source (input), layout (me) or output (output) is a separate component, and components are connected through nodes, for example, a connection between a component a and a component B is established and can be represented as connectNode (componentA, componentB), and a connection between a component a and a component B is released and can be represented as disconnectNode (componentA, componentB), so that different pipeline is formed. The input component is the head node of the pipeline and the output component is the tail node of the pipeline. Within a single multicast, each component has a unique ID created by the multicast station signaling server.
According to some embodiments, in a layout scenario, for example, the layout is divided into left and right split screens, the two layers of the left and right split screens are respectively set as input sources inputA and inputB, a subtitle CG is superimposed on the layout ME when needed, and then a preview is performed in a PVW window, and then the content of the subtitle is changed. Firstly, after the cloud director platform client is started, long connection is required to be established with the RTC conference platform and the cloud director platform. Under the condition that the RTC conference platform is a 100RTC conference platform, the cloud broadcasting guide platform client interacts with a 100RTC server through 100RTC sdk (client), firstly joins an RTC preview room, inquires media stream information of a room user, and synchronously monitors a new media stream release notice. The cloud director client interacts with a signaling server of the director platform through switcher-js-sdk, firstly sends a command (SWITCHERSTART) for starting the director platform to start the director platform, and the signaling server forwards a message to a bottom server to create an instance object of the director platform after receiving the command (SWITCHERSTART) for starting the director platform.
After the director is started, in combination with the application scenario, an input source InputA component switcherAddInput (inputAId), an input source InputB component switcherAddInput (inputBId), an ME layout component SWITCHERADDME (MEID), a CG subtitle component SWITCHERADDCG (CGID), a PVW pre-monitor component SWITCHERADDPVW (PVWID), and an output component switcherAddOutput (outputId) are required to be created. The ME layout components are provided with templates by the protocol for layout component arrangement templates (e.g., SWITCHERSETMETEMPLATE (TEMPLATEINFO)) in which component identification information IDs of InputA and InputB are configured into corresponding layers of templates. After receiving SWITCHERSETMETEMPLATE the cloud director platform, for example, through switcherConnectNode (InputAId, meId), switcherConnectNode (InputBId, meId) interfaces, the cloud director platform binds InputA and InputB components with the ME component, and updates the mixed-flow screen. After creating CG components when adding subtitles to a layout, the ME components and CG components need to be bound, for example, by switcherConnectNode (meId, cgId). The client switches the layout to PVW for pre-supervision, sends an instruction (such as switcherCutToPVW message) that the director switches to PVW for pre-supervision to the cloud director platform, binds the caption CG component and PVW component corresponding to the ME component through switcherConnectNode (cgId, pvwId), and thus transmits the ME component signal to PVW component. The PVW component signal is then passed to the Output component Output via switcherConnectNode (pvwId, outputId). The Output component Output outputs the signal encoding push stream to the RTC conference platform.
According to some embodiments, the creation of the input source, layout, and output components, the layer update instructions of the layout components are all sent by the cloud director client. The corresponding protocol interfaces are switcherAddInput, switcherAddME and switcherAddOutput. When a component is created on the client, the cloud director platform signaling server generates the component ID (componentId) and returns the component to the client. And configuring a layout component template according to the scene layout which is created on the client, and establishing the connection relation between the components. The connection and disconnection between the components are controlled by switcherConnectNode, switcherDisconnectNode protocol. The configuration of the layout templates is initialized and updated according to the established layout template setting protocol SWITCHERSETMETEMPLATE.
On-end, a create PVW component SWITCHERADDPVW instruction is sent to create PVW a pre-monitor component, and a switch to PVW window switcherCutToPvw instruction is sent to connect the layout component and PVW component. After receiving switcherCutToPvw, the bottom server processes the connection relationship of the components, releases the binding relationship disconnectNode (old-meId, pvwId) between PVW and the old layout component, and establishes the binding relationship connectNode (new-meId, pvwId) between PVW and the new layout component. The signal (e.g., audio-visual signal) of PVW components is then replaced with the signal of the new layout component.
According to some embodiments, the input sources corresponding to each layer in the layout scene may be any input source format type supported by the cloud director, including push address, live broadcast, on-demand, picture, monochrome, conference input signals (participant, share, speaker), and the like.
According to some embodiments, in order to implement editing of the layout scene in the PVW pre-monitor window on the interface where the PGM main monitor window is located, first, the cloud director platform executor may make an instruction that needs to edit the layout scene in the PVW pre-monitor window, and after receiving the instruction, the cloud director platform learns that the executor needs to edit the layout scene.
According to some embodiments, a right key event is defined for the PVW pre-monitor window, for example, for the node element name corresponding to the PVW pre-monitor window, a right key event addeventlister ('contextmenu', contextmenuHandler) is added, when an operator clicks the right mouse button in the area where the PVW pre-monitor window is located, an instruction for editing the layout scene in the PVW pre-monitor window is triggered, and at the same time, the cloud director can obtain the position of the right mouse button on the PVW pre-monitor window through contextmenuHandler.
According to some embodiments, when the cloud director station receives an instruction to edit the layout scene of the PVW pre-monitor window, an edit list is generated at the interface where the PGM main monitor window is located. The edit list generated by the cloud director may be a drop down list. In the generated edit list, information of the layers included in the layout scene and edit items corresponding to the layers are presented. For example, a layout scene includes 10 layers, and then the identification information and/or description information of each of the 10 layers is shown in an edit list, and for each layer, an editable item may be shown, such as deleting an input source, adding an input source, replacing an input source, setting the size of the layer, setting the position coordinates of the layer, setting the background of the layer, and the like.
According to some embodiments, the executive can edit the selected layer according to the displayed editing items, and after editing, a confirmation instruction is sent to the cloud broadcasting guide platform. After receiving the confirmation instruction, the cloud director generates layout template information, for example, METemplateInfo messages, where the layout template information records editing information of the layout scene by an executive, for example, which layer is added with which input source, which layer is set in size, and the like.
According to some embodiments, after generating the layout template information, the cloud director platform sends the layout template information METemplateInfo to the cloud director platform through a SWITCHERSETMETEMPLATE protocol, and the cloud director platform updates the layout scene according to the layout template information, for example, which input source is added to which layer, which layer is set in size, and the like, and pushes the updated layout scene to the RTC conference platform.
According to some embodiments, after the cloud director platform sends the layout template information to the cloud director platform, the signaling server of the cloud director platform sends a confirmation message to the cloud director platform after correctly receiving the layout template information, and the cloud director platform hides the edit list after receiving the confirmation message.
According to some embodiments, after the cloud director platform pushes the updated layout scene to the RTC conference platform, the cloud director client pulls the updated layout scene stream from the RTC conference platform. The cloud director client can pull the updated layout scene signal from the RTC conference platform through long connection with the RTC conference platform, and the updated layout scene is displayed in the PVW pre-monitor window.
According to some embodiments, when the cloud director receives an instruction to edit a layout scene in the PVW pre-monitor window, the layout editor is displayed accordingly in PVW pre-monitor window, indicating entry into edit mode.
According to some embodiments, when the cloud director station receives an instruction to edit the layout scene in the PVW pre-monitor window, the type of the received input source is first determined. The types of the layout scene input sources comprise common input sources and layout input sources, wherein the common input sources are input sources corresponding to the input source components, and the layout input sources are input sources corresponding to the layout components. If the common input source is received, then PVW the pre-monitor window does not enter the edit mode; if a layout input source is received, PVW the pre-monitor window enters edit mode.
According to some embodiments, PVW the pre-monitor window enters an edit mode to render the content of one or more layers contained in the layout scene.
According to some embodiments, the process of rendering the content of one or more layers contained in the layout scene is traversing one or more layers, which are rendered one by one.
According to some embodiments, for the currently traversed layer, information such as the position, the size, the frame and the like of the currently traversed layer is obtained, and then the position, the size and the frame of the currently traversed layer are set according to the information. For example, when obtaining the information that the currently traversed layer is located at the upper left corner of the layout scene, the size is 2cm x 2cm, and the border line width is 5 lbs, the currently traversed layer is displayed according to the information.
According to some embodiments, a sequence number is set for the currently traversed layer and the sequence number of the currently traversed layer is displayed. For example, the layout scene has 10 layers in total, and in the case that the layer currently traversed is the 2 nd layer, the sequence number of the layer is set and displayed as 2.
According to some embodiments, PVW when the pre-monitor window enters edit mode, there are some layers with input sources, while other layers do not have input sources. As described above, the input sources corresponding to the layers in the layout scene may be any input source format type supported by the cloud director, including push address, live broadcast, on-demand, picture, monochrome, conference input signals (participant, share, speaker), and the like. For different input source format types, including for example picture type, video type input source, etc., in order to display the input source, it is necessary to create a file element corresponding to the format type of the input source. Thus, it is first necessary to determine the format type of the input source corresponding to the layer currently traversed, and then create a file element corresponding to the format type of the input source.
According to some embodiments, after creating a file element corresponding to a format type of an input source, specific content of the input source of a currently traversed layer needs to be acquired, for example, if the file element is a picture, the picture needs to be put into the layer for display. Thus, it is necessary to know the location of the input source of the currently traversed layer, i.e. the address information, for example, in a storage location of the computer, and after the address information is acquired, the input source can be acquired through the address information, and the content of the input source is displayed on the currently traversed layer.
Based on the system shown in fig. 1, according to one aspect of the present application, a method for updating a layout scene in a cloud director client is provided. Fig. 2 is a flowchart of a method for updating a layout scene in a cloud podcast client according to an embodiment of the application. As shown in fig. 2, the method includes the following steps.
In step S201, in response to an instruction for editing the layout scene of the PVW pre-monitor window, an edit list is generated at the interface where the PGM main monitor window is located, where the edit list includes information of one or more layers included in the layout scene and edit items corresponding to the one or more layers.
According to some embodiments, in order to implement editing of the layout scene in the PVW pre-monitor window on the interface where the PGM main monitor window is located, first, the cloud director platform executor may make an instruction that needs to edit the layout scene in the PVW pre-monitor window, and after receiving the instruction, the cloud director platform learns that the executor needs to edit the layout scene.
According to some embodiments, a right key event is defined for the PVW pre-monitor window, for example, for the node element name corresponding to the PVW pre-monitor window, a right key event addeventlister ('contextmenu', contextmenuHandler) is added, when an operator clicks the right mouse button in the area where the PVW pre-monitor window is located, an instruction for editing the layout scene in the PVW pre-monitor window is triggered, and at the same time, the cloud director can obtain the position of the right mouse button on the PVW pre-monitor window through contextmenuHandler.
According to some embodiments, when the cloud director station receives an instruction to edit the layout scene of the PVW pre-monitor window, an edit list is generated at the interface where the PGM main monitor window is located. The edit list generated by the cloud director may be a drop down list. In the generated edit list, information of the layers included in the layout scene and edit items corresponding to the layers are presented. For example, a layout scene includes 10 layers, and then the identification information and/or description information of each of the 10 layers is shown in an edit list, and for each layer, an editable item may be shown, such as deleting an input source, adding an input source, replacing an input source, setting the size of the layer, setting the position coordinates of the layer, setting the background of the layer, and the like.
Step S202, generating layout template information in response to confirmation of editing the one or more layers according to the editing list.
According to some embodiments, the executive can edit the selected layer according to the displayed editing items, and after editing, a confirmation instruction is sent to the cloud broadcasting guide platform. After receiving the confirmation instruction, the cloud director generates layout template information, for example METemplateInfo information, which records editing information of the layout scene by an executive, for example, which layer is added with which input source, which layer is set in size, and the like.
Step S203, the layout template information is sent to a cloud director platform, so that the cloud director platform updates the layout scene according to the layout template information, and the updated layout scene is pushed to the RTC conference platform.
According to some embodiments, after generating the layout template information, the cloud director platform sends the layout template information METemplateInfo to the cloud director platform through a SWITCHERSETMETEMPLATE protocol, and the cloud director platform updates the layout scene according to the layout template information, for example, which input source is added to which layer, which layer is set in size, and the like, and pushes the updated layout scene to the RTC conference platform.
Step S204, pulling the updated layout scene from the RTC conference platform.
According to some embodiments, after the cloud director platform pushes the updated layout scene to the RTC conference platform, the cloud director client pulls the updated layout scene stream from the RTC conference platform. The cloud director client can pull the updated layout scene signal from the RTC conference platform through long connection with the RTC conference platform, and the updated layout scene is displayed in the PVW pre-monitor window.
According to some embodiments, after the cloud director platform sends the layout template information to the cloud director platform, the signaling server of the cloud director platform sends a confirmation message to the cloud director platform after correctly receiving the layout template information, and the cloud director platform hides the edit list after receiving the confirmation message.
Thus, the method shown in FIG. 2 may further comprise:
Step S205, hiding the edit list when receiving the confirmation of the layout template information sent by the cloud broadcasting platform.
According to some embodiments, when the cloud director receives an instruction to edit a layout scene in the PVW pre-monitor window, the layout editor is displayed accordingly in PVW pre-monitor window, indicating entry into edit mode.
According to some embodiments, when the cloud director station receives an instruction to edit the layout scene in the PVW pre-monitor window, the type of the received input source is first determined. The types of the layout scene input sources comprise common input sources and layout input sources, wherein the common input sources are input sources corresponding to the input source components, and the layout input sources are input sources corresponding to the layout components. If the common input source is received, then PVW the pre-monitor window does not enter the edit mode; if a layout input source is received, PVW the pre-monitor window enters edit mode.
According to some embodiments, PVW the pre-monitor window enters an edit mode to render the content of one or more layers contained in the layout scene.
Thus, the method shown in FIG. 2 may further comprise:
Step S206, responding to the instruction for editing the layout scene of the PVW pre-monitor window, and determining whether the type of the received input source information is a layout input source;
In step S207, in the case where the type of the received input source information is determined to be the layout input source, the content of one or more layers included in the layout scene is rendered.
According to some embodiments, the process of rendering the content of one or more layers contained in the layout scene is traversing one or more layers, which are rendered one by one.
According to some embodiments, for the currently traversed layer, information such as the position, the size, the frame and the like of the currently traversed layer is obtained, and then the position, the size and the frame of the currently traversed layer are set according to the information. For example, when obtaining the information that the currently traversed layer is located at the upper left corner of the layout scene, the size is 2cm x 2cm, and the border line width is 5 lbs, the currently traversed layer is displayed according to the information.
According to some embodiments, a sequence number is set for the currently traversed layer and the sequence number of the currently traversed layer is displayed. For example, the layout scene has 10 layers in total, and in the case that the layer currently traversed is the 2 nd layer, the sequence number of the layer is set and displayed as 2.
Thus, step S207 of fig. 2 may include: setting the position, the size and the frame of the current traversed layer for the current traversed layer; and displaying the sequence number of the currently traversed layer.
According to some embodiments, PVW when the pre-monitor window enters edit mode, there are some layers with input sources, while other layers do not have input sources. As described above, the input sources corresponding to the layers in the layout scene may be any input source format type supported by the cloud director, including push address, live broadcast, on-demand, picture, monochrome, conference input signals (participant, share, speaker), and the like. For different input source format types, including for example picture type, video type input source, etc., in order to display the input source, it is necessary to create a file element corresponding to the format type of the input source. Thus, it is first necessary to determine the format type of the input source corresponding to the layer currently traversed, and then create a file element corresponding to the format type of the input source.
Thus, step S207 of fig. 2 may include: determining the format type of an input source corresponding to the currently traversed layer; creating a file element corresponding to the format type of the input source.
According to some embodiments, after creating a file element corresponding to a format type of an input source, specific content of the input source of a currently traversed layer needs to be acquired, for example, if the file element is a picture, the picture needs to be put into the layer for display. Thus, it is necessary to know the location of the input source of the currently traversed layer, i.e. the address information, for example, in a storage location of the computer, and after the address information is acquired, the input source can be acquired through the address information, and the content of the input source is displayed on the currently traversed layer.
Thus, step S207 of fig. 2 may include: determining address information of an input source corresponding to the currently traversed layer; and acquiring the input source through the address information, and displaying the input source on the currently traversed layer.
Fig. 3 is a schematic diagram comparing a method for updating a layout scene in a cloud multicast platform client of the present application with a method for updating a layout scene in the prior art. As shown in fig. 3, in the prior art solution, if the layout scene needs to be edited, editing needs to be performed on the secondary interface by means of popup window, which can block the PGM main monitor window, and after editing, the PGM main monitor window is validated at PVW, and then the PGM main monitor window can be seen again. In contrast, in the scheme of the application, if editing of the layout scene is desired, the editing list is directly displayed on the interface where the PGM main monitor window is located, and the PGM main monitor window is not blocked, so that the execution failure rate is greatly reduced.
According to the method for updating the layout scene in the cloud guide platform client, under the condition that the layout scene of the PVW pre-monitor window is determined to be edited, the layout scene can be directly edited on the primary interface without being edited on a specific secondary interface. Therefore, the monitoring of live signals of the PGM master monitoring window is considered, the operation threshold is reduced, and the execution failure rate can be greatly reduced. And when the layout scene of the PVW pre-monitor window is determined to be edited, the PVW pre-monitor window enters a layout editing mode, so that a pilot broadcast executive personnel can acquire the current mode of the PVW pre-monitor window in real time.
According to one aspect of the application, an apparatus for updating a layout scene in a cloud director client is provided. Fig. 4 is a schematic diagram of an apparatus for updating a layout scene in a cloud podcast client according to an embodiment of the application. As shown in fig. 4, the apparatus includes the following modules.
The first generating module 401 is configured to generate, in response to an instruction for editing a layout scene of the PVW pre-monitor window, an edit list at an interface where the PGM main monitor window is located, where the edit list includes information of one or more layers included in the layout scene and edit items corresponding to the one or more layers.
According to some embodiments, in order to implement editing of the layout scene in the PVW pre-monitor window on the interface where the PGM main monitor window is located, first, the cloud director platform executor may make an instruction that needs to edit the layout scene in the PVW pre-monitor window, and after receiving the instruction, the cloud director platform learns that the executor needs to edit the layout scene.
According to some embodiments, a right key event is defined for the PVW pre-monitor window, for example, for the node element name corresponding to the PVW pre-monitor window, a right key event addeventlister ('contextmenu', contextmenuHandler) is added, when an operator clicks the right mouse button in the area where the PVW pre-monitor window is located, an instruction for editing the layout scene in the PVW pre-monitor window is triggered, and at the same time, the cloud director can obtain the position of the right mouse button on the PVW pre-monitor window through contextmenuHandler.
According to some embodiments, when the cloud director station receives an instruction to edit the layout scene of the PVW pre-monitor window, an edit list is generated at the interface where the PGM main monitor window is located. The edit list generated by the cloud director may be a drop down list. In the generated edit list, information of the layers included in the layout scene and edit items corresponding to the layers are presented. For example, a layout scene includes 10 layers, and then the identification information and/or description information of each of the 10 layers is shown in an edit list, and for each layer, an editable item may be shown, such as deleting an input source, adding an input source, replacing an input source, setting the size of the layer, setting the position coordinates of the layer, setting the background of the layer, and the like.
A second generating module 402, configured to generate layout template information in response to a confirmation of editing the one or more layers according to the edit list.
According to some embodiments, the executive can edit the selected layer according to the displayed editing items, and after editing, a confirmation instruction is sent to the cloud broadcasting guide platform. After receiving the confirmation instruction, the cloud director generates layout template information, for example METemplateInfo information, which records editing information of the layout scene by an executive, for example, which layer is added with which input source, which layer is set in size, and the like.
And the sending module 403 is configured to send the layout template information to a cloud director platform, so that the cloud director platform updates the layout scene according to the layout template information, and push the updated layout scene to the RTC conference platform.
According to some embodiments, after generating the layout template information, the cloud director platform sends the layout template information METemplateInfo to the cloud director platform through a SWITCHERSETMETEMPLATE protocol, and the cloud director platform updates the layout scene according to the layout template information, for example, which input source is added to which layer, which layer is set in size, and the like, and pushes the updated layout scene to the RTC conference platform.
And a pulling module 404, configured to pull the updated layout scene from the RTC conference platform.
According to some embodiments, after the cloud director platform pushes the updated layout scene to the RTC conference platform, the cloud director client pulls the updated layout scene stream from the RTC conference platform. The cloud director client can pull the updated layout scene signal from the RTC conference platform through long connection with the RTC conference platform, and the updated layout scene is displayed in the PVW pre-monitor window.
According to some embodiments, after the cloud director platform sends the layout template information to the cloud director platform, the signaling server of the cloud director platform sends a confirmation message to the cloud director platform after correctly receiving the layout template information, and the cloud director platform hides the edit list after receiving the confirmation message.
Thus, the apparatus shown in fig. 4 may further comprise:
And the hiding module 405 is configured to hide the edit list when receiving a confirmation of the layout template information sent by the cloud broadcasting platform.
According to some embodiments, when the cloud director receives an instruction to edit a layout scene in the PVW pre-monitor window, the layout editor is displayed accordingly in PVW pre-monitor window, indicating entry into edit mode.
According to some embodiments, when the cloud director station receives an instruction to edit the layout scene in the PVW pre-monitor window, the type of the received input source is first determined. The types of the layout scene input sources comprise common input sources and layout input sources, wherein the common input sources are input sources corresponding to the input source components, and the layout input sources are input sources corresponding to the layout components. If the common input source is received, then PVW the pre-monitor window does not enter the edit mode; if a layout input source is received, PVW the pre-monitor window enters edit mode.
According to some embodiments, PVW the pre-monitor window enters an edit mode to render the content of one or more layers contained in the layout scene.
Thus, the apparatus shown in fig. 4 may further comprise:
A determining module 406, configured to determine, in response to an instruction for editing the layout scene of the PVW pre-monitor window, whether the type of the received input source information is a layout input source;
A rendering module 407, configured to render, in case that the type of the received input source information is determined to be a layout input source, the content of one or more layers included in the layout scene.
According to some embodiments, the process of rendering the content of one or more layers contained in the layout scene is traversing one or more layers, which are rendered one by one.
According to some embodiments, for the currently traversed layer, information such as the position, the size, the frame and the like of the currently traversed layer is obtained, and then the position, the size and the frame of the currently traversed layer are set according to the information. For example, when obtaining the information that the currently traversed layer is located at the upper left corner of the layout scene, the size is 2cm x 2cm, and the border line width is 5 lbs, the currently traversed layer is displayed according to the information.
According to some embodiments, a sequence number is set for the currently traversed layer and the sequence number of the currently traversed layer is displayed. For example, the layout scene has 10 layers in total, and in the case that the layer currently traversed is the 2 nd layer, the sequence number of the layer is set and displayed as 2.
Thus, rendering module 407 of FIG. 4 may be used to: setting the position, the size and the frame of the current traversed layer for the current traversed layer; and displaying the sequence number of the currently traversed layer.
According to some embodiments, PVW when the pre-monitor window enters edit mode, there are some layers with input sources, while other layers do not have input sources. As described above, the input sources corresponding to the layers in the layout scene may be any input source format type supported by the cloud director, including push address, live broadcast, on-demand, picture, monochrome, conference input signals (participant, share, speaker), and the like. For different input source format types, including for example picture type, video type input source, etc., in order to display the input source, it is necessary to create a file element corresponding to the format type of the input source. Thus, it is first necessary to determine the format type of the input source corresponding to the layer currently traversed, and then create a file element corresponding to the format type of the input source.
Thus, rendering module 407 of FIG. 4 may be used to: determining the format type of an input source corresponding to the currently traversed layer; creating a file element corresponding to the format type of the input source.
According to some embodiments, after creating a file element corresponding to a format type of an input source, specific content of the input source of a currently traversed layer needs to be acquired, for example, if the file element is a picture, the picture needs to be put into the layer for display. Thus, it is necessary to know the location of the input source of the currently traversed layer, i.e. the address information, for example, in a storage location of the computer, and after the address information is acquired, the input source can be acquired through the address information, and the content of the input source is displayed on the currently traversed layer.
Thus, rendering module 407 of FIG. 4 may be used to: determining address information of an input source corresponding to the currently traversed layer; and acquiring the input source through the address information, and displaying the input source on the currently traversed layer.
According to the device for updating the layout scene in the cloud guide platform client, the layout scene can be directly edited on the primary interface without being edited on a specific secondary interface under the condition that the layout scene of the PVW pre-monitor window is determined to be edited. Therefore, the monitoring of live signals of the PGM master monitoring window is considered, the operation threshold is reduced, and the execution failure rate can be greatly reduced. And when the layout scene of the PVW pre-monitor window is determined to be edited, the PVW pre-monitor window enters a layout editing mode, so that a pilot broadcast executive personnel can acquire the current mode of the PVW pre-monitor window in real time.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.
It should be noted that, for simplicity of description, the foregoing method embodiments are all described as a series of acts, but it should be understood by those skilled in the art that the present application is not limited by the order of acts described, as some steps may be performed in other orders or concurrently in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are alternative embodiments, and that the acts and modules referred to are not necessarily required for the present application.
In the several embodiments provided by the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, such as the division of the units, merely a logical function division, and there may be additional manners of dividing the actual implementation, such as multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, electrical connection, or other forms.
Referring to fig. 5, fig. 5 provides an electronic device including a processor and a memory. The memory stores computer instructions that, when executed by the processor, cause the processor to execute the computer instructions to implement the method and refinement as shown in fig. 2.
It should be understood that the above-described device embodiments are illustrative only and that the disclosed device may be implemented in other ways. For example, the division of the units/modules in the above embodiments is merely a logic function division, and there may be another division manner in actual implementation. For example, multiple units, modules, or components may be combined, or may be integrated into another system, or some features may be omitted or not performed.
In addition, unless specifically described, each functional unit/module in each embodiment of the present invention may be integrated into one unit/module, or each unit/module may exist alone physically, or two or more units/modules may be integrated together. The integrated units/modules described above may be implemented either in hardware or in software program modules.
The integrated units/modules, if implemented in hardware, may be digital circuits, analog circuits, etc. Physical implementations of hardware structures include, but are not limited to, transistors, memristors, and the like. The processor or chip may be any suitable hardware processor, such as CPU, GPU, FPGA, DSP and an ASIC, etc., unless otherwise specified. The on-chip cache, off-chip memory, memory may be any suitable magnetic or magneto-optical storage medium, such as resistive random access memory RRAM (Resistive Random Access Memory), dynamic random access memory DRAM (Dynamic Random Access Memory), static random access memory SRAM (static random access memory), enhanced dynamic random access memory EDRAM (ENHANCED DYNAMIC Random Access Memory), high-bandwidth memory HBM (high-bandwidth memory), hybrid memory cube HMC (Hybrid Memory Cube), and the like, unless otherwise indicated.
The integrated units/modules may be stored in a computer readable memory if implemented in the form of software program modules and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a memory, comprising several instructions for causing a computer electronic device (which may be a personal computer, a server or a network electronic device, etc.) to perform all or part of the steps of the method described in the various embodiments of the disclosure. And the aforementioned memory includes: a usb disk, a read-only memory (ROM), a random access memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Embodiments of the present application also provide a non-transitory computer storage medium storing a computer program which, when executed by a plurality of processors, causes the processors to perform the method and refinement as shown in fig. 2.
The foregoing has outlined rather broadly the more detailed description of embodiments of the application in order that the detailed description of the principles and embodiments of the application may be implemented in conjunction with the detailed description of embodiments of the application that follows. Meanwhile, based on the idea of the present application, those skilled in the art can make changes or modifications on the specific embodiments and application scope of the present application, which belong to the protection scope of the present application. In view of the foregoing, this description should not be construed as limiting the application.

Claims (13)

1. The method for updating the layout scene in the cloud director client is characterized by comprising the following steps:
Responding to an instruction for editing a layout scene of a PVW pre-monitor window, and generating an editing list on an interface where a PGM main monitor window is located, wherein the editing list contains information of a plurality of layers contained in the layout scene and editing items corresponding to the plurality of layers;
generating layout template information in response to confirmation of editing the plurality of layers according to the editing list;
the layout template information is sent to a cloud broadcasting guiding platform, so that the cloud broadcasting guiding platform updates the layout scene according to the layout template information, and the updated layout scene is pushed to an RTC conference platform; and
And pulling the updated layout scene from the RTC conference platform.
2. The method as recited in claim 1, further comprising:
Determining whether the type of the received input source information is a layout input source or not in response to an instruction for editing the layout scene of the PVW pre-monitor window;
In the case where the type of the received input source information is determined to be a layout input source, the contents of a plurality of layers included in the layout scene are rendered.
3. The method of claim 2, wherein the rendering the content of the plurality of layers contained in the layout scene comprises:
setting the position, the size and the frame of the current traversed layer for the current traversed layer;
and displaying the sequence number of the currently traversed layer.
4. A method according to claim 2 or 3, wherein said rendering the content of a plurality of layers comprised by the layout scene comprises:
Determining the format type of an input source corresponding to the currently traversed layer;
creating a file element corresponding to the format type of the input source.
5. The method of claim 4, wherein rendering the content of the plurality of layers contained in the layout scene further comprises:
determining address information of an input source corresponding to the currently traversed layer;
And acquiring the input source through the address information, and displaying the input source on the currently traversed layer.
6. A method as claimed in any one of claims 1 to 3, further comprising:
And hiding the edit list under the condition that the confirmation of the layout template information sent by the cloud broadcasting guide platform is received.
7. An apparatus for updating a layout scene in a cloud director client, comprising:
The first generation module is used for responding to an instruction for editing the layout scene of the PVW pre-monitor window, and generating an editing list on the interface where the PGM main monitor window is located, wherein the editing list comprises information of a plurality of layers contained in the layout scene and editing items corresponding to the plurality of layers;
the second generation module is used for responding to confirmation of editing the plurality of layers according to the editing list and generating layout template information;
The sending module is used for sending the layout template information to the cloud broadcasting guide platform, so that the cloud broadcasting guide platform updates the layout scene according to the layout template information and pushes the updated layout scene to the RTC conference platform; and
And the pulling module is used for pulling the updated layout scene from the RTC conference platform.
8. The apparatus as recited in claim 7, further comprising:
a determining module, configured to determine whether the type of the received input source information is a layout input source in response to an instruction for editing the layout scene of the PVW pre-monitor window;
And the rendering module is used for rendering the contents of a plurality of layers contained in the layout scene under the condition that the type of the received input source information is determined to be the layout input source.
9. The apparatus of claim 8, wherein the rendering module is further to:
setting the position, the size and the frame of the current traversed layer for the current traversed layer;
and displaying the sequence number of the currently traversed layer.
10. The apparatus of claim 8 or 9, wherein the rendering module is further to:
Determining the format type of an input source corresponding to the currently traversed layer;
creating a file element corresponding to the format type of the input source.
11. The apparatus of claim 10, wherein the rendering module is further to:
determining address information of an input source corresponding to the currently traversed layer;
And acquiring the input source through the address information, and displaying the input source on the currently traversed layer.
12. An electronic device comprising a memory having a computer program stored thereon and a processor that when executing the computer program on the memory implements the method of any of claims 1 to 6.
13. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements the method of any one of claims 1 to 6.
CN202310685296.4A 2023-06-09 2023-06-09 Method and device for updating layout scene in cloud director client Active CN116916051B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310685296.4A CN116916051B (en) 2023-06-09 2023-06-09 Method and device for updating layout scene in cloud director client

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310685296.4A CN116916051B (en) 2023-06-09 2023-06-09 Method and device for updating layout scene in cloud director client

Publications (2)

Publication Number Publication Date
CN116916051A CN116916051A (en) 2023-10-20
CN116916051B true CN116916051B (en) 2024-04-16

Family

ID=88354046

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310685296.4A Active CN116916051B (en) 2023-06-09 2023-06-09 Method and device for updating layout scene in cloud director client

Country Status (1)

Country Link
CN (1) CN116916051B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101276275A (en) * 2008-04-22 2008-10-01 罗笑南 Software development visualizing editing method aiming at set top box
CN101692693A (en) * 2009-09-29 2010-04-07 北京中科大洋科技发展股份有限公司 Multifunctional integrated studio system and a method for producing radio and television programmers or films
CN104853065A (en) * 2015-05-29 2015-08-19 北京中庆现代技术有限公司 Dual broadcasting interface control platform
CN109963162A (en) * 2017-12-25 2019-07-02 阿里巴巴集团控股有限公司 A kind of cloud director system and live streaming processing method, device
KR20200068512A (en) * 2018-12-05 2020-06-15 주식회사 더픽트 Portal service object system for providing custom VR contents and Drive method of the Same
CN111324322A (en) * 2018-12-14 2020-06-23 西安诺瓦星云科技股份有限公司 Multi-picture pre-monitoring configuration method, device, system and computer readable medium
CN112540763A (en) * 2020-12-24 2021-03-23 贵阳货车帮科技有限公司 Front-end page generation method and device, platform equipment and storage medium
CN112565847A (en) * 2021-02-22 2021-03-26 成都云帆数联科技有限公司 Large-screen display control method and device
CN115767131A (en) * 2022-11-03 2023-03-07 咪咕文化科技有限公司 Cloud director method, device, equipment and computer storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106210861B (en) * 2016-08-23 2020-08-07 上海幻电信息科技有限公司 Method and system for displaying bullet screen

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101276275A (en) * 2008-04-22 2008-10-01 罗笑南 Software development visualizing editing method aiming at set top box
CN101692693A (en) * 2009-09-29 2010-04-07 北京中科大洋科技发展股份有限公司 Multifunctional integrated studio system and a method for producing radio and television programmers or films
CN104853065A (en) * 2015-05-29 2015-08-19 北京中庆现代技术有限公司 Dual broadcasting interface control platform
CN109963162A (en) * 2017-12-25 2019-07-02 阿里巴巴集团控股有限公司 A kind of cloud director system and live streaming processing method, device
KR20200068512A (en) * 2018-12-05 2020-06-15 주식회사 더픽트 Portal service object system for providing custom VR contents and Drive method of the Same
CN111324322A (en) * 2018-12-14 2020-06-23 西安诺瓦星云科技股份有限公司 Multi-picture pre-monitoring configuration method, device, system and computer readable medium
CN112540763A (en) * 2020-12-24 2021-03-23 贵阳货车帮科技有限公司 Front-end page generation method and device, platform equipment and storage medium
CN112565847A (en) * 2021-02-22 2021-03-26 成都云帆数联科技有限公司 Large-screen display control method and device
CN115767131A (en) * 2022-11-03 2023-03-07 咪咕文化科技有限公司 Cloud director method, device, equipment and computer storage medium

Also Published As

Publication number Publication date
CN116916051A (en) 2023-10-20

Similar Documents

Publication Publication Date Title
US11140106B2 (en) Method, device and storage medium for interactive message in video page
US10291679B2 (en) Permission request for social media content in a video production system
CN113099258B (en) Cloud guide system, live broadcast processing method and device, and computer readable storage medium
CN104516892B (en) It is associated with dissemination method, system and the terminal of the user-generated content of rich media information
JP2018110324A (en) Distribution system, distribution server, terminal and program
KR101915786B1 (en) Service System and Method for Connect to Inserting Broadcasting Program Using an Avata
JP2010157961A (en) Caption creation system and program
JP2023026478A (en) Information processing device, program, method, and system
US20240064271A1 (en) System and method for augmented views in an online meeting
CN115767131A (en) Cloud director method, device, equipment and computer storage medium
CN116916051B (en) Method and device for updating layout scene in cloud director client
CN106792237B (en) Message display method and system
JP2018110377A (en) Distribution system, distribution server, terminal and program
JP2010251920A (en) Content production management device, content production device, content production management program, and content production program
CN116886941B (en) Method and device for switching caption content in cloud broadcasting guide station
CN116627577A (en) Third party application interface display method
CN116582696B (en) Method and system for switching program scene to preset monitoring window
CN113963133B (en) Method and device for generating house source watching route, electronic equipment and readable medium
CN116260987A (en) Video rebroadcasting processing system, method, device and equipment
DE102019204521A1 (en) Context-dependent routing of media data
CN116980555B (en) Input signal source acquisition method and system
JP2007518288A (en) Construction of macro elements for automatic production control
CN117729188B (en) Water affair video acquisition system and method based on WebRTC
CN111770372B (en) Program editing method, device and system
CN115243064B (en) Live broadcast control method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant