CN111741349A - Multimedia information special-shaped screen publishing method, device and equipment - Google Patents

Multimedia information special-shaped screen publishing method, device and equipment Download PDF

Info

Publication number
CN111741349A
CN111741349A CN202010677062.1A CN202010677062A CN111741349A CN 111741349 A CN111741349 A CN 111741349A CN 202010677062 A CN202010677062 A CN 202010677062A CN 111741349 A CN111741349 A CN 111741349A
Authority
CN
China
Prior art keywords
program
resolution
content
canvas
player
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010677062.1A
Other languages
Chinese (zh)
Other versions
CN111741349B (en
Inventor
任占文
侯光磊
王俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jianyuan Technology Co ltd
Original Assignee
Beijing Jianyuan Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jianyuan Technology Co ltd filed Critical Beijing Jianyuan Technology Co ltd
Priority to CN202010677062.1A priority Critical patent/CN111741349B/en
Publication of CN111741349A publication Critical patent/CN111741349A/en
Application granted granted Critical
Publication of CN111741349B publication Critical patent/CN111741349B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application relates to a multimedia information special-shaped screen publishing method, which comprises the following steps: after receiving a program making command, acquiring the resolution of a currently input program; when the program resolution is greater than the preset resolution, more than two program canvases are laid out according to the program resolution and the picture output resolution of each player configured by the client; loading corresponding multimedia contents on each program canvas which is well laid out; and sending the program content and the segmentation information of the program content to the client, and playing and displaying the program content by each player in the client in a cooperative manner. The function of point-to-point playing of program content and client output display is achieved, so that when the special-shaped screen of the multimedia information is published, the program content with different program resolutions can be flexibly formulated according to actual conditions, the limitation of the resolution of conventional display equipment is avoided, and the displayed content is more flexible and diversified. Finally, various personalized requirements of the user are met.

Description

Multimedia information special-shaped screen publishing method, device and equipment
Technical Field
The application relates to the technical field of multimedia information display, in particular to a method, a device and equipment for publishing a multimedia information special-shaped screen.
Background
With the localization of display devices and the diversification of multimedia information, various manufacturers have begun to customize display devices with specific shapes and specific resolutions in order to better attract the eyes of customers. However, from the perspective of industrial production, the conventional resolution of the display device is highly matched with the application scenario, that is, the resolution of the display device produced by the manufacturer is generally the conventional resolution, such as: 13666 × 768, 1440 × 800, 1920 × 1080, 3840 × 2160, etc. Therefore, when a merchant needs to play and display multimedia information with an unconventional resolution in order to achieve a personalized advertising effect, the conventional display equipment is not matched with the played multimedia content with the unconventional resolution, so that the personalized requirements of users cannot be met.
Disclosure of Invention
In view of this, the present application provides a method for publishing a multimedia information special-shaped screen, which can realize flexible matching between a display device and multimedia content to meet the personalized requirements of users.
According to an aspect of the present application, there is provided a method for publishing a multimedia information special-shaped screen, including:
after receiving a program making command, acquiring the resolution of a currently input program;
performing program canvas layout according to the program resolution and the picture output resolution of each player configured by the client;
loading corresponding multimedia contents on the program canvas which is well laid out, and generating program contents which need to be displayed and played;
sending the program content and the segmentation information of the program content to the client, and performing playing and displaying of the program content cooperatively by each player in the client;
and the segmentation information is the corresponding relation between the sub canvas in the program canvas and the loaded multimedia content.
In one possible implementation manner, loading corresponding multimedia content on the laid out program canvas includes:
and acquiring a control corresponding to the currently triggered multimedia content, and adding the corresponding multimedia content to the corresponding sub canvas in the program canvas according to the triggered control.
In a possible implementation manner, when performing a layout of a program canvas according to the program resolution and each of the picture output resolutions, the method includes:
calculating the multiple of the program resolution and the picture output resolution, and determining the horizontal coordinate pixel value and the vertical coordinate pixel value of the program canvas according to the multiple;
and determining the number of the sub-canvas and the arrangement mode of the sub-canvas based on the horizontal coordinate pixel value and the vertical coordinate pixel value of the program canvas.
According to an aspect of the present application, there is also provided a method for publishing a multimedia information special-shaped screen, including:
receiving the program content and the segmentation information, and distributing different areas of the program content to different players according to the segmentation information based on the picture output resolution of each player;
wherein different areas of the program content correspond to different sub-canvases in the program canvas;
and controlling the players to synchronously play different areas of the program content respectively.
In a possible implementation manner, when different areas of the program content are allocated to different players according to the slicing information, the method includes:
determining different areas of the program content and program resolutions corresponding to the different areas of the program content based on the segmentation information;
and matching the picture output resolution of each player with the resolution of each program one by one, and correspondingly distributing different areas of the program content to different players according to the matching relation.
In a possible implementation manner, when controlling each of the players to synchronously play different areas of the program content, the method includes:
determining a main player in each player, and monitoring the playing time of the main player in real time;
and controlling other players except the main player in each player to play the corresponding program content according to the reference time by taking the playing time of the main player as the reference time.
In a possible implementation manner, when the playing time of the main player is used as a reference time and the other players in the players except the main player are controlled to play the corresponding program content according to the reference time, an error between the playing time of the other players except the main player and the reference time is less than or equal to 1 millisecond.
According to another aspect of the application, a multimedia information special-shaped screen publishing device is further provided, and comprises a resolution obtaining module, a canvas layout module, a content loading module and a program sending module;
the resolution acquisition module is configured to acquire the resolution of the currently input program after receiving a program production instruction;
the canvas layout module is configured to perform program canvas layout according to the program resolution and the picture output resolution of each player configured by the client;
the content loading module is configured to load corresponding multimedia content on the program canvas which is well laid out, and generate program content which needs to be displayed and played;
the program sending module is configured to send the program content and the segmentation information of the program content to the client, and each player in the client collaboratively plays and displays the program content;
and the segmentation information is the corresponding relation between the sub canvas in the program canvas and the loaded multimedia content.
According to another aspect of the application, a multimedia information special-shaped screen publishing device is further provided, and comprises a program distribution module and a synchronous playing module;
the program distribution module is configured to receive the program content and the segmentation information, and distribute different areas of the program content to different players according to the segmentation information based on picture output resolution of each player;
wherein different areas of the program content correspond to different sub-canvases in the program canvas;
the synchronous playing module is configured to control each of the players to synchronously play different areas of the program content.
According to an aspect of the present application, there is also provided a multimedia information special-shaped screen publishing device, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to execute the executable instructions to implement any of the methods described above.
According to the multimedia information special-shaped screen publishing method, when a program is manufactured at the server end, the resolution of the program content is defined by user, the layout of the program canvas is carried out according to the program resolution and the picture output resolution of the player configured by the client end to match the resolution of the display equipment of the client end, so that the program content is wholly divided into a plurality of sub-canvases through the layout of the program canvas, and the plurality of sub-canvases respectively present different areas in the program content. After the program content is manufactured, the program content is sent to the client side to be displayed and played, and meanwhile, the segmentation information of the program content is sent, so that each player of the client side can display and play the program content cooperatively according to the segmentation information, the function of displaying point-to-point playing of the program content and the output of the client side is realized, the program content with different program resolutions can be flexibly formulated according to actual conditions when the special-shaped screen of the multimedia information is released, the limitation of the resolution of conventional display equipment is avoided, and the displayed content is more flexible and diversified. And finally, the high matching between the program content and the display equipment is achieved, and various personalized requirements of users are met.
Other features and aspects of the present application will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments, features, and aspects of the application and, together with the description, serve to explain the principles of the application.
FIG. 1 is a flow chart of a multimedia information irregular screen publishing method according to an embodiment of the application;
FIG. 2 is a diagram illustrating a layout of a program canvas in a method for publishing a multimedia information special-shaped screen according to an embodiment of the present application;
FIG. 3 is a diagram illustrating another layout of a canvas for a program in a method for publishing a multimedia information odd-shaped screen according to an embodiment of the present application;
fig. 4 is a schematic view illustrating an operation interface when multimedia content is loaded on a program canvas in a multimedia information irregular screen publishing method according to an embodiment of the present application;
FIG. 5 is a diagram illustrating a case where the player's picture output resolution cannot cover the odd-shaped screen resolution;
fig. 6 is a schematic diagram illustrating an architecture of a multimedia information opposite-nature screen publishing method when a plurality of players cooperatively play the same program content according to an embodiment of the present application;
fig. 7 is a schematic diagram illustrating a program content being cut in a multimedia information irregular screen publishing method according to an embodiment of the present application;
fig. 8 is a schematic diagram illustrating a method for publishing a multimedia information irregular screen according to an embodiment of the present application when a synchronization mechanism is used to synchronously play different areas of program contents by multiple players;
fig. 9a to 9c are schematic diagrams respectively illustrating multimedia information distribution performed when the program resolution is smaller than the conventional resolution in a multimedia information irregular screen distribution method according to another embodiment of the present application;
FIG. 10 is a block diagram showing a multimedia information irregular screen distribution device according to an embodiment of the present application;
fig. 11 shows a block diagram of a multimedia information irregular screen distribution device according to an embodiment of the present application.
Detailed Description
Various exemplary embodiments, features and aspects of the present application will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present application. It will be understood by those skilled in the art that the present application may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present application.
First, it should be noted that the method for publishing the multimedia information special-shaped screen in the embodiment of the present application is mainly used for realizing normal display and play of program contents with an unconventional resolution (that is, a program resolution is greater than a preset resolution) on a display device. The preset resolution can be flexibly set according to actual conditions, and is usually 1920 × 1080.
That is to say, the method for publishing the multimedia information special-shaped screen in the embodiment of the application is mainly applied to large scenes such as exhibition halls and airports and is suitable for large display devices, for example: hairtail screen, spliced screen or other specially-shaped display screen and the like. In an application scenario with a resolution greater than 1920 × 1080, the playing and presentation of the program content is not implemented by one playing terminal and one display device, but by a plurality of playing terminals.
Fig. 1 shows a flow chart of a multimedia information irregular screen publishing method according to an embodiment of the application. As shown in fig. 1, the method includes: step S100, after receiving a program production instruction, acquiring the resolution of the currently input program. Here, it will be understood by those skilled in the art that the program resolution may be arbitrarily specified or defined by the user according to actual needs. Namely, after receiving a program production instruction, pushing and displaying a window interface with a user-defined program resolution. The user determines the resolution of the currently produced program content in a pop-up window interface in a selection or direct input mode.
And step S200, performing program canvas layout according to the program resolution and the picture output resolution of each player configured by the client. Here, it should be noted that the program canvas to be laid out differs depending on the resolution of the program. When the program resolution is less than or equal to the preset resolution, a program canvas can be directly generated as a carrier of the whole program content. When the program resolution is greater than the preset resolution, the program canvas usually includes a plurality of sub-canvases during layout of the program canvas, and the plurality of sub-canvases are arranged correspondingly according to the program resolution and the screen output resolution of each player configured by the client to form the whole canvas of the program content. It should be further explained that, in the present application, the program canvas may be understood as a virtual screen display range, and may also be thought of as a display screen during the playing of an actual program.
Meanwhile, the preset resolution can be flexibly set according to the actual situation. Such as: when the screen output resolutions of the players configured by the client are the same, the preset resolution may be the screen output resolution of each configured player. That is, when the screen output resolutions of the players are the same, the screen output resolution of any one of the players is directly obtained as the preset resolution, and the layout of the program canvas is performed according to the self-defined program resolution and the screen output resolution of any one player.
And selecting the minimum picture output resolution from the picture output resolutions of the players, and setting the minimum picture output resolution as a preset resolution. When the program canvas layout is performed, the layout can be performed according to the program resolution and the minimum picture output resolution.
Then, through step S300, corresponding multimedia content is loaded on the program canvas that is laid out, so as to implement the production of different areas of the program content. Here, it should be noted that the loaded multimedia content may be various contents such as pictures, videos, letters, clocks, weather, carousel, PPT, Word, PDF, Excel, Iframe, video streams, music, and the like, and is not limited herein. Meanwhile, as will be understood by those skilled in the art, the program content produced in the present application refers to the program canvas generated after the required multimedia content is loaded.
Finally, in step S400, the program content and the segmentation information of the program content are sent to the client, and the players in the client cooperate to play and display the program content. Here, it should be explained that the segmentation information of the program content refers to a corresponding relationship between each sub-canvas in the program canvas and the loaded multimedia content.
That is to say, according to the method for publishing the multimedia information special-shaped screen, when a program is manufactured at the server side, the resolution of the program content is customized, and then the layout of the program canvas is performed according to the customized program resolution and the picture output resolution of the player configured by the client side, so that the well-laid program canvas can be matched with the resolution of the display device of the client side. After the program content is manufactured, the program content is sent to the client side to be displayed and played, and meanwhile, the segmentation information of the program content is sent, so that each player of the client side can display and play the program content cooperatively according to the segmentation information, the function of displaying point-to-point playing of the program content and the output of the client side is realized, the program content with different program resolutions can be flexibly formulated according to actual conditions when the special-shaped screen of the multimedia information is released, the limitation of the resolution of conventional display equipment is avoided, and the displayed content is more flexible and diversified. And finally, the high matching between the program content and the display equipment is achieved, and various personalized requirements of users are met.
According to the foregoing, in the method for publishing a special-shaped screen of multimedia information, a program canvas refers to a virtual screen display range, and can also be understood as a screen for playing an actual program. That is to say, in the method for publishing a special-shaped screen of multimedia information according to the embodiment of the present application, the program canvas is laid out according to the program resolution and the picture output resolution of each player configured by the client, so that the finally prepared program content can be completely prepared according to the display range of the actual screen, which effectively improves the high matching degree between the program content and the actual display range of the display device.
Further, when the layout of the program canvas is performed according to the program resolution and the screen output resolution of each player, the following specific implementation can be performed.
The method comprises the steps of calculating the multiples of program resolution and picture output resolution, determining the horizontal coordinate pixel value and the vertical coordinate pixel value of a program canvas according to the calculated multiples, and then determining the number of the sub-canvases and the arrangement mode of the sub-canvases based on the horizontal coordinate pixel value and the vertical coordinate pixel value of the program canvas.
Here, when the multiples of the program resolution and the screen output resolution are calculated, the multiples of the horizontal coordinate pixel value of the program resolution and the horizontal coordinate pixel value of the screen output resolution and the multiples of the vertical coordinate pixel value of the program resolution and the vertical coordinate pixel value of the screen output resolution are calculated, respectively, and then the layout of the program canvas is performed based on the two calculated multiples.
Meanwhile, as can be seen from the foregoing, the screen output resolutions of the players configured by the client may be the same or different. Therefore, when the program resolution and the picture output resolution are multiplied and the layout of the program canvas is performed according to the multiple, the program resolution and the picture output resolution can be divided into two cases.
One situation is: the output resolution of the pictures of the players configured by the client is the same. In this case, when the layout of the program canvas is performed, any one of the screen output resolutions can be extracted directly from the screen output resolutions of the respective players, and then the multiples of the program resolution and the screen output resolution can be calculated.
The other case is that: the output resolution of the pictures of the players configured by the client is different. In this case, the minimum screen resolution may be extracted from the screen output resolutions of the players, and then the multiples of the program resolution and the minimum screen output resolution are calculated, and then the layout of the program canvas is performed according to the calculated multiples.
In order to more clearly describe the layout of the program canvas, the following description will be given taking the same screen output resolution of each player and 1920 × 1080 as an example.
Referring to fig. 2, when the program resolution is set to: 30720 × 1080, at this time: 30720/1920 is 16, 1080/1080 is 1, the two multiples are 16 and 1 respectively, so that 16 layouts are needed in the horizontal direction of the program canvas and only one layout is needed in the vertical direction. That is, the layout of the program canvas may be determined to be in the form of 1 row and 16 columns. Here, it should be noted that fig. 2 is only a schematic diagram of the embodiment, and only a part of the program canvas is shown. That is, FIG. 2 only shows a partial layout of the first 4 sub-canvases of the program canvas laid out in this embodiment, and the layout of the next 12 sub-canvases is the same as the layout of the first 4 sub-canvases. Meanwhile, as can be understood by those skilled in the art, the resolution of each sub-canvas block is 1920 × 1080.
Referring to fig. 3, when the program resolution is set to 3840 × 2160, the following are calculated: 3840/1920 is 2, 2160/1080 is 2, the two multiples are 2 and 2 respectively, so that it can be determined that the program canvas needs to be laid out 2 in the horizontal direction and 2 in the vertical direction, and thus the layout of the program canvas is determined to be 2 rows and 2 columns.
After the layout of the program canvas is completed, the corresponding multimedia content may be loaded on the program canvas. In a possible implementation manner, loading may be performed in a manner of dragging a control. Namely, acquiring a control corresponding to the currently triggered multimedia content, and adding the corresponding multimedia content to the program canvas according to the triggered control.
For example, referring to FIG. 4, various different types of controls for multimedia content may be preloaded in the left control bar. Therefore, when the multimedia content is added, the control in the control bar is directly dragged to the corresponding display position in the program canvas by adopting the control dragging method, and the addition of the multimedia content on the program canvas can be realized.
The method for triggering and dragging the control is adopted, so that the multimedia content is loaded on the program canvas more flexibly, the operation mode for loading the multimedia content is effectively simplified, and the program content is enriched.
In addition, it should be noted that, in the multimedia information irregular screen publishing method according to the embodiment of the present application, when a program is produced in any of the above manners, the multimedia information publishing system platform based on may adopt a B/S architecture, manage the broadcast terminal through a network, and may configure various management functions such as resource management, terminal management, program management, and user management.
Among them, resource management is mainly used to store various multimedia resources used in program production in advance. The terminal management is mainly used for acquiring and storing configuration information of each player configured by the update client, including information such as picture output resolution of each player. The program management is mainly used for executing any one of the program production processes to realize the production of program contents with any resolution. The user management is used for setting different authorities and the like for different users.
In the program management, a blank program canvas is provided, the program canvas is laid out, and meanwhile, various controls in a left control bar are dragged by a mouse to realize the program production.
Therefore, according to the multimedia information special-shaped screen publishing method, when the server side makes the program content, the size of the program resolution is defined by user, the program canvas is distributed according to the defined program resolution and the picture output resolution of the player of the client side, and then the corresponding multimedia content is loaded in the distributed program canvas to make the program content, so that the made program content is highly matched with the display screen of the display equipment of the client side, and conditions are provided for meeting the personalized display requirements of users.
In addition, it should be noted that after the program content is manufactured in any one of the foregoing multimedia information special-shaped screen publishing manners, the manufactured program content needs to be sent to the client, and the program content is played and displayed by each player of the client in a cooperative manner. In the implementation aspect of the multimedia information distribution terminal player, the terminal program needs to be received and played, and the terminal needs to be linked and the like according to the actual situation.
Referring to fig. 5, when the resolution of a single device cannot cover the resolution of the special-shaped screen, multiple players are required to play a program content at the same time, but each player is required to play a different area of the program content, so that the program content can be displayed and played on the display device completely and normally.
In a possible implementation manner, when the players configured by the client cooperate to play and display the program content, the following manner may be implemented.
That is, referring to fig. 6, the program content and the slicing information transmitted by the server are received first, and then different areas of the program content are allocated to different players according to the slicing information based on the picture output resolution of each player. Here, it will be appreciated by those skilled in the art that different regions of the program content correspond to different sub-canvases within the program canvas. Then, the players are controlled to synchronously play different areas of the program content respectively.
That is, after the client receives the program content and the segmentation information sent by the server, different areas of the program content are correspondingly allocated to different players according to the segmentation information, so that the players only play the received program part content when playing. When different players play multimedia contents in different areas of a program, synchronous playing of multiple players needs to be ensured in order to ensure accuracy of playing pictures.
More specifically, when different areas of the program content are allocated to different players according to the slicing information, the following manner may be adopted.
That is, different areas of the program content and program resolutions corresponding to the different areas of the program content are first determined based on the slicing information. And then, matching the picture output resolution of each player with the resolution of each program one by one, and correspondingly distributing different areas of the program content to different players according to the matching relation.
For example, referring to fig. 7, when the server side makes a program, the program resolution is input, and at the same time, the frame output resolution of the player is input. Such as: the program resolution is 11520 × 1080, since the player output maximum resolution is 3840 × 2160 and the picture output resolution is 3840 × 1080, here, it will be understood by those skilled in the art that the player resolution includes the output maximum resolution and the picture output resolution. Therefore, when different areas of the program content are divided into the players, the resolutions of the corresponding different areas can be determined based on the multimedia content loaded in each sub canvas in the segmentation information, then the picture output resolutions of the players are matched with the program resolutions corresponding to the different areas one by one, and the different areas of the program content (i.e. corresponding to each program canvas in the whole canvas) are distributed into different players according to the matching relationship.
After the program distribution is finished, the accurate and complete display of the program content can be ensured only by controlling the players to play simultaneously. Therefore, in a possible implementation manner, when the players are controlled to synchronously play different areas of the program content respectively, a synchronization mechanism can be adopted to implement.
Namely, a main player is determined by each player, and the playing time of the main player is monitored in real time. Meanwhile, the playing time of the main player is used as the reference time, and the other players except the main player in the players are controlled to play the corresponding program content according to the reference time.
For example, referring to fig. 8, a first player is used as a master device, a playing program or a switching program is used as a reference time, and other players are used as slave devices, and the latest playing time of the master device is automatically obtained through a program synchronization service to implement synchronous playing of multimedia information across terminals.
It should be noted that, in order to ensure the continuity, stability and smoothness of playing the program content, the playing time of each player allows a minimum error. That is, when the playing time of the main player is used as the reference time and the other players in the players except the main player are controlled to play the corresponding program content according to the reference time, the error between the playing time of the other players except the main player and the reference time should be less than or equal to 1 millisecond.
In addition, it should be noted that, in the method for publishing the multimedia information irregular screen according to the embodiment of the present application, when the set program resolution is smaller than the preset resolution, the application scene may be adapted to a smaller display device. Such as: a square display device, a diamond display device, a polygonal display device, or other specially shaped display device. In this case, when the server side makes a program, the currently required program resolution may be directly input, and a corresponding program canvas may be set according to the input program resolution. The program canvas can be understood as a virtual screen display range and can also be considered as a screen for playing an actual program, corresponding multimedia content is directly loaded on the program canvas after the setting of the program canvas is completed, the manufactured program content is directly sent to a player of a client after the loading is completed, the program content and the program resolution of the program content are read by the player, the dynamic adjustment of the picture output resolution is carried out according to the read program resolution, the point-to-point playing of the program and the output display is realized, and the effect that the program is seen and answered in the program manufacturing is finally achieved.
In order to more clearly illustrate the set program canvas mode when the program resolution is smaller than the preset resolution, the following three embodiments are exemplified. The predetermined resolution is 1920 × 1080. Referring to fig. 9a to 9c, the program resolutions are set as: 1920 × 1080, 500 × 500 and 1920 × 300, the layout of the set program canvas.
When the server side makes the program content, the program resolution of the program content is defined by user, and the corresponding program canvas is automatically set according to the defined program resolution, so that the finally made program content can be highly matched with the display screen of the client side, the effect of indiscriminate display of the program content can be finally realized, and the personalized requirements of users can be met.
In addition, according to any one of the multimedia information special-shaped screen publishing methods, the application also provides a multimedia information special-shaped screen publishing device. Because the working principle of the multimedia information special-shaped screen publishing device provided by the application is the same as or similar to that of the multimedia information special-shaped screen publishing method provided by the application, repeated parts are not repeated.
Referring to fig. 10, the multimedia information special-shaped screen publishing device 100 provided by the present application is suitable for being loaded to a server to produce program content, and includes a resolution obtaining module 110, a canvas layout module 120, a content loading module 130 and a program sending module 140. The resolution obtaining module 110 is configured to, after receiving a program making instruction, obtain a resolution of a currently input program. The canvas layout module 120 is configured to perform a canvas layout of the program according to the program resolution and the screen output resolution of each player configured by the client. And the content loading module 130 is configured to load corresponding multimedia content on the laid out program canvas, and generate the program content to be shown and played. The program sending module 140 is configured to send the program content and the segmentation information of the program content to the client, and each player in the client cooperatively displays the program content. And the segmentation information is the corresponding relation between the sub canvas in the program canvas and the loaded multimedia content.
In addition, the application also provides a multimedia information special-shaped screen publishing device, which is suitable for being loaded into a processor at a client and used for controlling players configured at the client to synchronously play different areas in the same program content so as to realize the cross-terminal playing effect of the multimedia information.
Specifically, the multimedia information special-shaped screen publishing device provided by the application comprises a program distribution module and a synchronous playing module. The program distribution module is configured to receive the program content and the segmentation information, and distribute different areas of the program content to different players according to the segmentation information based on the picture output resolution of each player. Wherein different areas of the program content correspond to different sub-canvases in the program canvas. And the synchronous playing module is configured to control the players to synchronously play different areas of the program content respectively.
Still further, according to another aspect of the present application, there is provided a multimedia information irregular screen distribution apparatus 200. Referring to fig. 11, the multimedia information irregular screen distribution device 200 according to the embodiment of the present application includes a processor 210 and a memory 220 for storing instructions executable by the processor 210. Wherein the processor 210 is configured to execute the executable instructions to implement any one of the multimedia information irregular screen distribution methods described above.
Here, it should be noted that the number of the processors 210 may be one or more. Meanwhile, in the multimedia information irregular screen distribution apparatus 200 according to the embodiment of the present application, an input device 230 and an output device 240 may be further included. The processor 210, the memory 220, the input device 230, and the output device 240 may be connected via a bus, or may be connected via other methods, which is not limited in detail herein.
The memory 220, which is a computer-readable storage medium, may be used to store software programs, computer-executable programs, and various modules, such as: the method for publishing the multimedia information special-shaped screen comprises the steps of displaying a program or a module corresponding to the method. The processor 210 executes various functional applications and data processing of the multimedia information irregular screen distribution apparatus 200 by executing software programs or modules stored in the memory 220.
The input device 230 may be used to receive an input number or signal. Wherein the signal may be a key signal generated in connection with user settings and function control of the device/terminal/server. The output device 240 may include a display device such as a display screen.
Having described embodiments of the present application, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (10)

1. A multimedia information special-shaped screen publishing method is characterized by comprising the following steps:
after receiving a program making command, acquiring the resolution of a currently input program;
performing program canvas layout according to the program resolution and the picture output resolution of each player configured by the client;
loading corresponding multimedia contents on the program canvas which is well laid out, and generating program contents which need to be displayed and played;
sending the program content and the segmentation information of the program content to the client, and performing playing and displaying of the program content cooperatively by each player in the client;
and the segmentation information is the corresponding relation between the sub canvas in the program canvas and the loaded multimedia content.
2. The method of claim 1, wherein loading the corresponding multimedia content on the laid out program canvas comprises:
and acquiring a control corresponding to the currently triggered multimedia content, and adding the corresponding multimedia content to the corresponding sub canvas in the program canvas according to the triggered control.
3. The method of claim 1, wherein the step of laying out the canvas of the program according to the program resolution and each of the picture output resolutions comprises:
calculating the multiple of the program resolution and the picture output resolution, and determining the horizontal coordinate pixel value and the vertical coordinate pixel value of the program canvas according to the multiple;
and determining the number of the sub-canvas and the arrangement mode of the sub-canvas based on the horizontal coordinate pixel value and the vertical coordinate pixel value of the program canvas.
4. A multimedia information special-shaped screen publishing method is characterized by comprising the following steps:
receiving the program content and the segmentation information, and distributing different areas of the program content to different players according to the segmentation information based on the picture output resolution of each player;
wherein different areas of the program content correspond to different sub-canvases in the program canvas;
and controlling the players to synchronously play different areas of the program content respectively.
5. The method of claim 4, wherein assigning different regions of the program content to different players according to the slicing information comprises:
determining different areas of the program content and program resolutions corresponding to the different areas of the program content based on the segmentation information;
and matching the picture output resolution of each player with the resolution of each program one by one, and correspondingly distributing different areas of the program content to different players according to the matching relation.
6. The method of claim 4, wherein controlling the players to synchronously play the different areas of the program content comprises:
determining a main player in each player, and monitoring the playing time of the main player in real time;
and controlling other players except the main player in each player to play the corresponding program content according to the reference time by taking the playing time of the main player as the reference time.
7. The method according to claim 6, wherein when the playing time of the main player is used as a reference time, and the other players in the players except the main player are controlled to play the corresponding program content according to the reference time, the error between the playing time of the other players except the main player and the reference time is less than or equal to 1 millisecond.
8. A multimedia information special-shaped screen publishing device is characterized by comprising a resolution acquisition module, a canvas layout module, a content loading module and a program sending module;
the resolution acquisition module is configured to acquire the resolution of the currently input program after receiving a program production instruction;
the canvas layout module is configured to perform program canvas layout according to the program resolution and the picture output resolution of each player configured by the client;
the content loading module is configured to load corresponding multimedia content on the program canvas which is well laid out, and generate program content which needs to be displayed and played;
the program sending module is configured to send the program content and the segmentation information of the program content to the client, and each player in the client collaboratively plays and displays the program content;
and the segmentation information is the corresponding relation between the sub canvas in the program canvas and the loaded multimedia content.
9. A multimedia information special-shaped screen publishing device is characterized by comprising a program distribution module and a synchronous playing module;
the program distribution module is configured to receive the program content and the segmentation information, and distribute different areas of the program content to different players according to the segmentation information based on picture output resolution of each player;
wherein different areas of the program content correspond to different sub-canvases in the program canvas;
the synchronous playing module is configured to control each of the players to synchronously play different areas of the program content.
10. A multimedia information dysmorphism screen publishing equipment, characterized by includes:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to carry out the method of any one of claims 1 to 3 when executing the executable instructions.
CN202010677062.1A 2020-07-14 2020-07-14 Multimedia information special-shaped screen publishing method, device and equipment Active CN111741349B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010677062.1A CN111741349B (en) 2020-07-14 2020-07-14 Multimedia information special-shaped screen publishing method, device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010677062.1A CN111741349B (en) 2020-07-14 2020-07-14 Multimedia information special-shaped screen publishing method, device and equipment

Publications (2)

Publication Number Publication Date
CN111741349A true CN111741349A (en) 2020-10-02
CN111741349B CN111741349B (en) 2022-08-02

Family

ID=72655348

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010677062.1A Active CN111741349B (en) 2020-07-14 2020-07-14 Multimedia information special-shaped screen publishing method, device and equipment

Country Status (1)

Country Link
CN (1) CN111741349B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114761912A (en) * 2020-10-27 2022-07-15 京东方科技集团股份有限公司 Terminal control method, device and system

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6473088B1 (en) * 1998-06-16 2002-10-29 Canon Kabushiki Kaisha System for displaying multiple images and display method therefor
KR20080087572A (en) * 2007-03-27 2008-10-01 (주)케이이씨디바이스 Method and device for controlling plural display device
JP2009139492A (en) * 2007-12-04 2009-06-25 Canon Inc Display control device and display control method
CN101894522A (en) * 2010-07-30 2010-11-24 深圳市中庆微科技开发有限公司 High-resolution universal display screen intelligent control system
CN102027450A (en) * 2008-05-20 2011-04-20 思杰***有限公司 Methods and systems for using external display devices with a mobile computing device
CN102695033A (en) * 2011-03-23 2012-09-26 夏普株式会社 Multi-display system
CN103686388A (en) * 2012-09-12 2014-03-26 武汉麦塔威科技有限公司 Video player system capable of playing ultrahigh resolution video
CN103744638A (en) * 2014-01-21 2014-04-23 国家电网公司 Multi-terminal combined display method
CN203675200U (en) * 2014-01-24 2014-06-25 北京泽视科技有限公司 Multi-image video processor
CN104375798A (en) * 2014-11-27 2015-02-25 中国科学技术大学 Method for displaying multimedia through multiple mobile intelligent device screens in combined mode
WO2015180433A1 (en) * 2014-05-27 2015-12-03 合一网络技术(北京)有限公司 Method and system for displaying interface streaming layout in adaptive adjustment mode
JP2016028472A (en) * 2014-07-10 2016-02-25 日本放送協会 Text content generation apparatus, transmission apparatus, reception apparatus, and program
CN105979198A (en) * 2015-03-12 2016-09-28 韩华泰科株式会社 Video wall security system
CN109164997A (en) * 2018-08-22 2019-01-08 南京南瑞信息通信科技有限公司 Distributed picture rendering and picture control method for playing back, device and equipment
CN109982004A (en) * 2019-05-20 2019-07-05 深圳市瑞众科技有限公司 A kind of point-to-point splicing system of video

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6473088B1 (en) * 1998-06-16 2002-10-29 Canon Kabushiki Kaisha System for displaying multiple images and display method therefor
KR20080087572A (en) * 2007-03-27 2008-10-01 (주)케이이씨디바이스 Method and device for controlling plural display device
JP2009139492A (en) * 2007-12-04 2009-06-25 Canon Inc Display control device and display control method
CN102027450A (en) * 2008-05-20 2011-04-20 思杰***有限公司 Methods and systems for using external display devices with a mobile computing device
CN101894522A (en) * 2010-07-30 2010-11-24 深圳市中庆微科技开发有限公司 High-resolution universal display screen intelligent control system
CN102695033A (en) * 2011-03-23 2012-09-26 夏普株式会社 Multi-display system
CN103686388A (en) * 2012-09-12 2014-03-26 武汉麦塔威科技有限公司 Video player system capable of playing ultrahigh resolution video
CN103744638A (en) * 2014-01-21 2014-04-23 国家电网公司 Multi-terminal combined display method
CN203675200U (en) * 2014-01-24 2014-06-25 北京泽视科技有限公司 Multi-image video processor
WO2015180433A1 (en) * 2014-05-27 2015-12-03 合一网络技术(北京)有限公司 Method and system for displaying interface streaming layout in adaptive adjustment mode
JP2016028472A (en) * 2014-07-10 2016-02-25 日本放送協会 Text content generation apparatus, transmission apparatus, reception apparatus, and program
CN104375798A (en) * 2014-11-27 2015-02-25 中国科学技术大学 Method for displaying multimedia through multiple mobile intelligent device screens in combined mode
CN105979198A (en) * 2015-03-12 2016-09-28 韩华泰科株式会社 Video wall security system
CN109164997A (en) * 2018-08-22 2019-01-08 南京南瑞信息通信科技有限公司 Distributed picture rendering and picture control method for playing back, device and equipment
CN109982004A (en) * 2019-05-20 2019-07-05 深圳市瑞众科技有限公司 A kind of point-to-point splicing system of video

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114761912A (en) * 2020-10-27 2022-07-15 京东方科技集团股份有限公司 Terminal control method, device and system

Also Published As

Publication number Publication date
CN111741349B (en) 2022-08-02

Similar Documents

Publication Publication Date Title
CN109671147B (en) Texture map generation method and device based on three-dimensional model
CN109840114A (en) Page processing method and mobile terminal
CN102053871A (en) Application program image display method and device
CN108647080A (en) Applied to the information processing method and device and computer readable storage medium in terminal
CN103414950A (en) Interface display method, device, set top box and server
CN111741349B (en) Multimedia information special-shaped screen publishing method, device and equipment
US11995371B2 (en) Dividing method, distribution method, medium, server, system
CN111971971B (en) Method and system for eliminating guest live delay in live broadcast and non-transitory computer readable recording medium
CN111290680B (en) List display method, device, terminal and storage medium
CN113617026B (en) Cloud game processing method and device, computer equipment and storage medium
US7030876B2 (en) System and method for three-dimensional imaging
CN111857521A (en) Multi-device management method and device and integrated display control system
CN112181329B (en) Data display method and device
CN112651801B (en) Method and device for displaying house source information
CN111831497B (en) Equipment simulation method and device, storage medium and simulation terminal
CN114327220A (en) Virtual display system and method
CN111104196B (en) Wallpaper display method and terminal equipment
CN111158618A (en) Method and equipment for displaying pattern based on mobile terminal
CN111522518B (en) Screen synchronous display method, device and system and electronic equipment thereof
CN105005850A (en) Method and apparatus for updating virtual audiences
CN115079978A (en) Scene interaction display method and device, server equipment and storage medium
CN111344744A (en) Method for presenting a three-dimensional object, and related computer program product, digital storage medium and computer system
CN113111035B (en) Special effect video generation method and equipment
CN115390775A (en) Multi-screen space collaborative display control method, system, equipment and storage medium
CN115576346A (en) Method and system for displaying formation airplane light matrix subtitles in split screen mode and application

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant