CN107872721B - Multimedia data transmission method, terminal and computer readable medium - Google Patents
Multimedia data transmission method, terminal and computer readable medium Download PDFInfo
- Publication number
- CN107872721B CN107872721B CN201711182236.1A CN201711182236A CN107872721B CN 107872721 B CN107872721 B CN 107872721B CN 201711182236 A CN201711182236 A CN 201711182236A CN 107872721 B CN107872721 B CN 107872721B
- Authority
- CN
- China
- Prior art keywords
- multimedia data
- terminal
- sub
- information
- control instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000005540 biological transmission Effects 0.000 title claims abstract description 32
- 238000004891 communication Methods 0.000 claims description 26
- 238000012545 processing Methods 0.000 claims description 21
- 238000004806 packaging method and process Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 4
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 230000003247 decreasing effect Effects 0.000 claims description 2
- 230000006870 function Effects 0.000 description 9
- 230000008569 process Effects 0.000 description 5
- 238000012546 transfer Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007334 memory performance Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000012146 running buffer Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a multimedia data transmission method, a terminal and a computer readable medium, wherein the method comprises the following steps: receiving a control instruction sent by a sub-terminal, wherein the control instruction comprises multimedia data information and hardware information of the sub-terminal; acquiring multimedia data according to the multimedia data information; determining a coding mode according to the hardware information, and coding the decoded multimedia data according to the coding mode; and encapsulating the coded multimedia data and sending the encapsulated multimedia data to the sub-terminal. The multimedia data transmission method, the terminal and the computer readable medium provided by the embodiment of the invention can send the media service to the sub-terminal under the condition of ensuring the normal terminal service, expand the media service of an operator to the sub-terminal, meet the requirements of family entertainment services and improve the market competitiveness of products.
Description
Technical Field
Embodiments of the present invention relate to communications technologies, and in particular, to a multimedia data transmission method, a terminal, and a computer-readable medium.
Background
The terminal in the invention refers to an intelligent terminal comprising an intelligent set top box and an intelligent television. The intelligent set top box is a set top box carrying an Aliyun or android system, and can realize functions of controlling intelligent home, browsing webpages, watching movies, watching televisions, listening to music, chatting QQ, playing games and the like besides functions of watching televisions and videos of a traditional television box. The smart television is a television product which is based on an Internet application technology, has an open operating system and a chip, has an open application platform, can realize a bidirectional man-machine interaction function, integrates various functions such as audio and video, entertainment, data and the like, and meets the diversified and personalized requirements of users.
Currently, intelligent terminals represented by IPTV (Internet Protocol Television) and OTT TV (Over-The-Top TV) are widely used. Generally, one IPTV terminal can only connect to one tv screen to perform one service (media service, internet access, game playing, etc.), but cannot connect to other sub-terminals (mobile phone, pad, computer, smart set-top box, smart tv, etc.) and send different multimedia data to other sub-terminals. For example, when the member a watches a movie using the IPTV terminal in the living room, the member b cannot acquire NBA live data from the IPTV terminal through the child terminal.
One OTT TV terminal can be connected with other sub-terminals to realize a multi-screen interaction function, namely, one OTT TV terminal can be simultaneously connected with a mobile phone, a pad and a computer and can transfer multimedia data such as audio, images, videos and the like in the mobile phone, the pad and the computer to an OTT TV terminal screen for playing, but the multimedia data played by the multi-screen is consistent, and the function that other sub-terminals obtain different multimedia data from the terminals still cannot be realized.
Disclosure of Invention
In view of this, embodiments of the present invention provide a multimedia data transmission method, a terminal and a computer readable medium, which can send a media service to a sub-terminal under the condition that a terminal service is guaranteed to be normal, so as to extend an operator media service to the sub-terminal, thereby satisfying a requirement of a home entertainment service and improving market competitiveness of a product.
In a first aspect, an embodiment of the present invention provides a multimedia data transmission method, including:
receiving a control instruction sent by a sub-terminal, wherein the control instruction comprises multimedia data information and hardware information of the sub-terminal;
acquiring multimedia data according to the multimedia data information;
determining a coding mode according to the hardware information, and coding the decoded multimedia data according to the coding mode;
and encapsulating the coded multimedia data and sending the encapsulated multimedia data to the sub-terminal.
In a second aspect, an embodiment of the present invention provides a terminal, including:
one or more processors;
a memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the multimedia data transmission method according to any embodiment of the present invention.
In a third aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a multimedia data transmission method according to any embodiment of the present invention.
According to the multimedia data transmission method, the terminal and the computer readable medium provided by the embodiment of the invention, the terminal can acquire corresponding multimedia data and a coding mode according to the sub-terminal control instruction, code the decoded multimedia data according to the coding mode, and send the coded data to the sub-terminal, so that the function of sending different multimedia data to the sub-terminal is realized, the requirement of family entertainment service is met, and the market competitiveness of products is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description will be given below of the drawings required for the embodiments or the technical solutions in the prior art, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart of a multimedia data transmission method according to an embodiment of the present invention;
fig. 2 is a flowchart of a multimedia data transmission method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a terminal according to a third embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described through embodiments with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
Fig. 1 is a flowchart of a multimedia data transmission method according to an embodiment of the present invention, where this embodiment is applicable to a situation where a terminal sends a media service to a sub-terminal, and the method may be implemented by a terminal, for example, an intelligent set-top box, an intelligent television, and the like, and may be implemented by software and/or hardware in the terminal.
Referring to fig. 1, the multimedia data transmission method includes the steps of:
s110, receiving a control instruction sent by the sub-terminal, wherein the control instruction comprises multimedia data information and hardware information of the sub-terminal.
The sub-terminal can be a mobile phone, a pad, a computer, an intelligent set-top box, an intelligent television and other terminals.
The multimedia data information may be a program name or a movie name, a broadcast channel and broadcast time, or multimedia data information selected by the sub-terminal according to a multimedia data list of the terminal, such as a multimedia data list number.
The multimedia list can be that after the terminal establishes communication connection with the sub-terminal, the multimedia data list is actively sent to the sub-terminal; or the terminal establishes communication connection with the sub-terminal, and sends the multimedia data list to the sub-terminal after receiving the request of acquiring the multimedia data list from the sub-terminal. The multimedia data list may be a live program list, an on-demand program list, or the like.
The hardware information refers to hardware information related to the execution of the media service by the sub-terminal, and may be, for example, a Central Processing Unit (CPU) running speed, a Digital Signal Processor (DSP) Processing capability, a screen resolution, an audio/video compatible format, and the like.
And S120, acquiring multimedia data according to the multimedia data information.
And after receiving the multimedia data information sent by the sub-terminal, the main terminal analyzes the multimedia data information and acquires the multimedia data corresponding to the multimedia data information from the server through a related transmission protocol. Related transmission protocols include, but are not limited to, local FILE Transfer Protocol (FILE), hypertext Transfer Protocol (HTTP), Real Time Streaming Protocol (RTSP), User Datagram Protocol (UDP), Real-Time Transport Protocol (RTP), and Internet Group Management Protocol (IGMP).
Optionally, the multimedia data is acquired according to the multimedia data information, and specifically, the method may include:
analyzing the address information of the multimedia data information; sending a request to the multimedia server according to the address information so that the multimedia server can call corresponding multimedia data; and receiving the multimedia data fed back by the multimedia server.
And S130, determining a coding mode according to the hardware information, and coding the decoded multimedia data according to the coding mode.
The encoding mode is a mode in which the terminal decodes the received multimedia data and then re-encodes the decoded multimedia data to generate multimedia data that can be processed by the sub-terminals. The encoding mode includes configuration parameters, and the configuration parameters may be parameters such as a code rate, a video resolution, a frame rate, and an encoding format.
Wherein the encoding mode corresponds to the hardware information. The configuration parameters included in the encoding method and the corresponding relationship between the encoding method and the hardware information may be stored in the terminal in advance or stored in the multimedia server in advance. The corresponding relationship between the hardware information and the encoding mode may be stored in a table, set global variables, or other modes.
After the terminal receives the hardware information of the sub-terminal, searching a coding mode matched with the hardware information, and calling configuration parameters in the coding mode for configuring the encoder if the searching is successful; if the search fails, the encoder may be configured using a default encoding scheme. The default coding mode can be a coding mode during terminal initialization, and can also be a coding mode set by a user through a reserved setting entrance.
Optionally, the hardware information includes a first resolution of the sub-terminal and an audio-video compatible format, where the first resolution refers to a screen resolution of the sub-terminal; correspondingly, the encoding mode includes a second resolution and an encoding format, wherein the second resolution refers to the resolution of the encoded multimedia data. On this basis, determining an encoding mode according to the hardware information, and encoding the decoded multimedia data according to the encoding mode may include:
determining an encoding mode according to the first resolution and the audio-video compatible format, wherein the encoding mode comprises a second resolution and an encoding format, the second resolution is matched with the first resolution, and the encoding format is matched with the audio-video compatible format;
and configuring a target encoder according to the encoding mode, and encoding the decoded multimedia data based on the target encoder.
The second resolution is matched with the first resolution, that is, the resolution of the sub-terminal screen is matched with the resolution of the encoded multimedia data, for example, when the resolution of the sub-terminal screen is 720p, the resolution of the multimedia data may be set to be less than or equal to 720p, and when the resolution of the sub-terminal screen is 1080p, the resolution of the multimedia data may be set to be less than or equal to 1080 p; the matching of the encoding format and the audio-video compatible format means that the audio-video compatible format of the sub-terminal comprises an encoding format type, namely the encoded multimedia data format can be compatible with the sub-terminal.
The encoding process may be performed synchronously with the decoding process, and the Video encoding format of the encoded multimedia data may be an Advanced Video Coding (AVC), i.e., h.264 standard. The Audio encoding format may be an Advanced Audio Coding (AAC) format.
Alternatively, the target encoder is a hard encoder, such as a Media Codec module or a hard coding module developed based on Software Development Kit (SDK). In the embodiment, the decoded multimedia data is hard-coded by using the hard encoder, so that the multimedia data can be coded under the condition of less CPU resource occupation, the coding rate of the terminal can be improved, and the normal operation of the terminal is ensured.
And S140, packaging the coded multimedia data and sending the multimedia data to the sub-terminal.
Among them, the encapsulation format includes, but is not limited to, Audio Video Interleaved (AVI), streaming media Format (FLV), Moving Picture Experts Group (MP 4), Variable bit rate format (RMVB), and Transport Stream format (TS).
And the terminal sends the encapsulated multimedia data to the sub-terminal through a related transmission protocol. Related transmission protocols include, but are not limited to, local FILE Transfer (FILE) Protocol, hypertext Transfer Protocol (HTTP), Real Time Streaming Protocol (RTSP), User Datagram Protocol (UDP), Real-Time Transport Protocol (RTP), and Internet Group Management Protocol (IGMP).
The terminal can execute the steps and the self service (media service, surfing, playing games and the like) at the same time without mutual influence, namely the terminal can send the media service to the sub-terminal under the condition of ensuring the self service to be normal, and the media service of an operator is expanded to the sub-terminal.
Illustratively, a user a watches a television program through a terminal, a user B can establish a communication channel with the terminal through a sub-terminal, and send a control instruction containing a movie name to the terminal, wherein the movie is in an operator media service borne by the terminal, and the terminal can obtain multimedia data of the movie through a server and send the multimedia data to the sub-terminal of the user B after encoding without affecting the normal use of the terminal, thereby satisfying different requirements of the user a and the user B, and improving the intellectualization of multimedia playing and user experience.
For example, different users can acquire playing contents of different time periods in the live program based on the above manner.
According to the multimedia data transmission method provided by the embodiment, the terminal can acquire corresponding multimedia data and a coding mode according to the sub-terminal control instruction, the decoded multimedia data are coded according to the coding mode, and the coded data are sent to the sub-terminal, so that the function of sending different multimedia data to the sub-terminal is realized when the terminal normally operates, the requirement of multi-user entertainment service is met, and the market competitiveness of products is improved.
On the basis of the above embodiment, after acquiring the multimedia data according to the multimedia data information in step S120, the method may further include:
acquiring parameter information of the multimedia data, and judging whether the parameter information is matched with the hardware information;
if yes, packaging the multimedia data and sending the multimedia data to the sub-terminal;
if not, determining the encoding mode according to the hardware information.
The parameter information of the multimedia data may include resolution, audio/video format, and the like of the multimedia data. If the parameter information of the multimedia data is consistent with the hardware information, that is, the parameter information of the multimedia data is matched with the hardware information, the sub-terminal can directly process the multimedia data, does not need the main terminal to perform decoding and encoding steps, and can directly package and send the multimedia data. If the parameter information of the multimedia data is inconsistent with the hardware information, that is, the parameter information of the multimedia data is not matched with the hardware information, the main terminal can perform encapsulation and transmission after performing the decoding and encoding steps.
Whether the encoder is configured or not can be selected by judging whether the parameter information of the multimedia data is matched with the hardware information, so that the efficiency of transmitting the multimedia data to the sub-terminal is improved, and the user experience is improved.
Example two
Fig. 2 is a flowchart of a multimedia data transmission method according to a second embodiment of the present invention, and this embodiment provides a preferred implementation manner based on the above embodiment, so as to implement a method for a terminal to send multimedia data to a plurality of sub-terminals, and further select and respond to a sub-terminal control instruction policy according to a terminal real-time resource usage. The same or corresponding terms as those of the above-described embodiments are explained, and the description of the present embodiment is omitted.
Referring to fig. 2, the multimedia data transmission method in this embodiment includes:
s210, establishing at least one communication channel with at least one sub-terminal.
When the terminal executes the service, a plurality of communication channels can be opened up for monitoring whether the sub-terminal establishes communication connection with the terminal in real time. And when a sub-terminal establishes communication connection with the terminal, the terminal receives a sub-terminal control instruction and sends multimedia data to the sub-terminal based on one unoccupied communication channel. The unoccupied communication channel means that the terminal does not communicate with the sub-terminal through the communication channel.
Wherein the terminal can communicate with a plurality of sub-terminals through a plurality of communication channels. The number of the communication channels may be a preset fixed value, or may be increased or decreased according to the real-time resource usage of the terminal. For example, the number of communication channels may be preset to a fixed value of 3; or when the opened 2 communication channels are occupied, if the 3 rd sub-terminal requests to connect with the terminal and the real-time resource of the terminal can be supported, the 3 rd communication channel is opened up to communicate with the 3 rd sub-terminal, and one communication channel can be reduced after the communication of any one of the sub-terminals is terminated.
S220, the multimedia data list is sent to at least one sub-terminal based on at least one communication channel.
After the terminal establishes communication connection with at least one sub-terminal, the multimedia data list can be sent to the at least one sub-terminal through a corresponding communication channel occupied by the sub-terminal. The sub-terminal may generate the multimedia data information according to the multimedia data list sent by the terminal, for example, a number of a program desired to be viewed in the list may be selected according to the multimedia data list, where the number of the program is the multimedia data information.
And S230, receiving a control instruction sent by the sub-terminal, wherein the control instruction comprises multimedia data information and hardware information of the sub-terminal.
S240, determining at least one multimedia data according to at least one control instruction sent by at least one sub-terminal, and sending the encapsulated at least one multimedia data to the corresponding sub-terminal.
In this embodiment, the step S240 substantially corresponds to the steps S120 to S140 in the first embodiment, wherein after the terminal receives at least one control command of at least one sub-terminal, a multimedia data is obtained according to the multimedia data information in each control command; determining a coding mode according to the hardware information of the sub-terminal in each control instruction, and coding the decoded multimedia data corresponding to the control instruction according to the coding mode; and packaging each coded multimedia data, and sending the multimedia data to the sub-terminal corresponding to each control instruction.
Optionally, after acquiring the at least one multimedia data according to the at least one multimedia data information, the method may further include:
acquiring parameter information of multimedia data, and judging whether the parameter information is matched with corresponding sub-terminal hardware information; if yes, packaging the multimedia data and sending the multimedia data to the corresponding sub-terminal; if not, determining the coding mode according to the hardware information of the corresponding sub-terminal.
Optionally, after receiving the control instruction sent by at least one of the child terminals, the method further includes:
acquiring current real-time resource information, wherein the real-time resource information comprises a CPU utilization rate, the number of idle encoders and a cache residual space; judging whether the current real-time resource information meets the processing condition of the control instruction; if so, processing the control instruction; if not, storing the control instruction to a preset position.
The terminal acquires and judges the real-time resource use condition after receiving at least one sub-terminal control instruction, and acquires corresponding multimedia data according to the sub-terminal control instruction if the real-time resource use condition can support responding to the sub-terminal control instruction, and sends the multimedia data to the sub-terminal through the steps of decoding, encoding and packaging; if the real-time resource usage does not support the control command of the response sub-terminal, the control command of the sub-terminal is stored to a preset position to wait for being processed. If the child terminal terminates the communication connection with the terminal when the child terminal control command has not been processed, the control command may be deleted after a predetermined time.
The real-time resource usage may include CPU usage, the number of idle encoders, and the size of the cache remaining space.
The CPU utilization rate refers to the percentage of the currently running program occupying the CPU resource, the more the running programs are processed, the higher the utilization rate is, when the CPU utilization rate reaches the preset utilization rate, it is determined that the control instruction processing condition of the sub terminal is not satisfied, for example, the preset utilization rate is 68%, and when the CPU utilization rate is higher than 68%, it is determined that the remaining 32% of the available space of the CPU is insufficient to support the processing of the control instruction of the sub terminal. The preset utilization rate can be set by a user in a self-defined way through a reserved setting entrance; and the user-defined setting can be carried out according to the CPU performance of the terminal.
If the idle encoder exists, judging that the control instruction processing condition of the sub-terminal is met; and if no idle encoder exists, judging that the control instruction processing condition of the sub-terminal is not met.
The size of the residual buffer space is the condition that the terminal CPU occupies the running buffer in the processing processes of decoding, encoding and the like of the acquired multimedia data. The smaller the cache residual space is, the more memory address areas occupied by the CPU in the process of processing the multimedia data are indicated, and when the residual space is smaller than a preset value, the control instruction processing condition of the sub-terminal is judged not to be met. For example, the preset value of the cache remaining space may be 10M, and when the cache remaining space is less than 10M, it is determined that the cache remaining space is not enough to support processing of the sub-terminal control instruction. The residual space preset value can be set by a user in a self-defined way through a reserved setting inlet; and the user-defined setting can be carried out according to the running memory performance of the terminal.
The performance of processing control instructions of the terminal is further optimized by selecting a strategy for responding to the sub-terminal control instructions according to the real-time resource use condition of the terminal.
On the basis of the above scheme, optionally, before obtaining the current real-time resource information, the method may further include:
sequencing at least one control instruction according to time sequence or priority;
correspondingly, when the current real-time resource information meets the processing condition of the control instruction, processing the control instruction according to the sequence;
after the control instruction is stored to the preset position, the method further comprises the following steps:
and acquiring the current real-time resource information according to a preset time interval, and judging whether the current real-time resource information meets the control instruction processing condition.
By sequencing at least one control instruction according to the time sequence or the priority, a control instruction response strategy can be further optimized, so that the sub-terminal with the higher priority or the sub-terminal with the earlier control instruction time sequence preferentially acquires the requested multimedia data, and the user experience can be further improved.
When the control instruction is stored to a preset position to wait for being processed, the terminal can also acquire the current real-time resource information according to a preset time interval, and when the current real-time resource information is judged to meet the processing condition of the control instruction, the control instruction can be sequentially processed according to the control instruction time sequence or the priority order.
The multimedia data transmission method provided by this embodiment implements sending the media service to the plurality of sub-terminals by the terminal under the condition that the service of the terminal is guaranteed to be normal by establishing the plurality of communication channels, and extends the media service of the operator to the plurality of sub-terminals. And based on the control instructions of the plurality of sub-terminals, a control instruction response strategy is further optimized according to the real-time resource use information of the terminal, and the user operation experience is improved.
EXAMPLE III
The embodiment provides a terminal, which can be used in the case that the terminal sends a media service to a sub-terminal. Fig. 3 is a schematic structural diagram of a terminal according to a third embodiment of the present invention. Referring to fig. 3, the terminal includes:
one or more processors 310;
a memory 320 for storing one or more programs;
when the one or more programs are executed by the one or more processors 310, the one or more processors 310 may implement the multimedia data transmission method as set forth in embodiments one to two.
In FIG. 3, a processor 310 is illustrated as an example; the processor 310 and the memory 320 may be connected by a bus or other means, such as the bus connection shown in FIG. 3.
The memory 320 is a computer-readable storage medium for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the multimedia data transmission method in the embodiment of the present invention. The processor 310 executes various functional applications of the terminal and data processing by executing software programs, instructions, and modules stored in the memory 320, that is, implements the above-described multimedia data transmission method.
The memory 320 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 320 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 320 may further include memory located remotely from the processor 310, which may be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
In addition, according to different forms of the terminal, the terminal may include other modules or structures besides the processor 310 and the memory 320, for example, the terminal may be a smart tv, and may further include a tv screen, a speaker, physical keys, and the like.
The terminal provided in this embodiment and the multimedia data transmission method provided in embodiments one to two belong to the same inventive concept, and technical details not described in detail in this embodiment can be referred to in embodiments one to two, and this embodiment and embodiments one to two have the same beneficial effects.
Example four
The present embodiment provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the multimedia data transmission method as set forth in embodiments one to two.
The computer-readable storage medium of the present embodiment and the multimedia data transmission method of the first to second embodiments belong to the same inventive concept, and technical details not described in detail in the present embodiment can be referred to in the first to second embodiments, and the present embodiment and the first to second embodiments have the same advantageous effects.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (6)
1. A method for multimedia data transmission, comprising:
establishing at least one communication channel with at least one sub-terminal, wherein the number of the communication channels is increased or decreased according to the real-time resource use condition of the terminal;
transmitting a multimedia data list to the at least one sub-terminal based on the at least one communication channel;
receiving at least one control instruction sent by at least one sub-terminal, wherein the control instruction comprises multimedia data information and hardware information of the sub-terminal, and the hardware information at least comprises a first resolution of the sub-terminal and an audio-video compatible format;
sequencing at least one control instruction according to time sequence or priority;
acquiring current real-time resource information, wherein the real-time resource information comprises a CPU (Central processing Unit) utilization rate, the number of idle encoders and cache residual space;
judging whether the current real-time resource information meets a control instruction processing condition;
if so, acquiring at least one multimedia data corresponding to at least one multimedia data information according to the sequence;
determining at least one coding mode according to hardware information of at least one sub-terminal, and coding at least one decoded multimedia data according to the at least one coding mode;
packaging the encoded at least one multimedia data, and sending the packaged at least one multimedia data to a corresponding sub-terminal;
if not, storing the control instruction to a preset position; acquiring current real-time resource information according to a preset time interval, and judging whether the current real-time resource information meets a control instruction processing condition;
the method for determining at least one coding mode according to the hardware information of at least one sub-terminal and coding at least one decoded multimedia data according to the at least one coding mode includes:
searching the coding mode according to the first resolution and the audio-video compatible format based on the corresponding relation between the pre-stored hardware information and the coding mode;
if the searching is successful, calling a second resolution and a coding format in the coding mode, wherein the second resolution is matched with the first resolution, and the coding format is matched with the audio-video compatible format;
if the search fails, taking a default coding mode as the coding mode;
and configuring a target encoder according to the encoding mode, and encoding the decoded multimedia data based on the target encoder.
2. The method of claim 1, wherein obtaining multimedia data according to the multimedia data information comprises:
analyzing the address information of the multimedia data information;
sending a request to a multimedia server according to the address information so that the multimedia server can call corresponding multimedia data;
and receiving the multimedia data fed back by the multimedia server.
3. The method of claim 1, wherein the target encoder is a hard encoder.
4. The method of claim 1, further comprising, after obtaining at least one multimedia data corresponding to the at least one multimedia data information according to the ordering, the steps of:
acquiring parameter information of the multimedia data, and judging whether the parameter information is matched with the hardware information;
if yes, packaging the multimedia data and sending the multimedia data to the sub-terminal;
if not, determining the encoding mode according to the hardware information.
5. A terminal, characterized in that the terminal comprises:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the method of multimedia data transmission according to any one of claims 1-4.
6. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of multimedia data transmission according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711182236.1A CN107872721B (en) | 2017-11-23 | 2017-11-23 | Multimedia data transmission method, terminal and computer readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711182236.1A CN107872721B (en) | 2017-11-23 | 2017-11-23 | Multimedia data transmission method, terminal and computer readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107872721A CN107872721A (en) | 2018-04-03 |
| CN107872721B true CN107872721B (en) | 2020-12-11 |
Family
ID=61754641
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711182236.1A Active CN107872721B (en) | 2017-11-23 | 2017-11-23 | Multimedia data transmission method, terminal and computer readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107872721B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108615531A (en) * | 2018-04-28 | 2018-10-02 | 上海与德科技有限公司 | A kind of speaker control method, device, terminal and computer-readable medium |
| CN108965900A (en) * | 2018-06-22 | 2018-12-07 | 中央电视台 | New media live broadcasting method and device, storage medium |
| CN110768932A (en) * | 2018-07-27 | 2020-02-07 | 视联动力信息技术股份有限公司 | Data transmission method and device |
| CN111294321B (en) * | 2018-12-07 | 2022-07-26 | 北京字节跳动网络技术有限公司 | Information processing method and device |
| CN110113669B (en) * | 2019-06-14 | 2021-07-16 | 北京达佳互联信息技术有限公司 | Method and device for acquiring video data, electronic equipment and storage medium |
| CN111416988B (en) * | 2020-03-26 | 2021-10-01 | 四川长虹电器股份有限公司 | Control method for realizing multi-screen playing on set-top box based on IPTV network |
| CN112422514B (en) * | 2020-10-26 | 2024-06-07 | 深圳Tcl新技术有限公司 | Multimedia data transmission method and device, intelligent household equipment and storage medium |
| CN114363301B (en) * | 2021-12-08 | 2022-08-23 | 慧之安信息技术股份有限公司 | Multimedia data offline loading method based on localStorage |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102014341A (en) * | 2010-12-02 | 2011-04-13 | 深圳市同洲电子股份有限公司 | Multi-media data transmission method and system |
| CN103024523A (en) * | 2012-12-07 | 2013-04-03 | 康佳集团股份有限公司 | Method and system for sharing television programs based on set top box (STB) |
| CN104602118A (en) * | 2013-10-30 | 2015-05-06 | ***通信集团公司 | Multimedia data output method and equipment |
| CN104811794A (en) * | 2014-01-27 | 2015-07-29 | 中兴通讯股份有限公司 | Medium data transmitting method, device and set top box |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101781869B1 (en) * | 2011-06-16 | 2017-09-26 | 엘지전자 주식회사 | Apparatus for tranforming image |
-
2017
- 2017-11-23 CN CN201711182236.1A patent/CN107872721B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102014341A (en) * | 2010-12-02 | 2011-04-13 | 深圳市同洲电子股份有限公司 | Multi-media data transmission method and system |
| CN103024523A (en) * | 2012-12-07 | 2013-04-03 | 康佳集团股份有限公司 | Method and system for sharing television programs based on set top box (STB) |
| CN104602118A (en) * | 2013-10-30 | 2015-05-06 | ***通信集团公司 | Multimedia data output method and equipment |
| CN104811794A (en) * | 2014-01-27 | 2015-07-29 | 中兴通讯股份有限公司 | Medium data transmitting method, device and set top box |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107872721A (en) | 2018-04-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107872721B (en) | Multimedia data transmission method, terminal and computer readable medium | |
| US9137559B2 (en) | Apparatus and method for providing media programming | |
| US9457271B2 (en) | Method and apparatus for managing a gaming application | |
| KR102506963B1 (en) | Receiving device, sending device, and data processing method | |
| CN102790921B (en) | Method and device for choosing and recording partial screen area of multi-screen business | |
| CN103024523A (en) | Method and system for sharing television programs based on set top box (STB) | |
| WO2018103644A1 (en) | Live stream sharing method and device, home media apparatus, and data storage medium | |
| CN106464933B (en) | Apparatus and method for remotely controlling rendering of multimedia content | |
| KR101354925B1 (en) | Method for controlling receiving of content data through a plurality of wireless networks connected in multiple mode and an apparatus for said method | |
| US20130185745A1 (en) | Method, system and television for picture reproduction | |
| JP7100052B2 (en) | Electronic device and its control method | |
| US20140150031A1 (en) | Method and apparatus for accessing media content | |
| CN103763614A (en) | Intelligent cloud IPTV terminal system and implementation method thereof | |
| CN107547517B (en) | Audio and video program recording method, network equipment and computer device | |
| US11218759B2 (en) | Dynamic playlist customization by adaptive streaming client | |
| RU2602831C1 (en) | Method and apparatus for reproducing multimedia data | |
| CN104780424A (en) | Local area network live video distribution method based on set-top box | |
| CN113114978A (en) | Multi-device video negotiation transmission method, system and related device | |
| JP6621484B2 (en) | Computer-readable recording medium storing a program for providing network adaptive content and network adaptive content providing apparatus | |
| US20190098351A1 (en) | Method for managing the access right to an item of digital content | |
| CN113923510B (en) | Method, device, equipment and readable storage medium for forwarding digital television content | |
| WO2018054349A1 (en) | Data sending and receiving methods, and apparatuses and systems thereof | |
| WO2021175394A1 (en) | System and method for providing multicast to unicast services | |
| CN112565655A (en) | Video data yellow identification method and device, electronic equipment and storage medium | |
| CN113747181A (en) | Network live broadcast method, live broadcast system and electronic equipment based on remote desktop |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |