CN114401422A - Video transmission method, device and system - Google Patents
Video transmission method, device and system Download PDFInfo
- Publication number
- CN114401422A CN114401422A CN202111516355.2A CN202111516355A CN114401422A CN 114401422 A CN114401422 A CN 114401422A CN 202111516355 A CN202111516355 A CN 202111516355A CN 114401422 A CN114401422 A CN 114401422A
- Authority
- CN
- China
- Prior art keywords
- video
- resolution
- video block
- transmitted
- parameters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 88
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000006872 improvement Effects 0.000 claims abstract description 53
- 238000013528 artificial neural network Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 230000009471 action Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011478 gradient descent method Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002787 reinforcement Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a video transmission method, a device and a system, wherein the method is applied to a server and comprises the following steps: receiving a video request of a user side; determining current transmission resolution and resolution improvement value according to the relevant parameter and current state parameter of the last video block transmitted carried by the video request; and after obtaining the video block to be transmitted with the current transmission resolution, transmitting the video block to be transmitted and the resolution improvement value to the user side. The server integrates the relevant parameters for transmitting the previous video block and the factors in various aspects of the current state parameters to dynamically decide the resolution improvement size of the resolution of the next video block, so that the average transmission code rate can be reduced, the bandwidth requirement can be reduced, the overall user experience can be improved, and the optimal video transmission service can be realized.
Description
Technical Field
The invention relates to the technical field of video transmission, in particular to a video transmission method, a video transmission device and a video transmission system.
Background
In video transmission services, in order to improve the quality of the video transmission services, a dynamic bitrate technique is generally used.
In the related art, the main consideration is the dynamics of the network state to optimize the video transmission service, i.e. the resolution size of the transmitted video is dynamically decided according to the change of the network state.
However, at present, the transmission mode only considering the network state cannot realize the optimal video transmission service.
Disclosure of Invention
The present invention provides a video transmission method, apparatus and system for overcoming the above-mentioned deficiencies in the prior art, and the object is achieved by the following technical solutions.
The first aspect of the present invention provides a video transmission method, which is applied to a server, and the method includes:
receiving a video request from a user side;
determining the current transmission resolution and a resolution improvement value according to the relevant parameters and the current state parameters of the last video block transmitted, which are carried by the video request;
and after the video block to be transmitted with the current transmission resolution is obtained, transmitting the video block to be transmitted and the resolution improvement value to the user side.
A second aspect of the present invention provides a video transmission method, where the method is applied to a user side, and the method includes:
receiving a video block and a resolution improvement value transmitted by a server;
according to the resolution enhancement value, carrying out resolution enhancement on the video block, and playing the video block with the enhanced resolution;
acquiring current state parameters and parameters related to the video block;
and generating a video request aiming at the next video block according to the parameters related to the video block and the current state parameters, and sending the video request to the server.
A third aspect of the present invention provides a video transmission apparatus, which is applied to a server, the apparatus including:
the request receiving module is used for receiving a video request from a user side;
a determining module, configured to determine a current transmission resolution and a resolution improvement value according to a related parameter and a current state parameter of a last video block transmitted in the video request;
and the transmission module is used for transmitting the video block to be transmitted and the resolution improvement value to the user side after acquiring the video block to be transmitted with the current transmission resolution.
A fourth aspect of the present invention provides a video transmission apparatus, which is applied to a user side, and includes:
the video receiving module is used for receiving the video block and the resolution improvement value transmitted by the server;
the video playing module is used for carrying out resolution enhancement on the video block according to the resolution enhancement value and playing the video block with the resolution enhanced;
a parameter obtaining module, configured to obtain a current state parameter and a parameter related to the video block;
and the request sending module is used for generating a video request containing parameters related to the video block and the current state parameters and sending the video request to the server.
A fifth aspect of the present invention provides a video transmission system, comprising:
the server is used for determining the current transmission resolution and the resolution improvement value according to the relevant parameters and the current state parameters of the last video block transmitted, which are carried by the video request, after receiving the video request from the user terminal; after the video block to be transmitted with the current transmission resolution is obtained, the video block to be transmitted and the resolution improvement value are transmitted to the user side;
the user side is used for carrying out resolution enhancement on the received video block to be transmitted according to the received resolution enhancement value and playing the video block with the resolution enhanced; acquiring current state parameters and parameters related to the video block; and generating a video request aiming at the next video block according to the parameters related to the video block and the current state parameters, and sending the video request to the server.
A sixth aspect of the present invention proposes a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the method according to the first or second aspect as described above.
Based on the video transmission method described in the first aspect and the second aspect, the present application has the following beneficial effects:
when a user terminal requests each video block, considering that the computing capability of the user terminal is poor compared with that of a server, the current state parameters and the related parameters of the previous video block are all sent to the server, the server decides the resolution and the resolution improvement size of the next video block to be transmitted according to the related parameters and the factors of the current state parameters, so that after the video block with the resolution is obtained, the obtained video block and the resolution improvement size obtained by the decision are transmitted to the user terminal, the user terminal carries out resolution improvement on the received video block according to the received resolution improvement size, and the video block with the improved resolution is played. The server integrates the relevant parameters for transmitting the previous video block and the factors in various aspects of the current state parameters to dynamically decide the resolution improvement size of the resolution of the next video block, so that the average transmission code rate can be reduced, the bandwidth requirement can be reduced, the overall user experience can be improved, and the optimal video transmission service can be realized.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a flow chart illustrating an embodiment of a video transmission method according to an exemplary embodiment of the present invention;
FIG. 2 is a flow diagram illustrating another embodiment of a video transmission method in accordance with the present invention;
fig. 3 is a schematic diagram illustrating a video transmission system according to an exemplary embodiment of the present invention;
fig. 4 is a schematic structural diagram of a video transmission apparatus according to an exemplary embodiment of the present invention;
fig. 5 is a schematic structural diagram of another video transmission apparatus according to an exemplary embodiment of the present invention;
fig. 6 is a schematic diagram illustrating a structure of a storage medium according to an exemplary embodiment of the present invention.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present invention. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
Example one
Fig. 1 is a flowchart illustrating an embodiment of a video transmission method according to an exemplary embodiment of the present invention, the video transmission method is applied to a server side providing a video service, in this embodiment, for each video stored in the server, the video is divided into video blocks with the same duration in advance, and each video block is processed into video blocks with different resolution sizes for selecting different resolutions during transmission. As shown in fig. 1, the video transmission method includes the steps of:
step 101: a video request from a user side is received.
The video request carries a video identifier of a video requested by a user terminal, a related parameter of a last video block transmitted, and a current state parameter.
It will be understood by those skilled in the art that if the video request is a request of the first video block sent by the user terminal, the video request does not include the related parameters for transmitting the previous video block, or includes a default related parameter.
In this embodiment, the related parameter of the last video block transmitted in the video request represents a series of action parameters involved in playing the last video block, and the current state parameter carried in the video request represents the current state between the server and the client, for example, the computing power currently allocated by the client for the video playing task, the current network state parameter between the client and the server, and the like.
Step 102: and determining the current transmission resolution and the resolution improvement value according to the relevant parameters and the current state parameters of the last video block transmitted, which are carried by the video request.
In an alternative embodiment, the related parameters and the current state parameters of the last video block to be transmitted may be input into a trained neural network decision model, so that the neural network decision model decides the current transmission resolution and resolution improvement value based on the related parameters and the current state parameters.
The neural network decision model is realized by a reinforcement learning method, before the decision model is used, model parameters need to be initialized in advance, continuous data with the time length of N are sampled in training data, namely data in the process of sending N continuous video blocks, and the data of each video block comprises:
(1) and a state s: state parameters between the server and the client, such as bandwidth size and network congestion state used for representing network state, and computing capacity allocated by the client for video playing tasks;
(2) action a: the current transmission resolution of the video block and the resolution improvement size when the video block is played;
(3) reporting r: the average resolution of the played video block is the average resolution after the resolution is improved by adopting a super-resolution technology.
When a decision model is trained, a Q value function used for evaluating the value of each action is used, wherein Q is Q (S, a), the method means that under the state S (S belongs to S) at a certain moment, action a (a belongs to A) is taken to obtain the expectation of profit, the environment feeds back corresponding reward r according to the action of agent, so the main idea of the algorithm is to construct a Q-table by the state S and the action a to store the Q value, and then the action capable of obtaining the maximum profit is selected according to the Q value.
Assume that the data of N consecutive video blocks contains si,ai,ri}，i∈[1,N]Initializing the Q function Q(s)i,ai) Then, the Q value is calculated using the following formula:
wherein, Q(s)i,ai) Is to take an action aiPost slave state siTransition to state si+1The Q value of (1); α is the learning rate, a fixed value; r isiIs to perform action aiPost slave state siTransition to state si+1The obtained reward; γ is a discount factor, a fixed value;
is the next state si+1All executable actions a' in (a) correspond to the maximum value of the Q value.
Finally, the model parameters are updated by a random gradient descent method.
It can be seen that the current state parameters include the computing power (expressed in flops) currently allocated by the user terminal for the video playing task, and the current network state between the user terminal and the server. The parameters associated with a video block include the resolution and resolution enhancement value of the previous video block.
That is, the server can decide the action of transmitting the next video block according to the resolution and resolution improvement value of the previous video block, the current computing power of the user terminal, and the network state.
Step 103: and after the video block to be transmitted with the current transmission resolution is obtained, the video block to be transmitted and the resolution improvement value are transmitted to the user side.
In an optional specific embodiment, since the server stores a series of consecutive video blocks corresponding to different resolution states for the same video data, the video blocks having the same video content but different resolutions may be used as the associated video blocks.
Specifically, the video identifier of the video to which the previous video block belongs may be obtained, the video data of the current transmission resolution corresponding to the video identifier is determined, and the next video block of the video block associated with the previous video block is read from the video data as the video block to be transmitted. Wherein the associated video block is a video block of a current transmission resolution size.
To this end, the video transmission process at the server side shown in fig. 1 is completed, when the user side requests a video block, considering that the computing capability of the user side is poor compared with that of the server, the current state parameter and the related parameter of the previous video block are sent to the server, the server decides the resolution and the resolution improvement size of the next video block to be transmitted according to the related parameter and the factors of the current state parameter, so that after the server obtains the video block with the resolution, the obtained video block and the resolution improvement size obtained by the decision are transmitted to the user side, and the user side performs resolution improvement on the received video block according to the received resolution improvement size and plays the video block with the improved resolution. The server integrates the relevant parameters for transmitting the previous video block and the factors in various aspects of the current state parameters to dynamically decide the resolution improvement size of the resolution of the next video block, so that the average transmission code rate can be reduced, the bandwidth requirement can be reduced, the overall user experience can be improved, and the optimal video transmission service can be realized.
Example two
Fig. 2 is a flowchart illustrating another embodiment of a video transmission method according to an exemplary embodiment of the present invention, the video transmission method is applied to a user side providing a video service, and based on the embodiment illustrated in fig. 1, as illustrated in fig. 2, the video transmission method includes the following steps:
step 201: and receiving the video block and the resolution improvement value transmitted by the server.
And the resolution enhancement value transmitted by the server is the resolution enhancement size required by the video block.
Step 202: and carrying out resolution enhancement on the video block according to the resolution enhancement value, and playing the video block with the resolution enhanced.
In an optional specific embodiment, for the resolution increasing process, a target resolution may be determined according to the resolution increasing value and the current resolution of the video block, and then the current resolution of the video block is increased to the target resolution.
For example, if the current resolution of the video block transmitted is 720p, and the resolution enhancement value transmitted is 360p, the target resolution is 720p +360p — 1080 p.
For example, super-resolution technology may be used to perform resolution enhancement on video blocks.
Step 203: and acquiring current state parameters and parameters related to the video block.
In an optional specific embodiment, the computing power currently allocated by the user side for the video playing task and the current network state between the user side and the server may be obtained, and the computing power and the current network state are used as current state parameters, and the resolution enhancement value and the current resolution of the video block are used as parameters related to the video block.
Step 204: and generating a video request for the next video block according to the parameters related to the video block and the current state parameters and sending the video request to the server.
To this end, the video transmission process on the user side shown in fig. 2 is completed, when the user side requests a video block, considering that the computing capability of the user side is poor compared with that of the server, the current state parameter and the related parameter of the previous video block are sent to the server, the server decides the resolution and the resolution improvement size of the next video block to be transmitted according to the related parameter and the factors of the current state parameter, so that after the server obtains the video block with the resolution, the obtained video block and the resolution improvement size obtained by the decision are transmitted to the user side, and the user side performs resolution improvement on the received video block according to the received resolution improvement size and plays the video block with the improved resolution. The server integrates the relevant parameters for transmitting the previous video block and the factors in various aspects of the current state parameters to dynamically decide the resolution improvement size of the resolution of the next video block, so that the average transmission code rate can be reduced, the bandwidth requirement can be reduced, the overall user experience can be improved, and the optimal video transmission service can be realized.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a video transmission system according to an exemplary embodiment of the present invention, based on the embodiments shown in fig. 1 to fig. 2, the system includes:
the server is used for determining the current transmission resolution and the resolution improvement value according to the relevant parameters and the current state parameters of the last video block transmitted, which are carried by the video request, after receiving the video request from the user terminal; after the video block to be transmitted with the current transmission resolution is obtained, the video block to be transmitted and the resolution improvement value are transmitted to the user side;
the user side is used for carrying out resolution enhancement on the received video block to be transmitted according to the received resolution enhancement value and playing the video block with the resolution enhanced; acquiring current state parameters and parameters related to the video block; and generating a video request aiming at the next video block according to the parameters related to the video block and the current state parameters, and sending the video request to the server.
The specific procedure is as follows:
when the server receives the video request, the server decides the current transmission resolution and the resolution improvement value according to the relevant parameters and the current state parameters of the last video block transmitted carried by the video request, then reads the next video block of the video block (which is the video block with the current transmission resolution) associated with the last video block as the video block to be transmitted, and transmits the video block to be transmitted and the resolution improvement value to the user side.
When the user side receives the video block and the resolution improvement value transmitted by the server, the resolution improvement value is carried out on the video block according to the resolution improvement value, the video block with the improved resolution is played, then the calculation capacity which is currently distributed for a video playing task by the user side and the current network state between the user side and the server are obtained as current state parameters, the resolution improvement value and the current resolution of the video block are simultaneously used as parameters related to the video block, finally, a video request aiming at the next video block is generated according to the parameters related to the video block and the current state parameters, the video request is sent to the server, and the like until the server finishes transmitting all video contents of certain video data.
Fig. 4 is a schematic structural diagram of a video transmission apparatus according to an exemplary embodiment of the present invention, the video transmission apparatus is applied to a server side providing a video service, and based on the above-mentioned embodiment of the method, as shown in fig. 4, the video transmission apparatus includes:
a request receiving module 410, configured to receive a video request from a user side;
a determining module 420, configured to determine a current transmission resolution and a resolution improvement value according to a related parameter and a current state parameter of a last video block transmitted in the video request;
the transmission module 430 is configured to transmit the video block to be transmitted and the resolution improvement value to the user side after obtaining the video block to be transmitted with the current transmission resolution.
Fig. 5 is a schematic structural diagram of another video transmission apparatus according to an exemplary embodiment of the present invention, the video transmission apparatus is applied to a user side, and based on the above-mentioned embodiment of the method, as shown in fig. 5, the video transmission apparatus includes:
a video receiving module 510, configured to receive the video block and the resolution enhancement value transmitted by the server;
the video playing module 520 is configured to perform resolution enhancement on the video block according to the resolution enhancement value, and play the video block with the resolution enhanced;
a parameter obtaining module 530, configured to obtain a current state parameter and a parameter related to the video block;
a request sending module 540, configured to generate a video request including parameters related to the video block and the current state parameters, and send the video request to the server.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the invention. One of ordinary skill in the art can understand and implement it without inventive effort.
Referring to fig. 6, the computer-readable storage medium is an optical disc 30, and a computer program (i.e., a program product) is stored thereon, and when being executed by a processor, the computer program executes the video transmission method provided in any of the foregoing embodiments.
It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory, or other optical and magnetic storage media, which are not described in detail herein.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (10)
1. A video transmission method, applied to a server, the method comprising:
receiving a video request from a user side;
determining the current transmission resolution and a resolution improvement value according to the relevant parameters and the current state parameters of the last video block transmitted, which are carried by the video request;
and after the video block to be transmitted with the current transmission resolution is obtained, transmitting the video block to be transmitted and the resolution improvement value to the user side.
2. The method of claim 1, wherein determining a current transmission resolution and a resolution enhancement value according to the related parameters and current state parameters of the last video block transmitted, which are carried in the video request, comprises:
and inputting the related parameters and the current state parameters of the last video block to be transmitted into a trained neural network decision model so as to decide the current transmission resolution and resolution improvement value based on the related parameters and the current state parameters by the neural network decision model.
3. The method of claim 1, wherein obtaining the video block to be transmitted at the current transmission resolution size comprises:
acquiring a video identifier of a video to which the previous video block belongs;
determining video data of current transmission resolution corresponding to the video identifier, and reading a next video block of the video blocks associated with the previous video block from the video data as a video block to be transmitted; wherein the associated video block is a video block of a current transmission resolution size.
4. A video transmission method is applied to a user side, and the method comprises the following steps:
receiving a video block and a resolution improvement value transmitted by a server;
according to the resolution enhancement value, carrying out resolution enhancement on the video block, and playing the video block with the enhanced resolution;
acquiring current state parameters and parameters related to the video block;
and generating a video request aiming at the next video block according to the parameters related to the video block and the current state parameters, and sending the video request to the server.
5. The method of claim 4, wherein performing resolution enhancement on the video block according to the resolution enhancement value comprises:
determining a target resolution according to the resolution improvement value and the current resolution of the video block;
and increasing the current resolution of the video block to the target resolution.
6. The method of claim 4, wherein obtaining current state parameters and parameters associated with the video block comprises:
acquiring the computing power currently allocated to the video playing task by the user side and the current network state between the user side and the server;
taking the computing power and the current network state as current state parameters;
the resolution enhancement value and the current resolution of the video block are used as parameters related to the video block.
7. A video transmission apparatus, wherein the apparatus is applied to a server, the apparatus comprising:
the request receiving module is used for receiving a video request from a user side;
a determining module, configured to determine a current transmission resolution and a resolution improvement value according to a related parameter and a current state parameter of a last video block transmitted in the video request;
and the transmission module is used for transmitting the video block to be transmitted and the resolution improvement value to the user side after acquiring the video block to be transmitted with the current transmission resolution.
8. A video transmission apparatus, wherein the apparatus is applied to a user side, the apparatus comprising:
the video receiving module is used for receiving the video block and the resolution improvement value transmitted by the server;
the video playing module is used for carrying out resolution enhancement on the video block according to the resolution enhancement value and playing the video block with the resolution enhanced;
a parameter obtaining module, configured to obtain a current state parameter and a parameter related to the video block;
and the request sending module is used for generating a video request containing parameters related to the video block and the current state parameters and sending the video request to the server.
9. A video transmission system, the system comprising:
the server is used for determining the current transmission resolution and the resolution improvement value according to the relevant parameters and the current state parameters of the last video block transmitted, which are carried by the video request, after receiving the video request from the user terminal; after the video block to be transmitted with the current transmission resolution is obtained, the video block to be transmitted and the resolution improvement value are transmitted to the user side;
the user side is used for carrying out resolution enhancement on the received video block to be transmitted according to the received resolution enhancement value and playing the video block with the resolution enhanced; acquiring current state parameters and parameters related to the video block; and generating a video request aiming at the next video block according to the parameters related to the video block and the current state parameters, and sending the video request to the server.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1-3 or 4-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111516355.2A CN114401422A (en) | 2021-12-09 | 2021-12-09 | Video transmission method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111516355.2A CN114401422A (en) | 2021-12-09 | 2021-12-09 | Video transmission method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114401422A true CN114401422A (en) | 2022-04-26 |
Family
ID=81227849
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111516355.2A Pending CN114401422A (en) | 2021-12-09 | 2021-12-09 | Video transmission method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114401422A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104410903A (en) * | 2014-12-25 | 2015-03-11 | 安科智慧城市技术（中国）有限公司 | Method and system for transcoding video based on mobile terminal |
| CN105635734A (en) * | 2014-11-03 | 2016-06-01 | 掌赢信息科技（上海）有限公司 | Self-adaptive video coding method and device based on video conversation scene |
| CN109587560A (en) * | 2018-11-27 | 2019-04-05 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and storage medium |
| CN113055742A (en) * | 2021-03-05 | 2021-06-29 | Oppo广东移动通信有限公司 | Video display method, device, terminal and storage medium |
| KR20210091812A (en) * | 2018-11-27 | 2021-07-22 | 광동 오포 모바일 텔레커뮤니케이션즈 코포레이션 리미티드 | Video augmentation control method, apparatus, electronic device and storage medium |
-
2021
- 2021-12-09 CN CN202111516355.2A patent/CN114401422A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105635734A (en) * | 2014-11-03 | 2016-06-01 | 掌赢信息科技（上海）有限公司 | Self-adaptive video coding method and device based on video conversation scene |
| CN104410903A (en) * | 2014-12-25 | 2015-03-11 | 安科智慧城市技术（中国）有限公司 | Method and system for transcoding video based on mobile terminal |
| CN109587560A (en) * | 2018-11-27 | 2019-04-05 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and storage medium |
| KR20210091812A (en) * | 2018-11-27 | 2021-07-22 | 광동 오포 모바일 텔레커뮤니케이션즈 코포레이션 리미티드 | Video augmentation control method, apparatus, electronic device and storage medium |
| CN113055742A (en) * | 2021-03-05 | 2021-06-29 | Oppo广东移动通信有限公司 | Video display method, device, terminal and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11463750B2 (en) | Method and apparatus for transmitting adaptive video in real time using content-aware neural network | |
| CN109286855B (en) | Panoramic video transmission method, transmission device and transmission system | |
| CN106851343B (en) | Method and device for live video | |
| US10395646B2 (en) | Two-stage training of a spoken dialogue system | |
| CN110268717A (en) | The bit rate of more presentation codes is optimized using statistical information is played | |
| US20220224990A1 (en) | Control apparatus, control method, and program | |
| CN111292001B (en) | Combined decision method and device based on reinforcement learning | |
| CN104918077B (en) | A kind of video transmission method, apparatus and system | |
| CN109407997A (en) | A kind of data processing method, device, equipment and readable storage medium storing program for executing | |
| KR102129115B1 (en) | Method and apparatus for transmitting adaptive video in real time using content-aware neural network | |
| AU2021225331B2 (en) | Method for playing on a player of a client device a content streamed in a network | |
| CN112565606B (en) | Panoramic video intelligent transmission method and equipment and computer storage medium | |
| CN117596376A (en) | 360-degree video intelligent edge transmission method, system, wearable device and medium | |
| CN114401422A (en) | Video transmission method, device and system | |
| CN102047661B (en) | Video encoding amount control method, video encoding amount control device, video encoding amount control program, and computer readable recording medium on which said program is recorded | |
| Ran et al. | SSR: Joint optimization of recommendation and adaptive bitrate streaming for short-form video feed | |
| EP3886451A1 (en) | Method for playing on a player of a client device a content streamed in a network | |
| CN110163652B (en) | Guest-obtaining conversion rate estimation method and device and computer readable storage medium | |
| CN114493781A (en) | User behavior prediction method and device, electronic equipment and storage medium | |
| US8438311B2 (en) | Image processing method and image display system | |
| JP7270344B2 (en) | Terminal equipment, bandwidth prediction equipment, and program | |
| CN113066038B (en) | Image evaluation method, device, electronic equipment and computer storage medium | |
| CN112333456B (en) | Live video transmission method based on cloud edge protocol | |
| CN113411628B (en) | Code rate self-adaption method and device of live video, electronic equipment and readable medium | |
| CN117648123B (en) | Micro-service rapid integration method, system, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |