CN108965858B - A kind of multi-viewpoint three-dimensional video multiple access control method and device for supporting VR - Google Patents
A kind of multi-viewpoint three-dimensional video multiple access control method and device for supporting VR Download PDFInfo
- Publication number
- CN108965858B CN108965858B CN201811012668.2A CN201811012668A CN108965858B CN 108965858 B CN108965858 B CN 108965858B CN 201811012668 A CN201811012668 A CN 201811012668A CN 108965858 B CN108965858 B CN 108965858B
- Authority
- CN
- China
- Prior art keywords
- user
- bandwidth
- message
- price
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The present invention provides a kind of multi-viewpoint three-dimensional video multiple access control method and device for supporting VR, method therein includes: that server is sent to it " response addition " message after receiving " request is added " message that mobile client is sent, and when reaching prefixed time interval, according to the satisfaction gain for the user that mobile client carries in " request is added " message, size of field of view and details coding complexity upper-limit information, using Stackelberg theory of games, analysis decision calculating is carried out to all users, determine the target user for allowing to obtain multi-view point video service, the unit bandwidth price of each user and the details coding complexity distributed for each target user, as calculated result, then " bandwidth price " message is sent to all mobile clients, target therein is mobile User terminal then can receive multi-view point video service according to calculated result.The present invention realizes raising network transmission efficiency, reaches the maximum technical effect of overall network resource resources profit.
Description
Technical field
The present invention relates to wireless network and technical field of video transmission, and in particular to a kind of multi-viewpoint three-dimensional for supporting VR regards
Frequency multiple access control method and device.
Background technique
Virtual reality (VR Virtual Reality) technology is that a kind of can create is believed with the multi-source in the experiencing virtual world
The interactive analogue system of breath fusion, can provide the system emulation of 3D solid what comes into a driver's and entity behavior, be immersed to user
In the environment.In virtual reality, 3D Stereoscopic Video Presentation is particularly critical, is just causing more and more to pay close attention to, wherein the 3D of mainstream
Technology mainly includes that binocular tri-dimensional video (video data comprising 2 viewpoints) and multi-viewpoint three-dimensional video (are regarded comprising 8 or more
The video data of point).Binocular tri-dimensional video can be divided into wear glasses viewing and two kinds of binocular bore hole stereoscopic display again, wherein the former
Polarising glass must be worn, brings inconvenience for viewing, the latter then requires viewer that must watch from fixed angle, when
When having more people while watching same display, because most viewers can not obtain best viewing location to largely effect on sight
See experience.And for multi-viewpoint three-dimensional video technology, it is more due to that can be provided simultaneously on same naked eye 3D stereoscopic display
The content of a viewpoint greatly improves the convenience of viewing so viewer can watch from any free angle.Institute
Have become the mainstream of current techniques research with multi-viewpoint three-dimensional video.
Such as: 2.57 inches of the 8 viewpoint LCD displays that Seiko Epson (Seiko Epson) is released can be applied
On mobile phone, the naked view 3D display device of 9 viewpoints can be imported 12.1 inch LCD display applications by Toshiba (Toshiba).Many researchs
Mechanism has had begun the research to multi-viewpoint three-dimensional video.The viewing pair that the user of multiple views can be liked with unrestricted choice oneself
As and viewing visual angle can use synthetic technology when required viewpoint is not in the viewpoint set of transmission, with reference to left and right viewpoint into
The synthesis of row content.
Applicant during implementing technical solution of the present invention, find current multiple views access control, exist as
Lower technical problem:
First, since the viewpoint that multi-view point video needs to transmit is more, need the data volume of transimission and storage to be multiplied, greatly
The pressure of network and video transmission is increased greatly.It synthesizes viewpoint and needs bigger transmission rate.Because synthesis viewpoint generally requires
It at least needs the reference video simultaneous transmission of the right and left (two or more) to user terminal, can just make the viewpoint quality of synthesis not low
In the viewpoint quality directly transmitted so that web database technology is multiplied, but user to the perceived quality of the viewpoint of synthesis not
It can be higher than the viewpoint perceived quality directly transmitted.Second, the equipment performance of user influences user-perceptive quality.Mobile phone is used in network
Family and large high-definition screen show that the requirement to network transmission video data rate is different, and the increase of rate can mention to a certain degree
High user video quality, but the limitation of user equipment decoding capability must be taken into consideration, customer satisfaction system perceived quality could be really provided.
The code distinguishability that different equipment can be supported is different and acquisition user experience is not also identical.Such as: for it is novel H.265
Transmission of video agreement, although the video transmission bandwidth needed has dropped, computation complexity is greatly increased, and user equipment must have
There is corresponding decoding capability that could obtain corresponding video quality.Code rate size is only relied on to be allocated Internet resources, and
It cannot judge to obtain the final display effect of video.Therefore, the different characteristics of user equipment determine that same area can be shown
The resolution detail difference upper limit, excessively providing bandwidth not will increase the perceived quality of user.
Multiple views application at present is concentrated mainly on two aspects, on the one hand, reduces video frequency coding rate in source；Another party
Face reduces bandwidth consumption in transmission.In the first aspect, the encoder bit rate of source must be set up accurately knowing network bandwidth
On the basis of dawn, bandwidth otherwise cannot be made full use of to improve the transmission quality of video.In the second aspect, current research
It is main to concentrate the utilization rate for improving single user under fixed-bandwidth, it does not account for multi-user and the network bandwidth transmission deposited is asked
Topic.Existing research considers not the user equipment under the wireless network environment of multiple views, multi-user with different display capabilities
Foot, cannot optimize network efficiency of service.Although miscellaneous multi-vision-point encoding technology can reduce the data volume of source,
So there is a large amount of, multiple views user and causes the low problem of network transmission efficiency in competition wireless network.
Summary of the invention
In view of this, the embodiment of the invention provides a kind of multi-viewpoint three-dimensional video multiple access controlling parties for supporting VR
Method and device, by considering mobile wireless network bandwidth constraint, investigate the decoding capability of different user end hardware, size of field of view and
The different unit bandwidth price of each user is arranged using theory of games in bandwidth consumption, can solve volume, multiple views use
The low problem of network transmission efficiency is caused in competition wireless network in family, and reaches the maximum technology effect of overall network resource resources profit
Fruit.
In order to reach above-mentioned technical effect, it is more that first aspect present invention provides a kind of multi-viewpoint three-dimensional video for supporting VR
User access control method is applied in wireless network, and the wireless network includes command channel and data channel, the control
Method includes:
Step S1: " request is added " message that mobile client is sent by described instruction channel is received, wherein described
For " request is added " message to indicate that wireless network is added in mobile client request, " request is added " message includes user
Network address label, user satisfaction yield value, size of field of view and the details coding complexity upper limit；
Step S2: judge whether the corresponding user of the mobile client is newly to use according to the network address label of the user
Server is had been received by " request is added " message if it is, sending " response addition " message to the mobile client by family
Notify the mobile client；
Step S3: when reach preheating setting time every when, satisfaction yield value of the server according to the user, the ken
Size and the details coding complexity upper limit regard all requests using the Stackelberg theory of games of lack of balance more
The user of point Video service carries out analysis decision calculating, determines to allow to obtain the target user of multi-view point video service, each
The unit bandwidth price of user and the details coding complexity distributed for each target user；
Step S4: by the target user determined, target user unit bandwidth price, for target user distribution
The network address label of details coding complexity and each target user are configured to " bandwidth price " message, the and " band by described in
Wide price " message is sent to the user of all request multi-view point video services, so that mobile client corresponding with target user
The details coding complexity of corresponding unit bandwidth price and distribution is determined according to corresponding network address label, and is passed through
The data channel reception multi-view point video service.
Further, when server receives " request is left " message of mobile client transmission, then to the movement
User terminal sends " response is left " message, stops providing multi-view point video service to the mobile client.
Further, step S3 is specifically included:
S3.1: the relationship of consumption bandwidth and encoded content complexity is preset are as follows:
Wherein, bn(cn) it is the bandwidth that user n needs to consume,For the details coding complexity of user n, α and β are
Video features parameter relevant to multi-view video content,The viewpoint number that user n needs to transmit is indicated, with size of field of view
It is related；
S3.2: according to the size of the satisfaction yield value of user, being ranked up the user of request multi-view point video service,
Wherein, λ1≥λ2≥λj…λn, then the satisfaction yield value of user 1 is expressed as λ1, the satisfaction yield value of user j is expressed as λj, n
For the total quantity of the user of request point Video service；
S3.3: the user 1 after sequence is calculated according to the relationship for presetting consumption bandwidth and encoded content complexity
The bandwidth for needing to consume, and judge whether wireless network available bandwidth is less than the bandwidth that the user 1 needs to consume, if so,
Then calculate the unit bandwidth price p of the user 11, whereinλ1For the satisfaction yield value of user 1,
B is wireless network available bandwidth, and sets infinitely great for the unit bandwidth price of other users, and go to step S3.6, such as
Fruit is no, then calculates the unit bandwidth price p of the user 11, wherein For the details coding of user 1
The complexity upper limit；
S3.4: the bandwidth summation B that j user needs to consume before successively calculatingj, and whether judge wireless network available bandwidth
Less than Bj, if it is, the number of users of access wireless network is reduced, and the S3.5 that gos to step, if not, repeating
S3.4 can work according to judging result determination in the number of users of the details coding complexity upper limit of user device hardware permission
I-1,
Wherein, Indicate j user
The middle details coding complexity upper limit for allowing to have i-1 user job to allow in its hardware needs the band consumed for i-1 user
Wide summation；
S3.5: the bandwidth summation B that j-1 user needs to consume before successively calculatingj', and judge wireless network available bandwidth
Whether B is less thanj', if it is, the number of users of access wireless network is reduced, and the S3.6 that gos to step, if it is not, then increasing
Adjunction enters the number of users of wireless network, repeats step S3.5, and being determined according to judging result allows to access in wireless network
Target user's quantity；
S3.6: the unit bandwidth price of all users and the details coding complexity for target user's distribution are obtained, wherein
Unit bandwidth price is respectively as follows:
Wherein:
The corresponding details coding complexity of target user is respectively as follows:Wherein:
Further, described " request is added " message further include: the network address label of server, request are added " message
Type codes, left view piont mark.
Further, step S4 is specifically included:
Step S4.1: the length of " bandwidth price " message is determined according to the quantity of the target user；
Step S4.2: according to the length of the message, the unit bandwidth price of target user, distribution details coding complexity
And the network address label of target user constructs " bandwidth price " message；
Step S4.3: " bandwidth price " message by described in is sent to the users of all request multi-view point video services, so that
Mobile client corresponding with target user according to corresponding network address label determine corresponding unit bandwidth price and
The details coding complexity of distribution, and corresponding expense is paid to the server according to corresponding unit bandwidth price, pass through institute
It states data channel and obtains multi-view point video service corresponding with the details coding complexity of the distribution.
Based on same inventive concept, it is multi-purpose that second aspect of the present invention provides a kind of multi-viewpoint three-dimensional video for supporting VR
Family access control apparatus is applied in wireless network, and the wireless network includes command channel and data channel, described device packet
It includes:
Message reception module is added in request, " requests to add by what described instruction channel was sent for receiving mobile client
Enter " message, wherein " request is added " message is to indicate that the wireless network, " request is added in mobile client request
Addition " message includes in the network address label of user, the satisfaction yield value of user, size of field of view and details coding complexity
Limit；
Message transmission module is added in response, for judging the mobile client pair according to the network address label of the user
Whether the user answered is new user, if it is, sending " response addition " message to the mobile client, by server
Receive mobile client described in " request is added " message informing；
Decision-making module, for when reach preheating setting time every when, satisfaction yield value of the server according to the user, institute
Size of field of view and the details coding complexity upper limit are stated, using the Stackelberg theory of games of lack of balance, ask the visitor in institute
It asks the user of multi-view point video service to carry out analysis decision calculating, determines that the target for allowing to obtain multi-view point video service is used
Family, the unit bandwidth price of each user and the details coding complexity for each target user distribution；
Bandwidth price messages sending module, for by the unit bandwidth valence of the target user determined, target user
Lattice are configured to " bandwidth valence for the details coding complexity of target user's distribution and the network address label of each target user
Lattice " message, and " bandwidth price " message by described in is sent to the users of all request multi-view point video services, so as to be used with target
The corresponding mobile client in family determines the thin of corresponding unit bandwidth price and distribution according to corresponding network address label
Encoder complexity is saved, and passes through the data channel reception multi-view point video service.
Further, described device further includes response leave group message sending module, for receiving mobile use when server
When " request is left " message that family end is sent, then " response is left " message is sent to the mobile client, stopped to the shifting
Dynamic user terminal provides multi-view point video service.
Further, the decision-making module is specifically used for:
Preset the relationship of consumption bandwidth and encoded content complexity are as follows:
Wherein, bn(cn) it is the bandwidth that user n needs to consume,For the details coding complexity of user n, α and β are
Video features parameter relevant to multi-view video content,The viewpoint number that user n needs to transmit is indicated, with size of field of view
It is related；
According to the size of the satisfaction yield value of user, the user of request multi-view point video service is ranked up, wherein
λ1≥λ2≥λj…λn, then the satisfaction yield value of user 1 is expressed as λ1, the satisfaction yield value of user j is expressed as λj, n is to ask
Seek the total quantity of the user of a Video service；
It needs to disappear according to the user 1 after the relationship calculating sequence for presetting consumption bandwidth and encoded content complexity
The bandwidth of consumption, and judge whether wireless network available bandwidth is less than the bandwidth that the user 1 needs to consume, if it is, calculating
The unit bandwidth price p of the user 11, whereinλ1For the satisfaction yield value of user 1, B is nothing
Line network availability bandwidth, and set infinitely great for the unit bandwidth price of other users, it gos to step and obtains all users
Unit bandwidth price and distribution details coding complexity the step of, if it is not, then calculating the unit bandwidth valence of the user 1
Lattice p1, wherein For the details coding complexity upper limit of user 1；
The bandwidth summation B that j user needs to consume before successively calculatingj, and judge whether wireless network available bandwidth is less than
Bj, if it is, reducing the number of users of access wireless network, and jump to and successively calculate what preceding j-1 user needed to consume
Bandwidth summation Bj' the step of, if not, repeating the step, can be worked according to judging result determination hard in user equipment
The number of users i-1 for the details coding complexity upper limit that part allows,
Wherein, Indicate j user
The middle details coding complexity upper limit for allowing to have i-1 user job to allow in its hardware needs the band consumed for i-1 user
Wide summation；
The bandwidth summation B that j-1 user needs to consume before successively calculatingj', and judge whether wireless network available bandwidth is small
In Bj', if it is, reducing the number of users of access wireless network, and jump to the unit bandwidth price for obtaining all users
The step of with the details coding complexity of distribution, repeats the step if it is not, then increasing the number of users of access wireless network
Suddenly, the target user's quantity for allowing to access in wireless network is determined according to judging result；
Obtain the unit bandwidth price of all users and the details coding complexity of distribution, wherein unit bandwidth price point
Not are as follows:
Wherein:
The corresponding details coding complexity of all users is respectively as follows:Wherein:
Based on same inventive concept, third aspect present invention provides a kind of computer readable storage medium, deposits thereon
Computer program is contained, which, which is performed, realizes method described in first aspect.
Based on same inventive concept, fourth aspect present invention provides a kind of computer equipment, including memory, processing
On a memory and the computer program that can run on a processor, when processor execution described program, is realized for device and storage
Method described in first aspect.
Said one or multiple technical solutions in the embodiment of the present application at least have following one or more technology effects
Fruit:
One, for a large amount of heterogeneous users and deposit, multiple views application scenarios, the invention proposes one kind be applied to wireless network
The multi-viewpoint three-dimensional video multiple access controlling mechanism of the support VR of network, reach preheating setting time every when, server according to
Satisfaction gain, size of field of view and the details coding complexity for the user that mobile client carries in " request is added " message
Upper-limit information divides the user of all request multi-view point video services using the Stackelberg theory of games of lack of balance
Decision is analysed to calculate, determine to allow to obtain the target user of multi-view point video service, the unit bandwidth price of each user and
For the details coding complexity of each target user distribution.During Stackelberg theory of games, server is equal to
" leader ", user are equivalent to " follower ", propose the requirement (size of field of view, decoding complex degree) of oneself by user first；It connects
Server pass through game, calculate the unit bandwidth price of different user；Finally, user is according to different unit bandwidth valences
Lattice determine oneself available video quality grade (i.e. details coding complexity).By server by selecting access
The user of network calculates Subscriber Unit bandwidth cost paid, can optimize the efficiency of service of network, solve volume, multiple views
User causes the low problem of network transmission efficiency in competition wireless network, and reaches the maximum technology effect of overall network resource resources profit
Fruit.
Two, only to improve user network amount of bandwidth as target in being different from the prior art, the present invention considers multiple views
The characteristics of Video Applications, proposes that the quality of user's perception depends not only on the size of field of view that can be observed, and depends on user
Show the decoded upper limit of equipment (i.e. the details coding complexity upper limit of user device hardware permission), the increase of rate can not generation
The increase of table multi-view point video viewing quality is subsequent to construct the relationship of consumption bandwidth and encoded content complexity
The distribution in broadband provides basis, and network transmission efficiency can be improved.
Three, only expand by promotion video quality or multiple views application merely with 2D video transmission bandwidth in the prior art
Scope of sight is different, in the embodiment of the present invention, when server passes through theory of games unit of account bandwidth price, while considering not
With the demand of user video quality and scope of sight, keep the bandwidth price of each user different.It is every by the control of bandwidth price
The overall utilization of network bandwidth can be improved in the bandwidth that a user obtains.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is a kind of process for the multi-viewpoint three-dimensional video multiple access control method for supporting VR in the embodiment of the present invention
Figure；
Fig. 2 is the structural schematic diagram of the wireless network of the application of method shown in Fig. 1；
Fig. 3 is the interactive examples schematic diagram of control method shown in Fig. 1；
Fig. 4 is a kind of structure for the multi-viewpoint three-dimensional video multiple access control device for supporting VR in the embodiment of the present invention
Figure；
Fig. 5 is a kind of structure chart of computer readable storage medium in the embodiment of the present invention；
Fig. 6 is a kind of structure chart of computer equipment in the embodiment of the present invention.
Specific embodiment
The embodiment of the invention provides a kind of multi-viewpoint three-dimensional video multiple access control method and device for supporting VR,
To solve the problems, such as that volume, multiple views user cause network transmission efficiency low in competition wireless network, and reach integral net
The maximum technical effect of network resource resources profit.
In order to reach above-mentioned technical effect, general thought of the invention is as follows:
Server returns to " response to mobile client after receiving " request is added " message of mobile client transmission
Be added " message, and reach preheating setting time every when, server carries in " request be added " message according to mobile client
Satisfaction gain, size of field of view and the details coding complexity upper-limit information of user, it is rich using the Stackelberg of lack of balance
Theory is played chess, analysis decision calculating is carried out to the user of all request multi-view point video services, determines to allow to obtain multiple views view
Be taken in small doses at short intervals the target user of business, the unit bandwidth price of each user and the details coding complexity for each target user distribution
Degree.And the user that " bandwidth price " message is sent to all request multi-view point videos is constructed according to the result of Analysis of Policy Making, so
The corresponding mobile client of target user can then be determined according to the user network address label in " bandwidth price " message afterwards
The information of server distribution can receive multi-view point video to target user, and other users are then in reception " bandwidth price "
Corresponding user network address label can not be matched in message, so that multi-view point video service cannot be received.Pass through above-mentioned side
Case can optimize the efficiency of service of network, solve volume, multiple views user in competition wireless network and cause network transmission efficiency
Low problem, and reach the maximum technical effect of overall network resource resources profit.
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
Embodiment one
A kind of multi-viewpoint three-dimensional video multiple access control method for supporting VR is present embodiments provided, is applied to wireless
In network, wireless network includes command channel and data channel, referring to Figure 1, this method comprises:
Step S1 is first carried out: receiving " request is added " message that mobile client is sent by command channel, wherein
For " request is added " message to indicate that wireless network is added in mobile client request, " request is added " message includes the net of user
Network address label, the satisfaction yield value of user, size of field of view and the details coding complexity upper limit.
Specifically, refer to Fig. 2, the multimedia wireless network at edge by access network server and groups of mobile subscribers
At in the specific implementation process, server can be content server, and multiple views 3D video content has prepared, and store
The requirement of multiple views 3D Video coding can be met in content server or in real time.
In order to adapt to the access of multi-user, in the present embodiment, special one section of frequency band is distributed as signalling frequency band,
It is referred to as command channel.The channel that wireless network in present embodiment has two classes shared, one kind is command channel；One kind is
Data channel.User can be freely added network, can also be exitted network at any time by Signalling exchange.Signaling of the invention is handed over
Mutually in command channel, and multi-view point video is transmitted in data channel.The present invention by multiple users according to not
With user equipment decoding performance, ken demand size, different prices and division are carried out to the bandwidth of channel, to improve the whole of user
Body effectiveness.
" request is added " message in one embodiment further include: the network address label of server, request are added " disappears
Cease type codes, left view piont mark.
When specific next, the format of " request is added " message is as shown in table 1,
The format of table 1 " request is added " message
Into the mobile subscriber of wireless network, the message of " request is added " is sent by command channel, until in wireless network
Content server." request is added " information is shorter, and " the network address label of user " comprising user oneself and " user's expires
Meaning degree yield value ", " the network address label of server " etc., the network address label of user are unique in network.Any entrance
The user of wireless network, the multi-view point video service provided if necessary to obtain network then need to send " request is added " message
To the corresponding server of network address label of server.The satisfaction yield value of user is supplied to network to characterize user
The numerical value of urgent degree is serviced multi-view point video.By " left view piont mark " and " size of field of view ", user can determine expectation
The ken angle and range of acquisition." details coding complexity " can be with the decoded upper limit to characterize the hardware device of userDifferent display equipment requires different, λ to the encoder complexity of detailsnIndicate the satisfaction yield value of user n.
Then execute step S2: according to the network address label of user judge the corresponding user of the mobile client whether be
Server is had been received by " request is added " message if it is, sending " response addition " message to mobile client by new user
Notify mobile client.
It specifically, include respective network address label in " request is added " message sent due to mobile client,
Thus server can determine each mobile client by network address label, and send " response to these mobile clients
It is added " message, for notifying these mobile clients, server to have received " request is added " message of its transmission.Wherein,
The format of " response addition " message is as shown in table 2.
The format of table 2 " response addition " message
Include that response is added in " response addition " message " type of message code, the network address label of server and user
Network address label.
Next execute step S3: when reach preheating setting time every when, server is according to the satisfaction yield value of user, view
Domain size and the details coding complexity upper limit, using the Stackelberg theory of games of lack of balance, to all request multiple views
The user of Video service carries out analysis decision calculating, determines target user, the Mei Geyong for allowing to obtain multi-view point video service
The unit bandwidth price at family and the details coding complexity distributed for each target user.
Specifically, preheating setting time is every according to the processing capacity of server and number of users, the frequency of access wireless network
Band frequency dependence strives for all users all known to server when it is implemented, time enough length can be reserved sufficiently.
Stackelberg theory of games, that is, Stark Burger theory of games, the participation both sides of game are leader and follower, sheet respectively
In embodiment, server is equal to " leader ", and user is equivalent to " follower ".First user propose oneself requirement (depending on
Domain size, decoding complex degree)；Then server passes through game, calculates the unit bandwidth price of different user；Finally, user
According to different unit bandwidth prices, oneself available amount of bandwidth and video quality grade are confirmed.By selecting access
The user of network calculates Subscriber Unit bandwidth cost paid, optimizes the efficiency of service of network.The unit bandwidth price of each user
The bandwidth price of bandwidth price and other users including target user, as long as be added into wireless network with including per family
Inside.
In one implementation, step S3 is specifically included:
S3.1: the relationship of consumption bandwidth and encoded content complexity is preset are as follows:
Wherein, bn(cn) it is the bandwidth that user n needs to consume,For the details coding complexity of user n, α and β are
Video features parameter relevant to multi-view video content,The viewpoint number that user n needs to transmit is indicated, with size of field of view
It is related；
S3.2: according to the size of the satisfaction yield value of user, being ranked up the user of request multi-view point video service,
Wherein, λ1≥λ2≥λj…λn, then the satisfaction yield value of user 1 is expressed as λ1, the satisfaction yield value of user j is expressed as λj, n
For the total quantity of the user of request point Video service；
S3.3: 1 needs of user after sequence are calculated according to the relationship for presetting consumption bandwidth and encoded content complexity
The bandwidth of consumption, and judge whether wireless network available bandwidth is less than the bandwidth that user 1 needs to consume, it is used if it is, calculating
The unit bandwidth price p at family 11, whereinλ1For the satisfaction yield value of user 1, B is wireless network
Available bandwidth, and set infinitely great for the unit bandwidth price of other users, go to step S3.6, if it is not, then calculating
The unit bandwidth price p of user 11, wherein For the details coding complexity upper limit of user 1；
S3.4: the bandwidth summation B that j user needs to consume before successively calculatingj, and whether judge wireless network available bandwidth
Less than Bj, if it is, the number of users of access wireless network is reduced, and the S3.5 that gos to step, if not, repeating
S3.4 can work according to judging result determination in the number of users of the details coding complexity upper limit of user device hardware permission
I-1,
Wherein, Indicate j user
The middle details coding complexity upper limit for allowing to have i-1 user job to allow in its hardware needs the band consumed for i-1 user
Wide summation；
S3.5: the bandwidth summation B that j-1 user needs to consume before successively calculatingj', and judge wireless network available bandwidth
Whether B is less thanj', if it is, the number of users of access wireless network is reduced, and the S3.6 that gos to step, if it is not, then increasing
Adjunction enters the number of users of wireless network, repeats step S3.5, and being determined according to judging result allows to access in wireless network
Target user's quantity；
S3.6: the unit bandwidth price of all users and the details coding complexity for target user's distribution are obtained, wherein
Unit bandwidth price is respectively as follows:
Wherein:
The corresponding details coding complexity of all users is respectively as follows:Wherein:
Specifically, the theory of games that the present invention uses is as follows: needing server to provide clothes if sharing n user at this time
Business, server useOptimization aim, whereinFor each use
The extent function at family,What is indicated is network profit,Indicate: viewpoint number is bigger, details is complicated
Degree is higher, if price is pn, then total price is higher, wherein λnIt is the satisfaction yield value of user, is a fixed value.With
The practical satisfaction at family can determine by the extent function of user, the viewpoint size and details complexity phase with acquisition
It closes.The extent function of user and the balance of both network profits can be so that network server price maximize.Therefore, originally
Invention optimization aim contains two parameters of Ciphering details complexity and size of field of view in multiple views, using lack of balance
Stackelberg theory of games can determine each user's after carrying out analysis decision calculating to the user of all request services
Unit bandwidth price reaches the maximization of network resource usage.Of the invention may finally determine 1) which user can permit
Permitted to obtain multi-view point video service (i.e. target user), 2) the unit bandwidth price of each user is how many respectively, 3) each use
The video encoding quality (fgs encoder complexity) that family finally obtains is how many, is calculated by constantly comparing with game, finally
User utility and the maximum target of network profit can be met simultaneously to result.
In step S3.1, the relationship one of 2D video transmission rate (bandwidth) and encoded content complexity in the prior art
As are as follows:
bn(cn)=(α cn+β)。 (1)
WhereinFor the details coding complexity of user n, α and β are that video relevant to multi-view video content is special
Parameter is levied, according to different quantization parameter QP, corresponding different α and β, for example, when QP=15, α and β be respectively 0896.33,
230266.7, as QP=20, when α and β are respectively 21500,121100, QP=25, α and β are respectively 11584,65040, QP
When=30, α and β are respectively 6282.667,35433.33.Present invention applicant is in implementing the present invention, it may, have found more
In viewpoint video, rate (consumption bandwidth) needed for transmitting is not only related with video quality (details coding complexity), and with
The size of field of view of family request is related.Thus, the relationship for consuming bandwidth and encoded content complexity is arranged in the present embodiment are as follows:
The object of concern of the embodiment of the present invention is the scene codes complexity (details coding complexity) of reference frame, general next
It says, more complicated image coding carries more video details, can satisfy the needs that user finely shows, but can consume more
Transmission bandwidth.Since multiple views camera generally equidistantly distributes, so the size of field of view of user/camera spacing distance, is rounded
After obtain It is the viewpoint number that user n needs to transmit.
Specifically, the user that network is added in request can be ranked up according to the satisfaction yield value of user, due to full
Meaning degree yield value characterization is urgent degree of the user to multi-view point video service, thus is preferentially calculated since user 1.
In step S3.3, the bandwidth that user 1 needs to consume can be calculated according to the formula in step S3.1, if wirelessly
Network availability bandwidth is less than the bandwidth that user 1 needs to consume, then showing that current wireless network is only capable of accommodating or being only capable of is 1
User provides Video service, at this point, then calculate the unit bandwidth price of user 1, and by the unit band of the user in addition to user 1
Wide price is set as infinitely great, shows that it can not receive Video service.If if wireless network available bandwidth is greater than or equal to
User 1 needs the bandwidth consumed, then shows current wireless network other than providing Video service for user 1, moreover it is possible to be other
User provides Video service, and the unit bandwidth price of user 1 is arranged at this time, and makes its work in the corresponding hardware device of user 1
The details coding complexity upper limit of permission, and increase the number of users of permission.
In step S3.4, the bandwidth summation B that preceding j user needs to consume successively is calculatedj, wherein j can be according to circumstances
It incrementally increases, the judging result of the bandwidth summation and wireless network available bandwidth that need to consume according to j user is so that it is determined that go out
The number of users i-1 for the details coding complexity upper limit allowed in user device hardware that can work.
In step S3.5, go out the target user for allowing to access in wireless network in conjunction with the result comprehensive descision of step S3.4
Quantity.
In step S3.6, the details of comprehensive abovementioned steps, the unit bandwidth price and distribution that calculate all users is compiled
Code complexity, whereinFor the unit bandwidth price of user 1,For the unit bandwidth valence of user i-1
Lattice, wherein preceding i-1 user can work in the details coding complexity upper limit of user device hardware permission, that is, preceding i-1
A user can receive the better multi-view point video service of video quality, can work from user i to user j in corresponding coding
Under details complexity upper range, the unit bandwidth price of user j+1 to user n is infinity ∞.For the list of user i
Position bandwidth price,For the unit bandwidth price of user j, the specific value of i and j are true by step S3.4 and step S3.5
It makes.δiIt is a process variable, is used for facilitating the unit bandwidth price for calculating user.Permit for the hardware device of user 1
Perhaps the details coding complexity upper limit,For the details coding complexity upper limit that the hardware device of user i-1 allows, ciFor with
The details coding complexity of the acquisition of family i, cjThe details coding complexity obtained for user j.
In specific implementation, step S3.1~step S3.6 can be by following algorithms (including Step1~Step6) come real
It is existing:
Step1: re-starting label and sequence to user according to user satisfaction yield value, after number, λ1≥λ2≥λj…
λn, the angle value that is satisfied with of user j is expressed as λj。
Step 2: to i and j assignment, i=1, j=1 indicate that network can access 1 user；
Step 3: after accessing user 1, the bandwidth that user 1 needs to consume is calculated
If B >=b1, thenI=2, j=2 are set.Jump to step 4.
Wherein, B indicates the available bandwidth of wireless network；p1For the unit bandwidth price of user 1,It is corresponding for user 1
The hardware encoding details complexity upper limit.λ1For 1 satisfaction yield value of user, whereinIt is the number that user 1 reports to server
Value.If B < b1, then calculateUnit bandwidth price needed for obtaining user 1 are as follows:Remaining user bandwidth is set as pn=∞.I=1, j=1 are set at this time, jump to 6 (program of step
Terminate).
Step 4:
It calculates
If B >=Bj, update i=i+1, j=j+1.It jumps to Step4 and re-executes the instruction.
If B < Bj, i=i-1, j=j-1 are set.The last i and j are returned to, Step5 is jumped to
Wherein, the m in sum formula and n is temporary variable, summation.BjJ user needs to consume before indicating
Bandwidth.It is the bandwidth summation that i-1 user needs to consume.It as i=j, indicates: the equal work of all users (i-1)
Make the maximum complexity allowed in its hardware.
Step 5:
It calculates
If B >=Bj, update j=j+1.It jumps to Step5 and re-executes the instruction.
If B < BjIf j > i, j=j-1 is set, and otherwise j is constant.Then, step6 (EP (end of program)) is jumped to.
Step6:
At this point, user's number that network allows to access is j.The unit bandwidth price difference that network is collected to every user
Are as follows:Wherein
The details coding complexity that wherein 1 to j user of label obtains again is respectively as follows:
Wherein
Step S4 is executed again: being distributed by the target user determined, the unit bandwidth price of target user, for target user
Details coding complexity and the network address label of each target user be configured to " bandwidth price " message, and by " bandwidth
Price " message is sent to the user of all request multi-view point video services, so that mobile client root corresponding with target user
The details coding complexity of corresponding unit bandwidth price and distribution is determined according to corresponding network address label, and passes through number
It is believed that road receives multi-view point video service.
Specifically, after the calculated result that step S3 obtains Analysis of Policy Making obtains, server is constructed according to calculated result
" bandwidth price " message.For different target users, server has recorded each in reception " request is added " message
The network address label of user, so as to correspond to each user.Then by the bandwidth price calculated separately out, the volume of distribution
In code details complexity and corresponding network address label filling " bandwidth price " message.Wherein, the tool of " bandwidth price " message
Physique formula is as shown in table 3.
The format of table 3 " bandwidth price " message
Server can will construct " bandwidth price " message and be sent to all users for requesting multi-view point video services,
In, target user can match according to corresponding network address label in " bandwidth price " message with itself, so that it is determined that going out
The details coding complexity (video quality grade) of the calculated unit bandwidth price of server and distribution, and then receive corresponding
Multi-view point video service.And other users will be unable to match corresponding network address after receiving " bandwidth price " message
Label shows that its price is set as infinite, and indicate this game the result is that server does not receive to provide the video clothes of the user
Business application.
In one implementation, step S4 is specifically included:
Step S4.1: the length of " broadband price " message is determined according to the quantity of target user；
Step S4.2: according to the length of message, the bandwidth price of target user, distribution details coding complexity and target
The network address label of user constructs " broadband price " message；
Step S4.3: " broadband price " message is sent to the user of all request multi-view point video services, so that and mesh
The corresponding mobile client of mark user determines the thin of corresponding bandwidth price and distribution according to corresponding network address label
Encoder complexity is saved, and corresponding expense is paid to server according to corresponding bandwidth price, is obtained and is distributed by data channel
The corresponding multi-view point video service of details coding complexity.
Specifically, every target user pays according to the unit bandwidth price received to server, so that it may obtain
The multi-view point video transmission service of video quality grade must be corresponded to.
In one implementation, when server receive mobile client transmission " request is left " message when, then to
Mobile client sends " response is left " message, stops providing multi-view point video service to mobile client.
Specifically, if user needs to leave network, need to send the message of " request is left ", service to server
Device confirms whether user leaves network with this, or has not needed server and provide transmission of video service.Corresponding server is received
It, then can loopback " response is left " message to after " request is left " message.Wherein, " request is left " message, response are left " message
Format is respectively as shown in table 4, table 5.
The format of table 4 " request is left " message
The format of table 5 " response is left " message
In order to illustrate more clearly of the process of control process of the invention, said below by a specific interactive examples
It is bright, Fig. 3 is referred to, is control flow chart, is divided into mobile client and server end, firstly, mobile client is to server end
" request is added " message is sent, after server receives " request is added " message of mobile client transmission, to corresponding movement
User sends " response addition " message, and interval time is waited to arrive, and when reaching preset interval time, server is then according to rich
It plays chess theoretical calculation and goes out allocation result, and " broadband price " message is sent to all mobile clients, wherein corresponding target
Mobile client then receives multi-view point video transmission service according to the calculated allocation result of server, when mobile client needs
When leaving wireless network, " request is left " message, server then loopback " response is left " message are sent to server end.
Based on the same inventive concept, present invention also provides more with the multi-viewpoint three-dimensional video of the support VR in embodiment one
The corresponding device of user access control method, detailed in Example two.
Embodiment two
The present embodiment provides a kind of multi-viewpoint three-dimensional video multiple access control devices for supporting VR, are applied to wireless network
In network, wireless network includes command channel and data channel, refers to Fig. 4, which includes:
Message reception module 401 is added in request, " requests to add by what command channel was sent for receiving mobile client
Enter " message, wherein to indicate that wireless network is added in mobile client request, " request is added " disappears " request is added " message
Breath includes the network address label of user, the satisfaction yield value of user, size of field of view and the details coding complexity upper limit；
Message transmission module 402 is added in response, for judging the mobile client pair according to the network address label of user
Whether the user answered is new user, if it is, sending " response addition " message to mobile client, server is had been received by
" request is added " message informing mobile client；
Decision-making module 403, for when reach preheating setting time every when, server is according to the satisfaction yield value of user, view
Domain size and the details coding complexity upper limit, using the Stackelberg theory of games of lack of balance, to all request multiple views
The user of Video service carries out analysis decision calculating, determines target user, the Mei Geyong for allowing to obtain multi-view point video service
The unit bandwidth price at family and the details coding complexity distributed for each target user；
Bandwidth price messages sending module 404, for by the unit bandwidth valence of the target user determined, target user
Lattice are configured to " bandwidth valence for the details coding complexity of target user's distribution and the network address label of each target user
Lattice " message, and " bandwidth price " message is sent to all users for requesting multi-view point video services, so that with target user couple
The mobile client answered determines that the details of corresponding unit bandwidth price and distribution is compiled according to corresponding network address label
Code complexity, and serviced by data channel reception multi-view point video.In one embodiment, mould is arranged in random back-off time
Block 501 is specifically used for:
In one implementation, the device provided in this implementation further includes response leave group message sending module, for working as
When server receives " request is left " message of mobile client transmission, then " response is left " is sent to mobile client and disappeared
Breath stops providing multi-view point video service to mobile client.
In one implementation, decision-making module 403 is specifically used for:
Preset the relationship of consumption bandwidth and encoded content complexity are as follows:
Wherein, bn(cn) it is the bandwidth that user n needs to consume,For the details coding complexity of user n, α and β are
Video features parameter relevant to multi-view video content,Indicate the viewpoint number that user n needs to transmit, it is big with the ken
Small correlation；
According to the size of the satisfaction yield value of user, the user of request multi-view point video service is ranked up, wherein
λ1≥λ2≥λj…λn, then the satisfaction yield value of user 1 is expressed as λ1, the satisfaction yield value of user j is expressed as λj, n is to ask
Seek the total quantity of the user of a Video service；
Calculate what the user 1 after sequence needed to consume according to the relationship for presetting consumption bandwidth and encoded content complexity
Bandwidth, and judge whether wireless network available bandwidth is less than the bandwidth that user 1 needs to consume, if it is, calculating the list of user 1
Position bandwidth price p1, whereinλ1For the satisfaction yield value of user 1, B is that wireless network can use band
Width, and set infinitely great for the unit bandwidth price of other users, go to step S3.6, if it is not, then calculating user's 1
Unit bandwidth price p1, wherein For the details coding complexity upper limit of user 1；
The bandwidth summation B that j user needs to consume before successively calculatingj, and judge whether wireless network available bandwidth is less than
Bj, if it is, the number of users of access wireless network is reduced, and the S3.5 that gos to step, if not, S3.4 is repeated,
It can be worked according to judging result determination in the number of users i-1 of the details coding complexity upper limit of user device hardware permission,
Wherein, Indicate j user
The middle details coding complexity upper limit for allowing to have i-1 user job to allow in its hardware needs the band consumed for i-1 user
Wide summation；
The bandwidth summation B that j-1 user needs to consume before successively calculatingj', and judge whether wireless network available bandwidth is small
In Bj', if it is, the number of users of access wireless network is reduced, and the S3.6 that gos to step, if it is not, then increasing access
The number of users of wireless network repeats step S3.5, and the target for allowing to access in wireless network is determined according to judging result
Number of users；
Obtain the unit bandwidth price of all users and the details coding complexity of distribution, wherein unit bandwidth price point
Not are as follows:
Wherein:
The corresponding details coding complexity of all users is respectively as follows:Wherein:
In one implementation, " request is added " message further include: the network address label of server, request are added "
Type of message code, left view piont mark.
In one implementation, bandwidth price messages sending module is specifically used for:
The length of " bandwidth price " message is determined according to the quantity of target user；
According to the length of message, the unit bandwidth price of target user, distribution details coding complexity and target user
Network address label construct " bandwidth price " message；
" bandwidth price " message is sent to the user of all request multi-view point video services, so that corresponding with target user
Mobile client the details coding of corresponding unit bandwidth price and distribution is determined according to corresponding network address label
Complexity, and corresponding expense is paid to server according to corresponding unit bandwidth price, it is obtained and distribution by data channel
The corresponding multi-view point video service of details coding complexity.
By the device that the embodiment of the present invention two is introduced, to implement a kind of more views for supporting VR in the embodiment of the present invention one
Device used by point three-dimensional video-frequency multiple access control method, so based on the method that the embodiment of the present invention one is introduced,
The affiliated personnel in this field can understand specific structure and the deformation of the device, so details are not described herein.All present invention are implemented
Device used by the method for example one belongs to the range of the invention to be protected.
Embodiment three
Based on the same inventive concept, present invention also provides a kind of computer readable storage medium 500, Fig. 5 is referred to,
On be stored with computer program 511, the program be performed realize embodiment one in method.
By the computer readable storage medium that the embodiment of the present invention three is introduced, to implement one in the embodiment of the present invention one
Kind supports computer readable storage medium used by the multi-viewpoint three-dimensional video multiple access control method of VR, so be based on
The method that the embodiment of the present invention one is introduced, the affiliated personnel in this field can understand the specific knot of the computer readable storage medium
Structure and deformation, so details are not described herein.Computer readable storage medium used by the method for all embodiment of the present invention one
Belong to the range of the invention to be protected.
Example IV
Based on the same inventive concept, present invention also provides a kind of computer equipment, Fig. 6 is referred to, including storage 601,
On a memory and the computer program 603 that can run on a processor, processor 602 executes above-mentioned for processor 602 and storage
The method in embodiment one is realized when program.
By the computer equipment that the embodiment of the present invention four is introduced, to implement a kind of support of work in the embodiment of the present invention one
Computer equipment used by the multi-viewpoint three-dimensional video multiple access control method of VR, so it is based on the embodiment of the present invention one
The method introduced, the affiliated personnel in this field can understand specific structure and the deformation of the computer equipment, so herein no longer
It repeats.Computer equipment used by the method for all embodiment of the present invention one belongs to the range of the invention to be protected.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Although preferred embodiments of the present invention have been described, it is created once a person skilled in the art knows basic
Property concept, then additional changes and modifications may be made to these embodiments.So it includes excellent that the following claims are intended to be interpreted as
It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, those skilled in the art can carry out various modification and variations without departing from this hair to the embodiment of the present invention
The spirit and scope of bright embodiment.In this way, if these modifications and variations of the embodiment of the present invention belong to the claims in the present invention
And its within the scope of equivalent technologies, then the present invention is also intended to include these modifications and variations.
Claims (10)
1. a kind of multi-viewpoint three-dimensional video multiple access control method for supporting VR is applied in wireless network, described wireless
Network includes command channel and data channel, which is characterized in that the control method includes:
Step S1: " request is added " message that mobile client is sent by described instruction channel is received, wherein " the request
It is added " for message to indicate that wireless network is added in mobile client request, " request is added " message includes the net of user
Network address label, the satisfaction yield value of user, size of field of view and the details coding complexity upper limit；
Step S2: judging whether the corresponding user of the mobile client is new user according to the network address label of the user,
If it is, sending " response addition " message to the mobile client, it is logical that server is had been received by " request is added " message
Know the mobile client；
Step S3: when reach preheating setting time every when, satisfaction yield value, the size of field of view of the server according to the user
And the details coding complexity upper limit regards all request multiple views using the Stackelberg theory of games of lack of balance
The user of business of being taken in small doses at short intervals carries out analysis decision calculating, determines to allow the target user, each user that obtain multi-view point video service
Unit bandwidth price and for each target user distribution details coding complexity；
Step S4: by the target user determined, target user unit bandwidth price, for target user distribution details
Encoder complexity and the network address label of each target user are configured to " bandwidth price " message, and " the bandwidth valence by described in
Lattice " message be sent to it is all request multi-view point video services users so that mobile client corresponding with target user according to
Corresponding network address label determines the details coding complexity of corresponding unit bandwidth price and distribution, and by described
Data channel reception multi-view point video service.
2. the method as described in claim 1, which is characterized in that when server receive mobile client transmission " request from
Open " message when, then to the mobile client send " response is left " message, stop to the mobile client provide multiple views
Video service.
3. the method as described in claim 1, which is characterized in that step S3 is specifically included:
S3.1: the relationship of consumption bandwidth and encoded content complexity is preset are as follows:
Wherein, bn(cn) it is the bandwidth that user n needs to consume,For the details coding complexity of user n, α and β be with it is more
The relevant video features parameter of viewpoint video content,The viewpoint number that user n needs to transmit is indicated, with size of field of view phase
It closes；
S3.2: according to the size of the satisfaction yield value of user, being ranked up the user of request multi-view point video service,
In, λ1≥λ2≥λj…λn, then the satisfaction yield value of user 1 is expressed as λ1, the satisfaction yield value of user j is expressed as λj, n is
The total quantity of the user of request point Video service；
S3.3: 1 needs of user after sequence are calculated according to the relationship for presetting consumption bandwidth and encoded content complexity
The bandwidth of consumption, and judge whether wireless network available bandwidth is less than the bandwidth that the user 1 needs to consume, if it is, meter
Calculate the unit bandwidth price p of the user 11, whereinλ1For the satisfaction yield value of user 1, B is
Wireless network available bandwidth, and set infinitely great for the unit bandwidth price of other users, go to step S3.6, if
It is no, then calculate the unit bandwidth price p of the user 11, wherein It is multiple for the details coding of user 1
The miscellaneous degree upper limit；
S3.4: the bandwidth summation B that j user needs to consume before successively calculatingj, and judge whether wireless network available bandwidth is less than
Bj, if it is, the number of users of access wireless network is reduced, and the S3.5 that gos to step, if not, S3.4 is repeated,
It can be worked according to judging result determination in the number of users i-1 of the details coding complexity upper limit of user device hardware permission,
Wherein, It indicates to permit in j user
Permitted the details coding complexity upper limit for thering is i-1 user job to allow in its hardware, the bandwidth for needing to consume for i-1 user is total
With；
S3.5: the bandwidth summation B that j-1 user needs to consume before successively calculatingj', and judge whether wireless network available bandwidth is small
In Bj', if it is, the number of users of access wireless network is reduced, and the S3.6 that gos to step, if it is not, then increasing access
The number of users of wireless network repeats step S3.5, and the target for allowing to access in wireless network is determined according to judging result
Number of users；
S3.6: the unit bandwidth price of all users and the details coding complexity for target user's distribution are obtained, wherein unit
Bandwidth price is respectively as follows:
Wherein:
It can work from user i to user j in corresponding Ciphering details
Under complexity upper range, the unit bandwidth price of user j+1 to user n is infinity ∞,For the unit band of user i
Wide price,For the unit bandwidth price of user j, δiFor process variable, for calculating the unit bandwidth price of user；
The corresponding details coding complexity of target user is respectively as follows:Wherein:
4. the method as described in claim 1, which is characterized in that " request is added " message further include: the network of server
Address label, " request is added " type of message code, left view piont mark.
5. the method as described in claim 1, which is characterized in that step S4 is specifically included:
Step S4.1: the length of " bandwidth price " message is determined according to the quantity of the target user；
Step S4.2: according to the length of the message, the unit bandwidth price of target user, distribution details coding complexity and
The network address label of target user constructs " bandwidth price " message；
Step S4.3: " bandwidth price " message by described in is sent to the users of all request multi-view point video services, so that and mesh
The corresponding mobile client of mark user determines corresponding unit bandwidth price and distribution according to corresponding network address label
Details coding complexity, and corresponding expense is paid to the server according to corresponding unit bandwidth price, passes through the number
It is believed that road obtains multi-view point video service corresponding with the details coding complexity of the distribution.
6. a kind of multi-viewpoint three-dimensional video multiple access control device for supporting VR is applied in wireless network, described wireless
Network includes command channel and data channel, which is characterized in that described device includes:
Message reception module is added in request, is disappeared for receiving mobile client by " request is added " that described instruction channel is sent
Breath, wherein " request is added " message is described " request is added " to indicate that wireless network is added in mobile client request
Message includes the network address label of user, the satisfaction yield value of user, size of field of view and the details coding complexity upper limit；
Message transmission module is added in response, judges that the mobile client is corresponding for the network address label according to the user
Whether user is new user, if it is, sending " response addition " message to the mobile client, server is had been received by
Mobile client described in " request is added " message informing；
Decision-making module, for when reach preheating setting time every when, satisfaction yield value of the server according to the user, the view
Domain size and the details coding complexity upper limit are more to all requests using the Stackelberg theory of games of lack of balance
The user of viewpoint video service carries out analysis decision calculating, determines the target user for allowing to obtain multi-view point video service, every
The unit bandwidth price of a user and the details coding complexity distributed for each target user；
Bandwidth price messages sending module, for by the unit bandwidth price of the target user determined, target user, be
The details coding complexity of target user's distribution and the network address label of each target user are configured to " bandwidth price " and disappear
Breath, and " bandwidth price " message by described in is sent to the users of all request multi-view point video services, so that with target user couple
The mobile client answered determines that the details of corresponding unit bandwidth price and distribution is compiled according to corresponding network address label
Code complexity, and pass through the data channel reception multi-view point video service.
7. device as claimed in claim 6, which is characterized in that described device further includes response leave group message sending module, is used
When receiving " request is left " message of mobile client transmission when server, then " response is sent to the mobile client
Leave " message, stop providing multi-view point video service to the mobile client.
8. device as claimed in claim 6, which is characterized in that the decision-making module is specifically used for:
Preset the relationship of consumption bandwidth and encoded content complexity are as follows:
Wherein, bn(cn) it is the bandwidth that user n needs to consume,For the details coding complexity of user n, α and β be with it is more
The relevant video features parameter of viewpoint video content,The viewpoint number that user n needs to transmit is indicated, with size of field of view phase
It closes；
According to the size of the satisfaction yield value of user, the user of request multi-view point video service is ranked up, wherein λ1≥
λ2≥λj…λn, then the satisfaction yield value of user 1 is expressed as λ1, the satisfaction yield value of user j is expressed as λj, n is request point
The total quantity of the user of Video service；
Calculate what the user 1 after sequence needed to consume according to the relationship for presetting consumption bandwidth and encoded content complexity
Bandwidth, and judge whether wireless network available bandwidth is less than the bandwidth that the user 1 needs to consume, if it is, described in calculating
The unit bandwidth price p of user 11, whereinλ1For the satisfaction yield value of user 1, B is wireless network
Network available bandwidth, and set infinitely great for the unit bandwidth price of other users, it gos to step and obtains the list of all users
The step of position bandwidth price and the details coding complexity of distribution, if it is not, then calculating the unit bandwidth price of the user 1
p1, wherein For the details coding complexity upper limit of user 1；
The bandwidth summation B that j user needs to consume before successively calculatingj, and judge whether wireless network available bandwidth is less than Bj, such as
Fruit is the number of users for then reducing access wireless network, and it is total to jump to the bandwidth that the preceding j-1 user of successively calculating needs to consume
And Bj' the step of, if not, repeating the step, can be worked according to judging result determination allows in user device hardware
The details coding complexity upper limit number of users i-1,
Wherein, It indicates to permit in j user
Permitted the details coding complexity upper limit for thering is i-1 user job to allow in its hardware, the bandwidth for needing to consume for i-1 user is total
With；
The bandwidth summation B that j-1 user needs to consume before successively calculatingj', and judge whether wireless network available bandwidth is less than
Bj', if it is, reduce the number of users of access wireless network, and jump to obtains the unit bandwidth price of all users with
The step of details coding complexity of distribution, repeats the step if it is not, then increasing the number of users of access wireless network
Suddenly, the target user's quantity for allowing to access in wireless network is determined according to judging result；
Obtain the unit bandwidth price of all users and the details coding complexity of distribution, wherein unit bandwidth price is respectively as follows:
Wherein:
It can work from user i to user j in corresponding Ciphering details
Under complexity upper range, the unit bandwidth price of user j+1 to user n is infinity ∞,For the unit band of user i
Wide price,For the unit bandwidth price of user j, δiFor process variable, for calculating the unit bandwidth price of user；
The corresponding details coding complexity of all users is respectively as follows:Wherein:
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is performed reality
The now method as described in any one of claims 1 to 5 claim.
10. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor
Calculation machine program, which is characterized in that realized when the processor executes described program as any one of claims 1 to 5 right is wanted
Seek the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811012668.2A CN108965858B (en) | 2018-08-31 | 2018-08-31 | A kind of multi-viewpoint three-dimensional video multiple access control method and device for supporting VR |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811012668.2A CN108965858B (en) | 2018-08-31 | 2018-08-31 | A kind of multi-viewpoint three-dimensional video multiple access control method and device for supporting VR |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108965858A CN108965858A (en) | 2018-12-07 |
| CN108965858B true CN108965858B (en) | 2019-09-10 |
Family
ID=64475640
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811012668.2A Active CN108965858B (en) | 2018-08-31 | 2018-08-31 | A kind of multi-viewpoint three-dimensional video multiple access control method and device for supporting VR |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108965858B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112684883A (en) * | 2020-12-18 | 2021-04-20 | 上海影创信息科技有限公司 | Method and system for multi-user object distinguishing processing |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8935328B2 (en) * | 2011-09-15 | 2015-01-13 | Ramakrishna J Tumuluri | System and method for collaborative 3D visualization and real-time interaction on a computer network |
| US10547825B2 (en) * | 2014-09-22 | 2020-01-28 | Samsung Electronics Company, Ltd. | Transmission of three-dimensional video |
| CN108307197A (en) * | 2015-12-01 | 2018-07-20 | 幸福在线（北京）网络技术有限公司 | Transmission method, playback method and the device and system of virtual reality video data |
| CN106303562B (en) * | 2016-09-20 | 2019-03-01 | 天津大学 | Multi-view point video adaptive transmitted control algorithm based on PI control |
| CN106454317B (en) * | 2016-11-15 | 2018-04-13 | 天津大学 | Stereoscopic video quality adaptive algorithm based on fuzzy control |
| CN107124603A (en) * | 2017-05-10 | 2017-09-01 | 中国电子科技集团公司第五十四研究所 | A kind of multi-view point video adaptive transmission method based on caching |
-
2018
- 2018-08-31 CN CN201811012668.2A patent/CN108965858B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN108965858A (en) | 2018-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Deng et al. | The server allocation problem for session-based multiplayer cloud gaming | |
| CN110226316A (en) | For executing conversion to virtual reality video and spreading defeated system and method | |
| Wang et al. | Adaptive mobile cloud computing to enable rich mobile multimedia applications | |
| CN103155572B (en) | For regulating the 3D video control system of 3D Video Rendering based on user preference | |
| Zheng et al. | Online cloud transcoding and distribution for crowdsourced live game video streaming | |
| CN102802054B (en) | Control method during a kind of multi-stream video is live and device | |
| Li et al. | Game-on-demand: An online game engine based on geometry streaming | |
| Park et al. | Volumetric media streaming for augmented reality | |
| Bilal et al. | Crowdsourced multi-view live video streaming using cloud computing | |
| CN101080001B (en) | Device for realizing balance of media content in network TV system and its method | |
| He et al. | Fog-based transcoding for crowdsourced video livecast | |
| CN105933727A (en) | Video stream transcoding and distributing method applied to live game video streaming platform | |
| CN106060513B (en) | A kind of code stream caching method for cylinder three-dimensional panoramic video netcast | |
| CN106162214A (en) | Method for video coding and net cast client | |
| CN103299347B (en) | Online rendering intent based on cloud application and off-line rendering intent and relevant apparatus | |
| CN103650001A (en) | Moving image distribution server, moving image playback device, control method, program, and recording medium | |
| CN105262960B (en) | A kind of three-dimensional television signal edit methods based on Cluster Rendering | |
| CN108769824A (en) | A kind of video mixed flow method, apparatus, system, equipment and medium | |
| CN105338372A (en) | Adaptive video stream transcoding method applied to game live broadcast platform | |
| CN106412641A (en) | Online and offline combined movie on-demand method | |
| CN106303562A (en) | The multi-view point video adaptive transmitted control algorithm controlled based on PI | |
| CN108965858B (en) | A kind of multi-viewpoint three-dimensional video multiple access control method and device for supporting VR | |
| Deng et al. | Server allocation for multiplayer cloud gaming | |
| Yaqoob et al. | Dynamic viewport selection-based prioritized bitrate adaptation for tile-based 360° video streaming | |
| Yarnagula et al. | QoE for mobile clients with segment-aware rate adaptation algorithm (SARA) for DASH video streaming |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |