Summary of the invention
The technical problem to be solved in the present invention provides a kind ofly carries out the method that solid is played up to scene, and the figure after this method makes solid play up has better stereo display effect.
In order to address the above problem, the invention provides and a kind of scene is carried out the method that solid is played up, comprising:
Calculate wait to play up scene with scene and camera between the relevant depth parameter of distance and wait to play up the scene scale parameter of scene;
According to relevant depth parameter and the scene scale parameter of distance between described that wait to play up scene and scene and camera, determine the parallax free face degree of depth of first camera and second camera;
Based on the described parallax free face degree of depth of determining, use described first camera and second camera to wait to play up scene and play up respectively to described.
Preferably,
The depth parameter that distance is relevant between described that wait to play up scene and scene and camera comprises minimum-depth, mean depth and the depth capacity of waiting to play up scene, and described mean depth equals the described mean value of waiting to play up the degree of depth of all pixels in the scene.
The described scene scale parameter of playing up scene of waiting comprises that described depth capacity deducts the depth difference that minimum-depth obtains.
Preferably,
Described according to relevant depth parameter and the scene scale parameter of distance between described that wait to play up scene and scene and camera, determine the parallax free face degree of depth of first camera and second camera, comprising:
Ranking operation result according to described minimum-depth, mean depth and depth capacity determines the described parallax free face degree of depth; Wherein, within weights border separately, the weights of described minimum-depth increase with the increase of described minimum-depth and depth difference, and the weights of described mean depth and depth capacity reduce with the increase of described minimum-depth and depth difference or remain unchanged.
Preferably,
The ranking operation result of described minimum-depth, mean depth and depth capacity is weighted the result that average calculating operation obtains to described minimum-depth, mean depth and depth capacity, the weights of each depth parameter are all more than or equal to 0 and smaller or equal to 1, and the weights sum of each depth parameter equals 1.
Preferably,
The weights of described depth capacity are zero, and the weights of described minimum-depth obtain according to the weighted sum and the corresponding weights border of described minimum-depth and depth difference, and described weighted sum is within described weights border the time, and the weights of described minimum-depth equal described weighted sum; When described weighted sum surpassed the coboundary on described weights border or lower boundary, the weights of described minimum-depth equaled described coboundary or lower boundary.
Preferably,
The weights of described minimum-depth obtain according to the weighted sum and the corresponding weights border of described minimum-depth and depth difference, wherein, the inverse of the weights sum of the weights of described minimum-depth and described depth difference equals the absolute value of the depth difference between cutting face far away and the nearly cutting face, and the coboundary in the corresponding weights border is less than 1.
Preferably,
Use described first camera and second camera to wait to play up before scene plays up respectively first spacing when determining to play up in the following manner between described first camera and second camera to described:
Based on the parallax free face degree of depth of determining, calculate and describedly wait to play up the pixel that has described depth capacity in the scene when the maximum positive parallax that the parallax of first view and second view equals to allow, second spacing between described first camera and second camera;
Based on the parallax free face degree of depth of determining, calculate and describedly wait to play up the pixel that has described minimum-depth in the scene when the maximum negative parallax that the parallax of first view and second view equals to allow, the 3rd spacing between described first camera and second camera;
With in described second spacing and the 3rd spacing less one be defined as described first spacing.
Another technical matters that the present invention will solve provides a kind of graph and image processing device, and the figure that this graph and image processing device carries out obtaining after solid is played up to scene has better stereo display effect.
In order to address the above problem, the invention provides a kind of graph and image processing device, it is characterized in that, comprising:
The scene analysis module, be used to calculate wait to play up scene with scene and camera between the relevant depth parameter of distance and wait to play up the scene scale parameter of scene;
The parameter determination module comprises again: the degree of depth is determined submodule, is used for determining the parallax free face degree of depth of first camera and second camera according to relevant depth parameter and the scene scale parameter of distance between described that wait to play up scene and scene and camera;
Three-dimensional rendering module is used for based on the described parallax free face degree of depth of determining, uses described first camera and second camera to wait to play up scene and play up respectively described.
Preferably,
Described scene analysis module comprises:
The statistics submodule, be used to calculate wait to play up scene with scene and camera between the relevant depth parameter of distance, described depth parameter comprises minimum-depth, mean depth and the depth capacity of waiting to play up scene, and described mean depth equals the described mean value of waiting to play up the degree of depth of all pixels in the scene;
Calculating sub module is used to calculate the scene scale parameter of waiting to play up scene, and described scene scale parameter comprises that described depth capacity deducts the depth difference that minimum-depth obtains.
Preferably,
The described degree of depth determines that submodule is that ranking operation result according to described minimum-depth, mean depth and depth capacity determines the described parallax free face degree of depth; Wherein, within weights border separately, the weights of described minimum-depth increase with the increase of described minimum-depth and depth difference, and the weights of described mean depth and depth capacity reduce with the increase of described minimum-depth and depth difference or remain unchanged.
Preferably,
The described degree of depth determines that submodule is to determine the described parallax free face degree of depth according to described minimum-depth, mean depth and depth capacity being weighted the result that average calculating operation obtains, the weights of each depth parameter are all more than or equal to 0 and smaller or equal to 1, and the weights sum of each depth parameter equals 1.
Preferably,
The described degree of depth determines that submodule is when being weighted result that average calculating operation obtains and determining the described parallax free face degree of depth to described minimum-depth, mean depth and depth capacity, the weights of described depth capacity are made as zero, the weights that obtain described minimum-depth according to the weighted sum and the corresponding weights border of described minimum-depth and depth difference, described weighted sum is within described weights border the time, and the weights of described minimum-depth equal described weighted sum; When described weighted sum surpassed the coboundary on described weights border or lower boundary, the weights of described minimum-depth equaled described coboundary or lower boundary.
Preferably,
The described degree of depth is determined the weights that submodule obtains described minimum-depth according to the weighted sum and the corresponding weights border of described minimum-depth and depth difference, wherein, the inverse of the weights sum of the weights of described minimum-depth and described depth difference equals the absolute value of the depth difference between cutting face far away and the nearly cutting face.
Preferably,
Described graph and image processing device is based on one or more realizations in central processing unit (CPU), coprocessor (GPU), programmable logic device (PLD) (FPGA) and the special IC (ASIC).
Preferably,
Described parameter determination module comprises that also spacing determines submodule, first spacing when being used to determine to play up between described first camera and second camera;
Described parameter determination module comprises again:
The first spacing arithmetic element, be used for based on the parallax free face degree of depth of determining, calculate and describedly wait to play up the pixel that has described depth capacity in the scene when the maximum positive parallax that the parallax of first view and second view equals to set, second spacing between described first camera and second camera;
The second spacing arithmetic element, be used for based on the parallax free face degree of depth of determining, calculate and describedly wait to play up the pixel that has described minimum-depth in the scene when the maximum negative parallax that the parallax of first view and second view equals to set, the 3rd spacing between described first camera and second camera;
Decision unit is used for that described second spacing and the 3rd spacing is less one and is defined as described first spacing.
Said method and graph and image processing device are carrying out solid when playing up to scene, calculate the parallax free face degree of depth of first camera and second camera adaptively according to the characteristics of distance between scene scale and scene and camera, the figure after making solid play up can bring more real stereoeffect to the beholder.In addition, can also pass through restriction, guarantee beholder's comfort, obtain stereoeffect as well as possible the spacing of first camera and second camera.Such scheme can be applied to need carry out the occasion that solid is played up and shown to scene as 3d gaming, three-dimensional animation and three-dimensional movie etc.
The another technical matters that the present invention will solve provides a kind of portable terminal, and the figure that this portable terminal carries out obtaining after solid is played up to scene has better stereo display effect.
In order to address the above problem, the invention provides a kind of portable terminal, comprise three-dimensional display, it is characterized in that, also comprise as graph and image processing device provided by the invention, described graph and image processing device use first camera and second camera to described wait to play up scene and play up respectively after, be sent to described three-dimensional display and show playing up two width of cloth figures that obtain.
Because adopted above-mentioned graph and image processing device, the figure that this portable terminal carries out obtaining after solid is played up to scene has better stereo display effect.
The another technical matters that the present invention will solve provides a kind of computer system, and the figure that this computer system carries out obtaining after solid is played up to scene has better stereo display effect.
In order to address the above problem, the invention provides a kind of computer system, comprise graphics storage devices, graph and image processing device and 3 d display device, it is characterized in that:
Described graphics storage devices is used to preserve view data and the attribute data of waiting to play up scene, and wherein, described attribute data comprises the described degree of depth of waiting to play up each pixel in the scene;
Described graph and image processing device, adopt graph and image processing device provided by the invention, wherein, the described degree of depth of waiting to play up each pixel in the scene reads from described graphics storage devices, and use first camera and second camera to described wait to play up scene and play up respectively after, be sent to described 3 d display device with playing up two width of cloth figures that obtain;
Described 3 d display device is used for based on described two width of cloth figures scene described to be played up being carried out stereo display.
Because adopted above-mentioned graph and image processing device, the figure that this computer system carries out obtaining after solid is played up to scene has better stereo display effect.
The another technical matters that the present invention will solve provides a kind of image acquisition equipment, and the figure that this image acquisition equipment carries out obtaining after solid is played up to scene has better stereo display effect.
In order to address the above problem, the invention provides a kind of image acquisition equipment, comprise image acquiring device and image display, it is characterized in that, also comprise graph and image processing device provided by the invention, described graph and image processing device calculates the employed described degree of depth of waiting to play up each pixel in the scene and obtains from described image acquiring device, use first camera and second camera to described wait to play up scene and play up respectively after, be sent to described image display with playing up two width of cloth figures that obtain.
Preferably, described image acquisition equipment can be stereocamera or stereocamera.
Because adopted above-mentioned graph and image processing device, the figure that this image acquisition equipment carries out obtaining after solid is played up to scene has better stereo display effect.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, hereinafter will be elaborated to embodiments of the invention in conjunction with the accompanying drawings.Need to prove that under the situation of not conflicting, embodiment among the application and the feature among the embodiment be combination in any mutually.
First embodiment
The scene that present embodiment is formed a plurality of objects is carried out solid when playing up, and according to the characteristics of the distance between scene scale and camera and scene, the parallax free face degree of depth of first camera and second camera is adjusted, and can obtain desirable stereo display effect.
People can be placed on notice on certain object when the little scene of close-ups, wish to see more details, so when stereo display, if allow more that object in the scene protrudes, it is truer to seem.As the example of Fig. 3 a, during little scene that a few object of close-ups is formed, wish that the object of front protrudes more more this moment.And people can think to obtain more the impression of panorama when the distant surveillance large scene, so if allow recessed more of object in the scene when stereo display, can bring stronger three-dimensional depth feelings.During large scene that a lot of objects of distant surveillance are formed,,,, can allow recessed more of object in the scene, also can avoid scene to be shown the influence that device is cut edge simultaneously in order to obtain a kind of depth feelings because scene is on a grand scale as the example of Fig. 3 b.
For this reason, can calculate earlier wait to play up scene with scene and camera between relevant depth parameter and the scene scale parameter of distance; Then, the parallax free face degree of depth of determining first camera and second camera according to the relevant depth parameter of distance between described and scene and camera and scene scale parameter; At last, based on the described parallax free face degree of depth, use first camera and second camera to wait to play up scene and play up respectively to described.
Scene is carried out can using one camera that the 3D scene is drawn before solid plays up, obtain scene to be played up.Fig. 5 shows the synoptic diagram that common use one camera is drawn the 3D scene.Plane, ABCD place among the figure is cutting face far away (Back clipping plane), and plane, A ' B ' C ' D ' place is nearly cutting face (Front clipping plane).Only the pixel in the scene between nearly cutting face and cutting face far away just may be projected to the projection plane (View plane) at EFGH place, and the part outside these two faces all can be dismissed.Each pixel that projects to projection plane has constituted scene to be played up.In the literary composition, the distance table between nearly cutting face and the cutting face far away is shown Z
f-Z
n, Z wherein
fBe the degree of depth of cutting face far away, Z
nThe degree of depth for nearly cutting face.Z
f, Z
nIn a certain application, can be taken as constant.
Present embodiment carries out method that solid plays up as shown in Figure 4 to scene, comprising:
Step 110 according to the degree of depth of waiting to play up each pixel in the scene, determines to wait to play up the minimum-depth Z of scene
Min, mean depth Z
AvgWith depth capacity Z
Max, and compute depth difference Z
s=Z
Max-Z
Min
Wait to play up that the degree of depth of each pixel is the transversal section at these pixel places and the distance between first camera and the transversal section, the second camera place in the scene.Wherein, Z
MinFor waiting to play up in the scene degree of depth with the nearest pixel of camera distance; Z
AvgFor waiting to play up the mean value of the degree of depth of all pixels in the scene; Z
MaxFor waiting to play up in the scene degree of depth with camera distance pixel farthest.Z
Min, Z
AvgAnd Z
MaxAll be with scene and camera between the relevant depth parameter of distance, wherein, Z
MinBe also referred to as the minor increment between camera and scene in the text, be used to represent to observe the characteristics of the distance of waiting to play up scene.Z
sAs scene scale parameter, be used to represent to wait play up the characteristics of the scene scale of scene.The data of the degree of depth of above-mentioned pixel can be obtained from corresponding memory storage such as buffer memory.
Step 120 is according to minimum-depth Z
Min, mean depth Z
AvgWith depth capacity Z
MaxThe ranking operation result determine the parallax free face degree of depth Z of first camera and second camera
Con, wherein, within weights border separately, Z
MinWeights with Z
MinAnd Z
sIncrease and increase Z
AvgAnd Z
MaxWeights with Z
MinAnd Z
sIncrease and reduce or remain unchanged;
Need to prove, according to Z
Min, Z
AvgAnd Z
MaxThe ranking operation result determine Z
ConThe time, Z
ConCan calculate according to corresponding operational formula; Z
ConAlso can be according to the Z that calculates
Min, Z
AvgAnd Z
MaxSearch in advance the result that preserves according to ranking operation as comprising Z
ConWith Z
Min, Z
AvgAnd Z
MaxCorresponding relation table and obtain; Z
ConAlso can obtain in conjunction with the aforementioned calculation and the dual mode of tabling look-up.
Above-mentioned Z
MinAnd Z
sIncrease and comprise Z
MinAnd Z
sIncrease simultaneously, and Z
MinAnd Z
sIn one increase a constant situation.
Within corresponding weights border, Z
MinWeights with Z
MinAnd Z
sIncrease and when increasing, can be as long as Z
MinAnd Z
sIncrease Z
MinWeights promptly increase; Also can be at Z
MinAnd Z
sAfter increasing certain numerical value, Z
MinWeights increase again.Be Z
MinWeights value continuously, also can quantize.
Above-mentioned ranking operation can adopt the weighted mean computing, that is, parallax free face degree of depth con can calculate according to following formula:
Z
Con=Z
Minα+Z
Avgβ+Z
Maxγ formula (1)
Wherein, α is Z
MinWeights, β is Z
AvgWeights, γ is Z
MaxWeights because be the weighted mean computing, so each weights satisfies: alpha+beta+γ=1,0≤α≤1,0≤β≤1,0≤γ≤1.According to the constraint condition that above-mentioned weights change, in the present embodiment, α, beta, gamma also satisfy: α is with Z
MinAnd Z
sIncrease and increase, and when α increases, beta, gamma reduce simultaneously or one constant one reduce.
Weights γ can also can be according to Z for fixed value
MinAnd Z
sDetermine, be not limited to certain specific mode.In one example, get γ=0, then formula (1) can be expressed as:
Z
Con=Z
Minα+Z
Avg(1-α) formula (2)
At this moment, 0≤α<1, β=1-α.
Step 130 is based on the parallax free face degree of depth Z that determines
Con, use first camera and second camera to wait to play up scene and play up respectively to described.
In this step, minimum-depth Z
MinWeights α can be according to Z
MinAnd Z
sWeighted sum and the border of weights α determine, specifically can be in the following ways:
Order:
Formula (3)
Wherein, Z
fThe degree of depth of the cutting face far away for to scene rendering the time, Z
nThe degree of depth of the nearly cutting face for to scene rendering the time, k is default coefficient, 0<k<1.K can adopt empirical value, has represented the weight of d and s.
As shown in Figure 6, according to the characteristics of distance between scene scale and camera and scene, roughly can be divided into closely play up little scene (as indoor scene), at a distance play up little scene, closely play up large scene (as outdoor scene) and play up situation such as large scene at a distance.Wherein, Z
MinAnd Z
sIn the time of all little, belong to the situation of closely playing up little scene, Z
MinAnd Z
sIn the time of all big, belong to the situation of playing up large scene at a distance.
According to the method for present embodiment, at Z
MinAnd Z
sIn the time of all little, Z
MinWeights α smaller, the parallax free face degree of depth Z of first camera that calculates and second camera
ConRelatively large, with regard to there being more part to be positioned at before the parallax free face, to finish solid like this and play up when carrying out stereo display in the scene, it is more that the object in the scene will protrude, and wants to see the custom of more details when meeting the little scene of people's close-ups.And Z
MinAnd Z
sIn the time of all big, Z
MinWeights α bigger, the parallax free face degree of depth Z of first camera that calculates and second camera
ConSmaller relatively, just there is more part to be positioned at after the parallax free face in the scene, finish solid like this and play up when carrying out stereo display, what the object in the scene will be recessed is more, meets the custom that people's distant surveillance large scene thinks to obtain more the panorama impression.Therefore, adopt the present embodiment method that scene is carried out the method that solid plays up and to bring more real stereoeffect to the observer.
Correspondingly, present embodiment also provides a kind of graph and image processing device, and this graph and image processing device can be based on one or more realizations in central processing unit (CPU), coprocessor (GPU), programmable logic device (PLD) (FPGA) and the special IC (ASIC).Can be that CPU, GPU move corresponding software and realize, also can realize based on the hardware logic in the logical circuits such as FPGA, ASIC that perhaps part is based on hardware logic electric circuit, part realizes based on software.
(spacing of second embodiment shown in broken lines is determined submodule 202 among the figure) as shown in Figure 7, the graph and image processing device of present embodiment comprises scene analysis module 10, parameter determination module 20 and three-dimensional rendering module 30, wherein:
Described scene analysis module 10, be used to calculate wait to play up scene with scene and camera between the relevant depth parameter of distance and wait to play up the scene scale parameter of scene.
This scene analysis module 10 comprises again:
Statistics submodule 101, be used to calculate wait to play up scene with scene and camera between the relevant depth parameter of distance, described depth parameter comprises minimum-depth, mean depth and the depth capacity of waiting to play up scene, and described mean depth equals the described mean value of waiting to play up the degree of depth of all pixels in the scene;
Calculating sub module 102 is used to calculate the scene scale parameter of waiting to play up scene, and described scene scale parameter comprises that described depth capacity deducts the depth difference that minimum-depth obtains.
Described parameter determination module 20 comprises again:
The degree of depth is determined submodule 201, is used for determining the parallax free face degree of depth of first camera and second camera according to relevant depth parameter and the scene scale parameter of distance between described that wait to play up scene and scene and camera.In the present embodiment, be that ranking operation result according to described minimum-depth, mean depth and depth capacity determines the described parallax free face degree of depth; Wherein, within weights border separately, the weights of described minimum-depth increase with the increase of described minimum-depth and depth difference, and the weights of described mean depth and depth capacity reduce with the increase of described minimum-depth and depth difference or remain unchanged.Above-mentioned ranking operation can be the weighted mean computing, and the weights of each depth parameter are all more than or equal to 0 and smaller or equal to 1, and the weights sum of each depth parameter equals 1.
In one example, the degree of depth determines that submodule is made as zero with the weights of described depth capacity, the weights that obtain described minimum-depth according to the weighted sum and the corresponding weights border of described minimum-depth and depth difference, described weighted sum is within described weights border the time, and the weights of described minimum-depth equal described weighted sum; When described weighted sum surpassed the coboundary on described weights border or lower boundary, the weights of described minimum-depth equaled described coboundary or lower boundary.Wherein, the inverse of the weights sum of the weights of described minimum-depth and described depth difference can equal the absolute value of the depth difference between cutting face far away and the nearly cutting face.
Described three-dimensional rendering module 30 is used for based on the described parallax free face degree of depth of determining, uses described first camera and second camera to wait to play up scene and play up respectively described.
Above-mentioned graph and image processing device can be applied to have in the equipment of three-dimensional display, in mobile phone, computer, TV or the like.
Correspondingly, present embodiment also provides a kind of portable terminal, comprise three-dimensional display, the graph and image processing device that also comprises present embodiment, this graph and image processing device use first camera and second camera to described wait to play up scene and play up respectively after, be sent to described three-dimensional display and show playing up two width of cloth figures that obtain.
Correspondingly, present embodiment provides a kind of computer system again, comprises graphics storage devices, graph and image processing device and 3 d display device, wherein:
Described graphics storage devices is used to preserve view data and the attribute data of waiting to play up scene, and wherein, described attribute data comprises the described degree of depth of waiting to play up each pixel in the scene;
Described graph and image processing device, adopt the graph and image processing device of present embodiment, wherein, the described degree of depth of waiting to play up each pixel in the scene reads from described graphics storage devices, and use first camera and second camera to described wait to play up scene and play up respectively after, be sent to described 3 d display device with playing up two width of cloth figures that obtain;
Described 3 d display device is used for based on described two width of cloth figures scene described to be played up being carried out stereo display.
Correspondingly, present embodiment provides a kind of image acquisition equipment again, comprise image acquiring device and image display, the graph and image processing device that also comprises present embodiment, described graph and image processing device calculates the employed described degree of depth of waiting to play up each pixel in the scene and obtains from described image acquiring device, use first camera and second camera to described wait to play up scene and play up respectively after, be sent to described image display with playing up two width of cloth figures that obtain.Described image acquisition equipment can be stereocamera or stereocamera.
Second embodiment
Among first embodiment, the spacing L when playing up between first camera and second camera
SepCan handle by the mode of prior art.Present embodiment then on the basis of first embodiment, has adopted hereinafter described determining deviation L really
SepMethod.
The spacing of human eye generally is about 65mm, so object can not be excessive in the positive negative parallax of first view and second view, otherwise can bring the sense of fatigue of eyes.Object is relevant with the degree of depth of spacing, the parallax free face degree of depth and the object of first camera and second camera in the positive negative parallax of first view and second view, limits by the spacing of the positive negative parallax of the maximum that sets in advance permission to first camera and second camera.
Please refer to Fig. 8 a, show and wait to play up the pixel that has depth capacity in the scene parallax D at first view and second view
1, D
1>0, the parallax free face of first camera and second camera is corresponding to display screen when playing up.As seen from the figure:
Each meaning of parameters is worked as D with above in the formula
1During the maximum positive parallax that equals to allow, the L that obtains
SepBe designated as L
Sep1
Please refer to Fig. 8 b, show and wait to play up the pixel that has minimum-depth in the scene parallax D at first view and second view
2, D
2<0.As seen from the figure:
With D
2During the maximum negative parallax that equals to allow, the L that obtains
SepBe designated as L
Sep2
In the present embodiment, maximum positive parallax and maximum positive negative parallax can be according to the spacing values of human eye, for example, and desirable [65mm, 65mm].
Present embodiment carries out the method that solid is played up to scene, comprising: the step 110 and 120 by first embodiment is handled, and obtains Z
ConAfter, calculate L in a manner described
Sep1And L
Sep2, with L
Sep1And L
Sep2In the spacing L of less first camera when being defined as playing up and second camera
SepThen, based on the Z that determines
ConAnd L
Sep, use first camera and second camera to treat to play up scene and play up respectively, generate two width of cloth figures that are used for stereo display.
By the L that determines with upper type
Sep, the disparity range that can guarantee all objects in the scene is in the scope of the maximum positive negative parallax that allows, thus the assurance human eye can not feel tired.Simultaneously, because L
SepBy the maximum positive negative parallax value that allows, can obtain better stereo display effect so that the object in the scene protrudes or recessed degree is bigger.
Correspondingly, present embodiment carries out the system that solid is played up to scene, and on the basis of the first embodiment system, the parameter determination module also comprises:
Spacing is determined submodule 202, first spacing when being used to determine to play up between described first camera and second camera.
Described spacing determines that submodule 202 comprises again:
The first spacing arithmetic element, be used for based on the parallax free face degree of depth of determining, calculate and describedly wait to play up the pixel that has described depth capacity in the scene when the maximum positive parallax that the parallax of first view and second view equals to set, second spacing between described first camera and second camera;
The second spacing arithmetic element, be used for based on the parallax free face degree of depth of determining, calculate and describedly wait to play up the pixel that has described minimum-depth in the scene when the maximum negative parallax that the parallax of first view and second view equals to set, the 3rd spacing between described first camera and second camera;
Decision unit is used for that described second spacing and the 3rd spacing is less one and is defined as described first spacing.
One of ordinary skill in the art will appreciate that all or part of step in the said method can instruct related hardware to finish by program, described program can be stored in the computer-readable recording medium, as ROM (read-only memory), disk or CD etc.Alternatively, the all or part of step of the foregoing description also can use one or more integrated circuit to realize, correspondingly, each the device/module/unit in the foregoing description can adopt the form of hardware to realize, also can adopt the form of software function module to realize.The present invention is not restricted to the combination of the hardware and software of any particular form.
The above is the preferred embodiments of the present invention only, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.Within the spirit and principles in the present invention all, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.