CN110177287A - A kind of image procossing and live broadcasting method, device, equipment and storage medium - Google Patents
A kind of image procossing and live broadcasting method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN110177287A CN110177287A CN201910503121.0A CN201910503121A CN110177287A CN 110177287 A CN110177287 A CN 110177287A CN 201910503121 A CN201910503121 A CN 201910503121A CN 110177287 A CN110177287 A CN 110177287A
- Authority
- CN
- China
- Prior art keywords
- pixel
- point
- image data
- texture coordinate
- brightness value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000003796 beauty Effects 0.000 claims description 29
- 238000012545 processing Methods 0.000 claims description 25
- 238000003672 processing method Methods 0.000 claims description 24
- 230000015654 memory Effects 0.000 claims description 18
- 230000004044 response Effects 0.000 claims description 14
- 230000002596 correlated effect Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 11
- 230000000875 corresponding effect Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 230000007704 transition Effects 0.000 description 6
- 239000003086 colorant Substances 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000001815 facial effect Effects 0.000 description 3
- WYTGDNHDOZPMIW-RCBQFDQVSA-N alstonine Natural products C1=CC2=C3C=CC=CC3=NC2=C2N1C[C@H]1[C@H](C)OC=C(C(=O)OC)[C@H]1C2 WYTGDNHDOZPMIW-RCBQFDQVSA-N 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 230000004438 eyesight Effects 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 210000000216 zygoma Anatomy 0.000 description 2
- AXDJCCTWPBKUKL-UHFFFAOYSA-N 4-[(4-aminophenyl)-(4-imino-3-methylcyclohexa-2,5-dien-1-ylidene)methyl]aniline;hydron;chloride Chemical compound Cl.C1=CC(=N)C(C)=CC1=C(C=1C=CC(N)=CC=1)C1=CC=C(N)C=C1 AXDJCCTWPBKUKL-UHFFFAOYSA-N 0.000 description 1
- VQLYBLABXAHUDN-UHFFFAOYSA-N bis(4-fluorophenyl)-methyl-(1,2,4-triazol-1-ylmethyl)silane;methyl n-(1h-benzimidazol-2-yl)carbamate Chemical compound C1=CC=C2NC(NC(=O)OC)=NC2=C1.C=1C=C(F)C=CC=1[Si](C=1C=CC(F)=CC=1)(C)CN1C=NC=N1 VQLYBLABXAHUDN-UHFFFAOYSA-N 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005662 electromechanics Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000003595 mist Substances 0.000 description 1
- 238000002203 pretreatment Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Generation (AREA)
Abstract
The invention discloses a kind of image procossings and live broadcasting method, device, equipment and storage medium.This method comprises: obtaining raw image data；Determine the texture coordinate of each pixel in raw image data；Determine that first object point and at least two second target points, the second target point are adjacent in texture coordinate with first object point from pixel；Brightness value of the first object point on texture coordinate is adjusted according to brightness value of second target point on texture coordinate, obtains destination image data；According to texture coordinate displaying target image data.The brightness of first object point is adjusted according to the brightness of the second target point around first object point, solves the problems, such as that user brightness overexposure and face's colour of skin in photo or video are non-uniform.
Description
Technical field
The present embodiments relate to image processing techniques more particularly to a kind of image procossing and live broadcasting method, device, equipment
And storage medium.
Background technique
With the prevalence of U.S. face, more and more users are wished to through U.S. face tool to the personage in picture or video
Carry out U.S. face processing.
Especially in mobile phone photograph and live streaming field, the demand to U.S. face is increasingly highlighted.Currently, general use passes through knowledge
The method of others' brightness of the face to control the exposure time of mobile phone, to adjust video image, to realize the adjusting to light.In this way
Adjusting method image pre-treatment is controlled by local message, to realize the brightness of adjusting video images.Such adjusting
Method has that part can not react the overall situation, such as: such as identification face control brightness is applicable in face and is not suitable for face
Brightness of image in addition.So as to cause user in photo or video brightness overexposure and the non-uniform problem of face's colour of skin.
Summary of the invention
The present invention provides a kind of image procossing and live broadcasting method, device, equipment and storage medium, to solve user in photo
Or brightness overexposure and the non-uniform problem of face's colour of skin in video.
In a first aspect, the embodiment of the invention provides a kind of image processing methods, comprising:
Obtain raw image data；
Determine the texture coordinate of each pixel in the raw image data；
First object point and at least two second target points, second target point and institute are determined from the pixel
It is adjacent in the texture coordinate to state first object point；
According to brightness value of second target point on the texture coordinate to the first object point in the texture
Brightness value on coordinate is adjusted, and obtains destination image data；
The destination image data is shown according to the texture coordinate.
On this basis, the texture coordinate includes first direction；
It is described that first object point and at least two second target points are determined from the pixel, comprising:
First object point successively is set by the pixel along first direction；
Centered on the coordinate of the first object point in said first direction, determined in the raw image data
First object range；
If the coordinate of the pixel in said first direction is located within the scope of the first object, by the pixel
Point is set as the second target point.
On this basis, the brightness value according to second target point on the texture coordinate is to first mesh
Brightness value of the punctuate on the texture coordinate is adjusted, and obtains destination image data, comprising:
Determine first weight of second target point relative to the first object point；
First weight is configured to the brightness value of second target point in said first direction, obtains the first candidate brightness
Value；
The average value between the described first candidate brightness value is calculated, in said first direction as the first object point
Brightness value.
On this basis, first weight of the determination second target point relative to the first object point, comprising:
Determine the distance between second target point and the first object point；
Determine that the first weight of second target point, first weight and the distance are positively correlated.
On this basis, the texture coordinate includes second direction；It is described that first object point is determined from the pixel
And at least two second target points, including
First object point successively is set by the pixel in a second direction；
Centered on the coordinate of the first object point in this second direction, determined in the raw image data
Second target zone；
If the coordinate of the pixel in this second direction is located in second target zone, by the pixel
Point is set as the second target point.
On this basis, the brightness value according to second target point on the texture coordinate is to first mesh
Brightness value of the punctuate on the texture coordinate is adjusted, and obtains destination image data, comprising:
Determine second weight of second target point relative to the first object point；
Second weight is configured to the brightness value of second target point in this second direction, obtains the second candidate brightness
Value；
The average value between the described second candidate brightness value is calculated, in this second direction as the first object point
Brightness value.
Second aspect, the embodiment of the invention also provides a kind of live broadcasting methods, comprising:
Direct broadcast server is requested to create direct broadcasting room；
Original live video data is acquired, the original live video data includes raw image data, the original graph
As each pixel has texture coordinate in data；
Receive beauty operation；
In response to the beauty operation, first object point and at least two second targets are determined from the pixel
Point, second target point and the first object point are adjacent in the texture coordinate；
According to brightness value of second target point on the texture coordinate to the first object point in the texture
Brightness value on coordinate is adjusted, and obtains destination image data；
The destination image data is shown according to the texture coordinate；
Generate target live video data according to the destination image data, and be sent to the direct broadcast server, with
It is played in the direct broadcasting room.
The third aspect, the embodiment of the invention also provides a kind of image processing apparatus, comprising:
Data acquisition module, for obtaining raw image data；
Coordinate determining module, for determining the texture coordinate of each pixel in the raw image data；
Target point determining module, for determining first object point and at least two second targets from the pixel
Point, second target point and the first object point are adjacent in the texture coordinate；
Luminance adjustment module, for according to brightness value of second target point on the texture coordinate to described first
Brightness value of the target point on the texture coordinate is adjusted, and obtains destination image data；
Data disaply moudle, for showing the destination image data according to the texture coordinate.
Fourth aspect, the embodiment of the invention also provides a kind of live broadcast devices, comprising:
Direct broadcasting room creation module, for requesting direct broadcast server to create direct broadcasting room；
Data acquisition module, for acquiring original live video data, the original live video data includes original graph
As data, each pixel has texture coordinate in the raw image data；
Receiving module is operated, for receiving beauty operation；
Operate respond module, in response to the beauty operation, determined from the pixel first object point and
At least two second target points, second target point and the first object point are adjacent in the texture coordinate；
Data obtaining module, for according to brightness value of second target point on the texture coordinate to described first
Brightness value of the target point on the texture coordinate is adjusted, and obtains destination image data；
Image display, for showing the destination image data according to the texture coordinate；
Video playback module for generating target live video data according to the destination image data, and is sent to institute
Direct broadcast server is stated, to play in the direct broadcasting room.
5th aspect, the embodiment of the invention also provides a kind of electronic equipment, comprising:
One or more processors；
Memory, for storing one or more programs；
When one or more of programs are executed by one or more of processors, so that one or more of processing
Device realizes a kind of image processing method as described in relation to the first aspect；
Or,
When one or more of programs are executed by one or more of processors, so that one or more of processing
Device realizes a kind of live broadcasting method as described in second aspect.
6th aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer
Program realizes a kind of image processing method as described in relation to the first aspect when the program is executed by processor；
Or,
A kind of live broadcasting method as described in second aspect is realized when the program is executed by processor.
In embodiments of the present invention, raw image data is obtained；Determine the texture of each pixel in raw image data
Coordinate；Determine that first object point and at least two second target points, the second target point and first object point exist from pixel
Texture coordinate is adjacent；Brightness according to brightness value of second target point on texture coordinate to first object point on texture coordinate
Value is adjusted, and obtains destination image data；According to texture coordinate displaying target image data.By determining first object point,
The brightness of first object point is adjusted according to the brightness of the second target point around first object point, so that first object
The luminance difference of point and the second target point becomes smaller, and the balance to realize brightness is excessive.The difficulty of operation is simplified using texture coordinate
Degree, improves arithmetic speed.
In embodiments of the present invention, request direct broadcast server creates direct broadcasting room；Original live video data is acquired, it is original straight
Broadcasting video data includes raw image data, and each pixel has texture coordinate in raw image data；Receive beauty operation；
In response to beauty operation, first object point and at least two second target points are determined from pixel, the second target point and the
One target point is adjacent in texture coordinate；First object point is sat in texture according to brightness value of second target point on texture coordinate
The brightness value put on is adjusted, and obtains destination image data；According to texture coordinate displaying target image data；According to target figure
As data generation target live video data, and it is sent to direct broadcast server, to play in direct broadcasting room.Realizing the flat of brightness
It weighs excessively, on the basis of improving arithmetic speed, so that electronic equipment (especially with the mobile device of battery) is for supporting
The electricity of which is reduced, and reduces equipment heating, improves the cruising ability of electronic equipment, and then extend the time of live streaming.
Detailed description of the invention
Figure 1A is a kind of flow chart for image processing method that the embodiment of the present invention one provides；
Figure 1B is the schematic diagram for possible second target point of one kind that the embodiment of the present invention one provides；
Fig. 2A is a kind of flow chart of image processing method provided by Embodiment 2 of the present invention；
Fig. 2 B is the schematic diagram of a kind of pair of pixel provided by Embodiment 2 of the present invention processing；
Fig. 2 C is a kind of flow chart of image processing method provided by Embodiment 2 of the present invention；
Fig. 2 D is a kind of structure chart of image processing method provided by Embodiment 2 of the present invention；
Fig. 3 is a kind of flow chart for live broadcasting method that the embodiment of the present invention three provides；
Fig. 4 is a kind of image processing apparatus that the embodiment of the present invention four provides；
Fig. 5 is a kind of live broadcast device that the embodiment of the present invention five provides；
Fig. 6 is the structure schematic diagram for a kind of electronic equipment that the embodiment of the present invention six provides.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just
Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
Embodiment one
Figure 1A is a kind of flow chart for image processing method that the embodiment of the present invention one provides.The present embodiment is suitable for passing through
The texture coordinate of pixel carries out the scene of brightness value adjusting to the brightness of image data.This method can be by a kind of image procossing
Device executes, which can be realized by the mode of software and/or hardware, and the device is configurable in the electronic device, for example,
Mobile phone, tablet computer, wearable device (such as smart glasses, smart watches), the electronic equipment are configured with screen, central processing
Device (CPU) and graphics processor (GPU).With reference to Figure 1A, this method is specifically included:
S101, raw image data is obtained.
Raw image data refers to the set of the value of each pixel (pixel) indicated with numerical value.Obtain the side of image data
Formula can refer to the picture that the live streaming that main broadcaster user uploads is acquired by picture pick-up device, be also possible to receive the figure of user's input
Picture.In general, raw image data includes people.I.e. raw image data can be divided into human body parts and background parts.
Raw image data may have the expression-form of corresponding multicolour model, such as: rgb color mode, cmyk color
Mode and Lab color mode.
Rgb color mode is a kind of color standard of industry, is by logical to red (R), green (G), blue (B) three colors
To obtain miscellaneous color, RGB is to represent red, green, blue three for the variation in road and their mutual superpositions
The color in channel, this standard almost include all colours that human eyesight can perceive, and are current with most wide color
One of system.
Cmyk color mode is when sunlight is irradiated on an object, this object will absorb a part of light, and will
Remaining light is reflected, and the light of reflection is exactly the object color that we are seen.This is that one kind loses lustre color mode.
CMYK represents four kinds of colors in printing, and C is represented cyan (Cyan), and M represents carmetta (Magenta), and Y represents yellow
(Yellow), K represents black (Black).
Numerical value in Lab color mode the people of twenty-twenty vision is described it can be seen that all colours.Because Lab is described
The display mode of color, rather than special color needed for equipment (such as display, desktop printer or digital camera) generation color
The quantity of material, so Lab is considered as and device-independent color model.L indicates lightness (Luminosity), and a is indicated from fuchsin
Color is to the range of green, and b expression is from yellow to the range of blue.When the codomain of L is by 0 to 100, L=50, it is equivalent to 50%
It is black；The codomain of a and b, wherein+127a is exactly red, is reformed into when being transitioned into -128a gradually green by+127 to -128
Color；Same principle ,+127b are yellow, and -128b is blue.
After obtaining raw image data, the colour model that the raw image data uses is determined.
In a feasible implementation, image processing apparatus obtains image data, as raw image data.
S102, the texture coordinate for determining each pixel in the raw image data.
After determining the colour model that the raw image data uses, raw image data is uniformly used to Lab color mould
Type is indicated.
In general, raw image data is indicated using rgb color mode.It is consistent for subsequent processing, it converts RGB to
Lab.RGB cannot be converted directly into Lab, need by XYZ color space, and RGB is transformed into XYZ color space, later again
XYZ color space is transformed into Lab.RGB and XYZ color space have following relationship:
Wherein each coefficient sum of X=0.412453 × R+0.412453 × G+0.412453 × B is 0.950456, non-
Very close in 1, it is understood that the value range of R/G/B is [0,255], if coefficient and the value range equal to 1, X also must
So between [0,255], therefore we can be considered etc. than modifying each coefficient, so that the sum of its is equal to 1, has thus accomplished XYZ
With RGB equivalents mapping.
The conversion between RGB and Lab can be realized based on above-mentioned formula (1) and formula (2).The subsequent Lab mentioned turns
Turn to RGB also in the same way.
Texture is actually a two-dimensional array, its element is some color values.Single color value is referred to as texture primitive
Element or texture pixel (the namely another address of pixel).Each texel have in texture one uniquely
Location.This address is made of a row and column, and U, V is used to indicate respectively.Each of texture texture pixel can by it
Coordinate is stated.For textured all texture pixels, one unified address range of the software requirements such as Direct3D.This
A range can make 0.0~1.0, include 0.0 and 1.0, identified with U, V.Texture coordinate is located in texture space, that is to say, that
It is corresponding with (0,0) position of texture.
For each pixel, it is associated with brightness value and texture coordinate.
In a feasible implementation, the raw image data for using Lab colour model to be indicated is loaded into out
It puts in shape library (Open Graphics Library, OPENGL), determines the brightness value of each pixel in raw graphics data
With texture coordinate information.
S103, first object point and at least two second target points are determined from the pixel.
Determine that first object point, first object point are the pixels for currently needing to adjust brightness in raw image data
Point.The determination of first object point is determined by way of order traversal, generally according to from top to bottom, from left to right or instead
Direction is traversed.
Second target point is to refer to the second target point and the first object with the associated pixel of first object point, association
Point is adjacent in the texture coordinate.When the quantity of the second target point is odd number, it can preset toward a direction and take more
One pixel.It, can be true to symmetrical both sides centered on first object point when the quantity of the second target point is even number
Fixed second target point.
Figure 1B is the schematic diagram for possible second target point of one kind that the embodiment of the present invention one provides.With reference to Figure 1B, when
After one target point 10 determines, however, it is determined that when the quantity of the second target point is 4.It is the center of circle, two pixels with first object point 10
Point is that radius determines border circular areas 11, and the pixel in border circular areas 11 is regarded as and the associated pixel of first object point
Point, i.e. the second target point.
S104, according to brightness value of second target point on the texture coordinate to the first object point described
Brightness value on texture coordinate is adjusted, and obtains destination image data.
Brightness value is the value of L in Lab, and each second target point is corresponding with a brightness value, according to the bright of the second target point
Angle value is adjusted the brightness value of first object point, to obtain destination image data.
Due to being only adjusted to the L in Lab, the numerical value of a, b do not change.It is corresponding according to raw image data
Colour model expression-form, convert Lab colour model to the performance shape for the colour model that the raw image data uses
Formula.
S105, the destination image data is shown according to the texture coordinate.
By OPENGL, destination image data is rendered into display equipment, according to texture coordinate displaying target picture number
According to.
OpenGL (Open Graphics Library, open graphic library) be for render 2D, 3D vector graphics across language
Speech, cross-platform application programming interface (API).This interface is made of nearly 350 different function calls, for drawing
From simple figure bit to complicated three-dimensional scence.And another program interface system is only for Microsoft
Direct3D on Windows.OpenGL is usually used in CAD, virtual reality, scientific visualization program and electronic game exploitation.
Using OpenGL from raw image data is obtained to the realization for showing the destination image data according to texture coordinate
Mode is as follows:
One, vertex converts:
Herein, the attribute on a vertex, such as position in space and its color, normal, texture coordinate, wherein
Including one group.The attribute on each vertex of the input in this stage.The operation as performed by fixed function is mainly completed
Work: vertex position transformation；Vertex is calculated to take into consideration；Texture coordinate transformation.
Two, pel assembles:
The transformed vertex of the input in this stage and connectivity.The block number evidence of this latter tells vertex
How to connect, to form a kind of original drawing data, this stage is also responsible for operating cones culling, and the back side is rejected.Grating
Scan determining segment and original location of pixels.
Segment in this context is one piece of data, by the pixel for being used to update in frame buffer zone, specific
Position.Segment includes to be not only color, and also normal and texture coordinate are used to calculate new pixel including possible attribute
Color.Vertex conversion stages above, calculated value are combined with vertex connection information, and the current generation is allowed to calculate phase
The segment for the attribute answered.For example, each vertex is shifted one's position.When considering vertex, makes a primitive, be the original that can be calculated
The position of beginning segment.Another example is that the color used.If a triangle, then has its vertex with different colors
Color triangle in the mode of color interpolation of distance weighted vertex of a triangle on opposite vertex of segment obtain
?.
Three, texture mapping, coloring:
Interpolation piece segment information is the input in this stage.It is colored the calculating of previous stage be by interpolation method,
Here, it can combine a such as texture pixel (texel).
Texture coordinate is also in previous stage interpolation.Mist was also applied in this stage.This stage of each segment
Common final result is the segment of a color value and depth.
Four, the segment on the pipeline of final stage, has carried out a series of test, such as: reducing test；Alpha is (transparent
Degree) test；Template test；Depth test.
In embodiments of the present invention, raw image data is obtained；Determine the texture of each pixel in raw image data
Coordinate；Determine that first object point and at least two second target points, the second target point and first object point exist from pixel
Texture coordinate is adjacent；Brightness according to brightness value of second target point on texture coordinate to first object point on texture coordinate
Value is adjusted, and obtains destination image data；According to texture coordinate displaying target image data.By determining first object point,
The brightness of first object point is adjusted according to the brightness of the second target point around first object point, so that first object
The luminance difference of point and the second target point becomes smaller, and the balance to realize brightness is excessive.The difficulty of operation is simplified using texture coordinate
Degree, improves arithmetic speed.
Image procossing is carried out using central processing unit, operation mode is handled using histogram equalization, in raw image data
It the use of the computational complexity that central processing unit carries out image procossing is M × M for sum of all pixels is M.The embodiment of the present invention passes through
The brightness of raw image data is handled by texture coordinate in graphics processor, reduces complexity, is reduced pair
The occupancy of central processing unit improves the utilization efficiency of equipment storage space.
Embodiment two
Fig. 2A is a kind of flow chart of image processing method provided by Embodiment 2 of the present invention.The present embodiment is in embodiment
It is refined on the basis of one, is described in detail and " determines first object point and at least two second from the pixel
Target point " and " according to brightness value of second target point on the texture coordinate to the first object point in the line
Reason coordinate on brightness value be adjusted, obtain destination image data " detailed process.With reference to Fig. 2A, this method is specifically included:
S201, raw image data is obtained.
S202, the texture coordinate for determining each pixel in the raw image data.
S203, first object point successively is set by the pixel along first direction.
Common agreement is to use U and V as the axis in texture space, and U corresponds to the X-axis of 2D coordinate system, and V corresponds to
Y-axis.To the processing mode of the value on UV axis in OpenGL are as follows: be incremented by from left to right on U axis, be incremented by from the bottom up on V axis
(origin is in the lower left corner).
In general, will can be determined as along the x axis first direction, will can be determined as along the y axis first direction,
The angular bisector direction that can be X-axis Y-axis is determined as first direction.
In a feasible implementation, along the x axis for first direction.Fig. 2 B is provided by Embodiment 2 of the present invention
A kind of schematic diagram of pair of pixel processing.It can then determine that pixel (1,1) is first object point, when to pixel (1,1)
After brightness value is adjusted, pixel (1,2) is determined as first object point, when the brightness value of the first row pixel is all adjusted
After section, start to determine first object point in the second row, it, can be according to side from left to right when the second row determines first object point
Pixel (2,1) is determined as first object point by formula, vegetarian refreshments (2,7) can also be determined as first object according to serpentine fashion
Point.
S204, centered on first object point coordinate in said first direction, in the raw image data
Middle determining first object range.
With reference to Fig. 2 B, with pixel (4,4) for first object point, to be described along the x axis for first direction.
First object range is to draw a circle to approve the range areas of the second target point, in general, first object range can be determined
For 2 pixels, i.e., centered on first object point coordinate in a first direction, first is determined using 2 pixels as radius
Target zone 21.
If S205, the coordinate of the pixel in said first direction are located within the scope of the first object, by institute
It states pixel and is set as the second target point.
It is determined as the pixel positioned at first object range 21 of the pixel (4,4) of first object point in a first direction
Point regard pixel (4,2), pixel (4,3), pixel (4,5) and pixel (4,6) as the second target point.
S206, first weight of second target point relative to the first object point is determined.
First weight is used to embody the size of the influence of the brightness of the brightness of the second target point to first object point.It can be right
Identical weight is arranged in second target point, identical weight can also be arranged to the second target point.It can be by first object point
Brightness is added in the setting of weight, can also be added without in the setting of weight.The present embodiment is not construed as limiting this.
In a feasible implementation, can distance according to the second target point apart from first object point determine second
The weight of target point.Distance of second target point apart from first object point is closer, illustrate it is closer with the relationship of first object point,
It should be influenced caused by first object point bigger.Determine the distance between the second target point and first object point；Determine second
First weight of target point, first weight with apart from positive correlation.For ease of calculation, the sum of all weights is set as 1.
With reference to Fig. 2 B, 0.4 can be set by the first weight as the pixel of first object point (4,4), it will be in the second target point
The first weight that first weight of pixel (4,2) is set as 0.1, pixel (4,3) is set as 0.2, pixel (4,5)
First weight be set as 0.2 and the first weight of pixel (4,6) be set as 0.1.
S207, the first weight is configured to the brightness value of second target point in said first direction, obtains first and waits
Select brightness value.
According to the brightness value of the second target point and the first weight of the second target point, the first of each second target point is determined
Candidate brightness value.The brightness value for determining pixel (4,4) is 60, and the brightness value of pixel (4,2) is 58, pixel (4,3)
Brightness value is 57, the brightness value of pixel (4,5) is 61 and the brightness value of pixel (4,6) is 62.
Then the first of pixel (4,4) the candidate brightness value is 24, the candidate brightness value of the first of pixel (4,2) is 5.8, as
The candidate brightness value of the first of vegetarian refreshments (4,3) be 11.4, first candidate's brightness value of pixel (4,5) is 12.2 and pixel (4,
6) the candidate brightness value of first is 6.2.
Average value between S208, the candidate brightness value of calculating described first, as the first object point described first
Brightness value on direction.
When the first weight does not do normalized, the quantity according to pixel is needed, to the first candidate brightness value
Be averaged.It, can be directly using the sum of the first candidate brightness value as first object point after the first weight does normalized
Brightness value in a first direction.
It is 24 by the first of pixel (4,4) the candidate brightness value, the candidate brightness value of the first of pixel (4,2) is 5.8,
The candidate brightness value of the first of pixel (4,3) is 11.4, the first candidate brightness value of pixel (4,5) is 12.2 and pixel
The candidate brightness value of the first of (4,6) be 6.2 and value: 59.6 brightness value as first object point in a first direction.
S209, the destination image data is shown according to the texture coordinate.
Fig. 2 C is a kind of flow chart of image processing method provided by Embodiment 2 of the present invention.Compared with Fig. 2A, Fig. 2 C is mentioned
The mode for adjusting first object point brightness value in a second direction is supplied.With reference to Fig. 2 C, this method is specifically included:
S211, first object point successively is set by the pixel in a second direction.
S212, centered on first object point coordinate in this second direction, in the raw image data
Middle the second target zone of determination.
If S213, the coordinate of the pixel in this second direction are located in second target zone, by institute
It states pixel and is set as the second target point.
S214, second weight of second target point relative to the first object point is determined.
S215, the second weight is configured in the described first upward brightness value to second target point, it is candidate obtains second
Brightness value.
Average value between S216, the candidate brightness value of calculating described second, as the first object point described second
Brightness value on direction.
S217, the destination image data is shown according to the texture coordinate.
How step S211-S217 description is in a second direction adjusted brightness value.In general, will along the x axis really
When being set to first direction, it will can be determined as along the y axis second direction；It, can be with when will be determined as first direction along the y axis
It will be determined as second direction along the x axis, the angular bisector direction for being also possible to X-axis Y-axis is determined as first direction.
When being along the y axis second direction.With reference to Fig. 2 B, then it can determine that pixel (1,1) is first object point, when
After the brightness value of pixel (1,1) is adjusted, pixel (2,1) is determined as first object point, when first row pixel
Brightness value be all adjusted after, start in secondary series to determine first object point, can be with when the second row determines first object point
Pixel (1,2) is determined as first object point in the way of from top to bottom, can also according to serpentine fashion by vegetarian refreshments (7,
2) it is determined as first object point.
With pixel (4,4) for first object point, to be along the x axis first direction, second will be determined as along the y axis
Direction is described.
First object range is to draw a circle to approve the range areas of the second target point, in general, can be by the second target zone and the
One target zone is the same, is determined as 2 pixels, i.e., centered on first object point coordinate in a second direction, with 2 pictures
Vegetarian refreshments is that radius determines the second target zone, due to being all the second target zone and the first mesh using 2 pixels as radius
Range 21 is marked to be overlapped.
It is determined as the pixel positioned at the second target zone of the pixel (4,4) of first object point in a first direction
Point regard pixel (2,4), pixel (3,4), pixel (5,4) and pixel (6,4) as the second target point.
0.4 can be set by the second weight as the pixel of first object point (4,4), by picture in the second target point
The second weight that second weight of vegetarian refreshments (2,4) is set as 0.1, pixel (3,4) is set as the of 0.2, pixel (5,4)
Two weights be set as 0.2 and the second weight of pixel (6,4) be set as 0.1.
According to the brightness value of the second target point and the second weight of the second target point, the second of each second target point is determined
Candidate brightness value.The brightness value for determining pixel (4,4) is 59.6, and the brightness value of pixel (4,2) is 58, pixel (4,3)
Brightness value be 57, the brightness value of pixel (4,5) is 61 and the brightness value of pixel (4,6) is 62.
Then the second of pixel (4,4) the candidate brightness value is 23.84, and the candidate brightness value of the second of pixel (4,2) is
5.8, the candidate brightness value of the second of pixel (4,3) is 11.4, the second candidate brightness value of pixel (4,5) is 12.2 and pixel
The candidate brightness value of the second of point (4,6) is 6.2.
By the second candidate brightness value and 59.44 brightness value as first object point in a second direction.
On the basis of the above embodiments, Fig. 2 D is a kind of structure of image processing method provided by Embodiment 2 of the present invention
Figure.Fig. 2 D describes the course of work of graphics processor in the present embodiment.
Raw image data is obtained, common raw image data uses rgb color model, raw image data is put into
In first texture of graphics processor creation, and progress RGB turns the operation of Lab in the piece tinter of this texture, finally will meter
Tri- component replacement RGB three-components of obtained Lab are stored in the first texture, for the L * component (brightness in the first texture
Value) the weighted average processing of first direction (X-direction) is carried out, and be stored in the first texture.Create the second texture storage the
Data after one texture processing is complete carry out first direction (Y to L (brightness value) component in the piece tinter in the second texture
Axis direction) weighted average processing, and be stored in the second texture.It carries out Lab and turns the operation of RGB, will finally be calculated
Tri- component replacement Lab three-components of RGB are stored in the second texture.The second texture is rendered into display equipment by OPENGL
On.
When due to carrying out brightness regulation in a first direction, the pixel on first direction is only depended on, therefore in figure
It, can be simultaneously to pixel (1,1), pixel (2,1), pixel (3,1), pixel in Fig. 2 B in the case that processor allows
(4,1), pixel (5,1), pixel (6,1) and the row where pixel (7,1), by the way of from left to right, while into
The brightness regulation of pixel on row first direction.After all pixels the point in a first direction adjusting of brightness value, together
When to pixel (1,1), pixel (1,2), pixel (1,3), pixel (Isosorbide-5-Nitrae), pixel (1,5), pixel (1,6) and
Column where pixel (1,7) by the way of from top to bottom, while carrying out the brightness regulation of the pixel in second direction.
To save the time of brightness value adjusting to greatest extent.
In embodiments of the present invention, request direct broadcast server creates direct broadcasting room；Original live video data is acquired, it is original straight
Broadcasting video data includes raw image data, and each pixel has texture coordinate in raw image data；Receive beauty operation；
In response to beauty operation, first object point and at least two second target points are determined from pixel, the second target point and the
One target point is adjacent in texture coordinate；First object point is sat in texture according to brightness value of second target point on texture coordinate
The brightness value put on is adjusted, and obtains destination image data；According to texture coordinate displaying target image data；According to target figure
As data generation target live video data, and it is sent to direct broadcast server, to play in direct broadcasting room.Realizing the flat of brightness
It weighs excessively, on the basis of improving arithmetic speed, so that electronic equipment (especially with the mobile device of battery) is for supporting
The electricity of which is reduced, and reduces equipment heating, improves the cruising ability of electronic equipment, and then extend the time of live streaming.
Embodiment three
Fig. 3 is a kind of flow chart for live broadcasting method that the embodiment of the present invention three provides.The present embodiment is suitable for main broadcaster visitor
The video data that family end uploads to direct broadcasting room carries out the scene of brightness value adjusting.This method can be held by a kind of live broadcast device
Row, especially mobile phone, computer used in main broadcaster's client etc..The device can be realized by the mode of software and/or hardware.
With reference to Fig. 3, this method is specifically included:
S301, request direct broadcast server create direct broadcasting room.
Main broadcaster's client requests creation direct broadcasting room to direct broadcast server, and the request of direct broadcast server response main broadcaster's client is
The main broadcaster user creates a direct broadcasting room.
S302, acquisition original live video data.
Original live video data includes raw image data, and each pixel has texture in the raw image data
Coordinate.It should be understood that since the present embodiment is suitable for the scene that main broadcaster is broadcast live, in acquisition original live video
While data, audio data should be acquired.
In a feasible implementation, when main broadcaster user starts the direct broadcast function of direct broadcasting room, live broadcast device is by taking the photograph
As the live streaming picture of equipment acquisition main broadcaster user, to acquire original live video data, and raw image data is therefrom obtained.It is right
Raw image data is handled to obtain the texture coordinate of each pixel in raw image data.
S303, beauty operation is received.
Main broadcaster user clicks beauty operation.The beauty operation includes but is not limited to carry out the operation of brightness value adjusting, may be used also
To include the conventional beauty operations such as thin face, mill skin.
Beauty operation can by receive main broadcaster user click a certain function button generate, can be by identification main broadcaster user's
Language is generated, can be generated by identifying the movement of main broadcaster user, is also possible to be generated according to the default option of main broadcaster user.
S304, in response to the beauty operation, first object point and at least two second is determined from the pixel
Target point.
The beauty operation is responded, intercepts raw image data from the original live video data that main broadcaster user uploads,
First object point and at least two second target points are determined in the raw image data.
Such as in response to the beauty operation of thin face, facial adjusting is carried out for the facial image of original live video data, with
So that the lower jaw of facial image stretches, receives in cheekbone or lowers cheekbone position, to reach the effect of thin face.For another example in response to mill
Image is polished by some filters with the ability for retaining edge, reaches the smooth mesh of skin by the beauty operation of skin
's.
On this basis, texture coordinate includes first direction；First object point and at least two is determined from pixel
Second target point, comprising: successively set first object point for pixel along first direction；In a first direction with first object point
On coordinate centered on, in raw image data determine first object range；If the coordinate bit of pixel in a first direction
In within the scope of first object, then the second target point is set by pixel.
On this basis, texture coordinate includes second direction；First object point and at least two is determined from pixel
Second target point, comprising: successively set first object point for pixel in a second direction；With first object point in second direction
On coordinate centered on, in raw image data determine the second target zone；If the coordinate bit of pixel in a second direction
In in the second target zone, then the second target point is set by pixel.
S305, according to brightness value of second target point on the texture coordinate to the first object point described
Brightness value on texture coordinate is adjusted, and obtains destination image data.
On this basis, first weight of second target point relative to first object point is determined；To the second target point
Brightness value on one direction configures the first weight, obtains the first candidate brightness value；Calculate being averaged between the first candidate brightness value
Value, as the brightness value of first object point in a first direction.
On this basis, second weight of second target point relative to first object point is determined；To the second target point
Brightness value on two directions configures the second weight, obtains the second candidate brightness value；Calculate being averaged between the second candidate brightness value
Value, as the brightness value of first object point in a second direction.
On this basis, the distance between the second target point and first object point are determined；Determine the first of the second target point
Weight, the first weight with apart from positive correlation.
S306, the destination image data is shown according to the texture coordinate.
Step S304-S306 can be with the explanation of correlation step in reference implementation example one and embodiment two, and details are not described herein.
S307, target live video data is generated according to the destination image data, and is sent to the direct broadcast server,
To be played in the direct broadcasting room.
Destination image data splicing rendering is become into target live video data, which is sent to live streaming
Server, to be played out in the direct broadcasting room that main broadcaster's client creates.
Wherein, spectators user has been logined in direct broadcasting room, direct broadcast server is by the live video data to logining the direct broadcasting room
Spectators user be distributed.
Wherein, live video data includes for the data flow of local echo and for being transmitted to spectators' user client
Data flow.Meanwhile audio-video is packaged as video file, direct broadcast server is uploaded to by the way of stream, direct broadcast server can
It is supplied to spectators.
The embodiment of the present invention creates direct broadcasting room by request direct broadcast server；Original live video data is acquired, it is original straight
Broadcasting video data includes raw image data, and each pixel has texture coordinate in raw image data；Receive beauty operation；
In response to beauty operation, first object point and at least two second target points are determined from pixel, the second target point and the
One target point is adjacent in texture coordinate；First object point is sat in texture according to brightness value of second target point on texture coordinate
The brightness value put on is adjusted, and obtains destination image data；According to texture coordinate displaying target image data；According to target figure
As data generation target live video data, and it is sent to direct broadcast server, to play in direct broadcasting room.It realizes in background
The balance transition of the balance transition of brightness and face's highlight area of main broadcaster user and other regions of face.
Example IV
Fig. 4 is a kind of image processing apparatus that the embodiment of the present invention four provides characterized by comprising data acquisition mould
Block 41, coordinate determining module 42, target point determining module 43, luminance adjustment module 44 and data disaply moudle 45.Wherein:
Data acquisition module 41, for obtaining raw image data；
Coordinate determining module 42, for determining the texture coordinate of each pixel in the raw image data；
Target point determining module 43, for determining first object point and at least two second targets from the pixel
Point, second target point and the first object point are adjacent in the texture coordinate；
Luminance adjustment module 44, for according to brightness value of second target point on the texture coordinate to described
Brightness value of one target point on the texture coordinate is adjusted, and obtains destination image data；
Data disaply moudle 45, for showing the destination image data according to the texture coordinate.
The embodiment of the present invention embodies following scheme: obtaining raw image data；Determine each picture in raw image data
The texture coordinate of vegetarian refreshments；Determine first object point and at least two second target points from pixel, the second target point and the
One target point is adjacent in texture coordinate；First object point is sat in texture according to brightness value of second target point on texture coordinate
The brightness value put on is adjusted, and obtains destination image data；According to texture coordinate displaying target image data.By determining the
One target point is adjusted the brightness of first object point according to the brightness of the second target point around first object point, real
The balance transition of the balance transition of the brightness in background and face's highlight area of main broadcaster user and other regions of face is showed.
On the basis of the above embodiments, target point determining module 43 is also used to:
First object point successively is set by the pixel along first direction；
Centered on the coordinate of the first object point in said first direction, determined in the raw image data
First object range；
If the coordinate of the pixel in said first direction is located within the scope of the first object, by the pixel
Point is set as the second target point.
On the basis of the above embodiments, luminance adjustment module 44 is also used to:
Determine first weight of second target point relative to the first object point；
First weight is configured to the brightness value of second target point in said first direction, obtains the first candidate brightness
Value；
The average value between the described first candidate brightness value is calculated, in said first direction as the first object point
Brightness value.
On the basis of the above embodiments, the determination second target point relative to the first object point first
Weight, comprising:
Determine the distance between second target point and the first object point；
Determine that the first weight of second target point, first weight and the distance are positively correlated.
On the basis of the above embodiments, target point determining module 43 is also used to:
First object point successively is set by the pixel in a second direction；
Centered on the coordinate of the first object point in this second direction, determined in the raw image data
Second target zone；
If the coordinate of the pixel in this second direction is located in second target zone, by the pixel
Point is set as the second target point.
On the basis of the above embodiments, luminance adjustment module 44 is also used to:
Determine second weight of second target point relative to the first object point；
Second weight is configured to the brightness value of second target point in this second direction, obtains the second candidate brightness
Value；
The average value between the described second candidate brightness value is calculated, in this second direction as the first object point
Brightness value.
A kind of figure that a kind of image processing apparatus provided in this embodiment can be used for executing embodiment one, embodiment two provides
As processing method, there is corresponding function and beneficial effect.
Embodiment five
Fig. 5 is a kind of live broadcast device that the embodiment of the present invention five provides, comprising: direct broadcasting room creation module 51, data acquisition
Module 52, operation receiving module 53, operation respond module 54, data obtaining module 55, image display 56 and video playing
Module 57.Wherein:
Direct broadcasting room creation module 51, for requesting direct broadcast server to create direct broadcasting room；
Data acquisition module 52, for acquiring original live video data, the original live video data includes original
Image data, each pixel has texture coordinate in the raw image data；
Receiving module 53 is operated, for receiving beauty operation；
Operate respond module 54, in response to the beauty operation, determined from the pixel first object point with
And at least two second target points, second target point and the first object point are adjacent in the texture coordinate；
Data obtaining module 55, for according to brightness value of second target point on the texture coordinate to described
Brightness value of one target point on the texture coordinate is adjusted, and obtains destination image data；
Image display 56, for showing the destination image data according to the texture coordinate；
Video playback module 57 for generating target live video data according to the destination image data, and is sent to
The direct broadcast server, to be played in the direct broadcasting room.
The embodiment of the present invention creates direct broadcasting room by request direct broadcast server；Original live video data is acquired, it is original straight
Broadcasting video data includes raw image data, and each pixel has texture coordinate in raw image data；Receive beauty operation；
In response to beauty operation, first object point and at least two second target points are determined from pixel, the second target point and the
One target point is adjacent in texture coordinate；First object point is sat in texture according to brightness value of second target point on texture coordinate
The brightness value put on is adjusted, and obtains destination image data；According to texture coordinate displaying target image data；According to target figure
As data generation target live video data, and it is sent to direct broadcast server, to play in direct broadcasting room.It realizes in background
The balance transition of the balance transition of brightness and face's highlight area of main broadcaster user and other regions of face.
A kind of live broadcast device provided in this embodiment can be used for executing a kind of live broadcasting method of the offer of embodiment three, have phase
The function and beneficial effect answered.
Embodiment six
Fig. 6 is the structural schematic diagram for a kind of electronic equipment that the embodiment of the present invention six provides.As shown in fig. 6, the electronics is set
Standby includes processor 60, memory 61, communication module 62, input unit 63 and output device 64；Processor 60 in electronic equipment
Quantity can be one or more, in Fig. 6 by taking a processor 60 as an example；Processor 60, memory in electronic equipment
61, communication module 62, input unit 63 and output device 64 can be connected by bus or other modes, by total in Fig. 6
For line connection.
Memory 61 is used as a kind of computer readable storage medium, can be used for storing software program, journey can be performed in computer
Sequence and module, if the corresponding module of one of the present embodiment image processing method is (for example, in a kind of image processing apparatus
: data acquisition module 41, coordinate determining module 42, target point determining module 43, luminance adjustment module 44 and data show mould
Block 45).Alternatively, if one of the present embodiment corresponding module of live broadcasting method is (for example, in a kind of live broadcast device: direct broadcasting room
Creation module 51, data acquisition module 52, operation receiving module 53, operation respond module 54, data obtaining module 55, image are aobvious
Show module 56 and video playback module 57).
Processor 60 includes central processing unit and graphics processor, and processor 60 is stored in memory 61 by operation
Software program, instruction and module are realized above-mentioned thereby executing the various function application and data processing of electronic equipment
A kind of image processing method, alternatively, a kind of image processing method.
Memory 61 can mainly include storing program area and storage data area, wherein storing program area can store operation system
Application program needed for system, at least one function；Storage data area, which can be stored, uses created data according to electronic equipment
Deng.In addition, memory 61 may include high-speed random access memory, it can also include nonvolatile memory, for example, at least
One disk memory, flush memory device or other non-volatile solid state memory parts.In some instances, memory 61 can
It further comprise the memory remotely located relative to processor 60, these remote memories can pass through network connection to electronics
Equipment.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Communication module 62 for establishing connection with display screen, and realizes the data interaction with display screen.Input unit 63 can
Number for receiving input or character information, and generate key related with the user setting of electronic equipment and function control
Signal input.
The embodiment of the present invention one, a kind of figure that embodiment two provides can be performed in a kind of electronic equipment provided in this embodiment
As processing method, alternatively, a kind of image processing method that embodiment three provides, specific corresponding function and beneficial effect.
Embodiment seven
The embodiment of the present invention seven also provides a kind of storage medium comprising computer executable instructions, and the computer can be held
When being executed by computer processor for executing a kind of image processing method, this method includes for row instruction
Obtain raw image data；
Determine the texture coordinate of each pixel in the raw image data；
First object point and at least two second target points, second target point and institute are determined from the pixel
It is adjacent in the texture coordinate to state first object point；
According to brightness value of second target point on the texture coordinate to the first object point in the texture
Brightness value on coordinate is adjusted, and obtains destination image data；
The destination image data is shown according to the texture coordinate.
Alternatively, a kind of image processing method, this method comprises:
Direct broadcast server is requested to create direct broadcasting room；
Original live video data is acquired, the original live video data includes raw image data, the original graph
As each pixel has texture coordinate in data；
Receive beauty operation；
In response to the beauty operation, first object point and at least two second targets are determined from the pixel
Point, second target point and the first object point are adjacent in the texture coordinate；
According to brightness value of second target point on the texture coordinate to the first object point in the texture
Brightness value on coordinate is adjusted, and obtains destination image data；
The destination image data is shown according to the texture coordinate；
Generate target live video data according to the destination image data, and be sent to the direct broadcast server, with
It is played in the direct broadcasting room.
Certainly, a kind of storage medium comprising computer executable instructions, computer provided by the embodiment of the present invention
The embodiment of the present invention one, one that embodiment two provides can also be performed in the method operation that executable instruction is not limited to the described above
Kind image processing method, alternatively, the relevant operation in a kind of image processing method that embodiment three provides.
By the description above with respect to embodiment, it is apparent to those skilled in the art that, the present invention
It can be realized by software and required common hardware, naturally it is also possible to which by hardware realization, but in many cases, the former is more
Good embodiment.Based on this understanding, technical solution of the present invention substantially in other words contributes to the prior art
Part can be embodied in the form of software products, which can store in computer readable storage medium
In, floppy disk, read-only memory (Read-Only Memory, ROM), random access memory (Random such as computer
Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions are used so that a calculatings electromechanics
Sub- equipment (can be personal computer, server or network electronic devices etc.) executes described in each embodiment of the present invention
Method.
It is worth noting that, a kind of above-mentioned image processing apparatus, alternatively, in a kind of embodiment of live broadcast device, it is included
Each unit and module be only divided according to the functional logic, but be not limited to the above division, as long as can be real
Now corresponding function；In addition, the specific name of each functional unit is also only for convenience of distinguishing each other, it is not limited to
Protection scope of the present invention.
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that
The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation,
It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention
It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also
It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.
Claims (11)
1. a kind of image processing method characterized by comprising
Obtain raw image data；
Determine the texture coordinate of each pixel in the raw image data；
Determine first object point and at least two second target points from the pixel, second target point and described the
One target point is adjacent in the texture coordinate；
According to brightness value of second target point on the texture coordinate to the first object point in the texture coordinate
On brightness value be adjusted, obtain destination image data；
The destination image data is shown according to the texture coordinate.
2. the method according to claim 1, wherein the texture coordinate includes first direction；
It is described that first object point and at least two second target points are determined from the pixel, comprising:
First object point successively is set by the pixel along first direction；
Centered on the coordinate of the first object point in said first direction, first is determined in the raw image data
Target zone；
If the coordinate of the pixel in said first direction is located within the scope of the first object, the pixel is set
It is set to the second target point.
3. according to the method described in claim 2, it is characterized in that, it is described according to second target point in the texture coordinate
On brightness value brightness value of the first object point on the texture coordinate is adjusted, obtain destination image data,
Include:
Determine first weight of second target point relative to the first object point；
First weight is configured to the brightness value of second target point in said first direction, obtains the first candidate brightness value；
The average value between the described first candidate brightness value is calculated, as the first object point in said first direction bright
Angle value.
4. according to the method described in claim 3, it is characterized in that, the determination second target point is relative to described first
First weight of target point, comprising:
Determine the distance between second target point and the first object point；
Determine that the first weight of second target point, first weight and the distance are positively correlated.
5. according to the method described in claim 3, it is characterized in that, the texture coordinate includes second direction；It is described from described
First object point and at least two second target points are determined in pixel, comprising:
First object point successively is set by the pixel in a second direction；
Centered on the coordinate of the first object point in this second direction, second is determined in the raw image data
Target zone；
If the coordinate of the pixel in this second direction is located in second target zone, the pixel is set
It is set to the second target point.
6. according to the method described in claim 5, it is characterized in that, it is described according to second target point in the texture coordinate
On brightness value brightness value of the first object point on the texture coordinate is adjusted, obtain destination image data,
Include:
Determine second weight of second target point relative to the first object point；
Second weight is configured to the brightness value of second target point in this second direction, obtains the second candidate brightness value；
The average value between the described second candidate brightness value is calculated, as the first object point in this second direction bright
Angle value.
7. a kind of live broadcasting method characterized by comprising
Direct broadcast server is requested to create direct broadcasting room；
Original live video data is acquired, the original live video data includes raw image data, the original image number
Each pixel has texture coordinate in；
Receive beauty operation；
In response to the beauty operation, first object point and at least two second target points, institute are determined from the pixel
It states the second target point and the first object point is adjacent in the texture coordinate；
According to brightness value of second target point on the texture coordinate to the first object point in the texture coordinate
On brightness value be adjusted, obtain destination image data；
The destination image data is shown according to the texture coordinate；
Target live video data is generated according to the destination image data, and is sent to the direct broadcast server, described
It is played in direct broadcasting room.
8. a kind of image processing apparatus characterized by comprising
Data acquisition module, for obtaining raw image data；
Coordinate determining module, for determining the texture coordinate of each pixel in the raw image data；
Target point determining module, for determining first object point and at least two second target points, institute from the pixel
It states the second target point and the first object point is adjacent in the texture coordinate；
Luminance adjustment module, for according to brightness value of second target point on the texture coordinate to the first object
Brightness value of the point on the texture coordinate is adjusted, and obtains destination image data；
Data disaply moudle, for showing the destination image data according to the texture coordinate.
9. a kind of live broadcast device characterized by comprising
Direct broadcasting room creation module, for requesting direct broadcast server to create direct broadcasting room；
Data acquisition module, for acquiring original live video data, the original live video data includes original image number
According to each pixel has texture coordinate in the raw image data；
Receiving module is operated, for receiving beauty operation；
Respond module is operated, in response to the beauty operation, determining first object point and at least from the pixel
Two the second target points, second target point and the first object point are adjacent in the texture coordinate；
Data obtaining module, for according to brightness value of second target point on the texture coordinate to the first object
Brightness value of the point on the texture coordinate is adjusted, and obtains destination image data；
Image display, for showing the destination image data according to the texture coordinate；
Video playback module for generating target live video data according to the destination image data, and is sent to described straight
Server is broadcast, to play in the direct broadcasting room.
10. a kind of electronic equipment characterized by comprising
One or more processors；
Memory, for storing one or more programs；
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
A kind of now image processing method as described in claim 1-6 is any；
Or,
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
A kind of now live broadcasting method as claimed in claim 7.
11. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
A kind of image processing method as described in claim 1-6 is any is realized when execution；
Or,
A kind of live broadcasting method as claimed in claim 7 is realized when the program is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910503121.0A CN110177287A (en) | 2019-06-11 | 2019-06-11 | A kind of image procossing and live broadcasting method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910503121.0A CN110177287A (en) | 2019-06-11 | 2019-06-11 | A kind of image procossing and live broadcasting method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110177287A true CN110177287A (en) | 2019-08-27 |
Family
ID=67698054
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910503121.0A Pending CN110177287A (en) | 2019-06-11 | 2019-06-11 | A kind of image procossing and live broadcasting method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110177287A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111343472A (en) * | 2020-02-21 | 2020-06-26 | 腾讯科技（深圳）有限公司 | Image processing effect adjusting method, device, equipment and medium |
| CN112529793A (en) * | 2020-11-25 | 2021-03-19 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| CN112712471A (en) * | 2019-10-25 | 2021-04-27 | 北京达佳互联信息技术有限公司 | Image processing method, device and equipment |
| CN113096233A (en) * | 2021-06-11 | 2021-07-09 | 腾讯科技（深圳）有限公司 | Image processing method and device, electronic equipment and readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5365429A (en) * | 1993-01-11 | 1994-11-15 | North American Philips Corporation | Computer detection of microcalcifications in mammograms |
| CN105787888A (en) * | 2014-12-23 | 2016-07-20 | 联芯科技有限公司 | Human face image beautifying method |
| CN107730443A (en) * | 2017-10-27 | 2018-02-23 | 北京小米移动软件有限公司 | Image processing method, device and user equipment |
| CN109146823A (en) * | 2018-09-25 | 2019-01-04 | 广州华多网络科技有限公司 | Image processing method, device, equipment and the storage medium retained based on high contrast |
| CN109377454A (en) * | 2018-09-25 | 2019-02-22 | 广州华多网络科技有限公司 | A kind of image processing method, device, equipment, storage medium and live broadcasting method |
| CN106157257B (en) * | 2015-04-23 | 2019-04-12 | 腾讯科技（深圳）有限公司 | The method and apparatus of image filtering |
-
2019
- 2019-06-11 CN CN201910503121.0A patent/CN110177287A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5365429A (en) * | 1993-01-11 | 1994-11-15 | North American Philips Corporation | Computer detection of microcalcifications in mammograms |
| CN105787888A (en) * | 2014-12-23 | 2016-07-20 | 联芯科技有限公司 | Human face image beautifying method |
| CN106157257B (en) * | 2015-04-23 | 2019-04-12 | 腾讯科技（深圳）有限公司 | The method and apparatus of image filtering |
| CN107730443A (en) * | 2017-10-27 | 2018-02-23 | 北京小米移动软件有限公司 | Image processing method, device and user equipment |
| CN109146823A (en) * | 2018-09-25 | 2019-01-04 | 广州华多网络科技有限公司 | Image processing method, device, equipment and the storage medium retained based on high contrast |
| CN109377454A (en) * | 2018-09-25 | 2019-02-22 | 广州华多网络科技有限公司 | A kind of image processing method, device, equipment, storage medium and live broadcasting method |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112712471A (en) * | 2019-10-25 | 2021-04-27 | 北京达佳互联信息技术有限公司 | Image processing method, device and equipment |
| CN112712471B (en) * | 2019-10-25 | 2024-03-15 | 北京达佳互联信息技术有限公司 | Image processing method, device and equipment |
| CN111343472A (en) * | 2020-02-21 | 2020-06-26 | 腾讯科技（深圳）有限公司 | Image processing effect adjusting method, device, equipment and medium |
| CN111343472B (en) * | 2020-02-21 | 2023-05-26 | 腾讯科技（深圳）有限公司 | Image processing effect adjusting method, device, equipment and medium |
| CN112529793A (en) * | 2020-11-25 | 2021-03-19 | 维沃移动通信有限公司 | Image processing method and device and electronic equipment |
| CN113096233A (en) * | 2021-06-11 | 2021-07-09 | 腾讯科技（深圳）有限公司 | Image processing method and device, electronic equipment and readable storage medium |
| CN113096233B (en) * | 2021-06-11 | 2021-08-27 | 腾讯科技（深圳）有限公司 | Image processing method and device, electronic equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110177287A (en) | A kind of image procossing and live broadcasting method, device, equipment and storage medium | |
| WO2021208648A1 (en) | Virtual object adjusting method and apparatus, storage medium and augmented reality device | |
| CN108876931B (en) | Three-dimensional object color adjustment method and device, computer equipment and computer readable storage medium | |
| CN112989904B (en) | Method for generating style image, method, device, equipment and medium for training model | |
| US9508185B2 (en) | Texturing in graphics hardware | |
| JP7007348B2 (en) | Image processing equipment | |
| CN110248242B (en) | Image processing and live broadcasting method, device, equipment and storage medium | |
| CN109510975B (en) | Video image extraction method, device and system | |
| CN112419472A (en) | Augmented reality real-time shadow generation method based on virtual shadow map | |
| US20200302579A1 (en) | Environment map generation and hole filling | |
| US11417060B2 (en) | Stereoscopic rendering of virtual 3D objects | |
| CN106558017A (en) | Spherical display image processing method and system | |
| AU2019226134A1 (en) | Environment map hole-filling | |
| JP3549871B2 (en) | Drawing processing apparatus and method, recording medium storing drawing processing program, drawing processing program | |
| EP4261784A1 (en) | Image processing method and apparatus based on artificial intelligence, and electronic device, computer-readable storage medium and computer program product | |
| US20240087219A1 (en) | Method and apparatus for generating lighting image, device, and medium | |
| US6559844B1 (en) | Method and apparatus for generating multiple views using a graphics engine | |
| RU2735066C1 (en) | Method for displaying augmented reality wide-format object | |
| CN112435173A (en) | Image processing and live broadcasting method, device, equipment and storage medium | |
| US10902669B2 (en) | Method for estimating light for augmented reality and electronic device thereof | |
| RU2792721C2 (en) | Method for asynchronous reprojection of 3d-scene image | |
| CN116860112B (en) | Combined scene experience generation method, system and medium based on XR technology | |
| WO2023026543A1 (en) | Information processing device, information processing method, and program | |
| US20240135659A1 (en) | Display method and apparatus and electronic device | |
| CN117455985A (en) | Display method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190827 |
|
| RJ01 | Rejection of invention patent application after publication |