CN107622192A - Video pictures processing method, device and mobile terminal - Google Patents
Video pictures processing method, device and mobile terminal Download PDFInfo
- Publication number
- CN107622192A CN107622192A CN201710812499.XA CN201710812499A CN107622192A CN 107622192 A CN107622192 A CN 107622192A CN 201710812499 A CN201710812499 A CN 201710812499A CN 107622192 A CN107622192 A CN 107622192A
- Authority
- CN
- China
- Prior art keywords
- user
- picture
- video
- current video
- video picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
This application discloses a kind of video pictures processing method, device and mobile terminal, wherein, this method includes:Obtain the current video picture with the second user of the first user video call;Judge in current video picture with the presence or absence of the 3rd user in addition to second user;If judging the 3rd user for having in addition to second user in current video picture, the video pictures of the first user in video display interface are switched into predetermined picture.Thus, in video call process so that the 3rd user cannot see that user and user where scene, avoid individual subscriber privacy it is compromised while, reduce the operation of user's manual-lock video pictures, improve user experience.
Description
Technical field
The application is related to communication technical field, more particularly to a kind of video pictures processing method, device and mobile terminal.
Background technology
With the development of scientific and technological level, the function of the terminal such as mobile phone, tablet personal computer is become stronger day by day.It is for example, increasing
Terminal is configured with camera, and user can shoot photo, video recording, Video chat etc. by camera.
The process of Video chat is carried out by camera and other side in user, can not only show that user draws in video pictures
Face, can also show the picture of scene where user, usual user only want to other side see oneself and oneself where scene, without
Wish other unrelated users see oneself and oneself where scene.
However, during two-party video, when user has found that user needs hand when having other people in other side's video pictures
Dynamic to close video calling, for a user, inconvenient for operation, if turned off not in time, video pictures may be seen
.Therefore, when how to avoid video, the individual privacy information of user is compromised, the personal secrets for protecting user, improves and uses
Family is experienced, significant.
The content of the invention
The purpose of the application is intended at least solve one of above-mentioned technical problem to a certain extent.
Therefore, first purpose of the application is to propose a kind of video pictures processing method, this method is in video calling
During, so that the 3rd user cannot see that user and user place scene, it is compromised to avoid individual subscriber privacy
While, reduce the operation of user's manual-lock video pictures, improve user experience.
Second purpose of the application is to propose a kind of video pictures processing unit.
The 3rd purpose of the application is to propose a kind of computer-readable recording medium.
The 4th purpose of the application is to propose a kind of mobile terminal.
The 5th purpose of the application is to propose a kind of computer program.
The video pictures processing method of the application first aspect embodiment, including:Obtain and the call of the first user video
The current video picture of second user;Judge in the current video picture with the presence or absence of the 3rd in addition to the second user
User;If judging the 3rd user for having in addition to the second user in the current video picture, video is shown
The video pictures of the first user switch to predetermined picture described in interface.
According to the video pictures processing method of the embodiment of the present application, in the first user and the process of second user video calling
In, the current video picture of second user is obtained, and have the 3rd of second user in current video picture is judged and use
During family, the video pictures of the first user in video display interface are switched into predetermined picture.Thus, so that the 3rd user not
Scene where user and user can be seen, avoid individual subscriber privacy it is compromised while, reduce user's manual-lock
The operation of video pictures, improves user experience.
The video pictures processing unit of the application second aspect embodiment, including:First acquisition module, for obtaining and the
The current video picture of the second user of one user video call;Judge module, it is in the current video picture for judging
No the 3rd user existed in addition to the second user;Handover module, for being deposited in the current video picture is judged
In three user in addition to the second user, the video pictures of the first user described in video display interface are switched
To predetermined picture.
According to the video pictures processing unit of the embodiment of the present application, in the first user and the process of second user video calling
In, the current video picture of second user is obtained, and have the 3rd of second user in current video picture is judged and use
During family, the video pictures of the first user in video display interface are switched into predetermined picture.Thus, so that the 3rd user not
Scene where user and user can be seen, avoid individual subscriber privacy it is compromised while, reduce user's manual-lock
The operation of video pictures, improves user experience.
The application third aspect embodiment provides one or more non-volatile meters for including computer executable instructions
Calculation machine readable storage medium storing program for executing, when the computer executable instructions are executed by one or more processors so that the processing
Device performs the video pictures processing method of the application first aspect embodiment.
The mobile terminal of the application fourth aspect embodiment, the mobile terminal includes memory and processor, described to deposit
Computer-readable instruction is stored in reservoir, when the instruction is by the computing device so that this Shen of the computing device
Please first aspect embodiment video pictures processing method.
According to the mobile terminal of the embodiment of the present application, during the first user and second user video calling, obtain
The current video picture of second user, and when there is three user of second user in judging current video picture, will
The video pictures of the first user switch to predetermined picture in video display interface.Thus, so that the 3rd user cannot see that
Scene where user and user, avoid individual subscriber privacy it is compromised while, reduce user's manual-lock video picture
The operation in face, improves user experience.
The aspect embodiment of the application the 5th provides a kind of computer program product, when in the computer program product
When instruction processing unit performs, the video pictures processing method of the application first aspect embodiment is performed.
The aspect and advantage that the application adds will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the application.
Brief description of the drawings
The above-mentioned and/or additional aspect of the application and advantage will become from the following description of the accompanying drawings of embodiments
Substantially and it is readily appreciated that, wherein,
Fig. 1 is the flow chart according to the video pictures processing method of the application one embodiment;
Fig. 2 is the three-dimensional face model according to second user, judges to whether there is in current video picture and removes second user
Outside the 3rd user refined flow chart;
Fig. 3 is the flow chart according to the video pictures processing method of the application another embodiment;
Fig. 4 is the flow chart according to the video pictures processing method of the application another embodiment;
Fig. 5 is the refined flow chart of the three-dimensional scenic picture of scene where obtaining the first user by structure light;
Fig. 6 (a) to Fig. 6 (e) is the schematic diagram of a scenario according to the structural light measurement of the application one embodiment;
Fig. 7 is the structural representation according to the video pictures processing unit of the embodiment of the present application of the application one embodiment
Figure;
Fig. 8 is the structural representation according to the video pictures processing unit of the embodiment of the present application of the application another embodiment
Figure;
Fig. 9 is the structural representation according to the video pictures processing unit of the embodiment of the present application of the application another embodiment
Figure;
Figure 10 is shown according to the structure of the video pictures processing unit of the embodiment of the present application of the application further embodiment
It is intended to;
Figure 11 is shown according to the structure of the video pictures processing unit of the embodiment of the present application of the application another embodiment
It is intended to;
Figure 12 is the schematic diagram according to the image processing circuit of the application one embodiment.
Embodiment
Embodiments herein is described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the application, and it is not intended that limitation to the application.
Below with reference to the accompanying drawings the video pictures processing method, device, mobile terminal and computer of the embodiment of the present application are described
Readable storage medium storing program for executing.
Fig. 1 is the flow chart according to the video pictures processing method of the application one embodiment.The video of the embodiment is drawn
Face processing method application is in the terminal.Wherein, terminal, which can include mobile phone, tablet personal computer, intelligent wearable equipment etc., has respectively
The hardware device of kind operating system.As shown in figure 1, the video pictures processing method comprises the following steps:
S11, obtain the current video picture with the second user of the first user video call.
Specifically, during the first user and second user video calling, the terminal of the first user is shown from video
The current video picture of second user is obtained in interface.
For example, the first user is user A, second user is user B, during user A and user's B video callings,
User A terminal obtains the current video picture of user B in video display interface.
S12, judge with the presence or absence of the 3rd user in addition to second user in current video picture, if so, then performing step
Rapid S13, if it is not, then return to step S11.
As a kind of exemplary embodiment, after the current video picture of second user is obtained, can be known by face
Other mode is determined in current video picture with the presence or absence of the 3rd user in addition to second user.Specifically, can be to working as forward sight
Frequency picture carries out recognition of face, to obtain the face recognition result of current video picture, and judges to work as according to face recognition result
Whether other faces remove second user face before are included in preceding video pictures, if it is judged that being included in current video picture
Except other faces before second user face, it is determined that have the in addition to second user the 3rd in current video picture and use
Family.
As the embodiment of another embodiment, second is removed in order to whether there is in accurate judgement current video picture
The 3rd user outside user, the three-dimensional face model of second user can also be first obtained, then, according to the three-dimensional of second user
Faceform, judge in current video picture with the presence or absence of the 3rd user in addition to second user.
Wherein, obtaining the mode of the three-dimensional face model of second user has a variety of, and for example, the terminal of the first user can
The mode of the three-dimensional face model of the second user of the terminal transmission of second user is received, or, the terminal of second user can use
The three-dimensional face model of second user is obtained in server.
Wherein, the three-dimensional face model of second user can be tied from the terminal of second user by being projected to second user
Structure light and establish.
Wherein, the terminal of second user is (following that the terminal of second user is referred to as into second user end in order to facilitate describing
Hold) be by the process of the three-dimensional face model of structure light acquisition second user:Structured light projector in second user terminal
To second user projective structure, then, structure light video camera head shoots the structure light image of second user, and according to structure light image
The depth image of second user is determined, afterwards, according to the depth image of second user, generates the three-dimensional face mould of second user
Type.
As a kind of exemplary embodiment, according to the three-dimensional face model of second user, current video picture is judged
In with the presence or absence of the 3rd user in addition to second user process, as shown in Fig. 2 can include:
S21, recognition of face is carried out to current video picture, to obtain the human face region in current video picture.
S22, extract the face characteristic information of human face region.
S23, according to the three-dimensional face model of face characteristic information and second user, judge whether deposited in current video picture
Three-dimensional face model in the 3rd user in addition to second user according to second user.
As a kind of exemplary embodiment, the face characteristic information of the human face region in current video picture is obtained
Afterwards, can determine whether face characteristic information in the human face region in current video picture whether the three-dimensional face mould with second user
Type is matched, if it is not, then determining the 3rd user for having in addition to second user in current video picture.If it is,
Then determine to only exist second user in current video picture.
S13, the video pictures of the first user in video display interface are switched into predetermined picture.
Wherein, it can randomly select that predetermined picture, which is, or the picture by user's sets itself.
Wherein, predetermined picture can include but is not limited to the pure color picture of virtual scene picture and predetermined color, the implementation
Example is not construed as limiting to predetermined picture.
That is, when the embodiment has three users in the current video picture for judge second user, will regard
The current video picture of the first user switches to the predetermined picture not comprising user and background in frequency display interface, automatically by video
Picture switches to predetermined picture, so that the 3rd user cannot see that user and user place scene, avoids user
While people's privacy is compromised, reduces the operation of user's manual-lock video pictures, improve user experience.
The video pictures processing method that the embodiment of the present application provides, in the first user and the process of second user video calling
In, the current video picture of second user is obtained, and have the 3rd of second user in current video picture is judged and use
During family, the video pictures of the first user in video display interface are switched into predetermined picture.Thus, so that the 3rd user not
Scene where user and user can be seen, avoid individual subscriber privacy it is compromised while, reduce user's manual-lock
The operation of video pictures, improves user experience.
On the basis of above-described embodiment, in order to prompt the state of the first user to second user, second user is avoided
The first user offline is thought, on the basis of shown in Fig. 1, as shown in figure 3, by the video of the first user in video display interface
Picture is switched to after predetermined picture, and this method can also include:
S14, the not offline prompt message of the first user is sent to the terminal of second user.
On the basis of above-described embodiment, in order to intelligently recover the original video background of user, user's hand is avoided
The dynamic trouble for recovering original video background, on the basis of shown in Fig. 3, as shown in figure 4, by first in video display interface
The video pictures of user are switched to after predetermined picture, and this method can also include:
S15, when detect again only exist second user in the current video picture of second user when, obtained by structure light
The three-dimensional scenic picture of scene where taking the first user.
As a kind of exemplary embodiment, original video background is rapidly switched in order to facilitate user, by
Before the video pictures of one user switch to three-dimensional scenic picture from predetermined picture, it can also display whether to recover video pictures
Prompt message, and when the recovery for receiving the first user recovers the confirmation instruction of video pictures, the video of the first user is drawn
Face switches to three-dimensional scenic picture from predetermined picture.
S16, the video pictures of the first user are switched into three-dimensional scenic picture from predetermined picture.
As a result, when the 3rd user leaves, user is without the operation by establishing video calling again, you can with it is right
Fang Jixu video callings, reduce user's operation, substantially increase the user experience of user video call.
As a kind of exemplary embodiment, as shown in figure 5, three of scene where obtaining the first user by structure light
The process of scenic picture is tieed up, can be included:
S51, scene simulation structure light where to the first user.
S52, shoot the structure light image through scene modulation where the first user.
S53, phase information corresponding to each pixel of demodulation structure light image is to obtain the depth of scene where the first user
Spend image.
In one embodiment of this application, shoot after the structure light image of scene modulation where the first user, can
Phase information corresponding to each pixel in demodulation structure light image, then, phase information is converted into depth information, and according to depth
Spend the depth image of scene where information generates the first user.
Specifically, can be tied by the structured light projector in the terminal of the first user to scene transmission where the first user
Structure light, then, the structure light video camera head in terminal can shoot the structure light image through scene modulation where the first user, and solution
Phase information corresponding to each pixel of structure light image is adjusted to obtain the depth image of the first user place scene, according to first
The depth image of scene where user, the three-dimensional scenic picture of scene where determining the first user.
, wherein it is desired to understand, the first user includes the first user and/or object in the scene.
Specifically, structured light projector by the project structured light of certain pattern to the first user in the scene tested
On object (testee includes the object in scene and the face and body of the first user), in the surface meeting of testee
The structure light image formed after being modulated by the first user.Structure light image after the shooting of structure light video camera head is modulated, then to knot
Structure light image is demodulated to obtain the depth image of the first user place scene.
Wherein, the pattern of structure light can be laser stripe, Gray code, sine streak, non-homogeneous speckle etc..
S54, the depth image of scene according to where the first user, the three-dimensional scenic of scene is drawn where determining the first user
Face.
Wherein, the three-dimensional scenic picture of scene where the depth image of scene determines the first user according to where the first user
Process, can be achieved by the prior art, the embodiment is not construed as limiting to this.
In order that those skilled in the art is more apparent from scene where gathering the first user according to structure light
Depth image process, illustrate its tool by taking a kind of widely used optical grating projection technology (fringe projection technology) as an example below
Body principle.Wherein, optical grating projection technology belongs to sensu lato area-structure light.
As shown in Fig. 6 (a), when being projected using area-structure light, sine streak is produced by computer programming first,
And sine streak is projected to measured object by structured light projector, recycle structure light video camera head shooting striped to be modulated by object
Degree of crook afterwards, then demodulate the curved stripes and obtain phase, then phase is converted into depth information to obtain depth map
Picture.The problem of to avoid producing error or error coupler, need to image structure light before carrying out depth information collection using structure light
Head carries out parameter calibration with structured light projector, and demarcation includes geometric parameter (for example, structure light video camera head and structured light projector
Between relative position parameter etc.) demarcation, the inner parameter of structure light video camera head and the inner parameter of structured light projector
Demarcation etc..
Specifically, the first step, computer programming produce sine streak.Need to obtain using the striped of distortion due to follow-up
Phase, for example phase is obtained using four step phase-shifting methods, therefore produce four width phase differences here and beStriped, then structure light throw
Emitter projects the four spokes line timesharing on measured object (mask shown in Fig. 6 (a)), and structure light video camera head is collected such as Fig. 6
(b) figure on the left side, while to read the striped of the plane of reference shown on the right of Fig. 6 (b).
Second step, carry out phase recovery.Bar graph (the i.e. structure that structure light video camera head is modulated according to four width collected
Light image) to calculate the phase diagram by phase modulation, now obtained be to block phase diagram.Because the knot that four step Phase-shifting algorithms obtain
Fruit is to calculate gained by arctan function, therefore the phase after structure light modulation is limited between [- π, π], that is to say, that every
Phase after modulation exceedes [- π, π], and it can restart again.Shown in the phase main value such as Fig. 6 (c) finally given.
Wherein, it is necessary to carry out the saltus step processing that disappears, it is continuous phase that will block phase recovery during phase recovery is carried out
Position.As shown in Fig. 6 (d), the left side is the continuous phase bitmap modulated, and the right is to refer to continuous phase bitmap.
3rd step, subtract each other to obtain phase difference (i.e. phase information) by the continuous phase modulated and with reference to continuous phase, should
Phase difference characterizes depth information of the measured object with respect to the plane of reference, then phase difference is substituted into the conversion formula (public affairs of phase and depth
The parameter being related in formula is by demarcation), you can obtain the threedimensional model of the object under test as shown in Fig. 6 (e).
In order to realize above-described embodiment, the application also proposed a kind of video pictures processing unit of the embodiment of the present application.
Fig. 7 is the structural representation according to the video pictures processing unit of the embodiment of the present application of the application one embodiment
Figure.
As shown in fig. 7, the video pictures processing unit of the embodiment of the present application can include the first acquisition module 110, sentence
Disconnected module 120 and handover module 130, wherein:
First acquisition module 110 is used to obtain the current video picture with the second user of the first user video call.
Judge module 120 is used to judge in current video picture with the presence or absence of the 3rd user in addition to second user.
Handover module 130 is used for when three user in addition to second user in judging current video picture be present,
The video pictures of first user in video display interface are switched into predetermined picture.
In some embodiments of the present application, in order to prompt the state of the first user to second user, in the base shown in Fig. 7
On plinth, as shown in figure 8, the device can also include:
Reminding module 140 is used to send the not offline prompt message of the first user to the terminal of second user.
Specifically, the video pictures of first user in video display interface are switched into predetermined picture in handover module 130
Afterwards, reminding module 140 sends the not offline prompt message of the first user to the terminal of second user, so that second user knows the
One user is not offline.
In some embodiments of the present application, on the basis of shown in Fig. 7, as shown in figure 9, the device can also include the
Two acquisition modules 150, wherein:
Second acquisition module 150 is used for the three-dimensional face model for obtaining second user;
Judge module 120 is specifically used for:According to the three-dimensional face model of second user, judge in current video picture whether
In the presence of the 3rd user in addition to second user.
In some embodiments of the present application, judge module 120 is specifically used for:Face knowledge is carried out to current video picture
Not, to obtain the human face region in current video picture;Extract the face characteristic information of human face region;According to face characteristic information
With the three-dimensional face model of second user, judge in current video picture with the presence or absence of the 3rd user in addition to second user.
, wherein it is desired to explanation, the structure of the second acquisition module 150 shown in above-mentioned Fig. 9 can also be included in Fig. 8 institutes
In the device embodiment shown, the embodiment is not construed as limiting to this.
In some embodiments of the present application, on the basis of shown in Fig. 7, as shown in Figure 10, the device can also include:
Processing module 160 be used for when detect again only exist second user in the current video picture of second user when,
The three-dimensional scenic picture of scene where obtaining the first user by structure light, and by the video pictures of the first user from predetermined picture
Switch to three-dimensional scenic picture.
, wherein it is desired to explanation, the structure of the processing module 160 shown in above-mentioned Figure 10 can also be included in Fig. 8 and Fig. 9
In shown device embodiment, the embodiment is not construed as limiting to this.
In some embodiments of the present application, on the basis of shown in Figure 10, as shown in figure 11, the device can also wrap
Include:
Display module 170 is used to display whether the prompt message for recovering video pictures.
, wherein it is desired to explanation, the foregoing explanation to video pictures processing method embodiment are also applied for the reality
The video pictures processing unit of example is applied, its realization principle is similar, and here is omitted.
The video pictures processing unit that the embodiment of the present application provides, in the first user and the process of second user video calling
In, the current video picture of second user is obtained, and have the 3rd of second user in current video picture is judged and use
During family, the video pictures of the first user in video display interface are switched into predetermined picture.Thus, so that the 3rd user not
Scene where user and user can be seen, avoid individual subscriber privacy it is compromised while, reduce user's manual-lock
The operation of video pictures, improves user experience.
In order to realize above-described embodiment, the application also proposes a kind of mobile terminal.
A kind of mobile terminal, include the video pictures processing unit of the application second aspect embodiment.
According to the mobile terminal of the embodiment of the present application, during the first user and second user video calling, obtain
The current video picture of second user, and when there is three user of second user in judging current video picture, will
The video pictures of the first user switch to predetermined picture in video display interface.Thus, so that the 3rd user cannot see that
Scene where user and user, avoid individual subscriber privacy it is compromised while, reduce user's manual-lock video picture
The operation in face, improves user experience.
The embodiment of the present application additionally provides a kind of computer-readable recording medium, and one or more can perform comprising computer
The non-volatile computer readable storage medium storing program for executing of instruction, when computer executable instructions are executed by one or more processors,
So that the video pictures processing method that computing device is foregoing.
In order to realize above-described embodiment, the application also proposes a kind of mobile terminal.
Above-mentioned mobile terminal includes image processing circuit, and image processing circuit can utilize hardware and/or component software
Realize, it may include define the various processing units of ISP (Image Signal Processing, picture signal processing) pipeline.Figure
12 be the schematic diagram according to the image processing circuit of the application one embodiment.As shown in figure 12, for purposes of illustration only, only show with
The various aspects of the related image processing techniques of the embodiment of the present application.
As shown in figure 12, the image processing circuit of mobile terminal 1200 includes imaging device 10, ISP processors 30 and control
Logic device 40.Imaging device 10 may include structured light projector 121 and structure light video camera head 122.Structured light projector 121 will be tied
Structure light projects scene where to the first user and the first user.Wherein, the structured light patterns can be laser stripe, Gray code,
Sine streak or, speckle pattern of random alignment etc..Structure light video camera head 122 can include imaging sensor 1221 and thoroughly
Mirror 1222.Wherein, the number of lens 1222 can be one or more.Imaging sensor 1221 is used to catch projection to measured object shape
Into structure light image, and structure light image is sent to ISP processors 30, structure light image carried out by ISP processors 30
Demodulation obtains the depth information of measured object.Meanwhile imaging sensor 1221 can also catch the color information of measured object.Certainly,
The structure light image and color information of measured object can also be caught respectively by two imaging sensors 1221.
Wherein, by taking pattern light as an example, ISP processors 30 are demodulated to structure light image, are specifically included, from the knot
The speckle image of measured object is gathered in structure light image, by the speckle image of measured object with entering with reference to speckle image according to pre-defined algorithm
Row view data calculates, and obtains each speckle point of speckle image on measured object relative to reference to the reference speckle in speckle image
The displacement of point.The depth value of each speckle point of speckle image is calculated using trigonometry conversion, and according to the depth
It is worth to the depth information of measured object.
It is, of course, also possible to obtain the depth image by the method for binocular vision or based on jet lag TOF method
Information etc., is not limited herein, as long as can obtain or belong to this by the method for the depth information that measured object is calculated
The scope that embodiment includes.
After the color information that ISP processors 30 receive the measured object that imaging sensor 1221 captures, it can be tested
View data corresponding to the color information of thing is handled.ISP processors 30 are analyzed view data can be used for obtaining
It is determined that and/or imaging device 10 one or more control parameters image statistics.Imaging sensor 1221 may include color
Color filter array (such as Bayer filters), imaging sensor 1221 can obtain is caught with each imaging pixel of imaging sensor 1221
The luminous intensity and wavelength information caught, and the one group of raw image data that can be handled by ISP processors 30 is provided.
ISP processors 30 handle raw image data pixel by pixel in various formats.For example, each image pixel can have
There is the bit depth of 8,10,12 or 14 bits, ISP processors 30 can carry out one or more image procossing behaviour to raw image data
Make, image statistics of the collection on view data.Wherein, image processing operations can be by identical or different bit depth precision
Carry out.
ISP processors 30 can also receive pixel data from imaging sensor 1221.Imaging sensor 1221 can be memory
Independent private memory in the part of device, storage device or electronic equipment, and may include DMA (Direct
Memory Access, direct direct memory access (DMA)) feature.
When receiving raw image data, ISP processors 30 can carry out one or more image processing operations.
After ISP processors 30 get color information and the depth information of measured object, it can be merged, obtain three
Tie up image.Wherein, quilt accordingly can be extracted by least one of appearance profile extracting method or contour feature extracting method
Survey the feature of thing.Such as pass through active shape model method ASM, active appearance models method AAM, PCA PCA, discrete remaining
The methods of string converter technique DCT, the feature of measured object is extracted, is not limited herein.To be extracted respectively from depth information again by
The feature for surveying thing and the feature that measured object is extracted from color information carry out registration and Fusion Features processing.What is herein referred to melts
Conjunction processing can be that the feature that will be extracted in depth information and color information directly combines or by different images
Identical feature combines after carrying out weight setting, it is possibility to have other amalgamation modes, finally according to the feature after fusion, generation three
Tie up image.
The view data of 3-D view can be transmitted to video memory 20, to carry out other place before shown
Reason.ISP processors 30 from the reception processing data of video memory 20, and to processing data carry out original domain in and RGB and
Image real time transfer in YCbCr color spaces.The view data of 3-D view may be output to display 60, so that user watches
And/or further handled by graphics engine or GPU (Graphics Processing Unit, graphics processor).In addition, ISP
The output of processor 30 also can be transmitted to video memory 20, and display 60 can read view data from video memory 20.
In one embodiment, video memory 20 can be configured as realizing one or more frame buffers.In addition, ISP processors 30
Output can be transmitted to encoder/decoder 50, so as to encoding/decoding image data.The view data of coding can be saved, and
Decompressed before being shown in the equipment of display 60.Encoder/decoder 50 can be realized by CPU or GPU or coprocessor.
The image statistics that ISP processors 30 determine, which can be transmitted, gives the unit of control logic device 40.Control logic device 40 can
Processor and/or microcontroller including performing one or more routines (such as firmware), one or more routines can be according to reception
Image statistics, determine the control parameter of imaging device 10.
It it is below the step of realizing video pictures processing method with image processing techniques in Figure 12:
S1', obtain the current video picture with the second user of the first user video call;
S2', obtain the current video picture with the second user of the first user video call;
S3', judge in current video picture with the presence or absence of the 3rd user in addition to second user;
S4', if judging the 3rd user for having in addition to second user in current video picture, video is shown into boundary
The video pictures of the first user switch to predetermined picture in face.
, wherein it is desired to explanation, the foregoing explanation to video pictures processing method embodiment also use the implementation
The mobile terminal of example, its realization principle is similar, and here is omitted.
A kind of computer program product, when the instruction processing unit in computer program product performs, perform foregoing regard
Frequency picture processing method.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description
Point is contained at least one embodiment or example of the application.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office
Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area
Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification
Close and combine.
In addition, term " first ", " second " are only used for describing purpose, and it is not intended that instruction or hint relative importance
Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present application, " multiple " are meant that at least two, such as two, three
It is individual etc., unless otherwise specifically defined.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include
Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize specific logical function or process
Point, and the scope of the preferred embodiment of the application includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be by the application
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following:Electricity with one or more wiring
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that can the paper of print routine thereon or other suitable be situated between
Matter, because can then enter edlin, interpretation or if necessary with other for example by carrying out optical scanner to paper or other media
Suitable method is handled electronically to obtain program, is then stored in computer storage.
It should be appreciated that each several part of the application can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage
Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware
Any one of row technology or their combination are realized:With the logic gates for realizing logic function to data-signal
Discrete logic, have suitable combinational logic gate circuit application specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries
Suddenly be can by program come instruct correlation hardware complete, program can be stored in a kind of computer-readable recording medium
In, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the application can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, can also be realized in the form of software function module.If integrated module with
The form of software function module realize and be used as independent production marketing or in use, can also be stored in one it is computer-readable
Take in storage medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although have been shown and retouch above
Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as the limit to the application
System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of application
Type.
Claims (14)
1. a kind of video pictures processing method, it is characterised in that the described method comprises the following steps:
Obtain the current video picture with the second user of the first user video call;
Judge in the current video picture with the presence or absence of the 3rd user in addition to the second user;
If judging the 3rd user for having in addition to the second user in the current video picture,
The video pictures of first user described in video display interface are switched into predetermined picture.
2. the method as described in claim 1, it is characterised in that switched in the video pictures by first user pre-
After determining picture, methods described also includes:
The not offline prompt message of first user is sent to the terminal of the second user.
3. the method as described in claim 1, it is characterised in that whether there is in the judgement current video picture and remove
Before the 3rd user outside the second user, methods described also includes:
Obtain the three-dimensional face model of the second user;
It is described to judge with the presence or absence of the 3rd user in addition to the second user in the current video picture, including:
According to the three-dimensional face model of the second user, judge in the current video picture to whether there is except described second uses
The 3rd user outside family.
4. method as claimed in claim 3, it is characterised in that the three-dimensional face model according to the second user, sentence
With the presence or absence of the 3rd user in addition to the second user in the disconnected current video picture, including:
Recognition of face is carried out to the current video picture, to obtain the human face region in the current video picture;
Extract the face characteristic information of the human face region;
According to the three-dimensional face model of the face characteristic information and the second user, judge be in the current video picture
No the 3rd user existed in addition to the second user.
5. the method as described in claim any one of 1-4, it is characterised in that send described the to the second user described
After the not offline prompt message of one user, methods described also includes:
When only existing the second user in the current video picture for detecting the second user again, obtained by structure light
The three-dimensional scenic picture of scene where taking first user;
The video pictures of first user are switched into the three-dimensional scenic picture from the predetermined picture.
6. method as claimed in claim 5, it is characterised in that in the video pictures by first user from described pre-
Determine picture to switch to before the three-dimensional scenic picture, methods described also includes:
Display whether the prompt message of recovery video pictures.
A kind of 7. video pictures processing unit, it is characterised in that including:
First acquisition module, for obtaining the current video picture with the second user of the first user video call;
Judge module, for judging in the current video picture with the presence or absence of the 3rd user in addition to the second user;
Handover module, for the 3rd user in addition to the second user in judging the current video picture be present
When, the video pictures of the first user described in video display interface are switched into predetermined picture.
8. device as claimed in claim 7, it is characterised in that described device also includes:
Reminding module, for sending the not offline prompt message of first user to the terminal of the second user.
9. device as claimed in claim 7, it is characterised in that described device also includes:
Second acquisition module, for obtaining the three-dimensional face model of the second user;
The judge module, is specifically used for:
According to the three-dimensional face model of the second user, judge in the current video picture to whether there is except described second uses
The 3rd user outside family.
10. device as claimed in claim 9, it is characterised in that the judge module, be specifically used for:
Recognition of face is carried out to the current video picture, to obtain the human face region in the current video picture;
Extract the face characteristic information of the human face region;
According to the three-dimensional face model of the face characteristic information and the second user, judge be in the current video picture
No the 3rd user existed in addition to the second user.
11. the device as described in claim any one of 7-10, it is characterised in that described device also includes:
Processing module, the second user is only existed in the current video picture for the second user ought to be detected again
When, the three-dimensional scenic picture of scene where obtaining first user by structure light, and the video of first user is drawn
Face switches to the three-dimensional scenic picture from the predetermined picture.
12. device as claimed in claim 11, it is characterised in that described device also includes:
Display module, for displaying whether the prompt message of recovery video pictures.
13. one or more includes the non-volatile computer readable storage medium storing program for executing of computer executable instructions, when the calculating
When machine executable instruction is executed by one or more processors so that the computing device such as any one of claim 1 to 6
Described video pictures processing method.
14. a kind of mobile terminal, including memory and processor, computer-readable instruction is stored in the memory, it is described
When instruction is by the computing device so that video pictures of the computing device as any one of claim 1 to 6
Processing method.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710812499.XA CN107622192A (en) | 2017-09-11 | 2017-09-11 | Video pictures processing method, device and mobile terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710812499.XA CN107622192A (en) | 2017-09-11 | 2017-09-11 | Video pictures processing method, device and mobile terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107622192A true CN107622192A (en) | 2018-01-23 |
Family
ID=61088674
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710812499.XA Pending CN107622192A (en) | 2017-09-11 | 2017-09-11 | Video pictures processing method, device and mobile terminal |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107622192A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109451262A (en) * | 2019-01-16 | 2019-03-08 | 中国联合网络通信集团有限公司 | A kind of holographic video call method and device |
CN110401806A (en) * | 2019-06-21 | 2019-11-01 | 努比亚技术有限公司 | A kind of video call method of mobile terminal, mobile terminal and storage medium |
CN111158624A (en) * | 2019-12-31 | 2020-05-15 | 维沃移动通信有限公司 | Application sharing method, electronic equipment and computer readable storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102610035A (en) * | 2012-04-05 | 2012-07-25 | 广州广电运通金融电子股份有限公司 | Financial self-service device and anti-peeping system and anti-peeping method thereof |
CN105141898A (en) * | 2015-08-11 | 2015-12-09 | 艾礼捷 | Computer anti-peeping early warning system based on video processor |
CN105472303A (en) * | 2015-11-20 | 2016-04-06 | 小米科技有限责任公司 | Privacy protection method and apparatus for video chatting |
CN105740775A (en) * | 2016-01-25 | 2016-07-06 | 北京天诚盛业科技有限公司 | Three-dimensional face living body recognition method and device |
CN106454195A (en) * | 2016-09-14 | 2017-02-22 | 惠州Tcl移动通信有限公司 | Anti-peeping method and system for video chats based on VR |
-
2017
- 2017-09-11 CN CN201710812499.XA patent/CN107622192A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102610035A (en) * | 2012-04-05 | 2012-07-25 | 广州广电运通金融电子股份有限公司 | Financial self-service device and anti-peeping system and anti-peeping method thereof |
CN105141898A (en) * | 2015-08-11 | 2015-12-09 | 艾礼捷 | Computer anti-peeping early warning system based on video processor |
CN105472303A (en) * | 2015-11-20 | 2016-04-06 | 小米科技有限责任公司 | Privacy protection method and apparatus for video chatting |
CN105740775A (en) * | 2016-01-25 | 2016-07-06 | 北京天诚盛业科技有限公司 | Three-dimensional face living body recognition method and device |
CN106454195A (en) * | 2016-09-14 | 2017-02-22 | 惠州Tcl移动通信有限公司 | Anti-peeping method and system for video chats based on VR |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109451262A (en) * | 2019-01-16 | 2019-03-08 | 中国联合网络通信集团有限公司 | A kind of holographic video call method and device |
CN109451262B (en) * | 2019-01-16 | 2021-05-11 | 中国联合网络通信集团有限公司 | Holographic video call method, video server and mobile terminal |
CN110401806A (en) * | 2019-06-21 | 2019-11-01 | 努比亚技术有限公司 | A kind of video call method of mobile terminal, mobile terminal and storage medium |
CN111158624A (en) * | 2019-12-31 | 2020-05-15 | 维沃移动通信有限公司 | Application sharing method, electronic equipment and computer readable storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11830141B2 (en) | Systems and methods for 3D facial modeling | |
CN107623817A (en) | video background processing method, device and mobile terminal | |
US7825948B2 (en) | 3D video conferencing | |
CN107623832A (en) | Video background replacement method, device and mobile terminal | |
CN107592490A (en) | Video background replacement method, device and mobile terminal | |
CN107493428A (en) | Filming control method and device | |
CN107483845B (en) | Photographic method and its device | |
CN107621867A (en) | Put out screen control method, device and terminal device | |
JP2015197745A (en) | Image processing apparatus, imaging apparatus, image processing method, and program | |
CN106991378B (en) | Depth-based face orientation detection method and device and electronic device | |
TWI637288B (en) | Image processing method and system for eye-gaze correction | |
CN107491744A (en) | Human body personal identification method, device, mobile terminal and storage medium | |
CN107705278B (en) | Dynamic effect adding method and terminal equipment | |
CN107360354B (en) | Photographing method, photographing device, mobile terminal and computer-readable storage medium | |
CN107564050A (en) | Control method, device and terminal device based on structure light | |
CN107622192A (en) | Video pictures processing method, device and mobile terminal | |
CN107438161A (en) | Shooting picture processing method, device and terminal | |
CN107705356A (en) | Image processing method and device | |
CN107590828A (en) | The virtualization treating method and apparatus of shooting image | |
JP4193342B2 (en) | 3D data generator | |
CN107613239B (en) | Video communication background display method and device | |
CN107682656B (en) | Background image processing method, electronic device, and computer-readable storage medium | |
CN107592491B (en) | Video communication background display method and device | |
CN107437268A (en) | Photographic method, device, mobile terminal and computer-readable storage medium | |
CN107705276B (en) | Image processing method and apparatus, electronic apparatus, and computer-readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant before: Guangdong OPPO Mobile Communications Co., Ltd. |
|
CB02 | Change of applicant information | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180123 |
|
RJ01 | Rejection of invention patent application after publication |