CN109525483A - The generation method of mobile terminal and its interactive animation, computer readable storage medium - Google Patents
The generation method of mobile terminal and its interactive animation, computer readable storage medium Download PDFInfo
- Publication number
- CN109525483A CN109525483A CN201811352022.9A CN201811352022A CN109525483A CN 109525483 A CN109525483 A CN 109525483A CN 201811352022 A CN201811352022 A CN 201811352022A CN 109525483 A CN109525483 A CN 109525483A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- image data
- face image
- user
- interactive animation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses the generation methods of a kind of mobile terminal and its interactive animation, computer readable storage medium.This method comprises: obtaining the face image data of user；The face image data is sent at least one other mobile terminal, and receives the face image data from least one other mobile terminal；The interactive animation at least two virtual images is generated according to the face image data of the user and the received face image data from least one other mobile terminal.Pass through the face image data of the respective user of each acquisition for mobile terminal, face image data is transmitted to other mobile terminals again, in this way interactive animation can be generated on each mobile terminal, there is the virtual image to match with each user's facial expressions and acts, to increase multi-party Interactive Experience in interactive animation.
Description
Technical field
The invention belongs to mobile communication technology field, in particular to the generation side of a kind of mobile terminal and its interactive animation
Method, computer readable storage medium.
Background technique
Intelligent mobile communication equipment is more and more common at present, and the frequency that people use is also more and more, and people use equipment
Scene it is also more and more, especially people it is more and more common use camera applications, and now camera also have many interests
Function.Such as extract face characteristic point data in preview, the expression of people is simulated using animal head, such as open one's mouth
Bar, shake the head, blink, mouth of beeping etc..But in the case where more people, it is difficult whole with the front camera shooting of a mobile phone
The face of people, is hardly produced the zoomorphism of more people in preview in this way, and Interactive Experience is poor.
Summary of the invention
(1) technical problems to be solved by the invention
The technical problem to be solved by the present invention is how to improve usage experience when being interacted using mobile terminal.
(2) the technical solution adopted in the present invention
In order to achieve the above purpose, present invention employs the following technical solutions:
A kind of generation method of the interactive animation of mobile terminal, comprising:
Obtain the face image data of user；
Send the face image data at least one other mobile terminal, and receive from it is described at least one its
The face image data of his mobile terminal；
According to the face image data of the user and the received face from least one other mobile terminal
Image data generates the interactive animation at least two virtual images.
Preferably, the specific method of the face image data for obtaining user includes:
Obtain multiple successive frame Interdynamic pictures of user；
Successively obtain the face key point position data of every frame Interdynamic picture in multiple successive frame Interdynamic pictures；
Face image data is generated according to the face key point position data of multiple successive frame Interdynamic pictures.
Preferably, face key point position data packet includes eye position data, mouth position data, nose shape number
Accordingly and eyebrow position data.
Preferably, the face image data according to the user and received at least one other movement is come from
The face image data of terminal generates, and there is the specific method of the interactive animation of at least two virtual images to include:
The animation with the first virtual image is generated according to the face image data of the user, and according to described at least one
The face image data of other a mobile terminals generates the animation at least one the second virtual image；
By the animation with the first virtual image and the animation compound at least one the second virtual image in same picture
In face, to generate the interactive animation at least two virtual images.
Preferably, the virtual image is zoomorphism.
Preferably, described to send the face image data at least one other mobile terminal, and receive and come from institute
The specific method for stating the face image data of at least one other mobile terminal includes:
The each mobile terminal as client is sent to the mobile terminal as server-side by WiFi communication mode
The face image data of user, and the face image data as the user of each mobile terminal of client is stored to described
Server-side, wherein the server-side is the originating end of multi-person interactive, and the client is the called end of multi-person interactive, and conduct
The quantity of the mobile terminal of the client is greater than or equal to 2；
And by WiFi communication mode to the client send the server-side user face image data and
The face image data of the user of other clients of the server-side storage.
Alternatively, described send the face image data at least one other mobile terminal, and receive from described
The specific method of the face image data of at least one other mobile terminal includes:
The face image data of user is sent to other another mobile terminals interacted by bluetooth communication mode,
And the face image data of other another mobile terminals interacted is received by bluetooth communication mode.
The invention also discloses a kind of computer readable storage medium, the computer-readable recording medium storage has movement
The generation program of the interactive animation of terminal is realized when the generation program of the interactive animation of the mobile terminal is executed by processor and is appointed
A kind of generation method of the interactive animation of above-mentioned mobile terminal.
The invention also discloses a kind of mobile terminal, the mobile terminal includes memory, processor and is stored in described
The generation program of the generation program of the interactive animation of mobile terminal on memory, the interactive animation of the mobile terminal is described
Processor realizes the generation method of the interactive animation of any above-mentioned mobile terminal when executing.
(3) beneficial effect
The invention discloses the generation methods of a kind of mobile terminal and its interactive animation, computer readable storage medium, lead to
The face image data of the respective user of each acquisition for mobile terminal is crossed, then face image data is transmitted to other mobile terminals,
Interactive animation can be generated on each mobile terminal in this way, there is the void to match with each user's facial expressions and acts in interactive animation
Quasi- image, to increase multi-party Interactive Experience.
Detailed description of the invention
Fig. 1 is the flow chart of the generation method of the embodiment of the present invention one；
Fig. 2 is the flow chart of the method for the face image data of the acquisition user of the embodiment of the present invention one；
Fig. 3 is the structural block diagram of the mobile terminal of the embodiment of the present invention three.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to embodiments, to the present invention
It is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not used to
Limit the present invention.
Embodiment one
As shown in Figure 1, the generation method flow chart of the interactive animation of the mobile terminal of embodiment according to the present invention one, it should
Generation method includes step S10 to step S20:
Step S10: the face image data of user is obtained.
Specifically, as shown in Fig. 2, the step includes the following steps S101 to step S103:
Step S101: multiple successive frame Interdynamic pictures of user are obtained.Specifically, current mobile terminal is moved with other
When dynamic terminal initiates multi-party or both sides interaction, the user of mobile terminal can make different facial expressions and acts, at this moment utilize and move
The front camera shooting of dynamic terminal has multiple successive frame Interdynamic pictures of different facial expressions and acts.It can certainly directly utilize
Front camera shooting user makes the video of different facial expressions and acts, has multiple successive frame Interdynamic pictures in such video,
And there is human facial expression information more abundant.The interval time between multiple successive frame Interdynamic pictures is not limited herein.
Step S102: the face key point positional number of every frame Interdynamic picture in multiple successive frame Interdynamic pictures is successively obtained
According to.
Specifically, feature extraction is carried out using facial image of the face recognition algorithms to every frame Interdynamic picture, obtains people
Face key point position data, wherein the detection algorithm on openCV platform can be used in face recognition algorithms, and this will not be repeated here.Into
One step, the face key point position data packet of acquisition include eye position data, mouth position data, nose shape data and
Eyebrow position data, these data can be used for characterizing the expression shape change of face.
Step S103: face image data is generated according to the face key point position data of multiple successive frame Interdynamic pictures.
The face key point position data that will acquire is packaged according to chronological order and generates face image data, convenient for follow-up data
Transmission.
Step S20: face image data is sent at least one other mobile terminal, and receives from least one it
The face image data of his mobile terminal.Specifically, the user for carrying out multi-party interactive is each using respective acquisition for mobile terminal
A face image data, and respective face image data is sent to the mobile terminal of the other user, user each in this way
Mobile terminal possess the face image data of whole users.
The transmission of progress face image data is illustrated how below by two embodiments.
The first embodiment is that point-to-point transmission is carried out in the way of bluetooth communication.
Specifically, only there are two mobile terminal progress both sides' interaction and when interaction both sides are closer, when one of them
After the acquisition for mobile terminal face image data of user, in the way of bluetooth communication the face image data of user is sent to
Other another mobile terminals, and one of mobile terminal receives other another shiftings interacted by bluetooth communication mode
The face image data of dynamic terminal.This transmission mode is suitble to both sides' interaction of short distance, and has good efficiency of transmission, mutually
Kinetoplast tests height.
Second of embodiment is to be carried out data transmission in the way of the local area networks such as WiFi.
Specifically, since blue-tooth technology currently on the market is mainly point-to-point transmission, be not suitable for point-to-points
Data transmission.When more people interact, WiFi communication mode can be used and carry out data transmission.Specifically, which includes such as
Lower step:
The each mobile terminal as client is sent to the mobile terminal as server-side by WiFi communication mode
The face image data of user, and the face image data as the user of each mobile terminal of client is stored to described
Server-side, wherein server-side is the originating end of multi-person interactive, and client is the called end of multi-person interactive, and as client
The quantity of mobile terminal is greater than or equal to 2.For example, when mobile terminal A, B, C carry out multi-party interactive, wherein mobile terminal A
Multi-party interactive is initiated to mobile terminal B and mobile terminal C, at this moment mobile terminal A is as server-side, and mobile terminal B and movement are eventually
Hold C as client.The face image data of respective user is sent to mobile terminal A respectively by mobile terminal B and mobile terminal C
In, the face image data of mobile terminal A, mobile terminal B and mobile terminal C tripartite user are at this moment possessed in mobile terminal A.
Further, the face image data and clothes of the user of server-side are sent to client by WiFi communication mode
The face image data of the user of other clients of business end storage.For example, the mobile terminal that mobile terminal A is stored
The face image data of two side of A and mobile terminal B is sent in mobile terminal C, at this moment possess in mobile terminal C mobile terminal A,
The face image data of mobile terminal B and mobile terminal C tripartite user.Meanwhile the mobile terminal A that mobile terminal A is stored
Be sent in mobile terminal B with the face image data of two side of mobile terminal C, at this moment possess in mobile terminal B mobile terminal A,
It is multi-party to be owned by progress in mobile terminal each in this way for the face image data of mobile terminal B and mobile terminal C tripartite user
The face image data of each side of interaction has the experience of good multi-person interactive.
Step S30: according to the face image data of user and the received face from least one other mobile terminal
Image data generates the interactive animation at least two virtual images.
Specifically, the animation with the first virtual image is generated according to the face image data of user, and according at least one
The face image data of other a mobile terminals generates the animation at least one the second virtual image.The shifting of i.e. each user
Dynamic terminal generates the table with each user according to the face image data of each user of the progress multi-person interactive of its storage respectively
Feelings act corresponding virtual image.Further, by the animation with the first virtual image and at least one the second void
Intend the animation compound of image in same picture, to generate the interactive animation at least two virtual images.It is same in this way
Possess virtual image corresponding with user's facial expressions and acts of multi-party interactive are carried out in animation, there is good Interactive Experience.And mutually
During dynamic, user can carry out mutual interaction by corresponding facial expressions and acts, to increase interest.As preferred reality
Example is applied, the virtual image of the present embodiment is zoomorphism, and but it is not limited to this.
Embodiment two
The computer readable storage medium of embodiment according to the present invention two, the computer-readable recording medium storage have shifting
The generation program of the interactive animation of dynamic terminal is realized strictly according to the facts when the generation program of the interactive animation of mobile terminal is executed by processor
Apply the generation method of the interactive animation of mobile terminal described in example one.
Embodiment three
As shown in figure 3, the mobile terminal of embodiment according to the present invention three, which includes memory 100, processing
The generation program 300 of the interactive animation of device 200 and the mobile terminal being stored on memory 100, the interactive animation of mobile terminal
Generation program 300 realize when being executed by processor 200 mobile terminal as described in embodiment one interactive animation generation side
Method.
Although the illustrative specific embodiment of the present invention is described above, in order to the technology of the art
Personnel are it will be appreciated that the present invention, but the present invention is not limited only to the range of specific embodiment, to the common skill of the art
For art personnel, as long as various change is in the spirit and scope of the invention that the attached claims limit and determine, all are sharp
With the innovation and creation of present inventive concept in the column of protection.
Claims (9)
1. a kind of generation method of the interactive animation of mobile terminal characterized by comprising
Obtain the face image data of user；
The face image data is sent at least one other mobile terminal, and receives and comes from least one other shifting
The face image data of dynamic terminal；
According to the face image data of the user and the received facial image from least one other mobile terminal
Data generate the interactive animation at least two virtual images.
2. the generation method of interactive animation according to claim 1, which is characterized in that the facial image for obtaining user
The specific method of data includes:
Obtain multiple successive frame Interdynamic pictures of user；
Successively obtain the face key point position data of every frame Interdynamic picture in multiple successive frame Interdynamic pictures；
Face image data is generated according to the face key point position data of multiple successive frame Interdynamic pictures.
3. the generation method of interactive animation according to claim 2, which is characterized in that the face key point position data
Including eye position data, mouth position data, nose shape data and eyebrow position data.
4. the generation method of interactive animation according to claim 2, which is characterized in that the face according to the user
Image data and the received face image data from least one other mobile terminal, which generate, has at least two void
The specific method of interactive animation for intending image includes:
Generate the animation with the first virtual image according to the face image data of the user, and according to it is described at least one its
The face image data of his mobile terminal generates the animation at least one the second virtual image；
By the animation with the first virtual image and the animation compound at least one the second virtual image in same picture,
To generate the interactive animation at least two virtual images.
5. the generation method of interactive animation according to claim 1, which is characterized in that the virtual image is animal shape
As.
6. the generation method of interactive animation according to any one of claims 1 to 5, which is characterized in that described at least one
Other a mobile terminals send the face image data, and receive the face from least one other mobile terminal
The specific method of image data includes:
The user of each mobile terminal as client is sent to the mobile terminal as server-side by WiFi communication mode
Face image data, and the face image data as the user of each mobile terminal of client is stored to the service
End, wherein the server-side is the originating end of multi-person interactive, and the client is the called end of multi-person interactive, and as described
The quantity of the mobile terminal of client is greater than or equal to 2；
And the face image data of user of the server-side and described is sent to the client by WiFi communication mode
The face image data of the user of other clients of server-side storage.
7. the generation method of interactive animation according to any one of claims 1 to 5, which is characterized in that described at least one
Other a mobile terminals send the face image data, and receive the face from least one other mobile terminal
The specific method of image data includes:
The face image data of user is sent to other another mobile terminals interacted by bluetooth communication mode, and
The face image data of other another mobile terminals interacted is received by bluetooth communication mode.
8. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has mobile terminal
Interactive animation generation program, realize when the generation program of the interactive animation of the mobile terminal is executed by processor such as right
It is required that the generation method of the interactive animation of 1 to 7 described in any item mobile terminals.
9. a kind of mobile terminal, which is characterized in that the mobile terminal includes memory, processor and is stored in the memory
On mobile terminal interactive animation generation program described in mobile terminal interactive animation generation program by the processor
The generation method of the interactive animation of mobile terminal as described in any one of claim 1 to 7 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811352022.9A CN109525483A (en) | 2018-11-14 | 2018-11-14 | The generation method of mobile terminal and its interactive animation, computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811352022.9A CN109525483A (en) | 2018-11-14 | 2018-11-14 | The generation method of mobile terminal and its interactive animation, computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109525483A true CN109525483A (en) | 2019-03-26 |
Family
ID=65777516
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811352022.9A Pending CN109525483A (en) | 2018-11-14 | 2018-11-14 | The generation method of mobile terminal and its interactive animation, computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109525483A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110430553A (en) * | 2019-07-31 | 2019-11-08 | 广州小鹏汽车科技有限公司 | Interactive approach, device, storage medium and controlling terminal between vehicle |
| CN113559503A (en) * | 2021-06-30 | 2021-10-29 | 上海掌门科技有限公司 | Video generation method, device and computer readable medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106937154A (en) * | 2017-03-17 | 2017-07-07 | 北京蜜枝科技有限公司 | Process the method and device of virtual image |
| CN108234276A (en) * | 2016-12-15 | 2018-06-29 | 腾讯科技（深圳）有限公司 | Interactive method, terminal and system between a kind of virtual image |
| CN108259806A (en) * | 2016-12-29 | 2018-07-06 | 中兴通讯股份有限公司 | A kind of video communication method, equipment and terminal |
-
2018
- 2018-11-14 CN CN201811352022.9A patent/CN109525483A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108234276A (en) * | 2016-12-15 | 2018-06-29 | 腾讯科技（深圳）有限公司 | Interactive method, terminal and system between a kind of virtual image |
| CN108259806A (en) * | 2016-12-29 | 2018-07-06 | 中兴通讯股份有限公司 | A kind of video communication method, equipment and terminal |
| CN106937154A (en) * | 2017-03-17 | 2017-07-07 | 北京蜜枝科技有限公司 | Process the method and device of virtual image |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110430553A (en) * | 2019-07-31 | 2019-11-08 | 广州小鹏汽车科技有限公司 | Interactive approach, device, storage medium and controlling terminal between vehicle |
| CN110430553B (en) * | 2019-07-31 | 2022-08-16 | 广州小鹏汽车科技有限公司 | Interaction method and device between vehicles, storage medium and control terminal |
| CN113559503A (en) * | 2021-06-30 | 2021-10-29 | 上海掌门科技有限公司 | Video generation method, device and computer readable medium |
| CN113559503B (en) * | 2021-06-30 | 2024-03-12 | 上海掌门科技有限公司 | Video generation method, device and computer readable medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102292537B1 (en) | Image processing method and apparatus, and storage medium | |
| CN106231434B (en) | A kind of living broadcast interactive special efficacy realization method and system based on Face datection | |
| US9398262B2 (en) | Communication using avatar | |
| CN106454481B (en) | A kind of method and device of live broadcast of mobile terminal interaction | |
| CN104038909B (en) | A kind of information interacting method and equipment | |
| JP2016537922A (en) | Pseudo video call method and terminal | |
| KR102382521B1 (en) | User device, call relay server and method for enabling video call with avatar | |
| CN112199016B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN111064919A (en) | VR (virtual reality) teleconference method and device | |
| EP3839768A1 (en) | Mediating apparatus and method, and computer-readable recording medium thereof | |
| CN109150690B (en) | Interactive data processing method and device, computer equipment and storage medium | |
| EP3739870B1 (en) | Depth camera based image stabilization | |
| WO2024078243A1 (en) | Training method and apparatus for video generation model, and storage medium and computer device | |
| CN109525483A (en) | The generation method of mobile terminal and its interactive animation, computer readable storage medium | |
| CN109413152A (en) | Image processing method, device, storage medium and electronic equipment | |
| Subramanyam et al. | Evaluating the impact of tiled user-adaptive real-time point cloud streaming on VR remote communication | |
| CN109039851B (en) | Interactive data processing method and device, computer equipment and storage medium | |
| CN111242714A (en) | Product recommendation method and device | |
| KR20170127354A (en) | Apparatus and method for providing video conversation using face conversion based on facial motion capture | |
| CN108320331A (en) | A kind of method and apparatus for the augmented reality video information generating user's scene | |
| CN116016837A (en) | Immersive virtual network conference method and device | |
| CN110413109A (en) | Generation method, device, system, electronic equipment and the storage medium of virtual content | |
| CN114915852B (en) | Video call interaction method, device, computer equipment and storage medium | |
| JP2023551181A (en) | Providing a 3D representation of sending participants in a virtual conference | |
| CN107846634B (en) | Audio and video file sharing method, device and system, storage medium and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190326 |
|
| RJ01 | Rejection of invention patent application after publication |