CN109150690A - Interaction data processing method, device, computer equipment and storage medium - Google Patents
Interaction data processing method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109150690A CN109150690A CN201710458909.5A CN201710458909A CN109150690A CN 109150690 A CN109150690 A CN 109150690A CN 201710458909 A CN201710458909 A CN 201710458909A CN 109150690 A CN109150690 A CN 109150690A
- Authority
- CN
- China
- Prior art keywords
- virtual session
- scene
- user
- dimensional
- expression
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/52—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail for supporting social networking services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present invention relates to a kind of interaction data processing method, device, computer equipment and storage mediums, which comprises corresponding virtual session scene is added by the first user identifier currently logged in;Acquire head image data;It identifies the expressive features in the head image data, obtains expression data;The expression data is sent to, terminal corresponding to the second user mark of the virtual session scene is added, make the terminal in the virtual session scene, controls virtual session member corresponding with first user identifier and trigger facial expressions and acts represented by the expression data.This method triggers the realization of facial expressions and acts represented by expression data by control virtual session member and interactively communicates, and for interacting communication based on user's authentic image, improves the personal secrets during interactively communicating to a certain extent.
Description
Technical field
The present invention relates to field of computer technology, set more particularly to a kind of interaction data processing method, device, computer
Standby and storage medium.
Background technique
With the rapid development of science and technology, the various communication technologys are increasingly advanced, demand of the people to communication form
It is more and more diversified.Current interactively communicates in mode, some movement looks of the video communication due to that can show communicating pair,
The uninteresting and welcome by users not as voice communication or plain text communicate.
However, in current video communication, shown user images may be by malice screenshot or recording, and can
It can be further propagated.And user images are to compare the information of privacy, if maliciously being recorded or being propagated, can seriously damage be used
The privacy at family.Therefore, there are certain personal secrets in video communication at present.
Summary of the invention
Based on this, it is necessary to there are certain personal secrets for current video communication, provide a kind of interactive number
According to processing method, device, computer equipment and storage medium.
A kind of interaction data processing method, which comprises
Corresponding virtual session scene is added by the first user identifier currently logged in;
Acquire head image data;
It identifies the expressive features in the head image data, obtains expression data;
The expression data is sent to, terminal corresponding to the second user mark of the virtual session scene is added, made
The terminal controls described in virtual session member triggering corresponding with first user identifier in the virtual session scene
Facial expressions and acts represented by expression data.
A kind of interaction data processing unit, which is characterized in that described device includes:
Module is added, corresponding virtual session scene is added for the first user identifier by currently logging in;
Image capture module, for acquiring head image data;
Expression Recognition module, the expressive features in the head image data, obtain expression data for identification;
Control module, for the expression data to be sent to the second user mark institute that the virtual session scene is added
Corresponding terminal makes the terminal in the virtual session scene, controls virtual meeting corresponding with first user identifier
Words member triggers facial expressions and acts represented by the expression data.
A kind of computer equipment, including memory and processor are stored with computer-readable instruction in the memory, institute
When stating computer-readable instruction and being executed by the processor, so that the processor executes following steps:
Corresponding virtual session scene is added by the first user identifier currently logged in;
Acquire head image data;
It identifies the expressive features in the head image data, obtains expression data;
The expression data is sent to, terminal corresponding to the second user mark of the virtual session scene is added, made
The terminal controls described in virtual session member triggering corresponding with first user identifier in the virtual session scene
Facial expressions and acts represented by expression data.
A kind of storage medium being stored with computer-readable instruction, the computer-readable instruction are handled by one or more
When device executes, so that one or more processors execute following steps:
Corresponding virtual session scene is added by the first user identifier currently logged in;
Acquire head image data;
It identifies the expressive features in the head image data, obtains expression data;
The expression data is sent to, terminal corresponding to the second user mark of the virtual session scene is added, made
The terminal controls described in virtual session member triggering corresponding with first user identifier in the virtual session scene
Facial expressions and acts represented by expression data.
Above-mentioned interaction data processing method, device, computer equipment and storage medium pass through the first user currently logged in
Corresponding virtual session scene is added in mark, acquires and identifies that face data obtains expression data, and the expression data is sent
The terminal corresponding to the second user mark that the virtual session scene is added.The terminal for receiving the expression data then virtually can
It talks about in scene, controls virtual session member corresponding with the first user identifier and trigger facial expressions and acts represented by expression data.It is logical
Facial expressions and acts realization represented by control virtual session member triggering expression data is crossed to interactively communicate, it is true compared to based on user
For image interacts communication, the personal secrets during interactively communicating are improved to a certain extent.
A kind of interaction data processing method, which comprises
Corresponding virtual session scene is added by the second user mark currently logged in;
Receive the expression data that terminal corresponding with the first user identifier that the virtual session scene is added is sent;
Expressive features value is extracted from the expression data;
In the virtual session scene, control described in virtual session member triggering corresponding with first user identifier
Facial expressions and acts represented by expressive features value.
A kind of interaction data processing unit, which is characterized in that described device includes:
Module is added, corresponding virtual session scene is added by the second user mark currently logged in;
Human facial feature extraction module receives terminal corresponding with the first user identifier that the virtual session scene is added and sends out
The expression data sent;Expressive features value is extracted from the expression data;
Control module, in the virtual session scene, control corresponding with first user identifier virtual session at
Member triggers facial expressions and acts represented by the expressive features value.
A kind of computer equipment, including memory and processor are stored with computer-readable instruction in the memory, institute
When stating computer-readable instruction and being executed by the processor, so that the processor executes following steps:
Corresponding virtual session scene is added by the second user mark currently logged in;
Receive the expression data that terminal corresponding with the first user identifier that the virtual session scene is added is sent;
Expressive features value is extracted from the expression data;
In the virtual session scene, control described in virtual session member triggering corresponding with first user identifier
Facial expressions and acts represented by expressive features value.
A kind of storage medium being stored with computer-readable instruction, the computer-readable instruction are handled by one or more
When device executes, so that one or more processors execute following steps:
Corresponding virtual session scene is added by the second user mark currently logged in;
Receive the expression data that terminal corresponding with the first user identifier that the virtual session scene is added is sent;
Expressive features value is extracted from the expression data;
In the virtual session scene, control described in virtual session member triggering corresponding with first user identifier
Facial expressions and acts represented by expressive features value.
Above-mentioned interaction data processing method, device, computer equipment and storage medium pass through the second user currently logged in
Corresponding virtual session scene is added in mark, receives terminal corresponding with the first user identifier of virtual session scene is added and sends
Expression data;Expressive features value is extracted from expression data;In virtual session scene, control corresponding with the first user identifier
Virtual session member trigger expressive features value represented by facial expressions and acts.Expression data is triggered by control virtual session member
Represented facial expressions and acts realization interactively communicates, for interacting communication based on user's authentic image, to a certain degree
On improve personal secrets during interactively communicating.
Detailed description of the invention
Fig. 1 is the applied environment figure of interaction data processing method in one embodiment;
Fig. 2 is the schematic diagram of internal structure of computer equipment in one embodiment;
Fig. 3 is the flow diagram of interaction data processing method in one embodiment;
Fig. 4 A is the interface schematic diagram of virtual session scene in one embodiment;
Fig. 4 B is the interface schematic diagram of virtual session scene in another embodiment;
Fig. 5 is the timing diagram of interaction data processing method in one embodiment;
Fig. 6 is the architecture diagram of interaction data processing method in one embodiment;
Fig. 7 is the flow diagram of virtual session scene display step in one embodiment;
Fig. 8 is the flow diagram of visual angle effect operating procedure in one embodiment;
Fig. 9 is the flow diagram of interaction data processing method in another embodiment;
Figure 10 is the flow diagram of interaction data processing method in another embodiment;
Figure 11 is the flow diagram of virtual session scene display step in another embodiment;
Figure 12 is the structural block diagram of interaction data processing unit in one embodiment;
Figure 13 is the structural block diagram of interaction data processing unit in another embodiment;
Figure 14 is the structural block diagram of interaction data processing unit in another embodiment;
Figure 15 is the structural block diagram of interaction data processing unit in further embodiment;
Figure 16 is the structural block diagram of interaction data processing unit in a still further embodiment.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Fig. 1 is the applied environment figure of interaction data processing method in one embodiment.Referring to Fig.1, which is handled
The application environment of method includes first terminal 110, second terminal 120 and server 130.Wherein, first terminal 110 and the second end
End 120 is the terminal for being mounted with to have the application program for realizing virtual session scenes function, first terminal 110 and second terminal
120 not only can be used for sending expression data, but also can be used for receiving expression data.Server 130 can be independent physics clothes
Business device is also possible to the server cluster that multiple physical servers are constituted.Server 130 may include open service platform, also
It may include the access server for accessing open service platform.First terminal 110 and second terminal 120 can be identical or not
Same terminal.Terminal can be mobile terminal or desktop computer, and mobile terminal may include mobile phone, tablet computer, individual
At least one of digital assistants and wearable device etc..
Corresponding virtual session scene can be added by the first user identifier currently logged in first terminal 110.First eventually
End 110 can acquire head image data, identify the expressive features in head image data, obtain expression data.First terminal
110 can be sent to expression data server 130, which is forwarded to and virtual session scene is added by server 130
The corresponding second terminal 120 of second user mark.Second terminal 120 is in virtual session scene, control and the first user
It identifies corresponding virtual session member and triggers facial expressions and acts represented by expression data.
It is appreciated that in other embodiments, first terminal 110 can be by point-to-point mode directly by expression data
It is sent to second terminal 120, the forwarding without passing through server 130.
Fig. 2 is the schematic diagram of internal structure of computer equipment in one embodiment.The computer equipment can be in Fig. 1
First terminal 110 and second terminal 120.Referring to Fig. 2, which includes the processor connected by system bus, non-
Volatile storage medium, built-in storage, network interface, display screen, input unit and image collecting device.Wherein, the computer
The non-volatile memory medium of equipment can storage program area and computer-readable instruction, which is performed
When, it may make processor to execute a kind of interaction data processing method.The processor of the computer equipment is calculated and is controlled for providing
Ability processed supports the operation of entire computer equipment.Computer-readable instruction can be stored in the built-in storage, which can
When reading instruction is executed by processor, processor may make to execute a kind of interaction data processing method.The network of computer equipment connects
Mouth is for carrying out network communication, such as transmission expression data.The display screen of computer equipment can be liquid crystal display or electricity
Sub- ink display screen, the input unit of computer equipment can be the touch layer covered on display screen, are also possible to computer and set
Key, trace ball or the Trackpad being arranged on standby shell, can also be external keyboard, Trackpad or mouse etc..Touch layer and
Display screen constitutes touch screen.Image collecting device can be camera.
It will be understood by those skilled in the art that structure shown in Figure 2, only part relevant to application scheme is tied
The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme, specific computer equipment
It may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
Fig. 3 is the flow diagram of interaction data processing method in one embodiment.The interaction data processing method can be with
Applied to the first terminal 110 and/or second terminal 120 in Fig. 1.The present embodiment is mainly applied in above-mentioned Fig. 1 in this way
First terminal 110 illustrate.Referring to Fig. 3, this method specifically comprises the following steps:
Corresponding virtual session scene is added by the first user identifier currently logged in S302.
Wherein, virtual session scene is the session context provided for virtual session member, the virtual session scene is added
When member carries out image display, all it is shown with the image of virtual session member.
In one embodiment, virtual session scene can be virtual room.Virtual session scene can be three-dimensional
Session context or two-dimensional virtual session context.Virtual session scene dialogue-based can create, and specifically, virtual session scene can
It, can also (session members be only based on double session with based on multi-conference (session members be greater than or equal to 3 session) creation
2 sessions) creation.In one embodiment, virtual session scene can also include the background information shown, wherein show
Background information may include background picture or three-dimensional background model, background picture can be two-dimension picture or tri-dimensional picture.Exhibition
The background information shown can be real background information or virtual background information.
In one embodiment, virtual session scene can be real-time virtual session context.Wherein, real-time virtual session
Scene refers to the virtual session scene for realizing real time communication.For example, wechat group is a multi-conference, in wechat group
Real time phone call is created in group, the member that the real time phone call is added can be shown with virtual image, i.e. displaying virtual session
Member realizes real time phone call, then constitutes above-mentioned virtual session scene.
Virtual session member is virtual image when member in the virtual session scene is shown.It is appreciated that void
Quasi- image is the image fictionalized, is different from authentic image.Virtual session member includes virtual figure image.Virtual session at
Member can also include the virtual image of animal, plant or other things.Virtual session member can be three-dimensional session members
Or two-dimensional virtual session members.Virtual session member can be the virtual image (for example, virtual session initial model) of default,
It can be customized by virtual session member's initial model combination user characteristics (such as user's face feature) and/or user
The virtual image that attribute (such as clothes attribute) obtains.
The first user identifier currently logged in is current to log in first of the application program for realizing virtual session scene
User identifier.For realizing the application program of virtual session scene, can be instant messaging application program, social application program or
Game application etc..Terminal corresponding to the first user identifier currently logged in, can be described as " first terminal ".
In one embodiment, first terminal can request the first user identifier currently logged in phase is added to server
In the members list for the virtual session scene answered, corresponding virtual meeting is added by the first user identifier currently logged in to realize
Talk about scene.After virtual session scene is added, first terminal then can be added the virtual session scene other user identifiers
It is communicated between corresponding terminal, for example transmission expression data is right to other user identifiers institute that the virtual session scene is added
Answer terminal.It is appreciated that the user identifier of virtual session scene is added, the members list positioned at the virtual session scene can be
In user identifier.
In one embodiment, first terminal can also in virtual session scene, by the virtual session scene at
Member is shown with the virtual session member of virtual image.Wherein, it can wrap in the virtual session member that first terminal is shown
Virtual session member corresponding to the first user identifier currently logged in by first terminal is included, can not also include currently passing through
Virtual session member corresponding to the first user identifier that first terminal logs in.Not by virtual meeting corresponding to the first user identifier
Members show is talked about in the virtual session scene that first terminal is shown, both will not influence corresponding to first terminal and other members
Terminal between interactively communicate, can also save system calculation processing resource and display resource.
S304 acquires head image data.
Wherein, head image data are to carry out the image data that real time image collection obtains to head.Head head image data
It may include face image data and headwork image data.Headwork, including head twist movement, for example bow, lift
Head, to left handed twist or the to the right movement such as torsion.
Specifically, first terminal can be by calling the machine camera to acquire head image data.Wherein, the machine camera
It can be the front camera or rear camera of the machine.It is appreciated that head image data collected can be to any
It appears in the head in image acquisition region and carries out what Image Acquisition obtained, be not limited to use corresponding to the first user identifier
Family.
In one embodiment, first terminal can detecte the number of members in the virtual session scene, work as virtual session
When number of members in scene is not less than preset quantity threshold value, then executes step S304 and carry out head image data acquisition process.
Wherein, preset quantity threshold value can be 2.It is appreciated that the number of members in virtual session scene mentioned here may include
First user identifier currently logged in itself.
S306 identifies the expressive features in head image data, obtains expression data.
Expressive features are can to give expression to one's sentiment or the feature of mood, including facial expression feature and posture expressive features.Face
Portion's expression is the expression expressed by face organ, for example chooses the facial expressions such as eyebrow or blink.Posture expression is to pass through limbs
Expression of manual expression, such as rotary head etc. act expression.
In one embodiment, first terminal can parse head image data, identify the head image data
In facial expression feature and/or headwork expressive features, obtain expression data.Expression data is can to indicate corresponding
The data of facial expressions and acts.
Expression data may include a string of expressive features values of arranged in sequence.In one embodiment, each expressive features
The corresponding position of value or sequence, characterize the expression type corresponding to it.For example, being located at the expression type of first position is
" crying ", the expressive features value in the first position are then used to characterize the degree cried.
Expression data also may include expression type identification and corresponding expressive features value.Expression type is expression dynamic
Make the classification of performance dimension, including opens one's mouth, blinks, laughing at, crying, rotary head or point head etc..It is appreciated that above-mentioned cited expression class
Type is only used for illustrating, and is not used to limit the classification of expression, can be set according to actual needs the type of expression type.
Expression data is sent to and terminal corresponding to the second user mark of virtual session scene is added, makes end by S308
End controls virtual session member corresponding with the first user identifier and triggers table represented by expression data in virtual session scene
Feelings movement.
Wherein, the second user that virtual session scene is added identifies, and in the members list for referring to the virtual session scene, removes
All or part of user identifier other than first user identifier.In the present embodiment, second user mark can be one or more
It is a.
The expression data can be sent to server by first terminal, and the expression data is forwarded to addition void by server
The corresponding terminal of the second user mark of quasi- session context.First terminal can also be by directly by a manner of point-to-point, by this
Expression data is sent directly to that terminal corresponding to the second user mark of virtual session scene is added, for example, working as virtual session
When scene is that the double session establishment based on point-to-point mode obtains, first terminal directly can directly be sent out the expression data
Send the terminal corresponding to the second user mark that virtual session scene is added.
In one embodiment, expression data is sent to and is added corresponding to the second user mark of virtual session scene
Terminal makes terminal in virtual session scene, controls virtual session member corresponding with the first user identifier and triggers expression data
Represented facial expressions and acts, comprising: expression data is sent to and is added corresponding to the second user mark of virtual session scene
Terminal makes terminal extract expressive features value corresponding with the expression type recognized from expression data, in virtual session field
It is dynamic to control expression represented by the expressive features value that virtual session member triggering corresponding with the first user identifier is extracted by Jing Zhong
Make.
In one embodiment, the corresponding terminal of second user mark, the expressive features value pair that can be determined and extract
The expression type answered according to expression control logic code corresponding to determining expression type and mentions in virtual session scene
The expressive features value taken controls the corresponding facial expressions and acts of corresponding with the first user identifier virtual session member implementation.For example, table
Facial expressions and acts represented by feelings data are " opening one's mouth 10 degree ", then control virtual session member corresponding with the first user identifier and implement
The movement of " opening one's mouth 10 degree ".
In one embodiment, the corresponding terminal of second user mark, can also be according to expressive features value and corresponding
Expression type generates corresponding texture information and is showed in texture information and the first user identifier in virtual session scene
The expression of corresponding virtual session member shows position.For example, second uses when facial expressions and acts represented by expression data are " crying "
Mark corresponding terminal in family then can generate " teardrop " texture information corresponding with " crying " according to expression data, by " the tear
The texture information of pearl " is showed in below the eyes of virtual session member corresponding with the first user identifier.
Fig. 4 A is the interface schematic diagram of the virtual session scene in one embodiment.The current member of the virtual session scene
Only 2, user a and user b.Assuming that Fig. 4 A is the interface of virtual session scene shown in terminal corresponding to user a,
The true head image using the user of terminal corresponding to user a is shown in the image acquisition region in the upper left corner in Fig. 4 A,
Virtual session member B corresponding with user b is shown in interface.
Fig. 4 B is the interface schematic diagram of the virtual session scene in another embodiment.The virtual session scene it is current at
Member has multiple, it is assumed that Fig. 4 A is the interface of virtual session scene shown in terminal corresponding to user a, the upper left corner in Fig. 4 A
Image acquisition region the true head image using the user of terminal corresponding to user a is shown, shown in interface
Three virtual figure images are virtual session member, and virtual session member B is virtual session member corresponding with user b, empty
Facial expressions and acts of " blinking right eye " represented by quasi- session members B triggering expression data.
Corresponding virtual session field is added by the first user identifier currently logged in above-mentioned interaction data processing method
Scape acquires and identifies that face data obtains expression data, and the expression data is sent to and is added the of the virtual session scene
Terminal corresponding to two user identifiers.The terminal of the expression data is received then in virtual session scene, control and the first user
It identifies corresponding virtual session member and triggers facial expressions and acts represented by expression data.Table is triggered by control virtual session member
The realization of facial expressions and acts represented by feelings data interactively communicates, for interacting communication based on user's authentic image, one
Determine to improve the personal secrets during interactively communicating in degree.
In addition, control virtual session member triggers facial expressions and acts represented by expression data, it is to interactively communicating user
Another manifestation mode of true expression, allows users to identify online user by facial expressions and acts, provides new mutual
Flowing mode.
In one embodiment, step S302 includes: to obtain more people's meetings corresponding to the first user identifier for currently logging in
Words mark;Multi-conference mark and the first user identifier are sent to server, server is added the first user identifier with more
Conference identifies the members list of identified virtual session scene.
Wherein, multi-conference mark is used for unique identification multi-conference.Number of members in multi-conference is greater than or equal to
3.Multi-conference can be group or interim more people's chat sessions, can also be other types of multi-conference.
It is appreciated that the first user identifier currently logged in, is more people corresponding with corresponding multi-conference mark
Member in session.Identified virtual session scene is identified with multi-conference, is the equal of right based on multi-conference mark institute
The virtual session scene for the multi-conference creation answered.Identified virtual session scene is identified with multi-conference, can be with more
Conference is identified as the virtual session scene directly identified, i.e. the unique identification of virtual session scene is exactly multi-conference mark
Itself.Identified virtual session scene is identified with multi-conference, is also possible to identify using multi-conference as indirect identification
Virtual session scene, the i.e. unique identification of virtual session scene are to identify unique corresponding virtual session scene mark with multi-conference
Know, virtual session scene identity can be determined according to multi-conference mark, and then determine corresponding virtual session scene, therefore,
Multi-conference mark can indirect unique identification virtual session scene.
Specifically, the application program that user can be logged in by the first user identifier for realizing virtual session scene, and
After logining successfully, multi-conference interface is opened in first terminal, the multi-conference interface of the opening is and the first user
Identify the interface of the corresponding multi-conference of corresponding multi-conference mark.User can send out in open multi-conference interface
Act the operation that virtual session scene is added.It is right to obtain the first user identifier institute currently logged in response to the operation for first terminal
The multi-conference mark answered, and multi-conference mark and the first user identifier are sent to server, server is by the first user
The members list that identified virtual session scene is identified with the multi-conference is added in mark, to realize first user identifier
Corresponding virtual session scene is added.
In one embodiment, server can believe the access that identified virtual session scene is identified with multi-conference
Breath is back to first terminal, and virtual session scene can be added according to the access information in first terminal.Wherein, access information includes
Access IP address and port.
In above-described embodiment, it is equivalent to and is added by the first user identifier that will currently log in based on corresponding more people's meetings
Talk about creation virtual session scene, and then realize by virtual session scene virtual session member trigger expression data institute it is right
The facial expressions and acts answered interactively communicate mode, are equivalent to and are improved on multi-conference, and it is mutual to propose a kind of new interaction
Flowing mode.
Fig. 5 is the timing diagram that the interaction data processing method is realized in one embodiment, specifically includes the following steps:
1) first terminal opens session, sends multi-conference corresponding with the first user identifier and identifies to server, with Shen
Virtual session scene please be added.
2) server creation identifies identified virtual session scene with multi-conference, and distributes for the virtual session scene
Corresponding access information.
3) server returns to the access information of distribution to first terminal.
4) first terminal establishes data channel with server according to the access information, the virtual session scene is added.
5) difference of terminal corresponding to other members in the multi-conference in the manner described above, establishes data with server
Virtual session scene is added in channel.
6) number of members being added in the virtual session scene is notified to be added each in virtual session scene by server
Terminal corresponding to member.
7) when number of members of each terminal in current virtual session context is greater than or equal to 2, starts local image and adopt
Collect equipment, acquires and identify that head image data obtain expression data.
8) expression data is sent to server by each terminal.
9) expression data is forwarded to terminal corresponding to other members of the virtual session scene by server.
10) terminal of expression data is received in virtual session scene, control and virtual meeting corresponding to the expression data
Member is talked about, facial expressions and acts represented by the expression data are triggered.
In one embodiment, multi-conference mark and the first user identifier are sent to server, makes server by first
The members list that identified virtual session scene is identified with multi-conference is added in user identifier, comprising: sends multi-conference mark
Know and the first user identifier is to server, server is made to identify identified virtual session scene with multi-conference existing
When, the first user identifier is added to the members list that identified virtual session scene is identified with multi-conference;Alternatively, sending more
Conference mark and the first user identifier make server that the virtual meeting identified with multi-conference be not present to server
When talking about scene, creation identifies identified virtual session scene with multi-conference, and the first user identifier is added to the void of creation
The members list of quasi- session context.
Specifically, first terminal sends multi-conference mark and the first user identifier to server, and request server is by the
One user identifier, which is added, identifies identified virtual session scene with multi-conference.Server, which can detecte, whether there is and more people
The corresponding virtual session scene of session identification.
When the existing corresponding virtual session scene of mark with multi-conference, then server can mark first user
Know the members list for being added and identifying identified virtual session scene with multi-conference, with realize by the first user identifier be added with
Multi-conference identifies identified virtual session scene.
When there is no with multi-conference mark corresponding virtual session scene, then server can be according to the multi-conference
Mark one new virtual session scene of creation, and it is used to the unique identification new wound using multi-conference mark as directly mark
The virtual session scene built, or generate one with the multi-conference mark uniquely and with newly created virtual session scene it is unique
Corresponding virtual session scene identity identifies using the multi-conference as indirect identification the virtual meeting for carrying out the unique identification creation
Scene is talked about, further, which can be added the members list of the virtual session scene of creation by server.
In one embodiment, virtual session scene is real-time virtual session context.First terminal can be by multi-conference
Mark and the first user identifier are sent to the real-time signalling service program in server by real-time signalling path, to real-time signaling
Real-time virtual session context is added in service routine request.After real-time signalling service program receives request, whether detection has currently been deposited
In real-time virtual session context corresponding with multi-conference mark, when there is no real-time virtual meetings corresponding with multi-conference mark
When talking about scene, then real-time signalling service program can be identified according to the multi-conference creation one it is new institute is identified with multi-conference
The real-time virtual session context of mark, and believe to Real-time Data Service program application access corresponding with the virtual session scene
Breath, and the access information is back to first terminal.When existing real-time virtual session context corresponding with multi-conference mark
When, then real-time signalling service program can directly return to access information corresponding with the real-time virtual session context to the first end
End.Wherein, access information includes access IP address and port.
First terminal begins setting up the data channel between Real-time Data Service program, in real time according to the access information
The members list of the virtual session scene of creation is added in first user identifier by signalling service program.Second user mark institute is right
Real-time virtual session context, and the data between Real-time Data Service program can also be added in the terminal answered through the above way
Channel, virtual session scene is added.It can be based on being established between terminal corresponding to first terminal and second user mark
Data channel, carry out the transmitting-receiving of expression data.Fig. 6 is the framework that the interaction data processing method is realized in one embodiment
Figure.
In above-described embodiment, the creation of virtual session scene and addition processing are integrated, user is only with passing through the
Corresponding multi-conference mark is sent to server to request to be added virtual session scene by one terminal, no matter in server when
It is preceding to whether there is virtual session scene corresponding with multi-conference mark, it can all be added and void is identified with the multi-conference
Quasi- session context, section eliminate the operating procedure of individually creation virtual session scene.In addition, being directed to all users, i.e., for the first time
Create virtual session scene user and virtual session scene creation after apply be added user, be all using same set of rule,
Redundancy caused by more set rules is avoided, the applicability of logic rules is improved.
In one embodiment, step S306 includes: the expressive features identified in head image data, obtains expression type
With corresponding expressive features value;The expression number for expressive features value corresponding with the expression type that identification obtains that generation includes
According to.
Wherein, expression type is classification of the expression in movement displaying dimension, including opens one's mouth, blinks, laughing at, crying, rotary head or point
First-class type.First terminal identifies that the obtained expression type of expressive features in head image data is at least one.Expression
Characteristic value, for characterizing the size of facial expressions and acts amplitude and/or degree corresponding to expression type.For example, expression type " crying ",
Corresponding expressive features value is different, then the degree cried is different, for example can be divided into and sob or wail etc. in various degree.Compare again
Such as, expression type " left-hand rotation head ", expressive features value can be the angle of rotary head, and rotary head angle is bigger, then the amplitude of rotary head is bigger.
In one embodiment, the expression number for expressive features value corresponding with the expression type that identification obtains that generation includes
According to, comprising: expressive features value corresponding with obtained expression type is identified is combined, expression data is obtained.
Specifically, first terminal can directly according to the obtained expression type of identification and corresponding expressive features value into
Row combination, obtains expression data.First terminal can also add expressive features value corresponding with the obtained expression type of identification
Position corresponding with corresponding expression type is added to, to generate corresponding expression data.It is appreciated that second user identifies institute
Corresponding terminal can determine expression type corresponding to the expression data according to the position corresponding to expression data.For example, table
Feelings type " opening one's mouth " corresponds to the 1st position, then expressive features value " 10 degree " corresponding with " opening one's mouth " is added to the 1st position, table
Feelings type " left-hand rotation head " corresponds to the 2nd position, then expressive features value " 15 degree " corresponding with " left-hand rotation head " is added to the 2nd
It sets, and so on, expressive features value is combined, to generate corresponding expression data.
It is appreciated that expressive features value included in expression data generated can be only and knowledge in the embodiment
The corresponding expressive features value of the expression type not obtained.For example, only recognizing expression type " left-hand rotation head " and " opening one's mouth ", then should
Expressive features value included in expression data, just expressive features value only corresponding with " left-hand rotation head " and " opening one's mouth ".
In another embodiment, the expression type identified belongs to default expression set of types and closes.Generation includes
The expression data of expressive features value corresponding with the expression type that identification obtains, comprising: in default expression set of types conjunction
The unidentified expression type arrived assigns the expressive features value for indicating not trigger corresponding facial expressions and acts;According to default expression set of types
The preset order of each expression type in conjunction combines the corresponding expressive features value of each expression type, constitutes expression data.
Expression type set has been preset in the present embodiment, in first terminal.It is default to identify that obtained expression type belongs to this
Expression type set.It identifies obtained expression type, can be one or more.
Wherein, it indicates the expressive features value for not triggering corresponding facial expressions and acts, destination virtual session members can be made not trigger
Corresponding facial expressions and acts.
Specifically, for the unidentified expression type arrived in default expression set of types conjunction, first terminal can assign expression
The expressive features value of corresponding facial expressions and acts is not triggered, and suitable according to presetting for each expression type in the conjunction of default expression set of types
Sequence combines the corresponding expressive features value of each expression type, constitutes expression data.It is appreciated that the expression number of this composition
According to can only include expressive features value, and can not have to including expression type or expression type identification these data.It is used second
Mark corresponding terminal control virtual session member corresponding with the first user identifier in family triggers table represented by expression data
When feelings act, the expression type corresponding to it can be determined, and then touch according to the sequence of expressive features value each in expression data
Send out facial expressions and acts represented by the expressive features value.Expression data can be made very small, ensure that the transmitting effect of expression data
Rate and Transfer Quality.
In one embodiment, this method further include: obtain the expression number that the corresponding terminal of second user mark is sent
According to;In virtual session scene, controls and identify the expression data institute that corresponding virtual session member triggers acquisition with second user
The facial expressions and acts of expression.
Specifically, the corresponding terminal of second user mark, can also acquire head image data, and from the head of acquisition
Expressive features are identified in image data, obtain corresponding expression data, and expression data is sent to first terminal.First terminal
The expression data that the corresponding terminal of second user mark is sent can be directly received by point-to-point mode, also can receive
Server forwarding identify corresponding terminal with second user transmitted by expression data.
In one embodiment, first terminal can control corresponding with second user mark in virtual session scene
Virtual session member implements facial expressions and acts represented by the expression data.For example, facial expressions and acts represented by expression data are " to open
10 degree of mouth " then controls the movement that virtual session member corresponding with second user mark implements " opening one's mouth 10 degree ".
In one embodiment, first terminal can also generate corresponding texture information according to expression data, virtual
In session context, which is showed in the expression for identifying corresponding virtual session member with second user and shows position.
For example, first terminal can then generate and " crying " phase according to expression data when facial expressions and acts represented by expression data are " crying "
Corresponding " teardrop " texture information, by the texture information of " teardrop " be showed in virtual session corresponding with second user mark at
Below the eyes of member.
In one embodiment, first terminal can extract expressive features value from expression data, in virtual session scene
In, control identifies corresponding virtual session member with second user and triggers facial expressions and acts represented by the expressive features value.
Specifically, first terminal can determine expression type corresponding with the expressive features value extracted, in virtual session field
Jing Zhong, according to the expressive features value of expression control logic code corresponding to determining expression type and extraction, control and first
The corresponding virtual session member of user identifier implements corresponding facial expressions and acts.First terminal can also be according to expressive features value and right
The expression type answered generates corresponding texture information and is showed in texture information and the first user in virtual session scene
The expression for identifying corresponding virtual session member shows position.
It is appreciated that when including multiple identifications in the expression data that the corresponding terminal of same second user mark is sent
When the corresponding expressive features value of the expression type arrived, first terminal can control virtual meeting corresponding with second user mark
Words member triggers facial expressions and acts represented by multiple expressive features values simultaneously.For example, include in expression data with " left-hand rotation head " and
" opening one's mouth " corresponding expressive features value, then can control virtual session member while the expression for triggering " left-hand rotation head " and " opening one's mouth " is dynamic
Make.
In above-described embodiment, control virtual session member triggers facial expressions and acts represented by expression data, is logical to interaction
Another manifestation mode of the true expression of credit household, allows users to identify online user by facial expressions and acts, provide
New interaction mode.
In one embodiment, by the first user identifier for currently logging in be added corresponding virtual session scene it
Before, this method further include: obtain user's face image data corresponding to the first user identifier currently logged in;According to user face
Portion's image data and virtual session member's initial model generate virtual session member corresponding with the first user identifier.
Virtual session member's initial model is the virtual image model of default.
Specifically, first terminal can carry out real-time face figure to user corresponding to the first user identifier currently logged in
As acquisition, user's face image data is obtained.First terminal is also corresponding to available the first user identifier currently logged in
The picture (for example, photo) of user extracts face image data from the picture and obtains the user's face image data.Wherein,
User corresponding to first user identifier is the user of the first user identifier unique identification.
User's face image data can be sent to server by first terminal, and server is according to user's face image data
With virtual session member's initial model, virtual session member corresponding with the first user identifier is generated.It can also be in first terminal
Virtual session member initial model is set, according to user's face image data and virtual session member's initial model, is generated and the
The corresponding virtual session member of one user identifier.
In one embodiment, it according to user's face image data and virtual session member's initial model, generates and first
The corresponding virtual session member of user identifier, comprising: parsing user's face image data generates corresponding face texture information, will
The face texture information superposition of generation obtains virtual session corresponding with the first user identifier in virtual session member's initial model
Member.
It is appreciated that the virtual session member that other users mark in virtual session scene is corresponding, be also possible to by
According to the above method, obtained according to user image data corresponding to each user identifier and virtual session member's initial model.
In above-described embodiment, according to user image data corresponding to each user identifier and virtual session member's introductory die
The corresponding virtual session member that type obtains, so that virtual session member more clearly characterizes corresponding member, convenient for handing over
Identification during mutual communication, and then be conducive to improve efficiency and validity that user interactively communicates.
In one embodiment, this method further include: obtain virtual session member corresponding with second user mark;It determines
Distributing position of the virtual session member in virtual session scene;Obtain background picture corresponding with virtual session scene;It will obtain
The virtual session member taken is distributed in corresponding distributing position, and is overlapped display with background picture, constitutes virtual session
Scene.
Wherein, background picture is the picture as display background.Background picture can be two-dimensional background picture, can also be with
It is three-dimensional background picture.Background picture can be virtual background picture, be also possible to real background picture.Virtual background picture,
It is the picture for showing virtual scene, for example, shown in caricature is exactly a kind of virtual scene.Real background picture is display
The picture of real scene, for example, to the photo that real scene is taken pictures, with regard to the real scene of display.
Specifically, first terminal can obtain virtual session member corresponding with second user mark from server, that is, obtain
Take avatar data corresponding with second user mark.Virtual session member can be three-dimensional session members or two dimension
Virtual session member.
The quantity that first terminal can be identified according to the second user in the members list of virtual session scene, determination are used for
The size of the geometric figure of distributing virtual session members is chosen in the geometric figure and meets the position of the quantity, with determine with
Second user identifies distributing position of the corresponding virtual session member in virtual session scene.Wherein it is possible in geometric figure
In randomly select the position for meeting the quantity, can also be chosen according to predeterminated position selection rule and meet the position of quantity.
For example, the quantity of second user mark is 5, then the geometric graph of distributing virtual session members is determined according to quantity 5
The size of shape, then chooses 5 positions in the geometric figure, and each position is virtual meeting corresponding with second user mark
Talk about distributing position of the member in virtual session scene.
In one embodiment, first terminal can also be marked according to all users in the members list of virtual session scene
The quantity of knowledge determines the size of the geometric figure for distributing virtual session members, chooses in the geometric figure and meets the number
The position of amount, and determine and identify distributing position of the corresponding virtual session member in virtual session scene with second user.
What first terminal can will acquire identifies corresponding virtual session member in corresponding distribution position with second user
It sets and is distributed, and be superimposed with acquired background picture, to constitute virtual session scene, and export and show the virtual session
Scene.
Virtual session member and background picture are overlapped display, constitute shown virtual session by above-described embodiment
Scene enriches virtual session scene, so that interactively communicating middle shown virtual session scene more close to actual life
In session context, realize the diversity for the mode of interactively communicating.
In one embodiment, virtual session member is three-dimensional session members, and virtual session scene is three-dimensional
Session context.As shown in fig. 7, this method further includes virtual session scene display step, specifically includes the following steps:
S702 obtains three-dimensional session members corresponding with second user mark.
Specifically, first terminal can obtain three-dimensional session members corresponding with second user mark from server,
Obtain three-dimensional avatars data corresponding with second user mark.
S704 determines distributing position of the three-dimensional session members in three-dimensional session context.
The quantity that first terminal can be identified according to the second user in the members list of three-dimensional session context, determines
For being distributed the size of the geometric figure of three-dimensional session members, the position for meeting the quantity is chosen in the geometric figure,
Distributing position of the corresponding three-dimensional session members in three-dimensional session context is identified with second user with determination.Its
In, the position for meeting the quantity can be randomly selected in geometric figure, can also be chosen according to predeterminated position selection rule full
The position of sufficient quantity.
For example, the quantity of second user mark is 5, then the several of distribution three-dimensional session members are determined according to quantity 5
The size of what figure, then chooses 5 positions in the geometric figure, and each position is and second user mark corresponding three
Tie up distributing position of the virtual session member in three-dimensional session context.
In one embodiment, first terminal can also be useful according to the institute in the members list of three-dimensional session context
The quantity of family mark, determines the size for being distributed the geometric figure of three-dimensional session members, chooses in the geometric figure
Meet the position of the quantity, and determines three-dimensional session members corresponding with second user mark in three-dimensional session context
In distributing position.
S706 obtains three-dimensional background model corresponding with three-dimensional session context.
Wherein, three-dimensional background model is the threedimensional model as display background.Three-dimensional background model can be three-dimensional
Background model is also possible to three-dimensional real background model.Three-dimensional background model is the model for showing three-dimensional virtual scene.
Three-dimensional real background model is the model for showing three-dimensional real scene.
Three-dimensional session members are distributed in corresponding distributing position, and carry out group with three-dimensional background model by S708
Display is closed, three-dimensional session context is constituted.
What first terminal can will acquire identifies corresponding three-dimensional session members in corresponding point with second user
Cloth is distributed on position, and is combined with three-dimensional background model, and to constitute three-dimensional session context, and exporting display should
Three-dimensional session context.
Three-dimensional session members and three-dimensional background model are combined display by above-described embodiment, what composition was shown
Three-dimensional session context, so that the three-dimensional session context shown in interactively communicating is further more close to existing
The session context to grow directly from seeds in living, realizes the diversity for the mode of interactively communicating.
As shown in figure 8, in one embodiment, this method further includes visual angle effect operating procedure, following step is specifically included
It is rapid:
S802, detection act on the touch control operation on three-dimensional session context, obtain touch trajectory.
Specifically, user can be by carrying out touch-control behaviour to the three-dimensional session context shown on first terminal interface
Make, obtains touch trajectory.Wherein, touch control operation includes the operation for pressing and pulling.
Touch trajectory is mapped as the motion track of the point of observation in three-dimensional session context by S804.
It is point according to the observation it is appreciated that the three-dimensional session context finally shown on first terminal display screen, it will be by
Three-dimensional session context that three-dimensional background model and three-dimensional session members are constituted projects to be shown on display screen.
Point of observation is different, and the three-dimensional session context projected on display screen is also different.
Specifically, touch trajectory can be mapped as by first terminal according to the mapping relations between touch point and point of observation
The motion track of point of observation in three-dimensional session context.
S806, according to motion track, the position of the point of observation after determining movement.
Specifically, motion track of the first terminal according to the point of observation determined, the position of the point of observation after determining movement
It sets.
S808 throws three-dimensional background model and three-dimensional session members according to the position of the point of observation after movement
Shadow is shown.
Specifically, first terminal according to the position of the point of observation after movement as new point of observation, by three-dimensional background model
It projects on first terminal display screen and is shown again with three-dimensional session members, then on first terminal display screen again
It is different from three-dimensional background model image shown before touch control operation to project obtained three-dimensional background model image, in first terminal
Shown angle is not yet before the angles of display and touch control operation of the three-dimensional session members projected again on display screen
Identical, then three-dimensional background model and three-dimensional session members after projecting again constitute the three-dimensional meeting under new visual angle
Talk about scene.
Above-described embodiment realizes the visual angle effect processing to three-dimensional session context, can be adjusted to user and be thought
The observation visual angle wanted, so that the display of three-dimensional session context is more flexible during interactively communicating, can make display
Three-dimensional session context more meets the demand of user, improves the validity of shown three-dimensional session context.
As shown in figure 9, in one embodiment, providing another interaction data processing method, this method is specifically included
Following steps:
S902 obtains user's face image data corresponding to the first user identifier currently logged in.
S904 is generated and the first user identifier pair according to user's face image data and virtual session member's initial model
The three-dimensional session members answered.
S906 obtains the mark of multi-conference corresponding to the first user identifier currently logged in, sends multi-conference mark
With the first user identifier to server, make server that the first user identifier to be added to the virtual meeting identified with multi-conference
Talk about scene group's list.
S908 acquires head image data, identifies the expressive features in head image data, obtains expression type and correspondence
Expressive features value.
S910, for the unidentified expression type arrived in default expression set of types conjunction, assigning indicates not triggering corresponding expression
The expressive features value of movement.
S912 is respectively right by each expression type according to the preset order of each expression type in the conjunction of default expression set of types
The expressive features value combination answered, constitutes expression data.
Expression data is sent to and terminal corresponding to the second user mark of virtual session scene is added, makes end by S914
Expressive features value corresponding with the expression type recognized is extracted at end from expression data, in virtual session scene, control
Facial expressions and acts represented by the expressive features value that three-dimensional session members triggering corresponding with the first user identifier is extracted.
S916 obtains three-dimensional session members corresponding with second user mark, determines that three-dimensional session members exist
Distributing position in three-dimensional session context.
S918 obtains three-dimensional background model corresponding with three-dimensional session context, three-dimensional session members is distributed
It is combined display in corresponding distributing position, and with three-dimensional background model, constitutes three-dimensional session context.
S920, detection act on the touch control operation on three-dimensional session context, obtain touch trajectory.
Touch trajectory is mapped as the motion track of the point of observation in three-dimensional session context, according to moving rail by S922
Mark, the position of the point of observation after determining movement.
S924 throws three-dimensional background model and three-dimensional session members according to the position of the point of observation after movement
Shadow is shown.
S926 obtains the expression data that the corresponding terminal of second user mark is sent.
S928 is controlled in virtual session scene and is identified what corresponding virtual session member triggering obtained with second user
Facial expressions and acts represented by expression data.
Above-mentioned interaction data processing method triggers facial expressions and acts represented by expression data by control virtual session member
Realization interactively communicates, and for interacting communication based on user's authentic image, improves interactively communicate to a certain extent
Personal secrets in the process.And control virtual session member triggers facial expressions and acts represented by expression data, is logical to interaction
Another manifestation mode of the true expression of credit household, allows users to identify online user by facial expressions and acts, provide
New interaction mode.
Secondly, the virtual meeting created based on corresponding multi-conference is added by the first user identifier that will currently log in
Scene is talked about, and then realizes and facial expressions and acts corresponding to expression data is triggered as the virtual session member in virtual session scene
Mode is interactively communicated, is equivalent to and is improved on multi-conference, proposes a kind of new interaction interaction mode.
Then, for the unidentified expression type arrived in default expression set of types conjunction, first terminal can assign expression not
Trigger the expressive features value of corresponding facial expressions and acts, and according to default expression set of types close in each expression type preset order,
By the corresponding expressive features value combination of each expression type, expression data is constituted.Expression data can be made very small, guaranteed
The transmission efficiency and Transfer Quality of expression data.
Furthermore it is obtained according to user image data corresponding to each user identifier and virtual session member's initial model
Corresponding virtual session member, so that virtual session member more clearly characterizes corresponding member, convenient for interactively communicating
Identification in journey, and then be conducive to improve efficiency and validity that user interactively communicates.
Finally, realizing the visual angle effect processing to three-dimensional session context, the sight that user wants can be adjusted to
Visual angle is examined, so that the display of three-dimensional session context is more flexible during interactively communicating, the three-dimensional of display can be made empty
Quasi- session context more meets the demand of user, improves the validity of shown three-dimensional session context.
As shown in Figure 10, in one embodiment, another interaction data processing method is provided, interaction data processing
Method can be applied to first terminal 110 and/or second terminal 120 in Fig. 1.The present embodiment is mainly applied to upper in this way
The second terminal 120 in Fig. 1 is stated to illustrate.This method comprises:
Corresponding virtual session scene is added by the second user mark currently logged in S1002.
Wherein, virtual session scene is the session context provided for virtual session member, the virtual session scene is added
When member carries out image display, all it is shown with the image of virtual session member.In one embodiment, virtual session scene
It can be virtual room.Virtual session scene can be three-dimensional session context or two-dimensional virtual session context.Virtual session
Scene dialogue-based can create, and specifically, virtual session scene can (session members be greater than or equal to 3 based on multi-conference
Session) creation, can also be based on double session (session members be only 2 session) creation.In one embodiment, virtually
Session context can also include the background information shown, wherein the background information of displaying may include background picture or three-dimensional back
Scape model, background picture can be two-dimension picture or tri-dimensional picture.
In one embodiment, virtual session scene can be real-time virtual session context.Wherein, real-time virtual session
Scene refers to the virtual session scene for realizing real time communication.For example, wechat group is a multi-conference, in wechat group
Real time phone call is created in group, the member that the real time phone call is added can be shown with virtual image, i.e. displaying virtual session
Member realizes real time phone call, then constitutes above-mentioned real-time virtual session context.
Virtual session member is virtual image when member in the virtual session scene is shown.It is appreciated that void
Quasi- image is the image fictionalized, is different from authentic image.Virtual session member includes virtual figure image.Virtual session at
Member can also include the virtual image of animal, plant or other things.Virtual session member can be three-dimensional session members
Or two-dimensional virtual session members.Virtual session member can be the virtual image (for example, virtual session initial model) of default,
It can be customized by virtual session member's initial model combination user characteristics (such as user's face feature) and/or user
The virtual image that attribute (such as clothes attribute) obtains.
The second user mark currently logged in is current to log in second of the application program for realizing virtual session scene
User identifier.For realizing the application program of virtual session scene, can be instant messaging application program, social application program or
Game application etc..The corresponding terminal of the second user mark currently logged in, can be described as " second terminal ".
In one embodiment, second terminal can request the second user that will currently log in mark that phase is added to server
In the members list for the virtual session scene answered, corresponding virtual meeting is added by the second user mark currently logged in to realize
Talk about scene.After virtual session scene is added, second terminal then can be added the virtual session scene other user identifiers
It is communicated between corresponding terminal, for example transmission expression data is right to other user identifiers institute that the virtual session scene is added
Answer terminal.It is appreciated that the user identifier of virtual session scene is added, the members list positioned at the virtual session scene can be
In user identifier.
In one embodiment, second terminal can also in virtual session scene, by the virtual session scene at
Member is shown with the virtual session member of virtual image.Wherein, it can wrap in the virtual session member that second terminal is shown
The corresponding virtual session member of the second user mark currently logged in by second terminal is included, can not also include currently passing through
The corresponding virtual session member of the second user mark that second terminal logs in.Second user mark is not corresponding virtual meeting
Members show is talked about in the virtual session scene that second terminal is shown, both will not influence corresponding to second terminal and other members
Terminal between interactively communicate, can also save system calculation processing resource and display resource.
S1004 receives the expression data that terminal corresponding with the first user identifier of virtual session scene is added is sent.
Expression data is the data that can indicate corresponding facial expressions and acts.
Expression data may include a string of expressive features values of arranged in sequence.In one embodiment, each expressive features
The corresponding position of value or sequence, characterize the expression type corresponding to it.For example, being located at the expression type of first position is
" crying ", the expressive features value in the first position are then used to characterize the degree cried.
Expression data also may include expression type identification and corresponding expressive features value.Expression type is expression dynamic
Make the classification of performance dimension, including opens one's mouth, blinks, laughing at, crying, rotary head or point head etc..It is appreciated that above-mentioned cited expression class
Type is only used for illustrating, and is not used to limit the classification of expression, can be set according to actual needs the type of expression type.
Second terminal can receive the corresponding terminal of the first user identifier of the addition virtual session scene of server forwarding
The expression data of transmission can also directly receive the second user mark that virtual session scene is added by point-to-point mode
The expression data that corresponding terminal is sent.
S1006 extracts expressive features value from expression data.
S1008 controls virtual session member corresponding with the first user identifier and triggers expression spy in virtual session scene
Facial expressions and acts represented by value indicative.
In one embodiment, second terminal can be in virtual session scene, according to corresponding to determining expression type
Expression control logic code and extraction expressive features value, control corresponding with the first user identifier virtual session member implementation
Corresponding facial expressions and acts.For example, facial expressions and acts represented by expression data are " opening one's mouth 10 degree ", then control and the first user identifier
Corresponding virtual session member implements the movement of " opening one's mouth 10 degree ".
In another embodiment, second terminal can also generate phase according to expressive features value and corresponding expression type
Texture information is showed in virtual session corresponding with the first user identifier in virtual session scene by corresponding texture information
The expression of member shows position.For example, when facial expressions and acts represented by expression data are " crying ", corresponding to second user mark
Terminal then can generate " teardrop " texture information corresponding with " crying " according to expression data, by the texture information exhibition of " teardrop "
It is shown in below the eyes of virtual session member corresponding with the first user identifier.
Above-mentioned interaction data processing method, device and computer equipment are added by the second user mark currently logged in
Corresponding virtual session scene receives the expression number that terminal corresponding with the first user identifier of virtual session scene is added is sent
According to;Expressive features value is extracted from expression data;In virtual session scene, virtual meeting corresponding with the first user identifier is controlled
It talks about member and triggers facial expressions and acts represented by expressive features value.It is triggered represented by expression data by control virtual session member
Facial expressions and acts realization interactively communicates, and for interacting communication based on user's authentic image, improves to a certain extent
Personal secrets during interactively communicating.
In addition, control virtual session member triggers facial expressions and acts represented by expression data, it is to interactively communicating user
Another manifestation mode of true expression, allows users to identify online user by facial expressions and acts, provides new mutual
Flowing mode.
In one embodiment, step S1002 includes: to obtain the corresponding more people's meetings of the second user mark currently logged in
Words mark;It sends multi-conference mark and second user is identified to server, server is added second user mark with more
Conference identifies the members list of identified virtual session scene.
Wherein, multi-conference mark is used for unique identification multi-conference.Number of members in multi-conference is greater than or equal to
3.Multi-conference can be group or interim more people's chat sessions, can also be other types of multi-conference.
It is appreciated that the second user mark currently logged in, is more people corresponding with corresponding multi-conference mark
Member in session.Identified virtual session scene is identified with multi-conference, can be using multi-conference mark as directly
The virtual session scene of mark, the i.e. unique identification of virtual session scene are exactly multi-conference mark itself.With multi-conference mark
Know identified virtual session scene, is also possible to identify the virtual session scene as indirect identification using ` multi-conference, i.e., it is empty
The unique identification of quasi- session context is to identify unique corresponding virtual session scene identity with multi-conference, according to multi-conference mark
Knowledge can determine virtual session scene identity, and then determine corresponding virtual session scene, therefore, multi-conference mark can between
Connect unique identification virtual session scene.
Specifically, user can identify the application program logged in for realizing virtual session scene by second user, and
After logining successfully, multi-conference interface is opened in second terminal, the multi-conference interface of the opening is and second user
Identify the interface of the corresponding multi-conference of corresponding multi-conference mark.User can send out in open multi-conference interface
The operation that virtual session scene is added is acted, it is right to obtain the second user mark institute currently logged in response to the operation for second terminal
The multi-conference mark answered, and multi-conference mark and second user mark are sent to server, server is by second user
The members list that identified virtual session scene is identified with the multi-conference is added in mark, is identified the second user with realizing
Corresponding virtual session scene is added.
In one embodiment, server can believe the access that identified virtual session scene is identified with multi-conference
Breath is back to first terminal, and virtual session scene can be added according to the access information in first terminal.Wherein, access information includes
Access IP address and port.
In above-described embodiment, it is equivalent to and is added by the first user identifier that will currently log in based on corresponding more people's meetings
The virtual session scene of creation is talked about, and then is realized, expression data institute is triggered by the virtual session member in virtual session scene
Corresponding facial expressions and acts interactively communicate mode, are equivalent to and are improved on multi-conference, propose a kind of new interaction
Interaction mode.
In one embodiment, it sends multi-conference mark and second user is identified to server, make server by second
The members list that identified virtual session scene is identified with multi-conference is added in user identifier, comprising: sends multi-conference mark
Know and second user is identified to server, server is made to identify identified virtual session scene with multi-conference existing
When, second user is identified to the members list for being added and identifying identified virtual session scene with multi-conference;Alternatively, sending more
Conference mark and second user are identified to server, make server that the virtual meeting identified with multi-conference be not present
When talking about scene, creation identifies identified virtual session scene with multi-conference, and second user is identified to the void that creation is added
The members list of quasi- session context.
Specifically, second terminal sends multi-conference mark and second user is identified to server, and request server is by the
Two user identifiers, which are added, identifies identified virtual session scene with multi-conference.Server, which can detecte, whether there is and more people
The corresponding virtual session scene of session identification.
When the existing corresponding virtual session scene of mark with multi-conference, then server can be by the second user mark
Know the members list for being added and identifying identified virtual session scene with multi-conference, with realize second user is identified be added with
Multi-conference identifies identified virtual session scene.
When there is no with multi-conference mark corresponding virtual session scene, then server can be according to the multi-conference
Mark one new virtual session scene of creation, and it is used to the unique identification new wound using multi-conference mark as directly mark
The virtual session scene built, or generate one with the multi-conference mark uniquely and with newly created virtual session scene it is unique
Corresponding virtual session scene identity identifies using the multi-conference as indirect identification the virtual meeting for carrying out the unique identification creation
Scene is talked about, further, which can be identified the members list that the virtual session scene of creation is added by server.
In above-described embodiment, the creation of virtual session scene and addition processing are integrated, user is only with passing through the
Corresponding multi-conference mark is sent to server to request to be added virtual session scene by one terminal, no matter in server when
It is preceding to whether there is virtual session scene corresponding with multi-conference mark, it can all be added and void is identified with the multi-conference
Quasi- session context, section eliminate the operating procedure of individually creation virtual session scene.In addition, being directed to all users, i.e., for the first time
Create virtual session scene user and virtual session scene creation after apply be added user, be all using same set of rule,
Redundancy caused by more set rules is avoided, the applicability of logic rules is improved.
In one embodiment, this method further include: obtain the user identifier institute in the members list of virtual session scene
Corresponding virtual session member;Determine distributing position of the virtual session member in virtual session scene;Acquisition and virtual session
The corresponding background picture of scene;The virtual session member that will acquire is distributed in corresponding distributing position, and and background picture into
Row Overlapping display constitutes virtual session scene.
Wherein, background picture is the picture as display background.Background picture can be two-dimensional background picture, can also be with
It is three-dimensional background picture.Background picture can be virtual background picture, be also possible to real background picture.Virtual background picture,
It is the picture for showing virtual scene, for example, shown in caricature is exactly a kind of virtual scene.Real background picture is display
The picture of real scene, for example, to the photo that real scene is taken pictures, with regard to the real scene of display.
Specifically, second terminal can be right from the user identifier institute in the members list that server obtains virtual session scene
The virtual session member answered, i.e. virtual image number corresponding to user identifier in the members list of acquisition virtual session scene
According to.Virtual session member can be three-dimensional session members or two-dimensional virtual session members.
Second terminal can be determined according to the quantity of the user identifier in the members list of virtual session scene for being distributed
The size of the geometric figure of virtual session member chooses the position for meeting the quantity in the geometric figure, to determine virtual meeting
Talk about distributing position of the virtual session member in virtual session scene corresponding to the user identifier in the members list of scene.Its
In, the position for meeting the quantity can be randomly selected in geometric figure, can also be chosen according to predeterminated position selection rule full
The position of sufficient quantity.
For example, the quantity of the user identifier in the members list of virtual session scene is 5, is then determined and divided according to quantity 5
The size of the geometric figure of cloth virtual session member, then chooses 5 positions in the geometric figure, and each position is as virtual
Distributing position of the virtual session member in virtual session scene corresponding to user identifier in the members list of session context.
In one embodiment, second terminal can also according in the members list of virtual session scene remove with this second
The quantity of user identifier after user identifier determines the size of the geometric figure for distributing virtual session members, in the geometry
The position for meeting the quantity is chosen in figure, and is removed in the members list of determining virtual session scene and identified with the second user
Distributing position of the virtual session member in virtual session scene corresponding to user identifier afterwards.
The virtual session member that second terminal can will acquire is distributed on corresponding distributing position, and is superimposed with
Acquired background picture to constitute virtual session scene, and exports and shows the virtual session scene.
Virtual session member and background picture are overlapped display, constitute shown virtual session by above-described embodiment
Scene enriches virtual session scene, so that it is more raw close to reality to interactively communicate middle shown virtual session scene
Session context in work realizes the diversity for the mode of interactively communicating.
In one embodiment, virtual session member is three-dimensional session members, and virtual session scene is three-dimensional
Session context.As shown in figure 11, this method further includes virtual session scene display step, specifically includes the following steps:
S1102 obtains three-dimensional session members corresponding to the user identifier in the members list of virtual session scene.
Specifically, second terminal can be right from the user identifier institute in the members list that server obtains virtual session scene
The three-dimensional session members answered, i.e. three-dimensional corresponding to user identifier in the members list of acquisition virtual session scene
Vivid data.
S1104 determines distributing position of the three-dimensional session members in three-dimensional session context.
Second terminal can be according to the quantity of the user identifier in the members list of three-dimensional session context, and determination is used for
It is distributed the size of the geometric figure of three-dimensional session members, chooses the position for meeting the quantity, in the geometric figure with true
Three-dimensional session members corresponding to the user identifier in the members list of virtual session scene are determined in three-dimensional session field
Distributing position in scape.Wherein it is possible to the position for meeting the quantity is randomly selected in geometric figure, it can also be according to default position
It sets selection rule and chooses the position for meeting quantity.
For example, the quantity of the user identifier in the members list of virtual session scene is 5, is then determined and divided according to quantity 5
Then the size of the geometric figure of cloth three-dimensional session members chooses 5 positions in the geometric figure, each position is
Three-dimensional session members are in three-dimensional session context corresponding to user identifier in the members list of virtual session scene
In distributing position.
In one embodiment, second terminal can also remove and this according in the members list of three-dimensional session context
The quantity of all user identifiers after second user mark, determines the ruler for being distributed the geometric figure of three-dimensional session members
It is very little, the position for meeting the quantity is chosen in the geometric figure, and remove and be somebody's turn to do in the members list of determining virtual session scene
Distribution position of the three-dimensional session members in three-dimensional session context corresponding to user identifier after second user mark
It sets.
S1106 obtains three-dimensional background model corresponding with three-dimensional session context.
Wherein, three-dimensional background model is the threedimensional model as display background.Three-dimensional background model can be three-dimensional
Background model is also possible to three-dimensional real background model.Three-dimensional background model is the model for showing three-dimensional virtual scene.
Three-dimensional real background model is the model for showing three-dimensional real scene.
Three-dimensional session members are distributed in corresponding distributing position, and carry out group with three-dimensional background model by S1108
Display is closed, three-dimensional session context is constituted.
The three-dimensional session members that second terminal can will acquire are distributed on corresponding distributing position, and with
Three-dimensional background model is combined, and to constitute three-dimensional session context, and is exported and is shown the three-dimensional session context.
Three-dimensional session members and three-dimensional background model are combined display by above-described embodiment, what composition was shown
Three-dimensional session context, so that the three-dimensional session context shown in interactively communicating is further more close to existing
The session context to grow directly from seeds in living, realizes the diversity for the mode of interactively communicating.
In one embodiment, this method further includes observation visual angle variation operation, specifically includes the following steps: detection acts on
Touch control operation on three-dimensional session context, obtains touch trajectory;Touch trajectory is mapped as three-dimensional session context
In point of observation motion track;According to motion track, the position of the point of observation after determining movement;According to the point of observation after movement
Position, three-dimensional background model and three-dimensional session members are subjected to Projection Display.
Specifically, user can be by carrying out touch-control behaviour to the three-dimensional session context shown on second terminal interface
Make, obtains touch trajectory.Wherein, touch control operation includes the operation for pressing and pulling.
It is point according to the observation it is appreciated that the three-dimensional session context finally shown on second terminal display screen, it will be by
Three-dimensional session context that three-dimensional background model and three-dimensional session members are constituted projects to be shown on display screen.
Point of observation is different, and the three-dimensional session context projected on display screen is also different.
Touch trajectory can be mapped as three-dimensional according to the mapping relations between touch point and point of observation by second terminal
The motion track of point of observation in session context.Second terminal is determined to move according to the motion track for the point of observation determined
The position of point of observation afterwards.
Second terminal according to the position of the point of observation after movement as new point of observation, three-dimensional background model and three-dimensional is empty
Quasi- session members are projected on second terminal display screen again and are shown, then projection obtains again on second terminal display screen
Three-dimensional background model image it is different from three-dimensional background model image shown before touch control operation, on second terminal display screen
Again shown angle is not also identical before the angles of display and touch control operation of the three-dimensional session members projected, then weighs
Three-dimensional background model and three-dimensional session members after new projection constitute the three-dimensional session context under new visual angle.
Above-described embodiment realizes the visual angle effect processing to three-dimensional session context, can be adjusted to user and be thought
The observation visual angle wanted, so that the display of three-dimensional session context is more flexible during interactively communicating, can make display
Three-dimensional session context more meets the demand of user, improves the validity of shown three-dimensional session context.
As shown in figure 12, in one embodiment, a kind of interaction data processing unit 1200 is provided, which includes:
Module 1202, image capture module 1204, Expression Recognition module 1206 and control module 1208 is added, in which:
Module 1202 is added, corresponding virtual session scene is added for the first user identifier by currently logging in.
Image capture module 1204, for acquiring head image data.
Expression Recognition module 1206, the expressive features in head image data, obtain expression data for identification.
Control module 1208 is added corresponding to the second user mark of virtual session scene for expression data to be sent to
Terminal, make terminal in virtual session scene, control corresponding with the first user identifier virtual session member triggering expression number
According to represented facial expressions and acts.
In one embodiment, addition module 1202 is also used to obtain more corresponding to the first user identifier currently logged in
Conference mark;Multi-conference mark and the first user identifier are sent to server, server is added by the first user identifier
The members list of identified virtual session scene is identified with multi-conference.
In one embodiment, module 1202 is added and is also used to send multi-conference mark and the first user identifier to service
Device, make server it is existing identified virtual session scene is identified with multi-conference when, by the first user identifier be added with
Multi-conference identifies the members list of identified virtual session scene;Alternatively, sending multi-conference mark and the first user mark
Know makes server when there is no identified virtual session scene is identified with multi-conference to server, creates with more people's meetings
Words identify identified virtual session scene, and the first user identifier is added to the members list of the virtual session scene created.
In one embodiment, Expression Recognition module 1206 is also used to identify the expressive features in head image data, obtains
To expression type and corresponding expressive features value;Expressive features value corresponding with the expression type that identification obtains that generation includes
Expression data.
In one embodiment, Expression Recognition module 1206 be also used to for preset expression set of types close in unidentified arrive
Expression type assigns the expressive features value for indicating not trigger corresponding facial expressions and acts;According to each table in the conjunction of default expression set of types
The preset order of feelings type combines the corresponding expressive features value of each expression type, constitutes expression data.
In one embodiment, control module 1208, which is also used to for expression data being sent to, is added the of virtual session scene
Terminal corresponding to two user identifiers makes terminal extract expression corresponding with the expression type recognized from expression data special
Value indicative controls virtual session member corresponding with the first user identifier and triggers the expressive features extracted in virtual session scene
The represented facial expressions and acts of value.
In one embodiment, control module 1208 is also used to obtain the table that the corresponding terminal of second user mark is sent
Feelings data;In virtual session scene, controls and identify the expression number that corresponding virtual session member triggers acquisition with second user
According to represented facial expressions and acts.
As shown in figure 13, in one embodiment, the device 1200 further include:
Virtual session member generation module 1201, for obtaining user face corresponding to the first user identifier currently logged in
Portion's image data;According to user's face image data and virtual session member's initial model, generate corresponding with the first user identifier
Virtual session member.
In one embodiment, the device 1200 further include:
Virtual session scene display module (not shown), for obtaining virtual session corresponding with second user mark
Member;Determine distributing position of the virtual session member in virtual session scene;Obtain background corresponding with virtual session scene
Picture;The virtual session member that will acquire is distributed in corresponding distributing position, and is overlapped display with background picture, constitutes
Virtual session scene.
As shown in figure 14, in one embodiment, virtual session member is three-dimensional session members, virtual session scene
For three-dimensional session context.The device 1200 further include:
Three-dimensional session context display module 1210, for obtaining three-dimensional session corresponding with second user mark
Member;Determine distributing position of the three-dimensional session members in three-dimensional session context;It obtains and three-dimensional session field
The corresponding three-dimensional background model of scape;Three-dimensional session members are distributed in corresponding distributing position, and with three-dimensional background mould
Type is combined display, constitutes three-dimensional session context.
As shown in figure 15, in one embodiment, the device 1200 further include:
Visual angle adjusts module 1212 and obtains touch-control for detecting the touch control operation acted on three-dimensional session context
Track;Touch trajectory is mapped as to the motion track of the point of observation in three-dimensional session context;According to motion track, determines and move
The position of point of observation after dynamic;According to the position of the point of observation after movement, by three-dimensional background model and three-dimensional session members
Carry out Projection Display.
As shown in figure 16, in one embodiment, a kind of interaction data processing unit 1600 is provided, which includes adding
Enter module 1602, human facial feature extraction module 1604 and control module 1606, in which:
Module 1602 is added, corresponding virtual session scene is added by the second user mark currently logged in;
Human facial feature extraction module 1604 receives terminal corresponding with the first user identifier of virtual session scene is added and sends out
The expression data sent;Expressive features value is extracted from expression data;
Control module 1608 controls virtual session member touching corresponding with the first user identifier in virtual session scene
Deliver facial expressions and acts represented by feelings characteristic value.
In one embodiment, control module 1608 is also used to determine expression class corresponding with the expressive features value of extraction
Type;It is special according to expression control logic code corresponding to determining expression type and the expression of extraction in virtual session scene
Value indicative controls the corresponding facial expressions and acts of corresponding with the first user identifier virtual session member implementation;And/or according to expression spy
Value indicative and corresponding expression type generate corresponding texture information, in virtual session scene, by texture information be showed in
The expression of the corresponding virtual session member of first user identifier shows position.
In one embodiment, addition module 1602 is also used to obtain more corresponding to the second user mark currently logged in
Conference mark;It sends multi-conference mark and second user is identified to server, identify server by second user and be added
The members list of identified virtual session scene is identified with multi-conference.
In one embodiment, addition module 1602 is also used to send multi-conference mark and second user is identified to service
Device, make server it is existing identified virtual session scene is identified with multi-conference when, second user is identified be added with
Multi-conference identifies the members list of identified virtual session scene;Alternatively, sending multi-conference mark and second user mark
Know makes server when there is no identified virtual session scene is identified with multi-conference to server, creates with more people's meetings
Words identify identified virtual session scene, and second user is identified to the members list that the virtual session scene of creation is added.
In one embodiment, device 1600 further include:
Virtual session scene display module (not shown), the use in members list for obtaining virtual session scene
The corresponding virtual session member of family mark;Determine distributing position of the virtual session member in virtual session scene;Obtain with
The corresponding background picture of virtual session scene;The virtual session member that will acquire is distributed in corresponding distributing position, and with back
Scape picture is overlapped display, constitutes virtual session scene.
In one embodiment, virtual session member is three-dimensional session members, and virtual session scene is three-dimensional
Session context.Device 1600 further include:
Three-dimensional session context display module (not shown), in the members list for obtaining virtual session scene
User identifier corresponding to three-dimensional session members;Determine three-dimensional session members in three-dimensional session context
Distributing position;Obtain three-dimensional background model corresponding with three-dimensional session context;Three-dimensional session members are distributed in institute
Corresponding distributing position, and it is combined display with three-dimensional background model, constitute three-dimensional session context.
In one embodiment, device 1600 further include:
Visual angle adjusts module and obtains touch trajectory for detecting the touch control operation acted on three-dimensional session context;
Touch trajectory is mapped as to the motion track of the point of observation in three-dimensional session context;According to motion track, after determining movement
Point of observation position;According to the position of the point of observation after movement, three-dimensional background model and three-dimensional session members are carried out
Projection Display.
In one embodiment, interaction data processing unit provided by the present application can be implemented as a kind of computer program
Form, the computer program can be run in computer equipment as shown in Figure 2, and the non-volatile of the computer equipment is deposited
Storage media can store each program module for forming the interaction data processing unit, for example, addition module 1202 shown in Figure 12,
Image capture module 1204, Expression Recognition module 1206 and control module 1208.It include computer-readable in each program module
Instruction, the computer-readable instruction is for making the computer equipment execute each implementation of the application described in this specification
Step in the interaction data processing method of example, for example, the computer equipment can pass through interaction data as shown in figure 12
Addition module 1202 in processing unit 1200 passes through the first user identifier currently logged in and corresponding virtual session scene is added,
Head graph data is acquired by image capture module 1204, is identified in head image data by Expression Recognition module 1206
Expressive features obtain expression data.And expression data is sent to by control module 1208 and is added the of virtual session scene
Terminal corresponding to two user identifiers makes terminal in virtual session scene, controls virtual meeting corresponding with the first user identifier
It talks about member and triggers facial expressions and acts represented by expression data.
In one embodiment, a kind of computer equipment, including memory and processor are provided, is deposited in the memory
Contain computer-readable instruction, when the computer-readable instruction is executed by the processor so that the processor execute with
Lower step: corresponding virtual session scene is added by the first user identifier currently logged in;Acquire head image data;Identification
Expressive features in the head image data, obtain expression data;The expression data is sent to, the virtual meeting is added
The corresponding terminal of the second user mark of scene is talked about, makes the terminal in the virtual session scene, control and described the
The corresponding virtual session member of one user identifier triggers facial expressions and acts represented by the expression data.
In one embodiment, it is added performed by processor by the first user identifier currently logged in corresponding virtual
Session context, comprising: obtain the mark of multi-conference corresponding to the first user identifier currently logged in;Send the multi-conference
The server is added first user identifier with more people's meetings to server in mark and first user identifier
Words identify the members list of identified virtual session scene.
In one embodiment, the transmission multi-conference mark and first user mark performed by processor
Know makes the server that first user identifier is added to the virtual meeting identified with the multi-conference to server
Talk about the members list of scene, comprising: send the multi-conference mark and first user identifier to server, make the clothes
Be engaged in device it is existing identified virtual session scene is identified with the multi-conference when, will first user identifier addition with
The multi-conference identifies the members list of identified virtual session scene;Alternatively, sending the multi-conference mark and institute
The first user identifier is stated to server, makes the server that the virtual session identified with multi-conference mark be not present
When scene, creation identifies identified virtual session scene with the multi-conference, and first user identifier is added and is created
The members list for the virtual session scene built.
In one embodiment, the expressive features in the identification head image data performed by processor, obtain
To expression data, comprising: identify the expressive features in the head image data, obtain expression type and corresponding expression is special
Value indicative;The expression data for expressive features value corresponding with the expression type that identification obtains that generation includes.
In one embodiment, the expression type identified belongs to default expression set of types and closes;Processor is held
The expression data for expressive features value corresponding with the expression type that identification obtains that the capable generation includes, comprising: right
The unidentified expression type arrived in the conjunction of default expression set of types, assigns the expressive features for indicating not trigger corresponding facial expressions and acts
Value;According to the preset order of each expression type in the default expression set of types conjunction, each expression type is respectively corresponded to
Expressive features value combination, constitute expression data.
In one embodiment, the virtual session is added in described be sent to the expression data performed by processor
The corresponding terminal of the second user mark of scene, makes the terminal in the virtual session scene, control and described first
The corresponding virtual session member of user identifier triggers facial expressions and acts represented by the expression data, comprising: by the expression number
According to the corresponding terminal of the second user that the virtual session scene is added mark is sent to, make the terminal from the expression number
Extract corresponding with the expression type recognized expressive features value according to middle, in the virtual session scene, control with it is described
The corresponding virtual session member of first user identifier triggers facial expressions and acts represented by the expressive features value extracted.
In one embodiment, computer-readable instruction also makes processor execute following steps: obtaining described second and uses
The expression data that mark corresponding terminal in family is sent;In the virtual session scene, control is identified with the second user
Corresponding virtual session member triggers facial expressions and acts represented by the expression data obtained.
In one embodiment, corresponding virtual session scene is added in first user identifier by currently logging in
Before, computer-readable instruction also makes processor execute following steps: obtaining corresponding to the first user identifier currently logged in
User's face image data;According to the user's face image data and virtual session member's initial model, generate with it is described
The corresponding virtual session member of first user identifier.
In one embodiment, computer-readable instruction also makes processor execute following steps: obtaining and described second
The corresponding virtual session member of user identifier;Determine distribution position of the virtual session member in the virtual session scene
It sets;Obtain background picture corresponding with the virtual session scene;The virtual session member that will acquire is distributed in corresponding
Distributing position, and be overlapped display with the background picture, constitute the virtual session scene.
In one embodiment, the virtual session member is three-dimensional session members, and the virtual session scene is
Three-dimensional session context;Computer-readable instruction also makes processor execute following steps: obtaining and the second user mark
Know corresponding three-dimensional session members;Determine point of the three-dimensional session members in the three-dimensional session context
Cloth position;Obtain three-dimensional background model corresponding with the three-dimensional session context;By the three-dimensional session members point
It is distributed in corresponding distributing position, and is combined display with the three-dimensional background model, constitutes three-dimensional session field
Scape.
In one embodiment, computer-readable instruction also makes processor execute following steps: detection acts on described
Touch control operation on three-dimensional session context, obtains touch trajectory;The touch trajectory is mapped as the three-dimensional meeting
Talk about the motion track of the point of observation in scene;According to the motion track, the position of the point of observation after determining movement;According to described
The three-dimensional background model and the three-dimensional session members are carried out Projection Display by the position of the point of observation after movement.
In one embodiment, a kind of computer equipment, including memory and processor are provided, is deposited in the memory
Contain computer-readable instruction, when the computer-readable instruction is executed by the processor so that the processor execute with
Lower step: corresponding virtual session scene is added by the second user mark currently logged in;It receives and the virtual meeting is added
Talk about the expression data that the corresponding terminal of the first user identifier of scene is sent;Expressive features value is extracted from the expression data;
In the virtual session scene, controls virtual session member corresponding with first user identifier and trigger the expressive features
The represented facial expressions and acts of value.
In one embodiment, performed by processor in the virtual session scene, control and first user
It identifies corresponding virtual session member and triggers facial expressions and acts represented by the expressive features value, comprising: determine the institute with extraction
State the corresponding expression type of expressive features value;In the virtual session scene, according to table corresponding to determining expression type
The expressive features value of feelings control logic code and extraction controls virtual session member corresponding with first user identifier
Implement corresponding facial expressions and acts;And/or corresponding line is generated according to the expressive features value and the corresponding expression type
Information is managed, in the virtual session scene, the texture information is showed in corresponding with first user identifier virtual
The expression of session members shows position.
In one embodiment, the second user mark by currently logging in performed by processor is added accordingly
Virtual session scene, comprising: obtain the corresponding multi-conference mark of the second user mark currently logged in;Send more people
Session identification and the second user are identified to server, and the server is added second user mark with described more
Conference identifies the members list of identified virtual session scene.
In one embodiment, the transmission multi-conference mark and the second user mark performed by processor
Know makes the server that the virtual meeting identified with the multi-conference is added in second user mark to server
Talk about the members list of scene, comprising: send the multi-conference mark and the second user is identified to server, make the clothes
Be engaged in device it is existing identified virtual session scene is identified with the multi-conference when, the second user is identified be added with
The multi-conference identifies the members list of identified virtual session scene;Alternatively, sending the multi-conference mark and institute
It states second user to identify to server, makes the server that the virtual session identified with multi-conference mark be not present
When scene, creation identifies identified virtual session scene with the multi-conference, and the second user is identified, wound is added
The members list for the virtual session scene built.
In one embodiment, computer-readable instruction also makes processor execute following steps: obtaining the virtual meeting
Talk about virtual session member corresponding to the user identifier in the members list of scene;Determine the virtual session member in the void
Distributing position in quasi- session context;Obtain background picture corresponding with the virtual session scene;What be will acquire is described virtual
Session members are distributed in corresponding distributing position, and are overlapped display with the background picture, constitute the virtual session
Scene.
In one embodiment, the virtual session member is three-dimensional session members, and the virtual session scene is
Three-dimensional session context.Computer-readable instruction also makes processor execute following steps: obtaining the virtual session scene
Members list in user identifier corresponding to three-dimensional session members;Determine the three-dimensional session members described
Distributing position in three-dimensional session context;Obtain three-dimensional background model corresponding with the three-dimensional session context;It will
The three-dimensional session members are distributed in corresponding distributing position, and are combined display with the three-dimensional background model,
Constitute the three-dimensional session context.
In one embodiment, computer-readable instruction also makes processor execute following steps: detection acts on described
Touch control operation on three-dimensional session context, obtains touch trajectory;The touch trajectory is mapped as the three-dimensional meeting
Talk about the motion track of the point of observation in scene;According to the motion track, the position of the point of observation after determining movement;According to described
The three-dimensional background model and the three-dimensional session members are carried out Projection Display by the position of the point of observation after movement.
In one embodiment, a kind of non-volatile readable storage medium for being stored with computer-readable instruction is provided,
When the computer-readable instruction is executed by one or more processors, so that one or more processors execute following steps: logical
Corresponding virtual session scene is added after the first user identifier currently logged in;Acquire head image data;Identify the head
Expressive features in image data, obtain expression data;The expression data is sent to, the virtual session scene is added
The corresponding terminal of second user mark, makes the terminal in the virtual session scene, control is marked with first user
Know corresponding virtual session member and triggers facial expressions and acts represented by the expression data.
In one embodiment, it is added performed by processor by the first user identifier currently logged in corresponding virtual
Session context, comprising: obtain the mark of multi-conference corresponding to the first user identifier currently logged in;Send the multi-conference
The server is added first user identifier with more people's meetings to server in mark and first user identifier
Words identify the members list of identified virtual session scene.
In one embodiment, the transmission multi-conference mark and first user mark performed by processor
Know makes the server that first user identifier is added to the virtual meeting identified with the multi-conference to server
Talk about the members list of scene, comprising: send the multi-conference mark and first user identifier to server, make the clothes
Be engaged in device it is existing identified virtual session scene is identified with the multi-conference when, will first user identifier addition with
The multi-conference identifies the members list of identified virtual session scene;Alternatively, sending the multi-conference mark and institute
The first user identifier is stated to server, makes the server that the virtual session identified with multi-conference mark be not present
When scene, creation identifies identified virtual session scene with the multi-conference, and first user identifier is added and is created
The members list for the virtual session scene built.
In one embodiment, the expressive features in the identification head image data performed by processor, obtain
To expression data, comprising: identify the expressive features in the head image data, obtain expression type and corresponding expression is special
Value indicative;The expression data for expressive features value corresponding with the expression type that identification obtains that generation includes.
In one embodiment, the expression type identified belongs to default expression set of types and closes;Processor is held
The expression data for expressive features value corresponding with the expression type that identification obtains that the capable generation includes, comprising: right
The unidentified expression type arrived in the conjunction of default expression set of types, assigns the expressive features for indicating not trigger corresponding facial expressions and acts
Value;According to the preset order of each expression type in the default expression set of types conjunction, each expression type is respectively corresponded to
Expressive features value combination, constitute expression data.
In one embodiment, the virtual session is added in described be sent to the expression data performed by processor
The corresponding terminal of the second user mark of scene, makes the terminal in the virtual session scene, control and described first
The corresponding virtual session member of user identifier triggers facial expressions and acts represented by the expression data, comprising: by the expression number
According to the corresponding terminal of the second user that the virtual session scene is added mark is sent to, make the terminal from the expression number
Extract corresponding with the expression type recognized expressive features value according to middle, in the virtual session scene, control with it is described
The corresponding virtual session member of first user identifier triggers facial expressions and acts represented by the expressive features value extracted.
In one embodiment, computer-readable instruction also makes processor execute following steps: obtaining described second and uses
The expression data that mark corresponding terminal in family is sent;In the virtual session scene, control is identified with the second user
Corresponding virtual session member triggers facial expressions and acts represented by the expression data obtained.
In one embodiment, corresponding virtual session scene is added in first user identifier by currently logging in
Before, computer-readable instruction also makes processor execute following steps: obtaining corresponding to the first user identifier currently logged in
User's face image data;According to the user's face image data and virtual session member's initial model, generate with it is described
The corresponding virtual session member of first user identifier.
In one embodiment, computer-readable instruction also makes processor execute following steps: obtaining and described second
The corresponding virtual session member of user identifier;Determine distribution position of the virtual session member in the virtual session scene
It sets;Obtain background picture corresponding with the virtual session scene;The virtual session member that will acquire is distributed in corresponding
Distributing position, and be overlapped display with the background picture, constitute the virtual session scene.
In one embodiment, the virtual session member is three-dimensional session members, and the virtual session scene is
Three-dimensional session context;Computer-readable instruction also makes processor execute following steps: obtaining and the second user mark
Know corresponding three-dimensional session members;Determine point of the three-dimensional session members in the three-dimensional session context
Cloth position;Obtain three-dimensional background model corresponding with the three-dimensional session context;By the three-dimensional session members point
It is distributed in corresponding distributing position, and is combined display with the three-dimensional background model, constitutes three-dimensional session field
Scape.
In one embodiment, computer-readable instruction also makes processor execute following steps: detection acts on described
Touch control operation on three-dimensional session context, obtains touch trajectory;The touch trajectory is mapped as the three-dimensional meeting
Talk about the motion track of the point of observation in scene;According to the motion track, the position of the point of observation after determining movement;According to described
The three-dimensional background model and the three-dimensional session members are carried out Projection Display by the position of the point of observation after movement.
In one embodiment, a kind of non-volatile readable storage medium for being stored with computer-readable instruction is provided,
When the computer-readable instruction is executed by one or more processors, so that one or more processors execute following steps: logical
Corresponding virtual session scene is added after the second user mark currently logged in;It receives and is added the of the virtual session scene
The expression data that the corresponding terminal of one user identifier is sent;Expressive features value is extracted from the expression data;Described virtual
In session context, controls virtual session member corresponding with first user identifier and trigger represented by the expressive features value
Facial expressions and acts.
In one embodiment, performed by processor in the virtual session scene, control and first user
It identifies corresponding virtual session member and triggers facial expressions and acts represented by the expressive features value, comprising: determine the institute with extraction
State the corresponding expression type of expressive features value;In the virtual session scene, according to table corresponding to determining expression type
The expressive features value of feelings control logic code and extraction controls virtual session member corresponding with first user identifier
Implement corresponding facial expressions and acts;And/or corresponding line is generated according to the expressive features value and the corresponding expression type
Information is managed, in the virtual session scene, the texture information is showed in corresponding with first user identifier virtual
The expression of session members shows position.
In one embodiment, the second user mark by currently logging in performed by processor is added accordingly
Virtual session scene, comprising: obtain the corresponding multi-conference mark of the second user mark currently logged in;Send more people
Session identification and the second user are identified to server, and the server is added second user mark with described more
Conference identifies the members list of identified virtual session scene.
In one embodiment, the transmission multi-conference mark and the second user mark performed by processor
Know makes the server that the virtual meeting identified with the multi-conference is added in second user mark to server
Talk about the members list of scene, comprising: send the multi-conference mark and the second user is identified to server, make the clothes
Be engaged in device it is existing identified virtual session scene is identified with the multi-conference when, the second user is identified be added with
The multi-conference identifies the members list of identified virtual session scene;Alternatively, sending the multi-conference mark and institute
It states second user to identify to server, makes the server that the virtual session identified with multi-conference mark be not present
When scene, creation identifies identified virtual session scene with the multi-conference, and the second user is identified, wound is added
The members list for the virtual session scene built.
In one embodiment, computer-readable instruction also makes processor execute following steps: obtaining the virtual meeting
Talk about virtual session member corresponding to the user identifier in the members list of scene;Determine the virtual session member in the void
Distributing position in quasi- session context;Obtain background picture corresponding with the virtual session scene;What be will acquire is described virtual
Session members are distributed in corresponding distributing position, and are overlapped display with the background picture, constitute the virtual session
Scene.
In one embodiment, the virtual session member is three-dimensional session members, and the virtual session scene is
Three-dimensional session context.Computer-readable instruction also makes processor execute following steps: obtaining the virtual session scene
Members list in user identifier corresponding to three-dimensional session members;Determine the three-dimensional session members described
Distributing position in three-dimensional session context;Obtain three-dimensional background model corresponding with the three-dimensional session context;It will
The three-dimensional session members are distributed in corresponding distributing position, and are combined display with the three-dimensional background model,
Constitute the three-dimensional session context.
In one embodiment, computer-readable instruction also makes processor execute following steps: detection acts on described
Touch control operation on three-dimensional session context, obtains touch trajectory;The touch trajectory is mapped as the three-dimensional meeting
Talk about the motion track of the point of observation in scene;According to the motion track, the position of the point of observation after determining movement;According to described
The three-dimensional background model and the three-dimensional session members are carried out Projection Display by the position of the point of observation after movement.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, which can be stored in a computer-readable storage and be situated between
In matter, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, storage medium above-mentioned can be
The non-volatile memory mediums such as magnetic disk, CD, read-only memory (Read-Only Memory, ROM) or random storage note
Recall body (Random Access Memory, RAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
Only several embodiments of the present invention are expressed for above embodiments, and the description thereof is more specific and detailed, but can not
Therefore it is construed as limiting the scope of the patent.It should be pointed out that for those of ordinary skill in the art,
Under the premise of not departing from present inventive concept, various modifications and improvements can be made, and these are all within the scope of protection of the present invention.
Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.
Claims (20)
1. a kind of interaction data processing method, which comprises
Corresponding virtual session scene is added by the first user identifier currently logged in;
Acquire head image data;
It identifies the expressive features in the head image data, obtains expression data;
The expression data is sent to, terminal corresponding to the second user mark of the virtual session scene is added, made described
Terminal controls virtual session member corresponding with first user identifier and triggers the expression in the virtual session scene
Facial expressions and acts represented by data.
2. the method according to claim 1, wherein phase is added in first user identifier by currently logging in
The virtual session scene answered, comprising:
Obtain the mark of multi-conference corresponding to the first user identifier currently logged in;
The multi-conference mark and first user identifier are sent to server, makes the server by first user
The members list that identified virtual session scene is identified with the multi-conference is added in mark.
3. according to the method described in claim 2, it is characterized in that, the multi-conference mark and described first that sends is used
Family is identified to server, and the server is added by first user identifier and identifies identified void with the multi-conference
The members list of quasi- session context, comprising:
The multi-conference mark and first user identifier are sent to server, makes the server existing with described
When multi-conference identifies identified virtual session scene, first user identifier is added, institute is identified with the multi-conference
The members list of the virtual session scene of mark;Alternatively,
The multi-conference mark and first user identifier are sent to server, the server is being not present with described
When multi-conference identifies identified virtual session scene, creation identifies identified virtual session field with the multi-conference
Scape, and the members list for the virtual session scene that first user identifier addition is created.
4. the method according to claim 1, wherein the expression in the identification head image data is special
Sign, obtains expression data, comprising:
It identifies the expressive features in the head image data, obtains expression type and corresponding expressive features value;
The expression data for expressive features value corresponding with the expression type that identification obtains that generation includes.
5. according to the method described in claim 4, it is characterized in that, the expression type that identification obtains belongs to default expression class
Type set;
The generation includes the expression data of expressive features value corresponding with the expression type that identification obtains, comprising:
For the unidentified expression type arrived in default expression set of types conjunction, the expression for indicating not trigger corresponding facial expressions and acts is assigned
Characteristic value;
According to the preset order of each expression type in the default expression set of types conjunction, each expression type is respectively corresponded to
Expressive features value combination, constitute expression data.
6. method according to claim 4 or 5, which is characterized in that described that the expression data is sent to described in addition
The corresponding terminal of the second user mark of virtual session scene, makes the terminal in the virtual session scene, control with
The corresponding virtual session member of first user identifier triggers facial expressions and acts represented by the expression data, comprising:
The expression data is sent to, terminal corresponding to the second user mark of the virtual session scene is added, made described
Terminal extracts expressive features value corresponding with the expression type recognized from the expression data, in the virtual session field
Jing Zhong controls virtual session member corresponding with first user identifier and triggers represented by the expressive features value extracted
Facial expressions and acts.
7. the method according to any one of claims 1 to 5, which is characterized in that the method also includes:
Obtain the expression data that the corresponding terminal of the second user mark is sent;
In the virtual session scene, controls and identify the institute that corresponding virtual session member triggers acquisition with the second user
State facial expressions and acts represented by expression data.
8. the method according to any one of claims 1 to 5, which is characterized in that in first by currently logging in
User identifier is added before corresponding virtual session scene, the method also includes:
Obtain user's face image data corresponding to the first user identifier currently logged in;
According to the user's face image data and virtual session member's initial model, generate corresponding with first user identifier
Virtual session member.
9. the method according to any one of claims 1 to 5, which is characterized in that the virtual session member is three-dimensional empty
Quasi- session members, the virtual session scene are three-dimensional session context;
The method also includes:
Obtain three-dimensional session members corresponding with second user mark;
Determine distributing position of the three-dimensional session members in the three-dimensional session context;
Obtain three-dimensional background model corresponding with the three-dimensional session context;
The three-dimensional session members are distributed in corresponding distributing position, and are combined with the three-dimensional background model
It has been shown that, constitutes the three-dimensional session context.
10. according to the method described in claim 9, it is characterized in that, the method also includes:
Detection acts on the touch control operation on the three-dimensional session context, obtains touch trajectory;
The touch trajectory is mapped as to the motion track of the point of observation in the three-dimensional session context;
According to the motion track, the position of the point of observation after determining movement;
According to the position of the point of observation after the movement, the three-dimensional background model and the three-dimensional session members are carried out
Projection Display.
11. a kind of interaction data processing method, which comprises
Corresponding virtual session scene is added by the second user mark currently logged in;
Receive the expression data that terminal corresponding with the first user identifier that the virtual session scene is added is sent;
Expressive features value is extracted from the expression data;
In the virtual session scene, controls virtual session member corresponding with first user identifier and trigger the expression
Facial expressions and acts represented by characteristic value.
12. according to the method for claim 11, which is characterized in that described in the virtual session scene, control and institute
It states the corresponding virtual session member of the first user identifier and triggers facial expressions and acts represented by the expressive features value, comprising:
Determine expression type corresponding with the expressive features value extracted;
In the virtual session scene, according to the institute of expression control logic code corresponding to determining expression type and extraction
It states expressive features value, controls the corresponding facial expressions and acts of corresponding with first user identifier virtual session member implementation;With/
Or,
Corresponding texture information is generated according to the expressive features value and the corresponding expression type, in the virtual session
In scene, the texture information is showed in the expression displaying portion of virtual session member corresponding with first user identifier
Position.
13. according to the method for claim 11, which is characterized in that the second user mark by currently logging in is added
Corresponding virtual session scene, comprising:
Obtain the corresponding multi-conference mark of the second user mark currently logged in;
It sends the multi-conference mark and the second user is identified to server, make the server by the second user
The members list that identified virtual session scene is identified with the multi-conference is added in mark.
14. according to the method for claim 13, which is characterized in that described to send the multi-conference mark and described second
User identifier identifies the server second user mark addition with the multi-conference to server
The members list of virtual session scene, comprising:
It sends the multi-conference mark and the second user is identified to server, make the server existing with described
When multi-conference identifies identified virtual session scene, the second user is identified and is added with multi-conference mark institute
The members list of the virtual session scene of mark;Alternatively,
It sends the multi-conference mark and the second user is identified to server, the server is being not present with described
When multi-conference identifies identified virtual session scene, creation identifies identified virtual session field with the multi-conference
Scape, and the second user is identified to the members list that the virtual session scene of creation is added.
15. method described in any one of 1 to 14 according to claim 1, which is characterized in that the virtual session member is three-dimensional
Virtual session member, the virtual session scene are three-dimensional session context;
The method also includes:
Obtain three-dimensional session members corresponding to the user identifier in the members list of the virtual session scene;
Determine distributing position of the three-dimensional session members in the three-dimensional session context;
Obtain three-dimensional background model corresponding with the three-dimensional session context;
The three-dimensional session members are distributed in corresponding distributing position, and are combined with the three-dimensional background model
It has been shown that, constitutes the three-dimensional session context.
16. according to the method for claim 15, which is characterized in that the method also includes:
Detection acts on the touch control operation on the three-dimensional session context, obtains touch trajectory;
The touch trajectory is mapped as to the motion track of the point of observation in the three-dimensional session context;
According to the motion track, the position of the point of observation after determining movement;
According to the position of the point of observation after the movement, the three-dimensional background model and the three-dimensional session members are carried out
Projection Display.
17. a kind of interaction data processing unit, which is characterized in that described device includes:
Module is added, corresponding virtual session scene is added for the first user identifier by currently logging in;
Image capture module, for acquiring head image data;
Expression Recognition module, the expressive features in the head image data, obtain expression data for identification;
Control module is added corresponding to the second user mark of the virtual session scene for the expression data to be sent to
Terminal, make the terminal in the virtual session scene, control corresponding with first user identifier virtual session at
Member triggers facial expressions and acts represented by the expression data.
18. a kind of interaction data processing unit, which is characterized in that described device includes:
Module is added, corresponding virtual session scene is added by the second user mark currently logged in;
Human facial feature extraction module receives what terminal corresponding with the first user identifier that the virtual session scene is added was sent
Expression data;Expressive features value is extracted from the expression data;
Control module controls virtual session member touching corresponding with first user identifier in the virtual session scene
Facial expressions and acts represented by sending out expressive features value described.
19. a kind of computer equipment, including memory and processor, it is stored with computer-readable instruction in the memory, institute
When stating computer-readable instruction and being executed by the processor, so that the processor is executed as in claim 1 to 5 or 11 to 14
Any one of the method the step of.
20. a kind of storage medium for being stored with computer-readable instruction, the computer-readable instruction is handled by one or more
When device executes, so that one or more processors execute in such as claim 1 to 5 or the step of any one of 11 to 14 the methods
Suddenly.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710458909.5A CN109150690B (en) | 2017-06-16 | 2017-06-16 | Interactive data processing method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710458909.5A CN109150690B (en) | 2017-06-16 | 2017-06-16 | Interactive data processing method and device, computer equipment and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109150690A true CN109150690A (en) | 2019-01-04 |
CN109150690B CN109150690B (en) | 2021-05-25 |
Family
ID=64830555
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710458909.5A Active CN109150690B (en) | 2017-06-16 | 2017-06-16 | Interactive data processing method and device, computer equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109150690B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110401810A (en) * | 2019-06-28 | 2019-11-01 | 广东虚拟现实科技有限公司 | Processing method, device, system, electronic equipment and the storage medium of virtual screen |
CN110418095A (en) * | 2019-06-28 | 2019-11-05 | 广东虚拟现实科技有限公司 | Processing method, device, electronic equipment and the storage medium of virtual scene |
CN111444389A (en) * | 2020-03-27 | 2020-07-24 | 焦点科技股份有限公司 | Conference video analysis method and system based on target detection |
CN114598738A (en) * | 2022-02-22 | 2022-06-07 | 网易(杭州)网络有限公司 | Data processing method, data processing device, storage medium and computer equipment |
WO2023082737A1 (en) * | 2021-11-12 | 2023-05-19 | 腾讯科技(深圳)有限公司 | Data processing method and apparatus, and device and readable storage medium |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101127737A (en) * | 2007-09-25 | 2008-02-20 | 腾讯科技(深圳)有限公司 | Implementation method of UI, user terminal and instant communication system |
US20090204908A1 (en) * | 2008-02-11 | 2009-08-13 | Ganz | Friends list management |
CN101635705A (en) * | 2008-07-23 | 2010-01-27 | 上海赛我网络技术有限公司 | Interaction method based on three-dimensional virtual map and figure and system for realizing same |
CN101908232A (en) * | 2010-07-30 | 2010-12-08 | 重庆埃默科技有限责任公司 | Interactive scene simulation system and scene virtual simulation method |
CN102142154A (en) * | 2011-05-10 | 2011-08-03 | 中国科学院半导体研究所 | Method and device for generating virtual face image |
CN103368816A (en) * | 2012-03-29 | 2013-10-23 | 深圳市腾讯计算机***有限公司 | Instant communication method based on virtual character and system |
CN103368929A (en) * | 2012-04-11 | 2013-10-23 | 腾讯科技(深圳)有限公司 | Video chatting method and system |
CN105653012A (en) * | 2014-08-26 | 2016-06-08 | 蔡大林 | Multi-user immersion type full interaction virtual reality project training system |
CN105797374A (en) * | 2014-12-31 | 2016-07-27 | 深圳市亿思达科技集团有限公司 | Method for giving out corresponding voice in following way by being matched with face expressions and terminal |
CN105797376A (en) * | 2014-12-31 | 2016-07-27 | 深圳市亿思达科技集团有限公司 | Method and terminal for controlling role model behavior according to expression of user |
CN106326678A (en) * | 2016-09-13 | 2017-01-11 | 捷开通讯(深圳)有限公司 | Sample room experiencing method, equipment and system based on virtual reality |
CN106598438A (en) * | 2016-12-22 | 2017-04-26 | 腾讯科技(深圳)有限公司 | Scene switching method based on mobile terminal, and mobile terminal |
CN106652015A (en) * | 2015-10-30 | 2017-05-10 | 深圳超多维光电子有限公司 | Virtual figure head portrait generation method and apparatus |
-
2017
- 2017-06-16 CN CN201710458909.5A patent/CN109150690B/en active Active
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101127737A (en) * | 2007-09-25 | 2008-02-20 | 腾讯科技(深圳)有限公司 | Implementation method of UI, user terminal and instant communication system |
US20090204908A1 (en) * | 2008-02-11 | 2009-08-13 | Ganz | Friends list management |
CN101635705A (en) * | 2008-07-23 | 2010-01-27 | 上海赛我网络技术有限公司 | Interaction method based on three-dimensional virtual map and figure and system for realizing same |
CN101908232A (en) * | 2010-07-30 | 2010-12-08 | 重庆埃默科技有限责任公司 | Interactive scene simulation system and scene virtual simulation method |
CN102142154A (en) * | 2011-05-10 | 2011-08-03 | 中国科学院半导体研究所 | Method and device for generating virtual face image |
CN103368816A (en) * | 2012-03-29 | 2013-10-23 | 深圳市腾讯计算机***有限公司 | Instant communication method based on virtual character and system |
CN103368929A (en) * | 2012-04-11 | 2013-10-23 | 腾讯科技(深圳)有限公司 | Video chatting method and system |
CN105653012A (en) * | 2014-08-26 | 2016-06-08 | 蔡大林 | Multi-user immersion type full interaction virtual reality project training system |
CN105797374A (en) * | 2014-12-31 | 2016-07-27 | 深圳市亿思达科技集团有限公司 | Method for giving out corresponding voice in following way by being matched with face expressions and terminal |
CN105797376A (en) * | 2014-12-31 | 2016-07-27 | 深圳市亿思达科技集团有限公司 | Method and terminal for controlling role model behavior according to expression of user |
CN106652015A (en) * | 2015-10-30 | 2017-05-10 | 深圳超多维光电子有限公司 | Virtual figure head portrait generation method and apparatus |
CN106326678A (en) * | 2016-09-13 | 2017-01-11 | 捷开通讯(深圳)有限公司 | Sample room experiencing method, equipment and system based on virtual reality |
CN106598438A (en) * | 2016-12-22 | 2017-04-26 | 腾讯科技(深圳)有限公司 | Scene switching method based on mobile terminal, and mobile terminal |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110401810A (en) * | 2019-06-28 | 2019-11-01 | 广东虚拟现实科技有限公司 | Processing method, device, system, electronic equipment and the storage medium of virtual screen |
CN110418095A (en) * | 2019-06-28 | 2019-11-05 | 广东虚拟现实科技有限公司 | Processing method, device, electronic equipment and the storage medium of virtual scene |
CN110418095B (en) * | 2019-06-28 | 2021-09-14 | 广东虚拟现实科技有限公司 | Virtual scene processing method and device, electronic equipment and storage medium |
CN111444389A (en) * | 2020-03-27 | 2020-07-24 | 焦点科技股份有限公司 | Conference video analysis method and system based on target detection |
WO2023082737A1 (en) * | 2021-11-12 | 2023-05-19 | 腾讯科技(深圳)有限公司 | Data processing method and apparatus, and device and readable storage medium |
CN114598738A (en) * | 2022-02-22 | 2022-06-07 | 网易(杭州)网络有限公司 | Data processing method, data processing device, storage medium and computer equipment |
Also Published As
Publication number | Publication date |
---|---|
CN109150690B (en) | 2021-05-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109150690A (en) | Interaction data processing method, device, computer equipment and storage medium | |
US11595617B2 (en) | Communication using interactive avatars | |
TWI650675B (en) | Method and system for group video session, terminal, virtual reality device and network device | |
CN108874114B (en) | Method and device for realizing emotion expression of virtual object, computer equipment and storage medium | |
CN113014471B (en) | Session processing method, device, terminal and storage medium | |
CN108305317A (en) | A kind of image processing method, device and storage medium | |
US20140351720A1 (en) | Method, user terminal and server for information exchange in communications | |
CN107210949A (en) | User terminal using the message service method of role, execution methods described includes the message application of methods described | |
WO2022252866A1 (en) | Interaction processing method and apparatus, terminal and medium | |
CN107924575A (en) | The asynchronous 3D annotations of video sequence | |
CN110213521A (en) | A kind of virtual instant communicating method | |
CN106156237B (en) | Information processing method, information processing unit and user equipment | |
CN109428859A (en) | A kind of synchronized communication method, terminal and server | |
JP6563580B1 (en) | Communication system and program | |
CN110536095A (en) | Call method, device, terminal and storage medium | |
CN109670385A (en) | The method and device that expression updates in a kind of application program | |
CN102780649A (en) | Method, client and system for filling instant image in instant communication message | |
CN109260710A (en) | A kind of game APP optimization method, device and terminal device based on mood | |
CN108615261A (en) | The processing method, processing unit and storage medium of image in augmented reality | |
CN109039851B (en) | Interactive data processing method and device, computer equipment and storage medium | |
CN108965101A (en) | Conversation message processing method, device, storage medium and computer equipment | |
US20230362333A1 (en) | Data processing method and apparatus, device, and readable storage medium | |
CN108989268A (en) | Session methods of exhibiting, device and computer equipment | |
CN107832366A (en) | Video sharing method and device, terminal installation and computer-readable recording medium | |
CN114425162A (en) | Video processing method and related device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |