CN109874021A - Living broadcast interactive method, apparatus and system - Google Patents

Abstract

The present invention relates to a kind of living broadcast interactive method, apparatus and systems, which comprises main broadcaster's client obtains the corresponding main broadcaster's virtual image of main broadcaster user；Display includes the live streaming picture of main broadcaster's virtual image at least one live streaming client of access direct broadcasting room；When playing includes the live streaming picture of main broadcaster's virtual image, it is broadcast live authorization for designated user, to allow the designated user to participate in living broadcast interactive；The corresponding spectators' virtual image of the designated user is obtained according to the live streaming authorization of the designated user；Display includes the live streaming picture of spectators' virtual image and main broadcaster's virtual image at least one described live streaming client.Solve the problems, such as that live content existing in the prior art is in the form of a single using the present invention.

Description

Living broadcast interactive method, apparatus and system

Technical field

The present invention relates to field of computer technology more particularly to a kind of living broadcast interactive method, apparatus and system.

Background technique

With the development of computer technology, the direct-seeding of real-time data sharing is carried out using internet and stream media technology Have become a kind of interactive communication mode of hot topic instantly.

Specifically, main broadcaster's client can establish direct broadcasting room online, to divide to the live streaming client for accessing the direct broadcasting room Live video is enjoyed, for client is broadcast live, then shows live content, example in the live streaming picture that can play in direct broadcasting room Such as, live video.

In order to improve live streaming liveness, main broadcaster user and spectators user can mutually send interactive resources, for example, interaction money Source includes virtual present, virtual expression, electronics red packet etc., alternatively, main broadcaster user can be itself one virtual image of configuration, And configure the virtual image with its own live streaming when form it is synchronous, with by be broadcast live picture in Dynamically Announce virtual image into Row live streaming, so that spectators user obtains the experience of exceeding reality.

However, being limited to the participation of main broadcaster user during above-mentioned live streaming, the form of live content is excessively single.

Summary of the invention

In order to solve the above-mentioned technical problem, it is an object of the present invention to provide a kind of living broadcast interactive method, apparatus and System.

Wherein, the technical scheme adopted by the invention is as follows:

A kind of living broadcast interactive method, comprising: main broadcaster's client obtains the corresponding main broadcaster's virtual image of main broadcaster user；It is accessing Display includes the live streaming picture of main broadcaster's virtual image at least one live streaming client of direct broadcasting room；It include that main broadcaster is virtual playing When the live streaming picture of image, it is broadcast live authorization for designated user, to allow the designated user to participate in living broadcast interactive；According to institute The live streaming authorization for stating designated user obtains the corresponding spectators' virtual image of the designated user；In at least one described live streaming client Display includes the live streaming picture of spectators' virtual image and main broadcaster's virtual image in end.

A kind of living broadcast interactive system, comprising: main broadcaster's client, for obtaining the corresponding main broadcaster's virtual image of main broadcaster user； At least one live streaming client for accessing direct broadcasting room, for showing the live streaming picture including main broadcaster's virtual image；The main broadcaster visitor Family end, is also used to when playing includes the live streaming picture of main broadcaster's virtual image, authorization is broadcast live for designated user, to allow It states designated user and participates in living broadcast interactive；Main broadcaster's client is also used to obtain institute according to the live streaming authorization of the designated user State the corresponding spectators' virtual image of designated user；At least one described live streaming client, is also used to show to include the virtual shape of spectators As the live streaming picture with main broadcaster's virtual image.

A kind of living broadcast interactive device, including processor and memory are stored with computer-readable instruction on the memory, The computer-readable instruction realizes living broadcast interactive method as described above when being executed by the processor.

A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor Living broadcast interactive method as described above is realized when row.

In the above-mentioned technical solutions, playing at least one live streaming client of access direct broadcasting room includes main broadcaster user couple When answering the live streaming picture of main broadcaster's virtual image, it is broadcast live authorization for designated user, to allow designated user to participate in living broadcast interactive, And then the corresponding spectators' virtual image of designated user is obtained by the live streaming authorization of designated user, and make at least one live streaming The live streaming picture that is shown in client while including main broadcaster's virtual image and spectators' virtual image, that is to say, that during live streaming, It is no longer dependent on the participation of main broadcaster user, designated user participates in living broadcast interactive also by spectators' virtual image, so that live streaming The form of content depends on the participation of designated user, the list in the form of this solves live content existing in the prior art simultaneously One the problem of.

It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not It can the limitation present invention.

Detailed description of the invention

The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention Example, and in specification together principle for explaining the present invention.

Fig. 1 is the schematic diagram of related implementation environment according to the present invention.

Fig. 2 is a kind of hardware block diagram of user terminal shown according to an exemplary embodiment.

Fig. 3 is a kind of another hardware block diagram of user terminal shown according to an exemplary embodiment.

Fig. 4 is a kind of flow chart of living broadcast interactive method shown according to an exemplary embodiment.

Fig. 5 is a kind of flow chart of living broadcast interactive method shown according to an exemplary embodiment.

Fig. 6 be it is shown according to an exemplary embodiment direct broadcasting room by the configured main broadcaster's virtual image of main broadcaster user into The flow chart of capable live streaming process.

Fig. 7 be in Fig. 5 corresponding embodiment step 310 in the flow chart of one embodiment.

Fig. 8 is the flow chart of living broadcast interactive request initiation process shown according to an exemplary embodiment.

Fig. 9 is the flow chart of another living broadcast interactive method shown according to an exemplary embodiment.

Figure 10 is the flow chart of another living broadcast interactive method shown according to an exemplary embodiment.

Figure 11 is the flow chart of another living broadcast interactive method shown according to an exemplary embodiment.

Figure 12 is a kind of specific implementation schematic diagram of living broadcast interactive method in an application scenarios.

Figure 13 is the signal of the live streaming picture of Dynamically Announce main broadcaster virtual image and spectators' virtual image in an application scenarios Figure.

Figure 14 is the signal of the live streaming picture of Dynamically Announce main broadcaster virtual image and spectators' virtual image in an application scenarios Figure.

Figure 15 is a kind of block diagram of living broadcast interactive device shown according to an exemplary embodiment.

Figure 16 is the block diagram of another living broadcast interactive device shown according to an exemplary embodiment.

Figure 17 be in Figure 15 corresponding embodiment authorized order generation module 1010 in the block diagram of one embodiment.

Figure 18 is the block diagram of another living broadcast interactive device shown according to an exemplary embodiment.

Figure 19 is the block diagram of another living broadcast interactive device shown according to an exemplary embodiment.

Figure 20 is that live streaming authorization obtains module 1310 in the block diagram of one embodiment in Figure 19 corresponding embodiment.

Figure 21 be in Figure 20 corresponding embodiment request initiating cell 1311 in the block diagram of one embodiment.

Figure 22 is the block diagram of another living broadcast interactive device shown according to an exemplary embodiment.

Through the above attached drawings, it has been shown that the specific embodiment of the present invention will be hereinafter described in more detail, these attached drawings It is not intended to limit the scope of the inventive concept in any manner with verbal description, but is by referring to specific embodiments Those skilled in the art illustrate idea of the invention.

Specific embodiment

Here will the description is performed on the exemplary embodiment in detail, the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended The example of device and method being described in detail in claims, some aspects of the invention are consistent.

As previously mentioned, being limited to the participation of main broadcaster user, the form of live content is excessively single during live streaming.It lifts For example, the virtual shape shown in picture is broadcast live when the virtual image configured by main broadcaster user is broadcast live in direct broadcasting room As only following form when main broadcaster's user live broadcast to generate corresponding variation, so that the form of live content is dependent on main broadcaster user's It participates in, in addition, this will also cause the ditch between main broadcaster user and other users (such as other main broadcaster users or spectators user) Logical and interaction is relatively deficient.

For this purpose, direct broadcasting room is allowed to be configured to be broadcast live jointly by multiple main broadcaster users, during being broadcast live herein, if Multiple main broadcaster users are in different geographical, live content be come in a manner of the corresponding live streaming window of each main broadcaster user to What spectators user was presented.Consider user's visual experience, if carrying out full frame displaying to each live streaming window, spectators user is not only It needs to multiple live streaming window manual switchings back and forth, operation is excessively cumbersome, and can not watch all main broadcasters simultaneously User, however it remains the excessively single defect of the form of live content.

Therefore, spy of the present invention proposes a kind of living broadcast interactive method, this kind of living broadcast interactive method can efficiently solve directly Broadcast the excessively single problem of content-form.

Fig. 1 is a kind of schematic diagram of implementation environment involved in living broadcast interactive method.The implementation environment includes client 100 With server-side 200.

Wherein, according to client and live streaming client is broadcast based on the different instructions of user, which is transported client 100 Capable electronic equipment can be desktop computer, laptop, tablet computer, smart phone or other offer videos and network The electronic equipment of linkage function provides the application client that can be operate in electronic equipment of video capability, can also To be webpage client, herein without limiting.

The server cluster that server-side 200 can be a server or be made of multiple servers, can also be one A cloud computing center, i.e., the virtual computing platforms formed by whole piece server cluster.

Communication connection will be established by wireless network or cable network between client 100 and server-side 200, and with this Real-time data sharing is carried out between main broadcaster's client and live streaming client.

Specifically, main broadcaster's client can establish direct broadcasting room online, and be collected local camera based on the direct broadcasting room Live video be uploaded to server-side 200, the live video is then transmitted to live streaming client by server-side 200.

Based on the direct broadcasting room that main broadcaster's client is established, multiple live streaming clients can be accessed simultaneously, such as million straight Broadcast client or ten million live streaming client.

Interactive data can be uploaded to server-side 200 by any one live streaming client as a result, by server-side 200 that this is mutual Dynamic data forwarding is to main broadcaster's client and remaining live streaming client.

Correspondingly, each live streaming client can receive the live video and interactive data of the transmission of server-side 200, And it is shown in the live streaming picture played in direct broadcasting room.

Referring to Fig. 2, Fig. 2 is the block diagram of a kind of electronic equipment shown according to an exemplary embodiment.

As shown in Fig. 2, electronic equipment 100 (only shows including memory 101, storage control 103, one or more in Fig. 2 One out) processor 105, Peripheral Interface 107, radio-frequency module 109, locating module 111, photographing module 113, audio-frequency module 115, Touch Screen 117 and key module 119.These components are mutually communicated by one or more communication bus/signal wire 121.

Wherein, memory 101 can be used for storing software program and module, such as the live streaming in exemplary embodiment of the present Interactive approach and the corresponding program instruction of device and module, processor 105 are referred to by the program that operation is stored in memory 101 It enables, thereby executing various functions and data processing, i.e. completion living broadcast interactive method.

The carrier that memory 101 is stored as resource, can be random access memory, for example high speed random access memory, it is non-easily The property lost memory, such as one or more magnetic storage devices, flash memory or other solid-state memories.Storage mode can be short Temporary storage permanently stores.

Peripheral Interface 107 may include an at least wired or wireless network interface, at least one series-parallel translation interface, at least One input/output interface and at least USB interface etc., for coupleeing memory 101 for external various input/output devices And processor 105, to realize the communication with external various input/output devices.

Radio-frequency module 109 is used for transceiving electromagnetic wave, the mutual conversion of electromagnetic wave and electric signal is realized, to pass through communication network Network is communicated with other equipment.Communication network includes cellular telephone networks, WLAN or Metropolitan Area Network (MAN), above-mentioned communication network Various communication standards, agreement and technology can be used in network.

Locating module 111 is used to obtain the geographical location of electronic equipment 100 being currently located.The example of locating module 111 Including but not limited to GPS (GPS), the location technology based on WLAN or mobile radio communication.

Photographing module 113 is under the jurisdiction of camera, for shooting picture or video.The picture or video of shooting can be deposited In storage to memory 101, host computer can also be sent to by radio-frequency module 109.

Audio-frequency module 115 provides a user audio interface, may include one or more microphone interfaces, one or more Speaker interface and one or more earphone interfaces.The interaction of audio data is carried out by audio interface and other equipment.Sound Frequency can also be sent according to can store to memory 101 by radio-frequency module 109.

Touch Screen 117 provides an I/O Interface between electronic equipment 100 and user.Specifically, Yong Huke The gesture operations such as input operation, such as click, touch, sliding are carried out by Touch Screen 117, so that electronic equipment 100 is to this Input operation is responded.Any one form of text, picture or video or combination are then formed by by electronic equipment 100 It exports content and output is shown to user by Touch Screen 117.

Key module 119 includes at least one key, to provide user's interface inputted to electronic equipment 100, User can make electronic equipment 100 execute different functions by pressing different keys.For example, sound regulating key for Realize the adjusting of the wave volume played to electronic equipment 100 in family.

Fig. 3 is another hardware block diagram of a kind of electronic equipment 100 shown according to an exemplary embodiment.

The hardware configuration of the electronic equipment 100 can generate biggish difference due to the difference of configuration or performance, such as Fig. 3 institute Show, electronic equipment 100 include: power supply 110, interface 130, at least a memory 150 and an at least central processing unit (CPU, Central Processing Units)170。

Wherein, power supply 110 is used to provide operating voltage for each hardware device on electronic equipment 100.

Interface 130 includes an at least wired or wireless network interface 131, at least a string and translation interface 133, at least one defeated Enter output interface 135 and at least usb 1 37 etc., is used for and external device communication.

The carrier that memory 150 is stored as resource, can be read-only memory, random access memory, disk or CD Deng the resource stored thereon includes operating system 151, application program 153 and data 155 etc., and storage mode can be of short duration It stores or permanently stores.Wherein, operating system 151 be used for manage and controlling electronic devices 100 on each hardware device and Application program 153 can be Windows to realize calculating and processing of the central processing unit 170 to mass data 155 ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM etc..Application program 153 be based on operating system 151 it The upper computer program for completing at least one particular job, may include an at least module (being not shown in Fig. 3), each module The series of computation machine readable instruction to electronic equipment 100 can be separately included.Data 155 can be stored in disk Photo, picture etc..

Central processing unit 170 may include the processor of one or more or more, and be set as through bus and memory 150 communications, for the mass data 155 in operation and processing memory 150.

As described in detail above, storage will be read by central processing unit 170 by being applicable in electronic equipment 100 of the invention The form of the series of computation machine readable instruction stored in device 150 completes living broadcast interactive method.

It should be noted that electronic equipment 100 shown in Fig. 2 or Fig. 3, which is one, adapts to example of the invention, no It can think that there is provided any restrictions to use scope of the invention.The electronic equipment 100 can not be construed to need to rely on In or must have one or more component in illustrative electronic equipment 100 shown in Fig. 2 or Fig. 3.

It is appreciated that Fig. 2 or structure shown in Fig. 3 are only to illustrate, electronic equipment 100 may also include than institute in Fig. 2 or Fig. 3 Show more or fewer components, or with the component different from shown in Fig. 2 or Fig. 3.Each component can shown in Fig. 2 or Fig. 3 To be realized using hardware, software or a combination thereof.

Referring to Fig. 4, in one exemplary embodiment, a kind of living broadcast interactive method be may comprise steps of:

Step 810, main broadcaster's client obtains the corresponding main broadcaster's virtual image of main broadcaster user.

Step 830, live streaming of the display including main broadcaster's virtual image at least one live streaming client of access direct broadcasting room Picture.

Step 850, when playing includes the live streaming picture of main broadcaster's virtual image, it is broadcast live authorization for designated user, with Designated user is allowed to participate in living broadcast interactive.

Step 870, the corresponding spectators' virtual image of designated user is obtained according to the live streaming authorization of designated user.

Step 890, display includes the straight of spectators' virtual image and main broadcaster's virtual image at least one live streaming client Broadcast picture.

During above-mentioned living broadcast interactive, based on the direct broadcasting room that main broadcaster's client is established, at least one of direct broadcasting room is accessed Live streaming picture of the client by display including main broadcaster's virtual image is broadcast live, as live streaming carries out, main broadcaster's client can be specified User is broadcast live authorization, and obtains the corresponding spectators' virtual image of designated user with this, so that at least one live streaming Client shows the live streaming picture including spectators' virtual image and main broadcaster's virtual image.

That is, the form of live content is no longer dependent on the participation of main broadcaster user, designated user is also by spectators Virtual image and participate in living broadcast interactive so that the form of live content depends on the participation of designated user simultaneously, solved with this Live content existing in the prior art problem in the form of a single.

Pass through the friendship of main broadcaster's client and live streaming client executed between movement and the two and server-side separately below Mutually living broadcast interactive process is illustrated.

Referring to Fig. 5, in one exemplary embodiment, a kind of living broadcast interactive method is suitable for implementation environment shown in Fig. 1 The structure of main broadcaster's client, main broadcaster's client can be as shown in Figure 2 or Figure 3.

This kind of living broadcast interactive method can be may comprise steps of by main broadcaster's client executing:

Step 310, the live streaming picture for incorporating main broadcaster's virtual image is played according to main broadcaster's virtual image of main broadcaster's user configuration.

The live streaming for passing through the configured main broadcaster's virtual image progress of main broadcaster user in direct broadcasting room is illustrated first as follows.

In an embodiment in the specific implementation, as shown in fig. 6, passing through the virtual shape of the configured main broadcaster of main broadcaster user in direct broadcasting room As the process being broadcast live may comprise steps of:

Step 410, the live streaming opening operation carried out according to triggering is established and passes through the configured main broadcaster's virtual image of main broadcaster user The direct broadcasting room being broadcast live.

Wherein, live streaming opening operation refers to that main broadcaster user is the relevant operation establishing direct broadcasting room and being triggered, for example, direct broadcasting room The confirmation operation etc. that the selection operation at background interface, the selection operation of main broadcaster's virtual image, live streaming start.

For example, it is additionally arranged the selection entrance of main broadcaster's virtual image in direct broadcasting room, for example corresponds to alternative master The button of virtual image is broadcast, the selection of main broadcaster's virtual image is if desired carried out, will test in direct broadcasting room to main broadcaster's virtual image The clicking operation of entrance triggering is selected, which is to be considered as the selection operation of main broadcaster's virtual image.

Based on this, after main broadcaster user completes above-mentioned sequence of operations, direct broadcasting room is just established, and is broadcast in the direct broadcasting room Main broadcaster's virtual image that main broadcaster user is configured is shown in the live streaming picture put.

It should be noted that display of main broadcaster's virtual image in live streaming picture is realized by two dimensional model, i.e., directly The live streaming picture for broadcasting interior broadcasting is as the foreground layer where the background layer and main broadcaster's virtual image where direct broadcasting room background interface What superposition was formed.Display position of main broadcaster's virtual image in live streaming picture can be adjusted by superposition as a result,.For example, Main broadcaster's virtual image is shown centered in live streaming picture.

Further, it for main broadcaster's client, is synchronized by configuring virtual image, i.e. main broadcaster's virtual image and main broadcaster Form when user live broadcast is synchronous, when realizing that the main broadcaster's virtual image shown in live streaming picture follows main broadcaster's user live broadcast with this Form generates corresponding variation, i.e., main broadcaster's virtual image during live streaming Dynamically Announce in live streaming picture, it is understood that To play the live streaming picture including main broadcaster's virtual image in direct broadcasting room.Wherein, form when main broadcaster's user live broadcast includes but unlimited In the headwork of: main broadcaster user, facial expression etc..

In other words, main broadcaster's user configuration main broadcaster virtual image includes two movements: first is that the selection of main broadcaster's virtual image, Second is that configuration virtual image is synchronous, it is synchronous in the form of when this guarantees main broadcaster's virtual image with main broadcaster's user live broadcast.

Step 430, corresponding main broadcaster user's face number is obtained for main broadcaster's virtual image of Dynamically Announce in live streaming picture According to.

Main broadcaster user's human face data is used to characterize form when main broadcaster's user live broadcast, can be caught by the face of main broadcaster user It acquires.Main broadcaster user's human face data include but is not limited to be broadcast live during main broadcaster's user's face entirety rotation, move with And five continually changing expression of official rank.

Wherein, the face capture of main broadcaster user includes: that starting face captures equipment, such as camera, and obtaining includes main broadcaster The image data of user's face, and recognition of face is carried out to the image data, main broadcaster user's human face data is obtained with this.

Due to main broadcaster's virtual image with form when main broadcaster's user live broadcast be it is synchronous, carried out with to main broadcaster user's face Track identification, main broadcaster user's human face data will follow form when main broadcaster's user live broadcast and changes, then main broadcaster's virtual image It will change with main broadcaster user's human face data, so that showing dynamic main broadcaster's virtual image in live streaming picture.

It should be noted that face tracking and recognizer include but is not limited to: being based on consumer level camera image video Geometrical characteristic algorithm, Local Features Analysis algorithm, Eigenface, elastic model algorithm and deep learning algorithm of stream etc. Deng.

Any one of the above face tracking and recognizer can be by the figures that comprising main broadcaster user's face and persistently change Face as identifying main broadcaster user in data, the including but not limited to expression shape change and face of main broadcaster user's human face five-sense-organ The variation such as whole rotation, movement is constituted main broadcaster user's human face data of consecutive variations with this, and then is existed for main broadcaster's virtual image The Dynamically Announce being broadcast live in picture provides sufficient foundation.

Based on this, the virtual shape of Dynamically Announce main broadcaster just can be generated for direct broadcasting room by the acquisition of main broadcaster user's human face data The live streaming picture of elephant.

Step 450, request server-side to the live streaming client of accessible direct broadcasting room forward main broadcaster user's human face data, with Main broadcaster's client with live streaming client in synchronize carry out incorporate main broadcaster's virtual image live streaming picture play.

For accessing the live streaming client of direct broadcasting room, in the main broadcaster user for the lasting variation for receiving server-side forwarding After human face data, the rendering of main broadcaster's virtual image in picture just can be broadcast live according to main broadcaster user's human face data, The movement of main broadcaster's user's head and/or facial expression i.e. by the instruction of main broadcaster user's human face data map to main broadcaster's virtual image, and Will rendering formed main broadcaster's virtual image Dynamically Announce live streaming picture in, with this realize main broadcaster's client and live streaming client it Between real-time data sharing.

Client is still broadcast live in either main broadcaster's client, after being installed in electronic equipment, just correspondingly in electronics Virtual image template is stored in the memory space that equipment is configured, and different main broadcaster's virtual image and sight are provided a user with this Many virtual images, therefore, in above process, main broadcaster's client only uploads main broadcaster user's human face data, straight without uploading Video (including main broadcaster user's human face data and main broadcaster's virtual image) is broadcast to server-side, greatly reduces the number during live streaming According to transmission quantity, the demand during being broadcast live to transmission bandwidth is not only significantly reduced, also reduces appointing between each interaction end Business processing pressure.

Step 330, it is played in the live streaming carried out in the live streaming picture by incorporating main broadcaster's virtual image, is designated user It is broadcast live authorization and generates live streaming authorized order.

From the foregoing, it will be observed that in direct broadcasting room, live streaming is that the main broadcaster's virtual image configured by main broadcaster user carries out, and herein During live streaming, as previously mentioned, being limited to the participation of main broadcaster user, the form of live content is excessively single.For this purpose, this implementation In example, authorization, and then the form of abundant live content will be broadcast live for designated user by the generation that authorized order is broadcast live.

Wherein, being broadcast live authorization by designated user can refer to that the spectators' virtual image for allowing designated user to configure is added Live streaming may also mean that and actively invite designated user to configure spectators' virtual image and live streaming be added.Herein, designated user can be Other main broadcaster users, are also possible to the spectators user into direct broadcasting room, and the user that main broadcaster's client can be carried out according to triggering selects Operation is selected, it is other main broadcaster users or spectators user that confirmation, which is broadcast live the designated user of authorization, is not limited herein.

It should be noted that spectators' virtual image is configured by designated user, it is different from main broadcaster user and is configured by its own Main broadcaster's virtual image.

For example, being broadcast live authorization to designated user for main broadcasting user in direct broadcasting room is provided with live streaming authorization entrance, work as finger When determining spectators' virtual image addition live streaming initiation request that user is configuration, live streaming authorizes entrance to be activated, and for example confirmation is talked with Frame is popped up and is shown in live streaming picture, and then be will test in direct broadcasting room and grasped to the confirmation of the live streaming authorization entrance triggering of activation Make, is that the live streaming authorization that designated user carries out generates live streaming authorized order according to the confirmation operation.

For designated user, when main broadcaster user generates live streaming authorized order, main broadcaster user just can be obtained to finger The live streaming authorization of user's progress is determined, so that live streaming is added in spectators' virtual image of configuration, and with this and main broadcaster user, spectators Implement living broadcast interactive between user.

Step 350, spectators' virtual image of designated user's configuration is obtained by live streaming authorized order.

After obtaining live streaming authorized order, just know that main broadcaster user is that designated user has carried out live streaming authorization, that is, obtains The spectators' virtual image for needing that designated user's configuration is incorporated in live streaming picture is known, for this purpose, firstly the need of the virtual shape of spectators is obtained As corresponding designated user's human face data, can be seen in live streaming picture according to designated user's human face data in order to subsequent The rendering of many virtual images.

It by designated user is illustrated for main broadcaster user actively invites, for main broadcaster's client, specified In the acquisition of user's human face data, live streaming authorized order is transmitted to other clients corresponding to designated user first, to pass through Live streaming authorized order controls other clients and captures to the face of designated user, thus generates designated user's face number According to, and designated user's human face data is obtained by the forwarding of server-side.

For other clients corresponding to the designated user, in the designated user for being controlled by main broadcaster's client and being carried out In face capture, designated user's human face data will be correspondingly obtained.

It should be noted that designated user will also see in above-mentioned designated user's face acquisition procedure for its own The configuration of many virtual images, and it is associated spectators' virtual image of designated user's human face data and configuration, and notify with this Server-side, in order to be the virtual shape of the spectators configured according to designated user's human face data to designated user in subsequent live streaming picture As being rendered.

Step 370, the live streaming picture for incorporating spectators' virtual image and main broadcaster's virtual image is played in direct broadcasting room.

It should be appreciated that for all clients for accessing direct broadcasting room, including main broadcaster's client, given client end and other Client is broadcast live, is consistent by the data of direct broadcasting room institute Real-Time Sharing, i.e., live content shown in live streaming picture is one It causes.

Designated user's human face data will be forwarded by server-side as a result, correspondingly, for all clients, After receiving the designated user's human face data issued by server-side, will according to designated user's human face data live streaming picture in into The rendering of row spectators' virtual image, in order to be able to the Real-Time Sharing of data is carried out by direct broadcasting room.

Rendering refers to and maps in live streaming picture between designated user's human face data and spectators' virtual image.Tool Body, the spectators' virtual image of storage in the client is obtained, and according to the instruction of designated user's human face data, by designated user Facial whole rotation, movement and the variation of five official rank expressions map to spectators' virtual image, and then the sight that will complete mapping It includes thus just to illustrate spectators simultaneously in direct broadcasting room in the live streaming picture of main broadcaster's virtual image that many virtual images, which are dissolved into, Virtual image and main broadcaster's virtual image.

Further, similarly in main broadcaster's virtual image, display of spectators' virtual image in live streaming picture is also to pass through back What the mode of background layer superposition foreground layer was formed, it is based on this, when carrying out spectators' virtual image involvement live streaming picture, the virtual shape of main broadcaster As can be adjusted by being superimposed with display position of spectators' virtual image in live streaming picture.For example, live streaming picture in into When row fusion, main broadcaster's virtual image is adjusted to display to the left by being shown centered on, correspondingly, spectators' virtual image is carried out to the right Display.

It is worth mentioning, spectators' virtual image, main broadcaster's virtual image and direct broadcasting room background interface are providing video capability When application client or webpage client are installed to client, that is, it is stored in client, user can also pass through The modes such as downloading carry out more the spectators' virtual image, main broadcaster's virtual image and direct broadcasting room background interface stored in client Newly, for user configuration selection.

By process as described above, the living broadcast interactive between main broadcaster user and designated user is realized, so that in live streaming The form of appearance is no longer dependent on the participation of main broadcaster user, additionally depends on the participation of designated user.

In addition, no matter whether designated user and main broadcaster user are in same region, incorporated by spectators' virtual image to packet Live streaming picture containing main broadcaster's virtual image realizes the interaction on the same stage between main broadcaster user and designated user, so that spectators use Family no longer needs the manual switching back and forth between multiple live streaming windows, enormously simplifies operation, and can directly watch simultaneously To all users for participating in live streaming, the form of live content is further effectively enriched.

Referring to Fig. 7, in one exemplary embodiment, step 330 may comprise steps of:

Step 331, the living broadcast interactive that spectators' virtual image application that designated user is configuration is added live streaming and initiates is received Request.

In the present embodiment, authorization is broadcast live by designated user and refers to the spectators' virtual image for allowing designated user to configure Live streaming is added, that is, the generation that authorized order is broadcast live is in response to be added in spectators' virtual image application that designated user is configuration straight The living broadcast interactive request broadcast and initiated.

For other clients where designated user, hereinafter referred to as given client end, as shown in fig. 7, live streaming The initiation process of interaction request may comprise steps of:

Step 3311, when detecting that the interaction request control in direct broadcasting room is triggered, show that spectators are empty in live streaming picture Quasi- image selection interface, and carry out the face capture of designated user.

Control refers to the text for including in interface, picture, chart, button, switch, slider bar, input frame etc..Wherein, it presses The controls such as button, switch, slider bar, input frame can be triggered and human-computer interaction is implemented with this.Interaction request control is as a result, Refer to any one above-mentioned being triggered in control, for example, interaction request control is that the button shown in picture is broadcast live, when Designated user clicks the button, that is, detects that the interaction request control in direct broadcasting room is triggered.

It is triggered in interaction request control, given client end just knows that designated user wishes to implement live streaming with main broadcaster user mutually It is dynamic, it thus initially enters and configures spectators' virtual image for designated user, in order to the subsequent virtual shape of spectators for enabling to configuration It is broadcast live as being added.

The configuration of spectators' virtual image includes: the selection and designated user's association of spectators' virtual image.

Specifically, spectators' virtual image selection interface is shown in live streaming picture, and virtual according to the spectators that triggering carries out Vivid selection operation is that designated user selectes spectators' virtual image.

Start face and capture equipment, such as camera, obtains the image data comprising designated user's face, and to the image Data carry out recognition of face and obtain designated user's human face data, complete the face capture to designated user with this.

The designated user's human face data obtained according to capture is associated with selected spectators' virtual image, notifies to refer to this Determine client to carry out the rendering of spectators' virtual image according to designated user's human face data in live streaming picture to be for selected spectators For virtual image.

Further, in image data acquisition, if the capture failure of designated user's face, generation is caught at given client end It obtains prompting message and shows, prompt designated user that face alignment face is captured equipment with this, and then implement accurately face and catch It obtains.More preferably, the display for capturing prompting message is carried out in spectators' virtual image selection interface, with this avoid into Capable live streaming impacts.

Step 3313, designated user's human face data of acquisition is associated with into spectators' virtual image selection interface to selected sight Many virtual images.

Step 3315, according to carried out the associated designated user's human face data of spectators' virtual image to main broadcaster's client initiate Living broadcast interactive request is that live streaming is added in the application of spectators' virtual image by living broadcast interactive request.

For server-side, after receiving living broadcast interactive request, i.e., designated user's human face data will be carried Living broadcast interactive request is forwarded to main broadcaster's client, in order to which main broadcaster's client can respond living broadcast interactive request and is Designated user is broadcast live authorization.

Step 333, it is added to be broadcast live to generate to be broadcast live for main broadcasting user permission spectators' virtual image according to living broadcast interactive request and award Power instruction.

Step 335, living broadcast interactive between main broadcaster user and designated user is being identified according to live streaming authorized order in server-side Unlatching.

When main broadcaster user allows spectators' virtual image that live streaming is added, authorized order is broadcast live by generating, and by server-side The live streaming authorized order is transmitted to given client end, so that subsequent be able to carry out in given client end incorporates spectators' virtual image and master The live streaming picture for broadcasting virtual image plays.

For server-side, just it can be known between main broadcaster user and designated user by the way that authorized order is broadcast live by progress Living broadcast interactive, at this point, server-side will be subsequent by being identified to living broadcast interactive unlatching between main broadcaster user and designated user The virtual image for being broadcast live picture for direct broadcasting room is synchronous.

That is, server-side is in addition to needing to access when the living broadcast interactive between main broadcaster user and designated user is opened The live streaming client of direct broadcasting room forwards main broadcaster user's human face data, it is also necessary to forward designated user's human face data, be guaranteed directly with this The form that main broadcaster's virtual image in picture, spectators' virtual image are broadcast when can be broadcast live respectively with main broadcaster user, designated user is kept It is synchronous.

Correspondingly, in one exemplary embodiment, step 350 may comprise steps of:

It executes live streaming authorized order living broadcast interactive is requested to carry out human face data extraction, obtains designated user's human face data.

As previously mentioned, living broadcast interactive request is that specified client is initiated according to designated user's human face data to main broadcaster's client , that is to say, that designated user's human face data is at least carried in living broadcast interactive request.

Therefore, main broadcaster user designated user has been carried out live streaming authorization after, just can be requested by living broadcast interactive in mention Designated user's human face data is obtained, and then provides sufficient foundation for the spectators' virtual image rendering carried out in live streaming picture.

Referring to Fig. 9, in one exemplary embodiment, after step 370, method as described above can also include following Step:

Step 510, the virtual image synchrodata of server-side push is received.

Virtual image synchrodata, for synchronizing spectators' virtual image, main broadcaster's virtual image and designated user, main broadcaster respectively Form when user live broadcast.Correspondingly, which includes designated user's human face data and/or main broadcaster user people Face data.

Wherein, either designated user's human face data or main broadcaster user's human face data, are by chasing after to face What track identified.That is, no matter main broadcaster's client or given client end, configuration respective virtual image and Xiang Yingyong When form when family is broadcast live is synchronous, the face of relative users is tracked constantly by equipment is captured by the face started The image data of relative users is got, and then the recognition of face by carrying out to the image data obtains relative users face number According to, and server-side is reported with this, and then server-side is requested to generate virtual image synchrodata according to relative users human face data.

For server-side, will for access direct broadcasting room all clients issue virtual image synchrodata, with for Direct broadcasting room is broadcast live the virtual image in picture and synchronizes, and then ensure that the client Real-Time Sharing numbers of all access direct broadcasting rooms According to consistent.

Step 530, virtual image synchrodata is mapped into the spectators' virtual image being broadcast live in picture and/or main broadcaster is virtual Image.

For example, in designated user's face tracking identification of progress, any one face tracking and identification are calculated Method, firstly, location parameter and pitch that most basic output parameter includes: face box are (around the pitching of X-axis rotation Angle), yaw (around Y-axis rotation yaw angle), roll (around Z axis rotation roll angle) etc. rotation parameters.Secondly, according to position It sets parameter and calculates the geometric center of face box, and compare with the geometric center of the taken the photograph rectangle picture of camera, obtain people Whole positional shift parameter (the Δ x, Δ y) relative to camera geometric center of face.Designated user's human face data includes: as a result, The rotation parameters such as positional shift parameter, pitch, yaw, roll.

Based on this, designated user's human face data is mapped to spectators' virtual image, makes spectators by positional shift parameter Virtual image has the positional shift of same degree relative to its geometric center.By the rotation parameters such as pitch, yaw, roll to Spectators' virtual image transmits the information such as head pitching, twisting and torticollis of designated user, with this realize spectators' virtual image with The synchronization of headwork when designated user is broadcast live.

Further, multiple face feature points will be also arranged in face tracking and recognizer on face, for example, face is special Sign point include: for describing the characteristic point of face contour, the characteristic point for describing right and left eyes profile, for describing left and right eyebrow wheel Wide characteristic point, the characteristic point for describing mouth profile and the characteristic point for describing nose profile.Face feature point Number can neatly be adjusted according to the required precision of track identification, herein without limiting.Designated user's face as a result, Data include: the corresponding facial characteristics value of multiple face feature points, and the facial characteristics value is for characterizing face feature point in face On position.

Spectators' virtual image can be respectively set the face feature point of respective numbers as a result, in mapping, pass through designated user Facial characteristics value in human face data is adjusted the face feature point of spectators' virtual image, and the transmitting of Xiang Guanzhong virtual image refers to Determine the information such as human face expression, the shape of the mouth as one speaks of user, facial expression when realizing spectators' virtual image and designated user's live streaming with this It is synchronous.

Further, if spectators' virtual image wears baldric, such as hair decorations, cap, the virtual shape of spectators is being carried out When as mapping, baldric can be deformed with the rotation parameter in designated user's human face data.Deformation includes but is not limited to roll up Song waves, extends, upwarping, sinking.Correspondingly, deformation extent changes, specific correlation function with the variation of rotation parameter Including but not limited to as rotation parameter is linearly increasing or reduces, index increaseds or decreases and logarithm increaseds or decreases etc.. The specific correlation function can be adjusted according to practical application scene and neatly, including but not limited to exclusive use or group It closes and uses.

In one exemplary embodiment, after step 370, method as described above can with the following steps are included:

When living broadcast interactive is exited in designated user's request, the spectators' virtual image shown in live streaming picture is removed, and request Server-side closes the living broadcast interactive between main broadcaster user and designated user.

As designated user exits living broadcast interactive, spectators' virtual image of Dynamically Announce in live streaming picture will be purged Processing.For example, there is the live streaming picture of main broadcaster's virtual image and spectators' virtual image for Dynamically Announce, spectators' virtual image is moved Picture is broadcast live out, is shown so that main broadcaster's virtual image restores placed in the middle in live streaming picture.

In addition, the request for the living broadcast interactive for initiating to close between main broadcaster user and designated user to server-side, is notified with this Server-side stopping is broadcast live spectators' virtual image in picture for direct broadcasting room and synchronizes.That is, for server-side, After knowing that main broadcaster user and designated user stop living broadcast interactive, it is only necessary to forward main broadcaster to the live streaming client of access direct broadcasting room User's human face data, it is synchronous in the form of when this guarantees that main broadcaster's virtual image is with main broadcaster's user live broadcast in live streaming picture.

Referring to Fig. 10, in one exemplary embodiment, a kind of living broadcast interactive method is suitable for implementation environment shown in Fig. 1 Client is broadcast live, the structure of the live streaming client can be as shown in figures 2 and 3.

This kind of living broadcast interactive method can be may comprise steps of by the live streaming client executing:

Step 610, main broadcaster's virtual image of main broadcaster's user configuration is obtained, and is played in direct broadcasting room and incorporates the virtual shape of main broadcaster The live streaming picture of elephant.

Step 630, it is played in the live streaming carried out by the live streaming picture for incorporating main broadcaster's virtual image, obtains main broadcaster and use The live streaming authorization that family carries out designated user.

Step 650, the spectators for obtaining designated user's configuration to the live streaming authorization that designated user carries out according to main broadcaster user are empty Quasi- image.

Step 670, the live streaming picture for incorporating spectators' virtual image and main broadcaster's virtual image is played in direct broadcasting room.

Further, in a further exemplary embodiment, step 630 may comprise steps of:

It receives main broadcaster user and invites designated user to configure spectators' virtual image and the live streaming authorization for being broadcast live and generating is added and refer to It enables.

It is that designated user obtains the live streaming that main broadcaster user allows spectators' virtual image that live streaming is added according to live streaming authorized order Authorization.

Please refer to Figure 11, in one exemplary embodiment, method as described above can with the following steps are included:

Step 710, synchronous by configuring virtual image, identification is tracked to the face of designated user.

Step 730, according to obtain designated user's human face data request server-side send virtual image synchrodata, with for It is synchronous that direct broadcasting room is broadcast live the virtual image in picture.

Figure 12 to Figure 14 is a kind of specific implementation schematic diagram of living broadcast interactive method in an application scenarios.

In this application scene, it is illustrated so that designated user is into the spectators user of direct broadcasting room as an example.The applied field Scape includes main broadcaster's client, server-side, two live streaming clients.

When main broadcaster's client is after line establishes direct broadcasting room, the main broadcaster user's human face data that can be carried out by server-side is forwarded, So that this two live streaming clients access the direct broadcasting room, and then picture is broadcast live in Real-Time Sharing.

For wherein broadcasting client always, live streaming is initiated mutually to main broadcaster's client by the configuration of spectators' virtual image Dynamic request, is broadcast live with being added for spectators' virtual image application, and waits main broadcaster user to carry out a wherein spectators user thus Live streaming authorization.

After wherein a spectators user is by main broadcaster's user live broadcast authorization, carried out by the acquisition of designated user's human face data straight The mapping of spectators' virtual image in picture is broadcast, and then has incorporated spectators' virtual image and master for the live streaming picture played in direct broadcasting room Virtual image is broadcast, as shown in figure 13, realizes wherein to be broadcast live between a spectators user and main broadcaster user with this and interacts.

During above-mentioned live streaming, main broadcaster user's human face data that server-side will receive main broadcaster's client and report, Yi Jiqi In broadcast designated user's human face data that client reports always, and it is synchronous with this to complete virtual image in live streaming picture, and then makes It obtains spectators' virtual image and main broadcaster's virtual image will be same in real time with form when a wherein spectators user, main broadcaster's user live broadcast respectively Step, as shown in figure 14.

When wherein a spectators user requests spectators' virtual image to release live streaming, the spectators' virtual image being broadcast live in picture is clear Remove, and notify server-side to close main broadcaster user and the wherein living broadcast interactive between a spectators user with this, as a result, in direct broadcasting room after It is continuous to be broadcast live by main broadcaster's virtual image.

Wherein, the live streaming carried out in direct broadcasting room by incorporating the live streaming picture of spectators' virtual image, main broadcaster's virtual image The detailed process of journey is as shown in figure 12.

For entering the spectators user of direct broadcasting room, regardless of whether it is located at same region with main broadcaster user, With activly request and main broadcaster user living broadcast interactive on the same stage, so that spectators' virtual image involvement of configuration has included that main broadcaster is virtual Image live streaming picture and to other spectators users provide live streaming, do not enrich the form of live content only effectively, Er Qiecao Make simply, there is very strong interactive and ornamental value.

Following is apparatus of the present invention embodiment, can be used for executing living broadcast interactive method according to the present invention.For this Undisclosed details in invention device embodiment please refers to living broadcast interactive embodiment of the method according to the present invention.

Figure 15 is please referred to, in one exemplary embodiment, a kind of living broadcast interactive device 1000 is applied to main broadcaster's client, institute Stating device 1000 includes but is not limited to: live streaming module 1010, authorized order generation module 1030, virtual image obtain module 1050 And virtual image incorporates module 1070.

Wherein, live streaming module 1010, which is used to be played according to main broadcaster's virtual image of main broadcaster's user configuration, incorporates the virtual shape of main broadcaster The live streaming picture of elephant.

Authorized order generation module 1030 is used to play progress in the live streaming picture by incorporating main broadcaster's virtual image In live streaming, authorization is broadcast live for designated user and generates live streaming authorized order.

Virtual image obtains the sight that module 1050 is used to obtain designated user's configuration by the live streaming authorized order Many virtual images.

Virtual image, which incorporates module 1070, to be used to carry out spectators in live streaming picture according to designated user's human face data The mapping of virtual image, and the live streaming picture for incorporating spectators' virtual image and main broadcaster's virtual image is played in the direct broadcasting room.

Figure 16 is please referred to, in one exemplary embodiment, device 1000 as described above further includes but is not limited to: direct broadcasting room is built Formwork erection block 1110, the second human face data obtain module 1130 and human face data forwarding module 1150.

Wherein, direct broadcasting room establishes live streaming opening operation of the module 1110 for carrying out according to triggering, establishes and is used by main broadcaster The direct broadcasting room that the configured main broadcaster's virtual image in family is broadcast live.

Second human face data obtains module 1130 and is used to obtain for main broadcaster's virtual image of Dynamically Announce in live streaming picture Corresponding main broadcaster user's human face data.

Human face data forwarding module 1150 is for requesting server-side to forward main broadcaster to the live streaming client of accessible direct broadcasting room User's human face data is played with carrying out incorporating the live streaming picture of main broadcaster's virtual image in the live streaming client of access direct broadcasting room.

Please refer to Figure 17, in one exemplary embodiment, authorized order generation module 1030 includes but is not limited to: interaction is asked Ask receiving unit 1031 and live streaming authorization unit 1033.

Wherein, spectators' virtual image application that interaction request reception unit 1031 is used to receive that designated user to be configuration is added The living broadcast interactive request for being broadcast live and initiating.

Authorization unit 1033 is broadcast live for being that main broadcasting user allows spectators' virtual image to be added directly according to living broadcast interactive request Broadcast generation live streaming authorized order.

In one exemplary embodiment, human face data acquisition module 1050 includes but is not limited to: the first face data acquisition Unit.

Wherein, the first face data capture unit requests living broadcast interactive to carry out face number for executing live streaming authorized order According to extraction, designated user's human face data is obtained.

In one exemplary embodiment, authorized order generation module 1030 includes but is not limited to: designated user's confirmation unit With the second live streaming authorization unit.

Wherein, designated user's confirmation unit is used for the user's selection operation carried out according to triggering, and confirmation is broadcast live authorization The designated user.

Second live streaming authorization unit is used to invite designated user to configure spectators' virtual image for main broadcasting user and live streaming is added Generate live streaming authorized order.

In one exemplary embodiment, human face data acquisition module 1050 includes but is not limited to: instruction transmission unit, face Capture control unit and human face data receiving unit.

Wherein, instruction transmission unit is used to transmit live streaming authorized order to other clients corresponding to designated user.

Face capture control unit be used for by transmission live streaming authorized order control other clients to designated user into Pedestrian's face captures to obtain designated user's human face data.

Human face data receiving unit is used to receive designated user's human face data of other client feedbacks.

Further, in one exemplary embodiment, authorized order generation module 1030 further includes but is not limited to: live streaming is mutual Dynamic opening module.

Wherein, living broadcast interactive opening module is used to identify the main broadcaster in server-side according to the live streaming authorized order and use The unlatching of living broadcast interactive between family and designated user.

Figure 18 is please referred to, in one exemplary embodiment, device 1000 as described above further includes but is not limited to: same to step number According to receiving module 1210 and synchrodata mapping block 1230.

Wherein, synchrodata receiving module 1210 is used to receive the virtual image synchrodata of server-side push.

The spectators that synchrodata mapping block 1230 is used to map to virtual image synchrodata in live streaming picture are virtual Image and/or main broadcaster's virtual image, by mapping keep spectators' virtual image, main broadcaster's virtual image respectively with designated user, master Form when broadcasting user is broadcast live is synchronous.

In one exemplary embodiment, device 1000 as described above further includes but is not limited to: virtual image removes module.

Wherein, virtual image removes module and is used to remove in live streaming picture when living broadcast interactive is exited in designated user's request Spectators' virtual image of display, and server-side is requested to close the living broadcast interactive between main broadcaster user and designated user.

Figure 19 is please referred to, in one exemplary embodiment, a kind of living broadcast interactive device 1300 includes but is not limited to: live streaming mould Block 1310, live streaming authorization obtain module 1330, virtual image obtains module 1350 and virtual image incorporates module 1370.

Wherein, live streaming module 1310 is used to obtain main broadcaster's virtual image of main broadcaster's user configuration, and plays in direct broadcasting room Incorporate the live streaming picture of main broadcaster's virtual image.

Live streaming authorization acquisition module 1330 is used to play progress in the live streaming picture by incorporating main broadcaster's virtual image In live streaming, the live streaming authorization that main broadcaster user carries out designated user is obtained.

It is specified that virtual image obtains the live streaming authorization acquisition that module 1350 is used to carry out designated user according to main broadcaster user Spectators' virtual image of user configuration.

Virtual image, which incorporates module 1370 and is used to play in direct broadcasting room, incorporates spectators' virtual image and main broadcaster's virtual image Live streaming picture.

Figure 20 is please referred to, in one exemplary embodiment, live streaming authorization obtains module 1330 and includes but is not limited to: request hair Play unit 1331 and live streaming authorization unit 1333.

Wherein, spectators' virtual image that request initiating cell 1331 is used to be configured according to designated user is to main broadcaster's client Request spectators' virtual image that live streaming is added.

Live streaming authorization unit 1333 is used to be that designated user acquisition main broadcaster user allows spectators' virtual image to add by request Enter the live streaming authorization of live streaming.

Please refer to Figure 21, in one exemplary embodiment, request initiating cell 1331 includes but is not limited to: control triggering is single First 1331a, data associating unit 1331c and application adding unit 1331e.

Wherein, control trigger unit 1331a is used to work as the interaction request control detected in direct broadcasting room and is triggered, and is being broadcast live Spectators' virtual image selection interface is shown in picture, and carries out the face capture of designated user.

Data associating unit 1331c, which is used to for designated user's human face data of acquisition being associated with to spectators' virtual image, selects boundary The spectators' virtual image selected in face.

Application adding unit 1331e is used for according to having carried out the associated designated user's human face data of spectators' virtual image to master It broadcasts client and initiates living broadcast interactive request, be that live streaming is added in the application of spectators' virtual image by living broadcast interactive request.

Please refer to Figure 22, in one exemplary embodiment, device 1300 as described above further includes but is not limited to: tracking is known Other module 1410 and virtual image synchronization module 1430.

Wherein, track identification module 1410 is used for synchronous by configuring virtual image, is chased after to the face of designated user Track identification.

Virtual image synchronization module 1430 is used to be sent according to obtained designated user's human face data request server-side virtual Vivid synchrodata, it is synchronous to be broadcast live the virtual image in picture for direct broadcasting room.

It should be noted that living broadcast interactive device provided by above-described embodiment is when carrying out invitation processing, only with The division progress of above-mentioned each functional module can according to need and for example, in practical application by above-mentioned function distribution by not Same functional module is completed, i.e., the internal structure of living broadcast interactive device will be divided into different functional modules, to complete above retouch The all or part of function of stating.

In addition, the embodiment of living broadcast interactive device provided by above-described embodiment and living broadcast interactive method belongs to same structure Think, the concrete mode that wherein modules execute operation is described in detail in embodiment of the method, no longer superfluous herein It states.

In one exemplary embodiment, a kind of living broadcast interactive system includes but is not limited to: main broadcaster's client and live streaming client End.

Wherein, main broadcaster's client, for obtaining the corresponding main broadcaster's virtual image of main broadcaster user.

At least one live streaming client for accessing direct broadcasting room, for showing the live streaming picture including main broadcaster's virtual image.

Main broadcaster's client is also used to when playing includes the live streaming picture of main broadcaster's virtual image, is carried out for designated user straight Authorization is broadcast, to allow designated user to participate in living broadcast interactive.

Main broadcaster's client is also used to obtain the corresponding virtual shape of spectators of designated user according to the live streaming authorization of designated user As.

At least one live streaming client, is also used to show the live streaming picture including spectators' virtual image and main broadcaster's virtual image Face.

In one exemplary embodiment, main broadcaster's client includes but is not limited to: request reception unit and live streaming authorization Unit.

Wherein, request reception unit requests the living broadcast interactive for participating in living broadcast interactive and initiating to be asked for receiving designated user It asks.

Authorization unit is broadcast live, allows designated user to participate in living broadcast interactive for being requested according to living broadcast interactive.

In one exemplary embodiment, main broadcaster's client includes but is not limited to: data receipt unit, data mapping are single Member and image incorporate unit.

Wherein, data receipt unit, for receiving designated user human face data of the designated user in live streaming authorization.

Data mapping unit, designated user's headwork and/or facial table for indicating designated user's human face data Feelings map to spectators' virtual image.

Image incorporates unit, and it is aobvious in live streaming picture to adjust main broadcaster's virtual image for the involvement for spectators' virtual image Show position, and spectators' virtual image is shown in the live streaming picture for having adjusted main broadcaster's virtual image display position.

In one exemplary embodiment, a kind of living broadcast interactive device, including processor and memory.

Wherein, it is stored with computer-readable instruction on memory, realization when which is executed by processor Living broadcast interactive method in each embodiment as described above.

In one exemplary embodiment, a kind of computer readable storage medium, is stored thereon with computer program, the calculating The living broadcast interactive method in each embodiment as described above is realized when machine program is executed by processor.

Above content, preferable examples embodiment only of the invention, is not intended to limit embodiment of the present invention, this Field those of ordinary skill central scope according to the present invention and spirit can be carried out very easily corresponding flexible or repaired Change, therefore protection scope of the present invention should be subject to protection scope required by claims.

Claims (15)

1. a kind of living broadcast interactive method characterized by comprising

Main broadcaster's client obtains the corresponding main broadcaster's virtual image of main broadcaster user；

Display includes the live streaming picture of main broadcaster's virtual image at least one live streaming client of access direct broadcasting room；

When playing includes the live streaming picture of main broadcaster's virtual image, it is broadcast live authorization for designated user, it is described specified to allow User participates in living broadcast interactive；

The corresponding spectators' virtual image of the designated user is obtained according to the live streaming authorization of the designated user；

Display includes the live streaming picture of spectators' virtual image and main broadcaster's virtual image at least one described live streaming client.

2. the method as described in claim 1, which is characterized in that described at least one live streaming client of access direct broadcasting room Display includes the live streaming picture of main broadcaster's virtual image, comprising:

At least one described live streaming client receives main broadcaster user face number of the main broadcaster user when establishing the direct broadcasting room According to；

It is empty that the movement of main broadcaster's user's head and/or facial expression by main broadcaster user's human face data instruction map to the main broadcaster Quasi- image；

The live streaming picture including main broadcaster's virtual image is shown with main broadcaster's client synchronization.

3. the method as described in claim 1, which is characterized in that described to be broadcast live authorization for designated user, comprising:

Receiving the designated user requests the living broadcast interactive for participating in living broadcast interactive and initiating to be requested；

The designated user is allowed to participate in living broadcast interactive according to living broadcast interactive request.

4. the method as described in claim 1, which is characterized in that described to be broadcast live authorization for designated user, comprising:

According to user's selection operation that triggering carries out, confirmation is broadcast live the designated user of authorization；

The invitation of participation living broadcast interactive is initiated to the designated user.

5. the method as claimed in claim 3 or 4, which is characterized in that described to be broadcast live authorization for designated user, further includes:

The unlatching of living broadcast interactive between the main broadcaster user and designated user is identified according to the live streaming authorization requests.

6. the method as described in claim 1, which is characterized in that described according to the live streaming authorization of designated user acquisition The corresponding spectators' virtual image of designated user, comprising:

Receive designated user human face data of the designated user in the live streaming authorization；

It is empty that designated user's headwork of designated user's human face data instruction and/or facial expression are mapped into the spectators Quasi- image；

The display at least one described live streaming client includes the live streaming picture of spectators' virtual image and main broadcaster's virtual image Face, comprising:

Display position of the main broadcaster's virtual image in the live streaming picture is adjusted for the involvement of spectators' virtual image, and Spectators' virtual image is shown in the live streaming picture for having adjusted main broadcaster's virtual image display position.

7. method as claimed in claim 6, which is characterized in that described to receive the designated user in live streaming authorization Before designated user's human face data, the method also includes:

When the designated user requests to participate in living broadcast interactive, live streaming client is in the live streaming picture where the designated user Middle display spectators virtual image selection interface, and carry out the face capture of the designated user；

Designated user's human face data of acquisition is associated with into spectators' virtual image selection interface to the selected virtual shape of spectators As；

Transmission has carried out the associated designated user's human face data of spectators' virtual image.

8. the method as described in claim 1, which is characterized in that it is described it is described at least one live streaming client in display include After the live streaming picture of spectators' virtual image and main broadcaster's virtual image, the method also includes:

Receive virtual image synchrodata；

The virtual image synchrodata is mapped to the spectators' virtual image and/or the virtual shape of main broadcaster in the live streaming picture As when keeping spectators' virtual image, main broadcaster's virtual image respectively with designated user, main broadcaster's user live broadcast by the mapping Form it is synchronous.

9. method according to claim 8, which is characterized in that before the reception virtual image synchrodata, the method Further include:

Synchronous by configuring virtual image, the face of face or the designated user to the main broadcaster user is tracked knowledge Not；

Virtual image synchrodata is sent according to obtained main broadcaster user's human face data or designated user's human face data request.

10. the method as described in claim 1, which is characterized in that described to show packet at least one described live streaming client After the live streaming picture for including spectators' virtual image and main broadcaster's virtual image, the method also includes:

When living broadcast interactive is exited in designated user request, main broadcaster's client removes the sight shown in the live streaming picture Many virtual images, and close the living broadcast interactive between the main broadcaster user and designated user.

11. a kind of living broadcast interactive system characterized by comprising

Main broadcaster's client, for obtaining the corresponding main broadcaster's virtual image of main broadcaster user；

At least one live streaming client for accessing direct broadcasting room, for showing the live streaming picture including main broadcaster's virtual image；

Main broadcaster's client is also used to when playing includes the live streaming picture of main broadcaster's virtual image, is carried out for designated user straight Authorization is broadcast, to allow the designated user to participate in living broadcast interactive；

Main broadcaster's client is also used to obtain the corresponding spectators of the designated user according to the live streaming authorization of the designated user Virtual image；

At least one described live streaming client, is also used to show the live streaming picture including spectators' virtual image and main broadcaster's virtual image Face.

12. system as claimed in claim 11, which is characterized in that main broadcaster's client includes:

Request reception unit requests the living broadcast interactive for participating in living broadcast interactive and initiating to be requested for receiving the designated user；

Authorization unit is broadcast live, for allowing the designated user to participate in living broadcast interactive according to living broadcast interactive request.

13. system as claimed in claim 11, which is characterized in that main broadcaster's client includes:

Data receipt unit, for receiving designated user human face data of the designated user in the live streaming authorization；

Data mapping unit, designated user's headwork and/or facial table for indicating designated user's human face data Feelings map to spectators' virtual image；

Image incorporates unit, adjusts main broadcaster's virtual image in the live streaming picture for the involvement for spectators' virtual image Display position in face, and spectators' virtual image is shown in the live streaming for having adjusted main broadcaster's virtual image display position Picture.

14. a kind of living broadcast interactive device characterized by comprising

Processor；And

Memory is stored with computer-readable instruction on the memory, and the computer-readable instruction is held by the processor The living broadcast interactive method as described in any one of claims 1 to 10 is realized when row.

15. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program The living broadcast interactive method as described in any one of claims 1 to 10 is realized when being executed by processor.