CN113852839A - Virtual resource allocation method and device and electronic equipment - Google Patents
Virtual resource allocation method and device and electronic equipment Download PDFInfo
- Publication number
- CN113852839A CN113852839A CN202111129289.3A CN202111129289A CN113852839A CN 113852839 A CN113852839 A CN 113852839A CN 202111129289 A CN202111129289 A CN 202111129289A CN 113852839 A CN113852839 A CN 113852839A
- Authority
- CN
- China
- Prior art keywords
- virtual
- action information
- live broadcast
- broadcast room
- anchor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000002452 interceptive effect Effects 0.000 claims description 65
- 230000003993 interaction Effects 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 7
- 230000000875 corresponding effect Effects 0.000 description 91
- 238000005516 engineering process Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 9
- 230000014509 gene expression Effects 0.000 description 8
- 238000011156 evaluation Methods 0.000 description 7
- 230000002596 correlated effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000002310 elbow joint Anatomy 0.000 description 1
- 210000003414 extremity Anatomy 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 210000002478 hand joint Anatomy 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 210000000323 shoulder joint Anatomy 0.000 description 1
- 210000003857 wrist joint Anatomy 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4784—Supplemental services, e.g. displaying phone caller identification, shopping application receiving rewards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The disclosure relates to a virtual resource allocation method and device and electronic equipment. The method comprises the following steps: acquiring sample action information corresponding to virtual resources to be allocated; acquiring action information of a virtual anchor image performing in a live broadcast room; determining whether the matching degree between the action information of the virtual anchor image and the sample action information meets a preset condition; and if so, allocating the virtual resources to be allocated to the account corresponding to the live broadcast room. By the method, the problem of insufficient interactivity and interestingness of the live broadcast room can be solved.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for allocating virtual resources, and an electronic device.
Background
In order to meet the increasingly abundant internet service requirements, viewers can generally initiate a virtual resource allocation request in live webcasting, so that a server allocates corresponding virtual resources to an account corresponding to a main webcasting; for example, the viewer may gift virtual gifts, platform credits, and the like to the anchor by way of a "gift.
In the related art, interactive props corresponding to different virtual resource values can be set, so that audiences can conveniently adjust the value of the virtual resources for distribution by selecting the number or the type of the interactive props corresponding to the virtual resource distribution requests.
However, under the condition of adopting the above scheme, the interactive prop can only generate an incentive for live broadcasting activities through the value of the virtual resource, and cannot further mobilize the live broadcasting interactive enthusiasm.
In a live network scene, a virtual anchor technology generally refers to a technology of mapping the expression and the action of an anchor person into the expression and the action of a pre-generated virtual image by adopting an action capture technology, so that the virtual image is presented in a live broadcast picture instead of the anchor person; although the audience cannot see the real image of the anchor, the audience can still know the expression and action of the anchor from the virtual image, so that the privacy of the anchor can be guaranteed, and the interest of live broadcast can be improved.
In practical application, the expressions and actions of the virtual anchor image are determined by the anchor and are not directly related to the behaviors of audiences, so that the interactivity under a live broadcast scene is not strong.
Disclosure of Invention
The present disclosure provides a virtual resource allocation method, an apparatus and an electronic device, so as to at least solve the problem of insufficient interactivity and interestingness in a live broadcast scene in the related art. The technical scheme of the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, a virtual resource allocation method is provided, including:
acquiring sample action information corresponding to virtual resources to be allocated;
acquiring action information of a virtual anchor image performing in a live broadcast room;
determining whether the matching degree between the action information of the virtual anchor image and the sample action information meets a preset condition;
and if so, allocating the virtual resources to be allocated to the account corresponding to the live broadcast room.
Optionally, the collecting the action information of the virtual anchor image performing in the live broadcast room includes:
acquiring an image frame sequence of a virtual anchor image in a live broadcast room;
identifying at least one action positioning point of the virtual anchor image in each image frame of the image frame sequence, and obtaining a motion track of the at least one action positioning point according to the image frame sequence;
and generating action information of the virtual anchor image based on the motion trail.
Optionally, after obtaining sample action information corresponding to the virtual resource to be allocated, the method further includes:
and displaying action prompt information corresponding to the sample action information on an anchor client corresponding to the live broadcast room so as to prompt the virtual anchor image performing in the live broadcast room to execute actions matched with the sample action information.
Optionally, the obtaining sample action information corresponding to the virtual resource to be allocated includes:
receiving a virtual item appreciation request bound with virtual resources to be allocated, and acquiring sample interactive action information corresponding to the virtual item;
the displaying of the action prompt information corresponding to the sample action information on the anchor client corresponding to the live broadcast room includes:
displaying interactive animation of the virtual prop on an anchor client corresponding to the live broadcast room;
the action information of the virtual anchor image of the acquisition in the live broadcast room performance includes:
and acquiring interactive action information of a virtual anchor image performing in a live broadcast room and interactive animation of the virtual prop.
Optionally, the interactive virtual prop is associated with a preset target area, and the sample action information indicates that the virtual anchor image moves the interactive animation of the virtual prop to the target area;
the determining whether the matching degree between the action information of the virtual anchor image and the sample action information meets a preset condition includes:
determining whether a movement trajectory of the interactive animation of the virtual prop intersects with the target area during the interaction of the interactive animation of the virtual anchor image and the virtual prop based on the interaction action information of the interactive animation of the virtual anchor image and the virtual prop.
Optionally, the image frame sequence includes a time axis; the generating of the action information of the avatar based on the motion trajectory includes:
and combining the motion trail and the time axis to obtain the action information of the virtual anchor image with time axis information.
Optionally, the sample action information has time axis information; the determining whether the matching degree between the action information of the virtual anchor image and the sample action information meets a preset condition includes:
aligning the time axis of the sample action information and the action information of the virtual anchor image;
comparing the actual matching degree of the sample action information and the action information of the virtual anchor image at least one evaluation moment on the time axis with a preset matching degree threshold value;
and if the actual matching degree is greater than or equal to the preset matching degree threshold value, matching the action information of the virtual anchor image with the sample action information.
Optionally, the live broadcast rooms include N live broadcast rooms, where N is a positive integer greater than 1;
the allocating the virtual resource to be allocated to the account corresponding to the live broadcast room includes:
determining a virtual resource allocation limit corresponding to each live broadcast room based on a preset allocation rule and the matching degree corresponding to each live broadcast room; wherein the virtual resource allocation quota is positively correlated with the matching degree;
and distributing the virtual resources to be distributed to accounts corresponding to the live broadcasting rooms based on the virtual resource distribution limit corresponding to the live broadcasting rooms.
According to a second aspect of the embodiments of the present disclosure, there is provided a virtual resource allocation apparatus, including:
an acquisition unit configured to perform acquisition of sample action information corresponding to a virtual resource to be allocated;
a collecting unit configured to perform collecting action information of an avatar performing in a live broadcast room;
a determination unit configured to perform a determination of whether a degree of matching between the action information of the avatar and the sample action information satisfies a preset condition;
and the allocation unit is configured to allocate the virtual resources to be allocated to the account corresponding to the live broadcast room when a preset condition is met.
Optionally, the collecting unit includes:
an acquisition subunit configured to perform acquisition of an image frame sequence of a virtual anchor image of a performance in a live broadcast room;
the identification subunit is configured to identify at least one action positioning point of the virtual anchor image in each image frame of the image frame sequence, and obtain a motion track of the at least one action positioning point according to the image frame sequence;
a generating subunit configured to perform generating motion information of the avatar based on the motion trajectory.
Optionally, the apparatus further comprises:
and the display unit is configured to display the action prompt information corresponding to the sample action information on the anchor client corresponding to the live broadcast room so as to prompt the virtual anchor image performing in the live broadcast room to execute the action matched with the sample action information.
Optionally, the obtaining unit is further configured to execute receiving a virtual item reward request bound to a virtual resource to be allocated, and obtain sample interaction action information corresponding to the virtual item;
the display unit is further configured to execute interactive animation for displaying the virtual item on an anchor client corresponding to the live broadcast room;
the acquisition unit is further configured to perform acquisition of interactive action information of an avatar performing in a live broadcast room and an interactive animation of the virtual item.
Optionally, the interactive virtual prop is associated with a preset target area, and the sample action information indicates that the virtual anchor image moves the interactive animation of the virtual prop to the target area;
the determining unit is further configured to execute determining whether a movement trajectory of the interactive animation of the virtual item intersects the target area during interaction of the virtual anchor image with the interactive animation of the virtual item based on the interactive action information of the interactive animation of the virtual anchor image with the virtual item.
Optionally, the image frame sequence includes a time axis;
the generating subunit is further configured to perform combining the motion trajectory with the timeline to obtain action information of the avatar with timeline information.
Optionally, the sample action information has time axis information; the determination unit includes:
an alignment subunit configured to perform aligning the sample action information with a time axis of the action information of the avatar;
a comparison subunit configured to perform comparison between an actual matching degree of the sample action information and the action information of the avatar at least one evaluation time on the time axis and a preset matching degree threshold;
and the determining subunit is configured to execute the matching of the action information of the virtual anchor image and the sample action information if the actual matching degree is greater than or equal to the preset matching degree threshold value.
Optionally, the live broadcast rooms include N live broadcast rooms, where N is a positive integer greater than 1;
the distribution unit is also configured to execute the step of determining the virtual resource distribution limit corresponding to each live broadcast room based on a preset distribution rule and the matching degree corresponding to each live broadcast room; wherein the virtual resource allocation quota is positively correlated with the matching degree; and distributing the virtual resources to be distributed to accounts corresponding to the live broadcasting rooms based on the virtual resource distribution limit corresponding to the live broadcasting rooms.
According to a third aspect of embodiments of the present disclosure, an electronic device includes:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the virtual resource allocation method of any one of the preceding claims.
According to a fourth aspect of embodiments of the present disclosure, a computer-readable storage medium, wherein instructions, when executed by a processor of an electronic device, enable the electronic device to perform the virtual resource allocation method of any one of the preceding claims.
According to a fifth aspect of embodiments of the present disclosure, a computer program product comprising a computer program which, when executed by a processor, implements the virtual resource allocation method of any one of the preceding claims.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
by applying the scheme, the anchor makes corresponding actions based on the sample action information by utilizing the sample action information corresponding to the virtual resources, so as to control the virtual anchor image in the live broadcast room to make the same actions, and the virtual resources are distributed to the anchor account corresponding to the live broadcast room when the matching degree meets the preset condition by acquiring the action information of the virtual anchor image and matching with the sample action information. Therefore, the virtual resources to be distributed are distributed to stimulate the virtual anchor image to execute the action corresponding to the virtual resources to be distributed, so that the interactive enthusiasm of the live broadcast room is improved; the interactivity of the live broadcast room is improved, and the interestingness of the live broadcast room is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 is a flow chart illustrating a virtual resource allocation method according to an example embodiment.
Fig. 2 is a block diagram illustrating a virtual resource allocation apparatus according to an example embodiment.
FIG. 3 is a block diagram illustrating an electronic device in accordance with an exemplary embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
As described above, in order to solve the problem of insufficient interactivity and interestingness in a live broadcast scene in the related art, the present specification provides a virtual resource allocation scheme, in which a anchor makes a corresponding action based on sample action information by using sample action information associated with a virtual resource to control an anchor avatar in a live broadcast room to make the same action, and allocates the virtual resource to an anchor account corresponding to the live broadcast room when a matching degree satisfies a preset condition by acquiring the action information of the anchor avatar and matching the action information with the sample action information. Therefore, the virtual resources to be distributed are distributed to stimulate the virtual anchor image to execute the action corresponding to the virtual resources to be distributed, so that the interactive enthusiasm of the live broadcast room is improved; the interactivity of the live broadcast room is improved, and the interestingness of the live broadcast room is improved.
Fig. 1 is a flowchart illustrating a virtual resource allocation method according to an exemplary embodiment, where the method may be applied to a anchor client and may also be applied to a live service corresponding to the anchor client. Specifically, the method may comprise the steps of:
In network live broadcast, a spectator can initiate a virtual resource allocation request to a live broadcast server through a spectator client so that a live broadcast server transfers virtual resources in an account corresponding to the spectator to an account corresponding to a main broadcast; for example, the viewer may gift the virtual gift in the account, credits of the live platform, etc. to the anchor by way of a "gift. By presenting the virtual resources in an interactive mode, the interaction between the audience and the anchor is increased, and meanwhile, the popularity of the live broadcast room can be improved.
In this example, the viewer may also specify sample action information corresponding to the transmitted virtual resource. The sample action information may refer to action information specified by the viewer for the anchor. For example, if the audience specifies "shoot" example action information, the anchor needs to complete the shooting action corresponding to the "shoot" example action information to obtain the virtual resource sent by the audience. For another example, if the viewer specifies "archery" sample action information, the anchor needs to complete the archery action corresponding to the "archery" sample action information to obtain the virtual resource sent by the viewer. For another example, if the viewer specifies "shoot" sample action information, the anchor needs to complete the shoot action corresponding to the "shoot" sample action information to obtain the virtual resource sent by the viewer, and so on.
In an exemplary embodiment, after obtaining the sample action information corresponding to the virtual resource to be allocated, the method may further include:
and displaying action prompt information corresponding to the sample action information on an anchor client corresponding to the live broadcast room so as to prompt the virtual anchor image performing in the live broadcast room to execute actions matched with the sample action information.
In this example, since the sample action information is for the anchor to make a corresponding action, the sample action information needs to be displayed on the anchor client, and the anchor is prompted to need an action corresponding to the sample action information, so that the virtual anchor image in the live broadcast room executes an action matching with the sample action information. The action prompt information may be animation prompt information corresponding to the sample action information.
For example, if the sample action information is "shoot", the anchor may be prompted to make an action corresponding to the shooting action animation by presenting the shooting action animation corresponding to "shoot" on the anchor client.
By applying the method, the sample action information to be done can be visually displayed to the anchor, so that the matching degree of actions corresponding to the sample action information by the anchor is improved, and finally, the matching degree between the action information of the virtual anchor image and the sample action information is improved.
In this example, after obtaining the sample action information corresponding to the virtual resource to be allocated, the action information of the virtual anchor image performing in the live broadcast room may be collected. In a live network scene, an avatar is an avatar that replaces the real avatar of the anchor in the live frame. When the method is realized, the expression and the action of the anchor person can be collected by adopting an action capturing technology generally, and then the collected expression and action are mapped into the expression and the action of the virtual anchor image displayed in the live broadcast room, so that the virtual anchor image in the live broadcast room can be made to have the same expression and action as the anchor person.
In an exemplary embodiment, the step 110 of acquiring sample action information corresponding to the virtual resource to be allocated may include:
receiving a virtual item appreciation request bound with virtual resources to be allocated, and acquiring sample interactive action information corresponding to the virtual items.
Correspondingly, the displaying of the action prompt information corresponding to the sample action information on the anchor client corresponding to the live broadcast room includes:
displaying interactive animation of the virtual prop on an anchor client corresponding to the live broadcast room;
in addition, the step 120 of collecting the action information of the avatar performing in the live broadcast room includes:
and acquiring interactive action information of a virtual anchor image performing in a live broadcast room and interactive animation of the virtual prop.
In this example, the virtual item reward request bound to the virtual resource to be allocated may also be initiated by a viewer watching a live broadcast through a viewer client. The virtual item is one selected by audience from a plurality of virtual items provided by a live broadcast platform; for example, when the audience initiates the appreciation, the audience client can show various virtual props provided by the live broadcast platform in the appreciation interface, and the virtual props can be shown in the form of dynamic images. And after the audience selects one virtual item, the audience client initiates a virtual item appreciation request bound with the virtual resource to be distributed to the live broadcast server.
For example, assuming that the virtual prop is "basketball" and the sample interaction information corresponding to "basketball" is "shooting," a basketball and a basket may be shown on the anchor client corresponding to the live room. The basketball can be displayed on a hand of the virtual anchor image, and the basket is located at a preset position of the live broadcast interface.
The anchor needs to complete the real shooting action, and the anchor action information is collected through an action capturing technology, so that the virtual anchor in the live broadcast room can complete the shooting action of the basketball in the hand; therefore, the interactive action information of the virtual main broadcasting image and the basketball interactive animation in the performance in the live broadcasting room can be collected. The interactive action information may include a shooting action of the virtual anchor image and a parabolic track of the basketball.
By applying the scheme, an interaction mode of the anchor and the virtual prop is provided, the anchor interacts with the virtual prop by controlling a virtual anchor image in a live broadcast room so as to complete interactive animation of the virtual prop, and the interactivity and interestingness of the live broadcast room can be improved.
In an exemplary embodiment, the step 120 of collecting motion information of an avatar performing in a live broadcast room may include:
acquiring an image frame sequence of a virtual anchor image in a live broadcast room;
identifying at least one action positioning point of the virtual anchor image in each image frame of the image frame sequence, and obtaining a motion track of the at least one action positioning point according to the image frame sequence;
and generating action information of the virtual anchor image based on the motion trail.
In this example, in general, an animation screen is formed by sequentially playing several frames of still images. The image frame sequence refers to a sequence of a plurality of static images which form a certain virtual anchor image animation. The image frames in the image frame sequence are typically ordered chronologically.
Wherein the action anchor points can be limb joint anchor points and/or facial organ anchor points of the virtual anchor image. For example, if arm motion information needs to be acquired, the motion anchor points to be identified may include hand joint points, wrist joint points, elbow joint points, shoulder joint points, and the like. For another example, if facial expression motion information needs to be acquired, the motion anchor points that need to be identified may include a mouth anchor point, an eye anchor point, a nose anchor point, and the like. It should be noted that the description here is only an example, and a specific action positioning point needs to be determined according to actual requirements in an application.
After the action positioning points are determined, the position information of the action positioning points in each frame of image is required to be determined according to the sequence of the image frames, then the motion trail of the action positioning points is constructed according to the position information of the action positioning points in each frame of image, and the action information of the virtual anchor image is generated based on the action trail.
By applying the scheme, the action information of the virtual anchor image can be quickly determined after the action positioning point of the virtual anchor image is identified.
In an exemplary implementation, the sequence of image frames includes a time axis; the generating of the action information of the avatar based on the motion trajectory includes:
and combining the motion trail and the time axis to obtain the action information of the virtual anchor image with time axis information.
This example can be used for interactive animations with requirements on the time axis. For example, dance-type interactive animations. In the dance type, the dance motion of the anchor needs to be performed according to the music beat, so that the time axis information needs to be carried by the motion information of the virtual anchor image.
For example, assuming that the virtual prop is "dancing" and the sample interactive action information corresponding to the "dancing" is the action information of a certain dance, a dance action picture and background music of the dance can be displayed on the anchor client corresponding to the live broadcast room.
The method comprises the steps that a main player makes corresponding dance actions according to dance action pictures displayed in a main player client, further image frame sequences of virtual main player images performed in a live broadcast room are obtained, at least one action positioning point of the virtual main player images in each image frame of the image frame sequences is identified, and a motion track of the at least one action positioning point is obtained according to the image frame sequences; and combining the motion trail and the time axis to obtain the action information of the virtual anchor image with time axis information.
In this example, after the sample action information and the action information of the avatar are acquired, it may be determined whether a matching degree between the action information of the avatar and the sample action information satisfies a preset condition. In implementation, a degree of matching between the action information of the avatar and the sample action information may be calculated.
In an exemplary embodiment, based on the aforementioned interactive animation with requirement on the time axis, the sample action information carries time axis information;
the step 130 of determining whether the matching degree between the action information of the avatar and the sample action information satisfies a preset condition includes:
aligning the time axis of the sample action information and the action information of the virtual anchor image;
comparing the actual matching degree of the sample action information and the action information of the virtual anchor image at least one evaluation moment on the time axis with a preset matching degree threshold value;
and if the actual matching degree is greater than or equal to the preset matching degree threshold value, matching the action information of the virtual anchor image with the sample action information.
In this example, the evaluation moment may refer to a time point corresponding to several symbolic actions in a dance. The sample motion information is compared with the motion information of the avatar on the same time axis.
And calculating the matching degree of the sample action information and the action information of the virtual anchor image at each evaluation moment, and further calculating the actual matching degree of the sample action information and the action information of the virtual anchor image according to each matching degree. For example, assuming that there are 4 evaluation times, the matching degrees are calculated as 80%, 85%, 70%, and 78% in sequence, and then the actual matching degree is calculated (e.g., an average value is calculated) to obtain 78.25%.
In an exemplary embodiment, the interactive virtual item is associated with a preset target area, and the sample action information instructs the virtual anchor image to move the interactive animation of the virtual item to the target area;
the step 130 of determining whether the matching degree between the action information of the avatar and the sample action information satisfies a preset condition includes:
determining whether a movement trajectory of the interactive animation of the virtual prop intersects with the target area during the interaction of the interactive animation of the virtual anchor image and the virtual prop based on the interaction action information of the interactive animation of the virtual anchor image and the virtual prop.
In this example, the virtual item displayed in the anchor client is further associated with a target area preset in the live interface, and the sample action information indicates that the virtual anchor image moves the interactive animation of the virtual item to the target area.
Still taking the virtual property as "basketball" and the sample interaction information corresponding to the virtual property as "shooting", a basketball (interactive virtual property) and a basket displayed in a preset target area are displayed on the anchor client corresponding to the live broadcast room.
The anchor needs to complete the real shooting action, and the anchor action information is collected through an action capturing technology, so that the virtual anchor in the live broadcast room can complete the shooting action of the basketball in the hand; therefore, the interactive action information of the virtual main broadcasting image and the basketball interactive animation in the performance in the live broadcasting room can be collected. And determining whether the moving track of the shot basketball intersects with the basket of the target area during the interaction of the virtual anchor image and the interactive animation of the basketball based on the collected interactive action information of the interactive animation of the virtual anchor image and the basketball. If yes, the shot basketball hits the basket, and the preset condition is met. Otherwise, the thrown basketball is not hit on the basket, namely the preset condition is not met.
By applying the scheme, the interaction of the movement track of the interactive animation of the virtual prop and the target area associated with the virtual prop is used as the preset condition, so that whether the matching degree between the action information and the sample action information meets the preset condition or not is determined.
And 140, if so, allocating the virtual resource to be allocated to an account corresponding to the live broadcast room.
And when the matching degree between the action information and the sample action information meets the preset condition, allocating the virtual resources to be allocated to the account corresponding to the live broadcast room.
In an example, the virtual resource allocated to the account corresponding to the live broadcast room may be allocated to 100% of the virtual resource to be allocated.
In another example, the virtual resources allocated to the account corresponding to the live broadcast room may be allocated to M% of the virtual resources to be allocated; and M is the matching degree between the determined action information and the sample action information.
In addition, the remaining virtual resources to be allocated may be returned to the account corresponding to the viewer who initiated the virtual resource allocation.
For example, assuming that the virtual resource to be allocated is X, and the matching degree between the determined action information and the sample action information is M%, the virtual resource finally allocated to the account corresponding to the live broadcast room is X × M%.
By applying the scheme, the number of the distributed dotted line resources is in direct proportion to the matching degree between the action information and the sample action information, so that the anchor can be stimulated to make standard actions as much as possible, and the interactivity and the interestingness of a live broadcast room are improved.
In an exemplary embodiment, the live broadcast room includes N live broadcast rooms, where N is a positive integer greater than 1;
the allocating the virtual resource to be allocated to the account corresponding to the live broadcast room includes:
determining a virtual resource allocation limit corresponding to each live broadcast room based on a preset allocation rule and the matching degree corresponding to each live broadcast room; wherein the virtual resource allocation quota is positively correlated with the matching degree;
and distributing the virtual resources to be distributed to accounts corresponding to the live broadcasting rooms based on the virtual resource distribution limit corresponding to the live broadcasting rooms.
In this example, a scheme for inter-anchor PK is provided. And aiming at the virtual resources watched by the audience, each anchor broadcast carrying out PK can act with the sample action information, and the virtual resources to be distributed are distributed according to the matching degree between the action information of the virtual anchor broadcast image corresponding to each anchor broadcast and the sample action information.
Corresponding to the foregoing embodiments of the virtual resource allocation method, the present specification further provides embodiments of a virtual resource allocation apparatus. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software.
Fig. 2 is a block diagram of a virtual resource allocation apparatus corresponding to fig. 1. Referring to fig. 2, the apparatus includes an acquisition unit 310, an acquisition unit 320, a determination unit 330, and an allocation unit 340.
The obtaining unit 310 is configured to perform obtaining of sample action information corresponding to a virtual resource to be allocated;
a collecting unit 320 configured to perform collecting motion information of an avatar performing in a live room;
a determining unit 330 configured to perform determining whether a degree of matching between the action information of the avatar and the sample action information satisfies a preset condition;
the allocating unit 340 is configured to, when a preset condition is met, allocate the virtual resource to be allocated to an account corresponding to the live broadcast room.
In an exemplary embodiment, the acquisition unit 320 includes:
an acquisition subunit configured to perform acquisition of an image frame sequence of a virtual anchor image of a performance in a live broadcast room;
the identification subunit is configured to identify at least one action positioning point of the virtual anchor image in each image frame of the image frame sequence, and obtain a motion track of the at least one action positioning point according to the image frame sequence;
a generating subunit configured to perform generating motion information of the avatar based on the motion trajectory.
In an exemplary embodiment, the apparatus further comprises:
and the display unit is configured to display the action prompt information corresponding to the sample action information on the anchor client corresponding to the live broadcast room so as to prompt the virtual anchor image performing in the live broadcast room to execute the action matched with the sample action information.
In an exemplary embodiment, the obtaining unit 310 is further configured to execute receiving a virtual item reward request bound with a virtual resource to be allocated, and obtain sample interaction action information corresponding to the virtual item;
the display unit is further configured to execute interactive animation for displaying the virtual item on an anchor client corresponding to the live broadcast room;
the collecting unit 320 is further configured to perform collecting interactive action information of an avatar performing in a live broadcast room and an interactive animation of the virtual item.
In an exemplary embodiment, the interactive virtual item is associated with a preset target area, and the sample action information instructs the virtual anchor image to move the interactive animation of the virtual item to the target area;
the determining unit 330 is further configured to perform determining whether a movement trajectory of the interactive animation of the virtual item intersects the target area during interaction of the virtual anchor image with the interactive animation of the virtual item based on the interaction action information of the interactive animation of the virtual anchor image with the virtual item.
In an exemplary embodiment, the sequence of image frames comprises a time axis;
the generating subunit is further configured to perform combining the motion trajectory with the timeline to obtain action information of the avatar with timeline information.
In an exemplary embodiment, the sample action information is provided with time axis information; the determining unit 330 includes:
an alignment subunit configured to perform aligning the sample action information with a time axis of the action information of the avatar;
a comparison subunit configured to perform comparison between an actual matching degree of the sample action information and the action information of the avatar at least one evaluation time on the time axis and a preset matching degree threshold;
and the determining subunit is configured to execute the matching of the action information of the virtual anchor image and the sample action information if the actual matching degree is greater than or equal to the preset matching degree threshold value.
In an exemplary embodiment, the live broadcast room includes N live broadcast rooms, where N is a positive integer greater than 1;
the allocation unit 340 is further configured to execute determining a virtual resource allocation quota corresponding to each live broadcast room based on a preset allocation rule and a matching degree corresponding to each live broadcast room; wherein the virtual resource allocation quota is positively correlated with the matching degree; and distributing the virtual resources to be distributed to accounts corresponding to the live broadcasting rooms based on the virtual resource distribution limit corresponding to the live broadcasting rooms.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
In an exemplary embodiment, there is also provided an electronic device, comprising a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to perform the virtual resource allocation method according to any of the above embodiments.
In an exemplary embodiment, there is also provided a computer-readable storage medium comprising instructions which, when executed by a processor of an electronic device, enable the electronic device to perform the virtual resource allocation method of any of the above embodiments.
In an exemplary embodiment, there is also provided a computer program product comprising a computer program/instructions which, when executed by a processor, performs the virtual resource allocation method of any of the above embodiments.
Fig. 3 is a schematic block diagram illustrating an electronic device in accordance with an embodiment of the present disclosure. Referring to fig. 3, electronic device 400 may include one or more of the following components: processing component 402, memory 404, power component 406, multimedia component 408, audio component 410, input/output (I/O) interface 412, sensor component 414, and communication component 418. The electronic device described above may employ a similar hardware architecture.
The processing component 402 generally controls overall operation of the electronic device 400, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to perform all or a portion of the steps of the method for generating a three-dimensional avatar described above. Further, the processing component 402 can include one or more modules that facilitate interaction between the processing component 402 and other components. For example, the processing component 402 can include a multimedia module to facilitate interaction between the multimedia component 408 and the processing component 402.
The memory 404 is configured to store various types of data to support operations at the electronic device 400. Examples of such data include instructions for any application or method operating on the electronic device 400, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 404 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 406 provides power to the various components of the electronic device 400. Power components 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for electronic device 400.
The multimedia component 408 includes a screen that provides an output interface between the electronic device 400 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 400 is in an operating mode, such as a shooting mode or a video mode. Each of the front camera and the rear camera may be a fixed or optical lens system with a focal length and optical zoom capability.
The audio component 410 is configured to output and/or input audio signals. For example, the audio component 410 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 400 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in memory 404 or transmitted via communications component 418. In some embodiments, audio component 410 also includes a speaker for outputting audio signals.
The I/O interface 412 provides an interface between the processing component 402 and peripheral interface modules, which may be keyboards, click wheels, options, and the like. These options may include, but are not limited to: a home option, a volume option, a start option, and a lock option.
The sensor component 414 includes one or more sensors for providing various aspects of status assessment for the electronic device 400. For example, the sensor assembly 414 may detect an open/closed state of the electronic device 400, the relative positioning of components, such as a display and keypad of the electronic device 400, the sensor assembly 414 may also detect a change in the position of the electronic device 400 or a component of the electronic device 400, the presence or absence of user contact with the electronic device 400, orientation or acceleration/deceleration of the electronic device 400, and a change in the temperature of the electronic device 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 414 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
In an embodiment of the present disclosure, the electronic device 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components, for executing the virtual resource allocation method described in any of the above embodiments.
In an embodiment of the present disclosure, a computer-readable storage medium comprising instructions, such as the memory 404 comprising instructions, which are executable by the processor 420 of the electronic device 400 to perform the virtual resource allocation method according to any of the embodiments described above, is also provided. For example, the computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A method for allocating virtual resources, comprising:
acquiring sample action information corresponding to virtual resources to be allocated;
acquiring action information of a virtual anchor image performing in a live broadcast room;
determining whether the matching degree between the action information of the virtual anchor image and the sample action information meets a preset condition;
and if so, allocating the virtual resources to be allocated to the account corresponding to the live broadcast room.
2. The method of claim 1, wherein capturing motion information of an avatar performing in a live room comprises:
acquiring an image frame sequence of a virtual anchor image in a live broadcast room;
identifying at least one action positioning point of the virtual anchor image in each image frame of the image frame sequence, and obtaining a motion track of the at least one action positioning point according to the image frame sequence;
and generating action information of the virtual anchor image based on the motion trail.
3. The method of claim 1, wherein after obtaining sample action information corresponding to virtual resources to be allocated, the method further comprises:
and displaying action prompt information corresponding to the sample action information on an anchor client corresponding to the live broadcast room so as to prompt the virtual anchor image performing in the live broadcast room to execute actions matched with the sample action information.
4. The method according to claim 3, wherein the obtaining sample action information corresponding to the virtual resource to be allocated comprises:
receiving a virtual item appreciation request bound with virtual resources to be allocated, and acquiring sample interactive action information corresponding to the virtual item;
the displaying of the action prompt information corresponding to the sample action information on the anchor client corresponding to the live broadcast room includes:
displaying interactive animation of the virtual prop on an anchor client corresponding to the live broadcast room;
the action information of the virtual anchor image of the acquisition in the live broadcast room performance includes:
and acquiring interactive action information of a virtual anchor image performing in a live broadcast room and interactive animation of the virtual prop.
5. The method of claim 4, wherein the interactable virtual item is associated with a preset target area, the sample action information instructing an avatar to move the interactable animation of the virtual item to the target area;
the determining whether the matching degree between the action information of the virtual anchor image and the sample action information meets a preset condition includes:
determining whether a movement trajectory of the interactive animation of the virtual prop intersects with the target area during the interaction of the interactive animation of the virtual anchor image and the virtual prop based on the interaction action information of the interactive animation of the virtual anchor image and the virtual prop.
6. The method of claim 2, wherein the sequence of image frames comprises a time axis; the generating of the action information of the avatar based on the motion trajectory includes:
and combining the motion trail and the time axis to obtain the action information of the virtual anchor image with time axis information.
7. A virtual resource allocation apparatus, comprising:
an acquisition unit configured to perform acquisition of sample action information corresponding to a virtual resource to be allocated;
a collecting unit configured to perform collecting action information of an avatar performing in a live broadcast room;
a determination unit configured to perform a determination of whether a degree of matching between the action information of the avatar and the sample action information satisfies a preset condition;
and the allocation unit is configured to allocate the virtual resources to be allocated to the account corresponding to the live broadcast room when a preset condition is met.
8. An electronic device, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the virtual resource allocation method of any of claims 1-6.
9. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the virtual resource allocation method of any of claims 1-6.
10. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the virtual resource allocation method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111129289.3A CN113852839B (en) | 2021-09-26 | 2021-09-26 | Virtual resource allocation method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111129289.3A CN113852839B (en) | 2021-09-26 | 2021-09-26 | Virtual resource allocation method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113852839A true CN113852839A (en) | 2021-12-28 |
| CN113852839B CN113852839B (en) | 2024-01-26 |
Family
ID=78979788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111129289.3A Active CN113852839B (en) | 2021-09-26 | 2021-09-26 | Virtual resource allocation method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113852839B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114567792A (en) * | 2022-02-18 | 2022-05-31 | 北京达佳互联信息技术有限公司 | Virtual resource display method, device, equipment, server and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109874021A (en) * | 2017-12-04 | 2019-06-11 | 腾讯科技（深圳）有限公司 | Living broadcast interactive method, apparatus and system |
| CN110944235A (en) * | 2019-11-22 | 2020-03-31 | 广州华多网络科技有限公司 | Live broadcast interaction method, device and system, electronic equipment and storage medium |
| CN111246232A (en) * | 2020-01-17 | 2020-06-05 | 广州华多网络科技有限公司 | Live broadcast interaction method and device, electronic equipment and storage medium |
| CN111355974A (en) * | 2020-03-12 | 2020-06-30 | 广州酷狗计算机科技有限公司 | Method, apparatus, system, device and storage medium for virtual gift giving processing |
| CN111885394A (en) * | 2020-07-31 | 2020-11-03 | 广州华多网络科技有限公司 | Live broadcast room interaction method, device and system, electronic equipment and storage medium |
| CN112383786A (en) * | 2020-11-03 | 2021-02-19 | 广州繁星互娱信息科技有限公司 | Live broadcast interaction method, device, system, terminal and storage medium |
| CN112672175A (en) * | 2020-12-11 | 2021-04-16 | 北京字跳网络技术有限公司 | Live broadcast interaction method and device, electronic equipment and storage medium |
-
2021
- 2021-09-26 CN CN202111129289.3A patent/CN113852839B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109874021A (en) * | 2017-12-04 | 2019-06-11 | 腾讯科技（深圳）有限公司 | Living broadcast interactive method, apparatus and system |
| CN110944235A (en) * | 2019-11-22 | 2020-03-31 | 广州华多网络科技有限公司 | Live broadcast interaction method, device and system, electronic equipment and storage medium |
| CN111246232A (en) * | 2020-01-17 | 2020-06-05 | 广州华多网络科技有限公司 | Live broadcast interaction method and device, electronic equipment and storage medium |
| CN111355974A (en) * | 2020-03-12 | 2020-06-30 | 广州酷狗计算机科技有限公司 | Method, apparatus, system, device and storage medium for virtual gift giving processing |
| CN111885394A (en) * | 2020-07-31 | 2020-11-03 | 广州华多网络科技有限公司 | Live broadcast room interaction method, device and system, electronic equipment and storage medium |
| CN112383786A (en) * | 2020-11-03 | 2021-02-19 | 广州繁星互娱信息科技有限公司 | Live broadcast interaction method, device, system, terminal and storage medium |
| CN112672175A (en) * | 2020-12-11 | 2021-04-16 | 北京字跳网络技术有限公司 | Live broadcast interaction method and device, electronic equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114567792A (en) * | 2022-02-18 | 2022-05-31 | 北京达佳互联信息技术有限公司 | Virtual resource display method, device, equipment, server and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113852839B (en) | 2024-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11503377B2 (en) | Method and electronic device for processing data | |
| CN111970533B (en) | Interaction method and device for live broadcast room and electronic equipment | |
| CN106791893B (en) | Video live broadcasting method and device | |
| CN106506448B (en) | Live broadcast display method and device and terminal | |
| CN112153400B (en) | Live broadcast interaction method and device, electronic equipment and storage medium | |
| CN112905074B (en) | Interactive interface display method, interactive interface generation method and device and electronic equipment | |
| CN106911967B (en) | Live broadcast playback method and device | |
| CN109862380B (en) | Video data processing method, device and server, electronic equipment and storage medium | |
| CN106792147A (en) | A kind of image replacement method and device | |
| CN106604147A (en) | Video processing method and apparatus | |
| US10289193B2 (en) | Use of virtual-reality systems to provide an immersive on-demand content experience | |
| CN110798726A (en) | Bullet screen display method and device, electronic equipment and storage medium | |
| CN111866531A (en) | Live video processing method and device, electronic equipment and storage medium | |
| CN113852839B (en) | Virtual resource allocation method and device and electronic equipment | |
| CN108986803B (en) | Scene control method and device, electronic equipment and readable storage medium | |
| CN112691385B (en) | Method and device for acquiring outgoing and installed information, electronic equipment, server and storage medium | |
| CN113873270A (en) | Game live broadcast method, device, system, electronic equipment and storage medium | |
| CN111526380B (en) | Video processing method, video processing device, server, electronic equipment and storage medium | |
| CN110769275B (en) | Method, device and system for processing live data stream | |
| CN114374880B (en) | Joint live broadcast method, joint live broadcast device, electronic equipment and computer readable storage medium | |
| CN110769282A (en) | Short video generation method, terminal and server | |
| CN114125528B (en) | Video special effect processing method and device, electronic equipment and storage medium | |
| CN112423008B (en) | Live broadcast method, device, terminal, server and storage medium | |
| CN113315903B (en) | Image acquisition method and device, electronic equipment and storage medium | |
| CN113989424A (en) | Three-dimensional virtual image generation method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |