WO2023061461A1 - 直播间的特效播放方法、***及设备 - Google Patents
直播间的特效播放方法、***及设备 Download PDFInfo
- Publication number
- WO2023061461A1 WO2023061461A1 PCT/CN2022/125262 CN2022125262W WO2023061461A1 WO 2023061461 A1 WO2023061461 A1 WO 2023061461A1 CN 2022125262 W CN2022125262 W CN 2022125262W WO 2023061461 A1 WO2023061461 A1 WO 2023061461A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- live broadcast
- broadcast room
- item
- special effect
- target
- Prior art date
Links
- 230000000694 effects Effects 0.000 title claims abstract description 241
- 238000000034 method Methods 0.000 title claims abstract description 56
- 238000004590 computer program Methods 0.000 claims description 24
- 238000012545 processing Methods 0.000 abstract description 8
- 230000006870 function Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 11
- 238000012549 training Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000013527 convolutional neural network Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 101000822695 Clostridium perfringens (strain 13 / Type A) Small, acid-soluble spore protein C1 Proteins 0.000 description 1
- 101000655262 Clostridium perfringens (strain 13 / Type A) Small, acid-soluble spore protein C2 Proteins 0.000 description 1
- 101000655256 Paraclostridium bifermentans Small, acid-soluble spore protein alpha Proteins 0.000 description 1
- 101000655264 Paraclostridium bifermentans Small, acid-soluble spore protein beta Proteins 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
- H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/27—Server based end-user applications
- H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
- H04N21/2743—Video hosting of uploaded data from client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
Definitions
- the embodiments of the present disclosure relate to the field of computer processing technologies, and in particular to a method, system and device for playing special effects in a live broadcast room.
- a user's use of an electronic device is usually the use of various application programs of the electronic device.
- the host can broadcast live through the host terminal, and the audience can watch the live broadcast through the audience terminal.
- Embodiments of the present disclosure provide a method, system and device for playing special effects in a live broadcast room.
- an embodiment of the present disclosure provides a method for playing special effects in a live broadcast room, the method comprising:
- the special effect is played in the live broadcast room.
- an embodiment of the present disclosure provides a device for playing special effects in a live broadcast room, the device comprising:
- An item identification module configured to identify items in the live broadcast room
- a special effect determination module configured to determine a corresponding special effect according to the item and the target attribute of the live broadcast room, the correspondence between the item, the target attribute and the special effect is preset;
- the special effect playing module is used to play the special effect in the live broadcast room.
- an embodiment of the present disclosure provides an electronic device, including: at least one processor and a memory;
- the memory stores computer-executable instructions
- the at least one processor executes the computer-executed instructions stored in the memory, so that the electronic device implements the method as described in the first aspect.
- an embodiment of the present disclosure provides a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when the processor executes the computer-executable instructions, the computing device implements the first aspect. the method described.
- an embodiment of the present disclosure provides a computer program, the computer program is used to implement the method described in the first aspect.
- an embodiment of the present disclosure provides a computer program product, where the computer program product includes a computer program, and when the computer program is executed by a processor, the method according to the first aspect is implemented.
- FIG. 1 is a schematic diagram of a live broadcast scene applicable to an embodiment of the present disclosure
- Fig. 2 is a flow chart of the steps of a method for playing special effects in a live broadcast room provided by an embodiment of the present disclosure
- Fig. 3 is a structural block diagram of a special effect playback device in a live broadcast room provided by an embodiment of the present disclosure
- Fig. 4 and Fig. 5 are structural block diagrams of two kinds of electronic devices provided by the embodiments of the present disclosure.
- FIG. 1 is a schematic diagram of a live broadcast scene applicable to an embodiment of the present disclosure.
- the live broadcast scene involves a terminal device and a server, and each terminal device runs a client, and the client is used to access the above-mentioned server.
- Fig. 1 includes a server and 4 terminal equipments TE1, TE2, TE3 and TE4, running CT1, CT2, CT3 and CT4 respectively.
- CT1, CT2, CT3, and CT4 can all access the server.
- the terminal device TE2 is a terminal device used by a host, and may also be called a host terminal, and the corresponding client CT2 may be called a host client.
- the terminal devices TE1, TE3 and TE4 are terminal devices used by viewers respectively, and may also be referred to as viewer terminals, and the corresponding clients CT1, CT3 and CT4 may be referred to as viewer clients.
- the anchor terminal TE2 may send the live broadcast data of the anchor client CT2 to the server.
- the server can send the live broadcast data to the audience terminals accessing the live broadcast room: TE1, TE3 and TE4, so that the terminal equipment TE1, TE3 and TE4 can display the live broadcast of the live broadcast room on the corresponding audience clients CT1, CT3 and CT4 data.
- the host can display items in the live broadcast room.
- this method of only displaying items is relatively simple, which reduces the fun of live broadcast.
- embodiments of the present disclosure provide a method, system, and device for playing special effects in a live broadcast room.
- the method includes: identifying items in the live broadcast room; 1.
- the corresponding relationship between the target attribute and the special effect is preset; the special effect is played in the live broadcast room.
- the embodiments of the present disclosure can play corresponding special effects in the live broadcast room according to the items in the live broadcast room. In this way, items and special effects can be combined, which enriches the display mode of items in the live broadcast room, improves the interactive effect of live broadcast, and improves the user experience.
- Fig. 2 is a flow chart of steps of a method for playing special effects in a live broadcast room according to an embodiment of the present disclosure.
- the method shown in FIG. 2 can be applied in electronic devices, for example, any terminal device in the aforementioned FIG. 1 , including: anchor terminals and audience terminals.
- the special effect playback method of the live broadcast room includes:
- the item in the live broadcast room may be any item.
- Embodiments of the present disclosure may provide multiple ways of identifying the item.
- the items in the live broadcast room may be identified according to a certain time period, for example, once every N milliseconds. Items in the live broadcast room, such as the actual objects captured by the anchor during the live broadcast, and the items displayed by the anchor, etc.
- a plurality of pictures of the target items can be pre-stored, which can be called the first image; then, during the live broadcast process, screenshots are taken of the live room or the data of the live room is obtained to obtain the second image; finally , comparing the first image with the second image to determine whether the target item exists in the live broadcast room.
- items in the live broadcast room can also be identified through a pre-trained item recognition model. Firstly, during the live broadcast process, take screenshots of the live room or obtain the data of the live room to obtain the second image; then, input the second image into the item recognition model to obtain the items in the live room.
- the above-mentioned item recognition model is any machine model obtained by pre-training, for example, CNN (convolutional neural networks, convolutional neural network) model, DNN (deep neural networks, deep neural network) model, etc.
- CNN convolutional neural networks, convolutional neural network
- DNN deep neural networks, deep neural network
- the training process of the above item recognition model is realized through training sample sets and multiple rounds of iterations.
- the training sample set may include a plurality of sample images, and sample items are marked in the sample images.
- each sample image is input into the item recognition model to recognize the item from the sample image, which is predicted by the item recognition model, so it can be called the predicted item; then, according to this
- the predicted items and sample items corresponding to all the sample images used in the round of iterations are used to determine the loss value; finally, according to the loss value, it is determined to continue the next iteration or end the training. If the loss value does not meet the preset conditions, adjust the item according to the loss value Identify the parameters of the model for the next round of iterative training. If the loss value satisfies the preset condition, the training ends, and the item recognition model after this round of iteration is used as the item recognition model obtained by training.
- the above-mentioned loss value can be obtained by calculating a loss function
- the loss function is an existing known function, for example, a cross-entropy loss function and a mean square loss function.
- the acquisition process of sample images required in the above training process may include: firstly, determining items that support special effects; then, shooting these items that support special effects under various conditions to obtain multiple sample images, for example, in different lighting, Shoot under different angles and other conditions; finally, mark the item in the sample image as a sample item.
- S102 Determine the corresponding special effect according to the item and the target attribute of the live broadcast room, and the corresponding relationship among the item, the target attribute and the special effect is preset.
- the target attribute may include but not limited to: the anchor attribute of the live broadcast room and the attribute of the live broadcast room.
- the aforementioned anchor attributes include at least one of the following: anchor identifier, anchor name, and anchor type.
- the host identifier may be the account number of the host in the live broadcast room, and is used to uniquely represent a host.
- the anchor type can be divided according to any dimension. For example, according to the live broadcast content that the anchor is good at, it can be divided into event review anchors and sales anchors.
- the attributes of the above-mentioned live room include at least one of the following: live room identifier, live room name, and live room type.
- the type of live room can be divided according to any dimension. For example, according to the purpose of the live room, the live room can be divided into a live room for selling items and a live room for commenting on events. It can also be divided according to the duration of the live room. The room is divided into live rooms of different durations.
- the target attribute of the live broadcast room can be obtained, so that whether to play the special effect can be determined according to whether the target attribute and the special effect are obtained.
- the target property is not fetched. Since the target attribute required by the special effect is not determined at this time, the special effect is not played.
- the target attribute is obtained, but the corresponding special effect is not obtained according to the item and the target attribute. Since the special effect is not obtained at this time, the special effect is not played.
- the target attribute is obtained, and the corresponding special effect is obtained according to the item and the target attribute, so as to play the special effect.
- multiple correspondences used in S102 may be preset, and items and/or target attributes and/or special effects in different correspondences are different.
- an item can correspond to multiple target attributes, and each target attribute corresponds to a special effect.
- the target attribute is the anchor ID
- the special effect corresponding to the item M1 is SE1.
- the special effect corresponding to the item M1 is SE2.
- the host ID ID ID3 the special effect corresponding to the item M1 is SE1.
- the item M1 has corresponding special effects in the live broadcast rooms of the three anchors.
- the corresponding special effects of M1 in the live broadcast room of the anchor of ID1 are different from the corresponding special effects in the live broadcast room of ID2.
- the corresponding special effects in the live broadcast room of the anchor of ID1 are the same as the corresponding special effects in the live broadcast room of ID3.
- the same item can play special effects in the live broadcast rooms of multiple anchors, and the special effects in different anchors can be the same or different.
- special effects not only correspond to items, but also correspond to target attributes.
- the special effects displayed can be different, which improves the flexibility of the special effects.
- one target attribute can correspond to one or more items, and the special effects corresponding to different items can be the same or different.
- the target attribute is the anchor ID
- M1 and M2 correspond to different special effects
- M1 and M3 correspond to the same special effect SE1.
- one target attribute and one item can also correspond to two special effects.
- the target attribute is the anchor ID
- the anchor ID is ID1
- the item M1 taken out by the anchor is a trophy, not only the audio special effect SE1 but also the video special effect SE2 can be played.
- one or more correspondences can be selected from the one or more correspondences that match the target attributes of the item identified in S101 and the live room in S101, and the target correspondence
- the special effects in are used as the special effects to be played in S103.
- the object correspondence is a correspondence including object attributes corresponding to the item identified in S101 and the live room in S101.
- special effects may include but not limited to: image special effects, video special effects and audio special effects.
- the above image special effects are special effects represented by images, and the image special effects may be a frame of images with specific content.
- the corresponding image special effect may be a trophy image with the host's profile picture.
- the above-mentioned video special effects are special effects represented by consecutive multiple frames of images, and each frame of images may include specific content.
- the corresponding video special effect may be a trophy animation with the host's head portrait.
- the above-mentioned audio special effect is a special effect represented by sound.
- the corresponding audio special effect may be the sound of "Wow, gold medal winner”.
- special effects can be played when preset conditions are met.
- the preset conditions may include but are not limited to: the historical playback times are less than or equal to the preset times threshold, the current time is within the valid period of the special effect, the status of the item is the target item status, and the host status is the target host status.
- the above-mentioned one or more preset conditions are satisfied, the above-mentioned special effects are played in the above-mentioned live broadcast room.
- the above-mentioned preset conditions are not met, the above-mentioned special effects are not played in the above-mentioned live broadcast room.
- the preset condition is that the historical playback times are less than or equal to the preset times threshold
- the historical playback times of special effects in the above-mentioned live broadcast room within the preset time period can be obtained first; then, determine the difference between the historical playback times and the preset times threshold If the historical playback times are less than or equal to the preset times threshold, the special effects will be played in the live broadcast room, and if the historical playback times are greater than the preset times thresholds, the special effects will not be played in the live broadcast room.
- the preset time period may be days, hours and so on.
- S101 detects an item in a live broadcast room.
- the historical playback times 0 of the special effects determined by S102 in the live broadcast room between 10 and 11 o'clock in the current hour are less than the preset times threshold 1, thus The effect can be played.
- the historical play times of the above-mentioned special effects in the live broadcast room are updated from 0 to 1.
- the preset condition is that the current time is within the valid time period
- the item is identified in S101 and the special effect is determined in S102
- the relationship between the current time and the valid time period of the special effect can be judged. If the current time is within the valid time period, the special effect determined in S102 is played in the live broadcast room in S101 above. If the current time is not within the valid time period, the special effect determined in S102 will not be played in the live broadcast room in S101 above.
- the effective time period may be preset, and the effective time period is used to indicate the time period during which the special effect can be played in the live broadcast room corresponding to the target attribute.
- the above valid time period may be associated with the corresponding relationship in S102 above. Specifically, each corresponding relationship in the above S102 corresponds to a valid time period.
- the effective time periods of the same item in the live broadcast rooms of different hosts can be the same or different. For example, if the item identified in S101 is a trophy in 2015, you can set a valid time period for the trophy from 2015 to 2017, so that after 2018, even if the trophy is detected in the host’s live broadcast room , and no longer display the special effects of the trophy in the live broadcast room.
- the playing time of the special effect may be limited by the above effective time period, and the effective time period may be a time period when the item has a greater influence.
- the effective time period can be set as a period of time after the awarding time of the trophy.
- the preset condition is that the state of the item is the target item state
- identify the state of the item in the live broadcast room then, determine whether the state of the item is the target item state, if the state of the item is the target item state, then The special effect will be played in the live broadcast room. If the status of the item is not the target item status, the special effect will not be played in the live broadcast room.
- the state of the target item may include at least one of the following: a hand-held state, and being at a target position.
- the above-mentioned hand-held state means that the item is in the hands of a person.
- the item if the item is in the hands of a person, it means that the host is displaying the item, so that the special effects of the item can be played. Conversely, if the item is not in the hands of the person, then the special effects of the item will not be played.
- the aforementioned target location may be a preset item display location.
- the target location may be directly in front of the anchor. That is to say, if the item is directly in front of the host, it means that the host is displaying the item, so that the special effects of the item can be played. Conversely, if the item is not directly in front of the host, the special effects of the item will not be played.
- the embodiment of the present disclosure can determine that the host is displaying the item through the state of the item, so as to ensure that the special effect is played when the host is displaying the item. Specifically, when the state of the item is the state of the target item, it is considered that the host is displaying the item, and thus the special effect is played. And when the state of the item is not the state of the target item, it is considered that the host is not displaying the item, so the special effect is not played. In this way, the embodiment of the present disclosure can ensure that the playing of the special effect is in accordance with the timing, and avoid playing the special effect at a wrong timing.
- the preset condition is that the anchor state is the target anchor state
- identify the anchor state in the live broadcast room then, determine whether the anchor state is the target anchor state, if the anchor state is the target anchor state, then play the special effect in the live broadcast room, if If the host status is not the target host status, special effects will not be played in the live broadcast room.
- the target host state includes at least one of the following: the host's gesture is a gesture directed at the item, and the relative positional relationship between the host and the item is a target positional relationship.
- the host's gesture above is a gesture directed at the item, which may indicate that the host is displaying the item. For example, when an anchor displays an item, he usually points to the item with his finger.
- the above-mentioned relative positional relationship of the target may be the relative positional relationship between any limb of the host and the item.
- the above-mentioned relative positional relationships can be used as target positional relationships to indicate that the host is displaying the item.
- the embodiment of the present disclosure it can be determined that the anchor is displaying the item through the anchor state, so as to ensure that the special effect is played when the anchor is displaying the item. In this way, the embodiment of the present disclosure can ensure that the playing of the special effect is in accordance with the timing, and avoid playing the special effect at a wrong timing.
- the preset condition is that the existence duration is less than or equal to the preset duration threshold
- the preset duration threshold may be a relatively small value, so as to prevent the live broadcast from being affected by an excessively long playback duration of special effects.
- the preset duration threshold can be set to 10 seconds, so that the special effect will be played within the first 10 seconds after the item is displayed in the live room. After 10 seconds, even if the item is still displayed in the live room, the special effect will not be played.
- the special effect When multiple preset conditions are set, it is necessary to play special effects when the multiple preset conditions are satisfied at the same time. If at least one preset condition is not satisfied, the special effect is not played.
- the preset conditions set include: the number of historical playbacks is less than or equal to the preset times threshold, the current time is within the effective time period of the special effect, the status of the item is the target item status, and the status of the host is the target status of the host, then it needs to be in the history
- the number of playbacks is less than or equal to the preset threshold, and the current time is within the effective period of the special effect, and the status of the item is the target item status, and the host status is the target host status
- the special effect will be played, and if the historical playback times are greater than the preset When the times threshold, and/or the current time is not within the effective period of the special effect, and/or the status of the item is not the target item status, and/or the host status is not the target host status, the special effect
- the above-mentioned special effects are image special effects or video special effects
- the image special effects or video special effects can be played according to the position of the item in the live broadcast room. Specifically, special effects are played around items in the live broadcast room. This way, the relationship between effects and items can be made clearer. For example, image special effects or video special effects can be played on the left, right, top, and bottom sides of the trophy.
- the host may display different items at different times during the live broadcast, so that the special effects corresponding to each item can be played one by one in chronological order. For example, at time t1, the anchor shows item M1, then the special effect of item M1 can be played at time t1. At time t2, the host shows the item M2 again, so the special effect of item M2 can be played at time t2.
- the special effects of M1 and M2 may be the same or different.
- FIG. 3 is a structural block diagram of a device for playing special effects in a live broadcast room provided by an embodiment of the present disclosure, which is applied to a system for playing special effects in a live broadcast room.
- the above-mentioned special effect playing device 200 in the live broadcast room includes: an item identification module 201 , a special effect determination module 202 , and a special effect playing module 203 .
- the item identification module 201 is configured to identify items in the live broadcast room.
- the special effect determining module 202 is configured to determine a corresponding special effect according to the item and the target attribute of the live broadcast room, and the correspondence between the item, the target attribute and the special effect is preset.
- the special effect playing module 203 is configured to play the special effect in the live broadcast room.
- the target attribute includes at least one of the following: an anchor attribute of the live broadcast room and an attribute of the live broadcast room.
- the anchor attributes include at least one of the following: anchor identifier, anchor name, and anchor type.
- the attributes of the live room include at least one of the following: a live room identifier, a live room name, and a live room type.
- the special effect playing module 203 is also used for:
- Play the special effect in the live broadcast room when a preset condition is met includes at least one of the following: the historical play times of the special effect in the live broadcast room within a preset time period are less than or Equal to the preset number of times threshold, the current time is within the effective time period of the special effect, the status of the item in the live broadcast room is the target item status, the host status of the live broadcast room is the target host status, and the item is in the The duration of existence in the live broadcast room is less than or equal to a preset duration threshold, and the valid time period is used to indicate the time period during which the special effect can be played in the live broadcast room corresponding to the target attribute.
- the state of the target item includes at least one of the following: a hand-held state, and being at a target position.
- the target anchor state includes at least one of the following: the anchor's gesture is a gesture directed at the item, and the relative positional relationship between the anchor and the item is a target positional relationship.
- the special effects include at least one of the following: image special effects, video special effects and audio special effects.
- the special effect playing module 203 is also used for:
- the special effect is played around the item in the live broadcast room.
- the special effect playback device in the live broadcast room provided by this embodiment can be used to execute the technical solution of the method embodiment shown in FIG. 2 above, and its implementation principle and technical effect are similar, so this embodiment will not repeat them here.
- Fig. 4 is a structural block diagram of an electronic device 600 provided by an embodiment of the present disclosure.
- the electronic device 600 includes a memory 602 and at least one processor 601 .
- the memory 602 stores computer-executable instructions.
- At least one processor 601 executes the computer-executed instructions stored in the memory 602, so that the electronic device 600 implements the aforementioned method in FIG. 2 .
- the electronic device may also include a receiver 603 and a transmitter 604, the receiver 603 is used to receive information from other devices or devices and forwards it to the processor 601, and the transmitter 604 is used to send information to other devices or devices .
- FIG. 5 it shows a schematic structural diagram of an electronic device 900 suitable for implementing the embodiments of the present disclosure
- the electronic device 900 may be a terminal device.
- the terminal equipment may include but not limited to mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (Personal Digital Assistant, PDA for short), tablet computers (Portable Android Device, PAD for short), portable multimedia players (Portable Media Player, PMP for short), mobile terminals such as vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital televisions (Television, TV), desktop computers, and the like.
- PDA Personal Digital Assistant
- PMP portable multimedia players
- mobile terminals such as vehicle-mounted terminals (such as vehicle-mounted navigation terminals)
- fixed terminals such as digital televisions (Television, TV), desktop computers, and the like.
- the electronic device shown in FIG. 5 is only an example, and should not limit the functions and scope of use of the embodiments of the present disclosure.
- the electronic device 900 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 908 loads the programs in the random access memory (Random Access Memory, RAM for short) 903 to execute various appropriate actions and processes.
- a processing device such as a central processing unit, a graphics processing unit, etc.
- RAM Random Access Memory
- various programs and data necessary for the operation of the electronic device 900 are also stored.
- the processing device 901, ROM 902, and RAM 903 are connected to each other through a bus 904.
- An input/output (I/O) interface 905 is also connected to the bus 904 .
- an input device 906 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; ), a speaker, a vibrator, etc.
- a storage device 908 including, for example, a magnetic tape, a hard disk, etc.
- the communication means 909 may allow the electronic device 900 to perform wireless or wired communication with other devices to exchange data. While FIG. 5 shows electronic device 900 having various means, it should be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.
- embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, where the computer program includes program codes for executing the methods shown in the flowcharts.
- the computer program may be downloaded and installed from a network via communication means 909 , or from storage means 908 , or from ROM 902 .
- the processing device 901 When the computer program is executed by the processing device 901, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are performed.
- the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two.
- a computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof.
- Computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Electrical Programmable Read Only Memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (Compact Disc Read Only Memory, CD-ROM), optical storage device, magnetic storage device, or any suitable combination.
- a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
- a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying computer-readable program code therein.
- Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
- a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device .
- the program code contained on the computer readable medium can be transmitted by any appropriate medium, including but not limited to: electric wire, optical cable, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.
- the above-mentioned computer-readable medium may be included in the above-mentioned electronic device, or may exist independently without being incorporated into the electronic device.
- the above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device is made to execute the methods shown in the above-mentioned embodiments.
- Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, or combinations thereof, including object-oriented programming languages—such as Java, Smalltalk, C++, and conventional Procedural Programming Language - such as "C" or a similar programming language.
- the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer can be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or it can be connected to an external A computer (connected via the Internet, eg, using an Internet service provider).
- LAN Local Area Network
- WAN Wide Area Network
- each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions.
- the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved.
- each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.
- the units involved in the embodiments described in the present disclosure may be implemented by software or by hardware. Wherein, the name of the unit does not constitute a limitation of the unit itself under certain circumstances, for example, the first obtaining unit may also be described as "a unit for obtaining at least two Internet Protocol addresses".
- exemplary types of hardware logic components include: Field Programmable Gate Arrays (Field Programmable Gate Arrays, FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (Application Specific Standard Product, ASSP), System On Chip (System On Chip, SOC), Complex Programmable Logic Device (Complex Programmable Logic Device, CPLD) and so on.
- an embodiment of the present disclosure provides a method for playing special effects in a live broadcast room, the method comprising:
- the special effect is played in the live broadcast room.
- the target attribute includes at least one of the following: an anchor attribute of the live broadcast room and an attribute of the live broadcast room.
- the anchor attributes include at least one of the following: anchor identifier, anchor name, and anchor type.
- the attribute of the live broadcast room includes at least one of the following: a live broadcast room identifier, a live room name, and a live room type.
- playing the special effect in the live broadcast room includes:
- Play the special effect in the live broadcast room when a preset condition is met includes at least one of the following: the historical play times of the special effect in the live broadcast room within a preset time period are less than or Equal to the preset number of times threshold, the current time is within the effective time period of the special effect, the status of the item in the live broadcast room is the target item status, the host status of the live broadcast room is the target host status, and the item is in the The duration of existence in the live broadcast room is less than or equal to a preset duration threshold, and the valid time period is used to indicate the time period during which the special effect can be played in the live broadcast room corresponding to the target attribute.
- the state of the target item includes at least one of the following: a hand-held state, and being at the target position.
- the target host state includes at least one of the following: the host's gesture is a gesture for the item, the host and the The relative positional relationship between the above items is the target positional relationship.
- the special effects include at least one of the following: image special effects, video special effects, and audio special effects.
- playing the special effect in the live broadcast room includes:
- the special effect is played around the item in the live broadcast room.
- a device for playing special effects in a live broadcast room includes:
- An item identification module configured to identify items in the live broadcast room
- a special effect determination module configured to determine a corresponding special effect according to the item and the target attribute of the live broadcast room, the correspondence between the item, the target attribute and the special effect is preset;
- the special effect playing module is used to play the special effect in the live broadcast room.
- the target attribute includes at least one of the following: an anchor attribute of the live broadcast room and an attribute of the live broadcast room.
- the anchor attributes include at least one of the following: anchor identifier, anchor name, and anchor type.
- the attribute of the live broadcast room includes at least one of the following: a live broadcast room identifier, a live room name, and a live room type.
- the special effects playback module is further used for:
- Play the special effect in the live broadcast room when a preset condition is met includes at least one of the following: the historical play times of the special effect in the live broadcast room within a preset time period are less than or Equal to the preset number of times threshold, the current time is within the effective time period of the special effect, the status of the item in the live broadcast room is the target item status, the host status of the live broadcast room is the target host status, and the item is in the The duration of existence in the live broadcast room is less than or equal to a preset duration threshold, and the valid time period is used to indicate the time period during which the special effect can be played in the live broadcast room corresponding to the target attribute.
- the state of the target item includes at least one of the following: a hand-held state, and being at the target position.
- the target anchor state includes at least one of the following: the anchor's gesture is a gesture for the item, the anchor and the The relative positional relationship between the above items is the target positional relationship.
- the special effects include at least one of the following: image special effects, video special effects, and audio special effects.
- the special effect playing module is further configured to:
- the special effect is played around the item in the live broadcast room.
- an electronic device including: at least one processor and a memory;
- the memory stores computer-executable instructions
- the at least one processor executes the computer-executed instructions stored in the memory, so that the electronic device implements the method according to any one of the first aspect.
- a computer-readable storage medium stores computer-executable instructions, and when a processor executes the computer-executable instructions, Making a computing device implement the method of any one of the first aspects.
- a computer program is provided, the computer program is used to implement the method described in any one of the first aspect.
- a computer program product including a computer program, and when the computer program is executed by a processor, the method according to any one of the first aspect is implemented.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
Claims (14)
- 一种直播间的特效播放方法,其中,所述方法包括:识别所述直播间中的物品;根据所述物品和所述直播间的目标属性确定对应的特效,所述物品、所述目标属性和所述特效之间的对应关系是预先设置的;在所述直播间中播放所述特效。
- 根据权利要求1所述的方法,其中,所述目标属性包括以下至少一种:所述直播间的主播属性和所述直播间的属性。
- 根据权利要求2所述的方法,其中,所述主播属性包括以下至少一种:主播标识、主播名称、主播类型。
- 根据权利要求2或3所述的方法,其中,所述直播间的属性包括以下至少一种:直播间标识、直播间名称、直播间类型。
- 根据权利要求1至4任一项所述的方法,其中,所述在所述直播间中播放所述特效,包括:在满足预设条件时,在所述直播间中播放所述特效,所述预设条件包括以下至少一种:在预设时间周期内所述特效在所述直播间中的历史播放次数小于或等于预设次数阈值、当前时间在所述特效的有效时间段内、所述直播间中的所述物品的状态为目标物品状态、所述直播间的主播状态为目标主播状态、所述物品在所述直播间中的存在时长小于或等于预设时长阈值,所述有效时间段用于指示所述特效在所述目标属性对应的直播间中可播放的时间段。
- 根据权利要求5所述的方法,其中,所述目标物品状态包括以下至少一种:手持状态、位于目标位置。
- 根据权利要求5所述的方法,其中,所述目标主播状态包括以下至少一种:所述主播的手势为针对所述物品的手势、所述主播和所述物品之间的相对位置关系为目标位置关系。
- 根据权利要求1至7任一项所述的方法,其中,所述特效包括以下至少一种:图像特效、视频特效和音频特效。
- 根据权利要求1至8任一项所述的方法,其中,当所述特效为图像特效或视频特效时,所述在所述直播间中播放所述特效,包括:在所述直播间中的所述物品周围播放所述特效。
- 一种直播间的特效播放装置,其中,所述装置包括:物品识别模块,用于识别所述直播间中的物品;特效确定模块,用于根据所述物品和所述直播间的目标属性确定对应的特效,所述物品、所述目标属性和所述特效之间的对应关系是预先设置的;特效播放模块,用于在所述直播间中播放所述特效。
- 一种电子设备,其中,包括:至少一个处理器和存储器;所述存储器存储计算机执行指令;所述至少一个处理器执行所述存储器存储的计算机执行指令,使得所述电子设备实现如权利要求1至9任一项所述的方法。
- 一种计算机可读存储介质,其中,所述计算机可读存储介质中存储有计算机执行指令,当处理器执行所述计算机执行指令时,使计算设备实现如权利要求1至9任一项所述的方法。
- 一种计算机程序,其中,所述计算机程序用于实现如权利要求1至9任一项所述的方 法。
- 一种计算机程序产品,所述计算机程序产品包括计算机程序,所述计算机程序被处理器执行时实现如权利要求1至9任一项所述的方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP22880397.9A EP4344218A1 (en) | 2021-10-14 | 2022-10-14 | Special effect playback method and system for live broadcast room, and device |
US18/393,603 US20240129598A1 (en) | 2021-10-14 | 2023-12-21 | Mehtod, system and device for playing effect in live room |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111198430.5A CN115988227A (zh) | 2021-10-14 | 2021-10-14 | 直播间的特效播放方法、***及设备 |
CN202111198430.5 | 2021-10-14 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/393,603 Continuation US20240129598A1 (en) | 2021-10-14 | 2023-12-21 | Mehtod, system and device for playing effect in live room |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023061461A1 true WO2023061461A1 (zh) | 2023-04-20 |
Family
ID=85956797
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/125262 WO2023061461A1 (zh) | 2021-10-14 | 2022-10-14 | 直播间的特效播放方法、***及设备 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20240129598A1 (zh) |
EP (1) | EP4344218A1 (zh) |
CN (1) | CN115988227A (zh) |
WO (1) | WO2023061461A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116366909A (zh) * | 2023-05-31 | 2023-06-30 | 北京达佳互联信息技术有限公司 | 虚拟物品处理方法、装置、电子设备及存储介质 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150172599A1 (en) * | 2013-12-13 | 2015-06-18 | Blake Caldwell | System and method for interactive animations for enhanced and personalized video communications |
CN106604048A (zh) * | 2016-12-15 | 2017-04-26 | 深圳市智联宝生态科技有限公司 | 一种直播间嵌入购物模块的直播方法及*** |
CN107071580A (zh) * | 2017-03-20 | 2017-08-18 | 北京潘达互娱科技有限公司 | 数据处理方法及装置 |
CN112419143A (zh) * | 2020-11-20 | 2021-02-26 | 广州繁星互娱信息科技有限公司 | 图像处理方法、特效参数设置方法、装置、设备及介质 |
CN112804585A (zh) * | 2021-04-13 | 2021-05-14 | 杭州次元岛科技有限公司 | 一种在直播过程中实现产品智能展示的处理方法及装置 |
CN113448475A (zh) * | 2021-06-30 | 2021-09-28 | 广州博冠信息科技有限公司 | 虚拟直播间的交互控制方法、装置、存储介质与电子设备 |
-
2021
- 2021-10-14 CN CN202111198430.5A patent/CN115988227A/zh active Pending
-
2022
- 2022-10-14 EP EP22880397.9A patent/EP4344218A1/en active Pending
- 2022-10-14 WO PCT/CN2022/125262 patent/WO2023061461A1/zh active Application Filing
-
2023
- 2023-12-21 US US18/393,603 patent/US20240129598A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150172599A1 (en) * | 2013-12-13 | 2015-06-18 | Blake Caldwell | System and method for interactive animations for enhanced and personalized video communications |
CN106604048A (zh) * | 2016-12-15 | 2017-04-26 | 深圳市智联宝生态科技有限公司 | 一种直播间嵌入购物模块的直播方法及*** |
CN107071580A (zh) * | 2017-03-20 | 2017-08-18 | 北京潘达互娱科技有限公司 | 数据处理方法及装置 |
CN112419143A (zh) * | 2020-11-20 | 2021-02-26 | 广州繁星互娱信息科技有限公司 | 图像处理方法、特效参数设置方法、装置、设备及介质 |
CN112804585A (zh) * | 2021-04-13 | 2021-05-14 | 杭州次元岛科技有限公司 | 一种在直播过程中实现产品智能展示的处理方法及装置 |
CN113448475A (zh) * | 2021-06-30 | 2021-09-28 | 广州博冠信息科技有限公司 | 虚拟直播间的交互控制方法、装置、存储介质与电子设备 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116366909A (zh) * | 2023-05-31 | 2023-06-30 | 北京达佳互联信息技术有限公司 | 虚拟物品处理方法、装置、电子设备及存储介质 |
CN116366909B (zh) * | 2023-05-31 | 2023-10-17 | 北京达佳互联信息技术有限公司 | 虚拟物品处理方法、装置、电子设备及存储介质 |
Also Published As
Publication number | Publication date |
---|---|
US20240129598A1 (en) | 2024-04-18 |
EP4344218A1 (en) | 2024-03-27 |
CN115988227A (zh) | 2023-04-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020253806A1 (zh) | 展示视频的生成方法、装置、设备及存储介质 | |
CN109640188B (zh) | 视频预览方法、装置、电子设备及计算机可读存储介质 | |
WO2021008223A1 (zh) | 信息的确定方法、装置及电子设备 | |
CN112259062B (zh) | 特效展示方法、装置、电子设备及计算机可读介质 | |
CN110324646A (zh) | 特效的展示处理方法、装置及电子设备 | |
US10110933B2 (en) | Video file processing | |
CN109474850B (zh) | 运动像素视频特效添加方法、装置、终端设备及存储介质 | |
US20230421716A1 (en) | Video processing method and apparatus, electronic device and storage medium | |
CN110072151B (zh) | 虚拟礼物展示方法、电子设备及计算机可读存储介质 | |
CN109618216B (zh) | 显示视频加载状态标识的方法、装置、设备及存储介质 | |
CN109600559B (zh) | 一种视频特效添加方法、装置、终端设备及存储介质 | |
WO2022007565A1 (zh) | 增强现实的图像处理方法、装置、电子设备及存储介质 | |
US20230182028A1 (en) | Game live broadcast interaction method and apparatus | |
CN109640129A (zh) | 视频推荐方法、装置,客户端设备、服务器及存储介质 | |
WO2022095954A1 (zh) | 基于直播的数据交互方法、装置、电子设备和可读介质 | |
CN112291590A (zh) | 视频处理方法及设备 | |
US11924500B2 (en) | Information interaction method and device, electronic apparatus, and computer readable storage medium | |
US20240129598A1 (en) | Mehtod, system and device for playing effect in live room | |
WO2020155915A1 (zh) | 用于播放音频的方法和装置 | |
CN113873314A (zh) | 直播互动方法、装置、可读介质及电子设备 | |
US11886484B2 (en) | Music playing method and apparatus based on user interaction, and device and storage medium | |
US20220272283A1 (en) | Image special effect processing method, apparatus, and electronic device, and computer-readable storage medium | |
WO2023001065A1 (zh) | 群组互动方法、装置、设备及存储介质 | |
WO2023103720A1 (zh) | 视频特效处理方法、装置、电子设备及程序产品 | |
CN115190366B (zh) | 一种信息展示方法、装置、电子设备、计算机可读介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22880397 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022880397 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2023579381 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2022880397 Country of ref document: EP Effective date: 20231220 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |