CN115098000B

CN115098000B - Image processing method, device, electronic equipment and storage medium

Info

Publication number: CN115098000B
Application number: CN202210162048.7A
Authority: CN
Inventors: 赵楠; 李奇
Original assignee: Beijing Zitiao Network Technology Co Ltd
Current assignee: Beijing Zitiao Network Technology Co Ltd
Priority date: 2022-02-22
Filing date: 2022-02-22
Publication date: 2023-10-10
Anticipated expiration: 2042-02-22
Also published as: CN115098000A

Abstract

The embodiment of the disclosure discloses an image processing method, an image processing device, electronic equipment and a storage medium, wherein the method comprises the following steps: when a preset special effect triggering operation for starting a fluid delivery special effect is received, displaying a special effect scene image corresponding to the fluid delivery special effect, and displaying a target fluid element corresponding to the fluid delivery special effect in a first display mode, wherein the special effect scene image comprises a scene first interaction body; when detecting that a target interaction object and the first interaction main body of the scene generate relative motion, generating a fluid channel in the first interaction main body of the scene according to the motion information of the target interaction object; and determining a second display mode of the target fluid element according to the fluid channel, and displaying the target fluid element in the second display mode. According to the technical scheme, the fluid conveying scene can be simulated, interactive interestingness is increased, the image display effect is enriched, and user interaction experience is improved.

Description

Image processing method, device, electronic equipment and storage medium

Technical Field

The embodiment of the disclosure relates to the technical field of image processing, in particular to an image processing method, an image processing device, electronic equipment and a storage medium.

Background

With the rapid development of internet technology and intelligent terminals, more and more information transmission modes emerge. Under fast-paced life, short video becomes one of the favored information acquisition modes.

At present, most of short videos take shot pictures or videos as main display contents, and most of short videos are displayed by publishers, so that users watching the short videos can only passively receive display information, and users cannot participate in the short videos. Therefore, the short video display mode is poor in interactivity and lacks of interestingness, and the display effect is relatively single, so that the user experience is affected.

Disclosure of Invention

The embodiment of the disclosure provides an image processing method, an image processing device, electronic equipment and a storage medium, so as to achieve improved image interaction.

In a first aspect, an embodiment of the present disclosure provides an image processing method, including:

when a preset special effect triggering operation for starting a fluid delivery special effect is received, displaying a special effect scene image corresponding to the fluid delivery special effect, and displaying a target fluid element corresponding to the fluid delivery special effect in a first display mode, wherein the special effect scene image comprises a scene first interaction body;

When detecting that a target interaction object and the first interaction main body of the scene generate relative motion, generating a fluid channel in the first interaction main body of the scene according to the motion information of the target interaction object;

and determining a second display mode of the target fluid element according to the fluid channel, and displaying the target fluid element in the second display mode.

In a second aspect, an embodiment of the present disclosure further provides an image processing apparatus, including:

the scene image display module is used for displaying a special effect scene image corresponding to the fluid delivery special effect when a preset special effect triggering operation for starting the fluid delivery special effect is received, and displaying a target fluid element corresponding to the fluid delivery special effect in a first display mode, wherein the special effect scene image comprises a scene first interaction body;

the fluid channel generation module is used for generating a fluid channel in the first interaction body of the scene according to the motion information of the target interaction object when the relative motion between the target interaction object and the first interaction body of the scene is detected;

and the fluid element display module is used for determining a second display mode of the target fluid element according to the fluid channel and displaying the target fluid element in the second display mode.

In a third aspect, embodiments of the present disclosure further provide an electronic device, including:

one or more processors;

storage means for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the image processing methods provided by any of the embodiments of the present disclosure.

In a fourth aspect, the embodiments of the present disclosure further provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the image processing method provided by any of the embodiments of the present disclosure.

According to the technical scheme, when the preset special effect triggering operation for starting the fluid delivery special effect is received, a special effect scene image corresponding to the fluid delivery special effect is displayed, the special effect scene image comprises a scene first interaction main body, a basic interaction scene is provided for a user, a target fluid element corresponding to the fluid delivery special effect is displayed in a first display mode, the initial scene of fluid delivery is displayed, further, when the relative motion of the target interaction object and the scene first interaction main body is detected, a fluid channel is generated in the scene first interaction main body according to the motion information of the target interaction object, interaction between the target interaction object and the scene first interaction main body is realized, the display mode of the scene first interaction main body is changed through the motion information of the target interaction object, the fluid channel is generated, further, a second display mode of the target fluid element is determined according to the fluid channel, the second display mode is used for displaying the target fluid element, and the association is established between the display mode of the target fluid element and the interaction action of the target interaction object, the problem that the interaction mode tends to be interactive, the interaction mode is poor, the interaction effect is lacked, the interaction effect is relatively single is solved, the interaction effect is simulated, the display of the interaction effect is improved, and the user is enriched, and the display experience is enriched.

Drawings

In order to more clearly illustrate the technical solution of the exemplary embodiments of the present disclosure, a brief description is given below of the drawings required to describe the embodiments. It is obvious that the drawings presented are only drawings of some of the embodiments of the invention to be described, and not all the drawings, and that other drawings can be made according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a flowchart of an image processing method according to a first embodiment of the disclosure;

fig. 2 is a flowchart of an image processing method according to a second embodiment of the disclosure;

fig. 3 is a flowchart of an image processing method according to a third embodiment of the disclosure;

FIG. 4 is a schematic view showing the effects of soil and water removal of a fluid delivery effect according to an embodiment of the present disclosure;

FIG. 5 is a flow chart of an alternative interaction example of an image processing method provided in an embodiment of the disclosure;

fig. 6 is a schematic structural diagram of an image processing apparatus according to a fifth embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of an electronic device according to a sixth embodiment of the disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.

It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units. It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.

The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

Example 1

Fig. 1 is a schematic flow chart of an image processing method according to an embodiment of the present disclosure, where the embodiment may be suitable for a case of interacting with a scene interaction body shown in an image to implement fluid delivery, and the method may be implemented by an image processing apparatus, which may be implemented by software and/or hardware, and may be configured in a terminal and/or a server to implement the image processing method according to the embodiment of the present disclosure.

As shown in fig. 1, the method of this embodiment may specifically include:

and S110, when a preset special effect triggering operation for starting the fluid delivery special effect is received, displaying a special effect scene image corresponding to the fluid delivery special effect, and displaying a target fluid element corresponding to the fluid delivery special effect in a first display mode, wherein the special effect scene image comprises a scene first interaction body.

Among other things, fluid delivery special effects are understood as special effects for achieving a simulated fluid delivery process. The preset special effects triggering operation may be understood as an operation for enabling the special effects of fluid delivery after the preset triggering. In the embodiment of the present disclosure, the generation manner of the preset special effect triggering operation may be various. The preset special effect triggering operation may be a control triggering operation acting on a preset special effect triggering control, or the preset special effect triggering operation may be input voice information or gesture information for enabling the fluid delivery special effect, etc. The expression form and the display position of the special effect trigger control can be set according to actual requirements, and the special effect trigger control is not particularly limited herein. Typically, the special effects trigger control may be a special effects trigger identifier displayed in a special effects display interface in the application program. The special effect trigger mark can be in a text form, a picture-text combined form and the like.

The special effect scene image is understood to be an image containing preset scene information which can interact with a target fluid element in the fluid delivery special effect. The target fluid element may be understood as a flowable element preset in the fluid delivery special effect. The target fluid element may be constructed based on a fluid simulation algorithm, e.g., the target fluid element may be modeled based on an azimuthal fluid (Position Based Fluid, PBF) approach. Illustratively, the target fluid element may be a rain element, a water element, a snow element, a hail, a magma, a wind element, or the like.

Optionally, multiple scene interaction subjects may be included in the special effects scene image. In particular, for a target fluid element, the scene interaction body may be a body capable of interacting with the target fluid element. The interaction with the target fluid element may include an acceleration or a blocking effect on the flow of the target fluid element. For the target interaction object, the scene interaction subject may include a subject capable of interacting with the target interaction object, or may include a subject incapable of interacting with the target interaction object. It is understood that the first interaction subject of the scene of the special effect scene image may be understood as a scene interaction subject capable of interacting with the target interaction object.

The first display mode may be a default display mode of a preset target fluid element in the special effect scene image. In the embodiment of the disclosure, a main body appearing in an actual scene can be set in the special effect scene image as a scene interaction main body, such as a building, a land, a stone, a sand, a flower, a grass, a tree, and the like. In the disclosed embodiments, the first interaction of the scene to the subject may be soil or sand, or the like. The default display mode of the target fluid element in the special effect scene image can be used for performing motion simulation according to the situation in an actual scene, for example, initial flow speed and gravity information can be set for the target fluid element, and constraint conditions, such as main body friction information and the like, can be set for the flow of the target fluid element according to the scene interaction main body. The setting has the advantages that the user can feel realism and substitution in the interaction process, and accordingly user experience is improved.

Optionally, when a preset special effect triggering operation for enabling the special effect of fluid delivery is received, the special effect scene image corresponding to the special effect of fluid delivery and the target fluid element corresponding to the special effect of fluid delivery are displayed in the target display area at the same time, or when the preset special effect triggering operation for enabling the special effect of fluid delivery is received, the special effect scene image corresponding to the special effect of fluid delivery is displayed in the target display area first, and then the target fluid element corresponding to the special effect of fluid delivery is displayed in the target display area in a first display mode.

For example, the target fluid element corresponding to the fluid delivery special effect may be displayed in the target display area in the first display manner upon receiving a fluid display trigger operation for displaying the target fluid element corresponding to the fluid delivery special effect. The triggering mode of the fluid display triggering operation is not particularly limited, and may be, for example, triggering by inputting a preset triggering gesture, or triggering by acting on a preset triggering control, or triggering by inputting preset voice information, etc.

And S120, when the relative movement of the target interaction object and the first interaction main body of the scene is detected, generating a fluid channel in the first interaction main body of the scene according to the movement information of the target interaction object.

The target interaction object may be understood as an object capable of interacting with the first interaction subject of the scene and changing the presentation form of the first interaction subject of the scene. The target interactive object is different from the target fluid element. The target interactive object may be an object for which the fluid delivery effect is intended, or alternatively, the fluid delivery may be achieved through interaction. Typically, the target interactive object may be an object controlled by a target user using the fluid delivery special effects. The target user may be a real or virtual human or animal, and the virtual human or animal may be a human or animal simulated by a machine. Optionally, the target interaction object is a body part of a target user. Specifically, the target interactive object includes a facial portion or a limb portion. Illustratively, the facial portion includes a forehead, nose, mouth, cheek, eyes, tongue, chin, or the like. The limb portion may include a shoulder, finger, elbow, arm, leg, or toe, or the like.

Optionally, the target interaction object is a controlled target prop of the target user. The target prop may be a physical prop or a virtual prop displayed in a fluid delivery special effect.

It will be appreciated that the relative movement of the target interactive object with the first interactive body of the scene results from the movement of the target interactive object. Specifically, whether the target interaction object and the first interaction body of the scene generate relative motion or not can be determined by detecting the relative position of the target interaction object and the first interaction body of the scene in the special effect scene image. Specifically, the relative motion between the target interaction object and the first interaction body of the scene can be determined according to the position change of the target interaction object in the multi-frame image corresponding to the fluid delivery special effect. For example, the relative motion between the target interactive object and the first interactive body of the scene may be determined according to the position information of the target interactive object in the current image frame and the position information in the previous N image frames corresponding to the current image frame, where N is a positive integer greater than or equal to 1.

It should be noted that, when the position information of the target interaction object is detected to move to the position where the first interaction object of the scene is located, or when the collision between the target interaction object and the first interaction object of the scene is detected, it is determined that the target interaction object and the first interaction object of the scene move relatively. In other words, when the target interactive object moves within an image area other than the scene first interactive object, it is not determined that the target interactive object and the scene first interactive object move relatively.

It will be appreciated that before generating the fluid channel in the first interaction volume of the scene based on the motion information of the target interaction object, the method further comprises: and acquiring the motion information of the target interactive object. Specifically, when it is detected that the switched image frames reach a preset first image frame number threshold, motion information of the target interactive object may be acquired. Wherein the first image frame number may be any positive integer greater than or equal to 1. The specific value of the number of first image frames may be set according to practical situations, and is not specifically limited herein.

Alternatively, the motion information of the target interactive object may include position information and radius information of the target interactive object. The position information of the target interaction object can be determined by detecting the position of a preset pixel point corresponding to the position detection key point corresponding to the target interaction object in the special effect scene image. The position information of the target interaction object may be a preset radius value, or may be calculated according to a plurality of preset radius detection key points corresponding to the target interaction object. Taking a target interactive object as a nose as an example, the position information of the nose can be obtained by detecting the position of a corresponding pixel point in the special effect scene image of a pre-marked key point positioned at the position of the nose tip. The radius information of the nose may be a fixed value set in advance. Or a pre-marked value of the horizontal distance between the key point at the tip of the nose and the key point at the wing of the nose.

A fluid channel is understood to mean, among other things, a channel which is capable of allowing a flow of a target fluid element. It should be noted that in the embodiments of the present disclosure, the fluid channel may have the target fluid element or may have no target fluid element. Illustratively, the fluid channel is generated in the first interaction body of the scene according to the motion information of the target interaction object, and it is understood that the first interaction body of the scene through which the motion of the target interaction object passes is changed to the fluid channel. Taking the first interactive main body of the scene as an example of a soil element, the motion trail of the target interactive object in the soil element display area is the basis for forming a fluid channel, and in terms of visual effect, the target interactive object digs out soil or the soil passing through the target interactive object disappears, so that the fluid channel is formed.

In the embodiment of the disclosure, optionally, when a preset special effect triggering operation for enabling the special effect of fluid delivery is received, acquiring image information of a target interaction object; or when an interaction triggering operation for triggering interaction to start is received, collecting image information of the target interaction object.

S130, determining a second display mode of the target fluid element according to the fluid channel, and displaying the target fluid element in the second display mode.

The second display mode can be understood as a display mode after the fluid channel appears in the special effect scene image. The second display mode may be the same as or different from the first display mode. Specifically, the second display mode is a current display mode of displaying the target fluid element or the target fluid element along the fluid channel. In other words, the second display manner of the target fluid element determined according to the fluid channel may be that the target fluid element is displayed along the fluid channel, or may be that the target fluid element is displayed currently.

Optionally, if the fluid channel is in communication with a current flow region of the target fluid element, displaying the target fluid element along the fluid channel; if the fluid channel is not in communication with the current flow region of the target fluid element, continuing to display the target fluid element in the current display mode of the target fluid element. Wherein the fluid channel not communicating with the current flow area of the target fluid element may be understood as two image areas of the fluid channel and the current flow area of the target fluid element being independent of each other. It will be appreciated that the current display mode may be the same as or different from the first display mode.

Optionally, the second presentation of the target fluid element is determined by detecting whether the target fluid element collides with the fluid channel. Illustratively, if the target fluid element collides with the fluid channel, presenting the target fluid element along the fluid channel; if the target fluid element does not collide with the fluid channel, continuing to display the target fluid element in the current display mode of the target fluid element. And detecting whether the target fluid element collides with the fluid channel according to the directed distance field image corresponding to the special effect scene image and the position information of the target fluid element.

On the basis of each optional scheme of the embodiment of the disclosure, optionally, the graphics processing method of the embodiment of the disclosure further includes: determining a target detection position in the special effect scene image; and detecting whether the target fluid element is conveyed to the target position or not according to the color value of the pixel point corresponding to the target detection position. By adopting the technical scheme, the fixed-point detection can be carried out on the conveying path of the target fluid element, a foundation is laid for further enriching the display effect of the image according to the target detection position, and whether the target fluid element is conveyed to the target position or not is simply and rapidly determined through the color value of the pixel point corresponding to the target detection position, so that the detection efficiency is ensured.

The target detection position may be a preset detection position located in the special effect scene image. Illustratively, the target detection location may be marked by a scene interaction agent that is distinct from the scene first interaction agent. The target detection location may be used to characterize delivery progress or delivery completion of the target fluid element. Wherein the delivery completion may be an indicator for characterizing the quality of the delivery interaction.

Specifically, when the switched image frames reach a preset second image frame number threshold, whether the target fluid element is conveyed to the target position or not is detected according to the color value of the pixel point corresponding to the target detection position. Wherein the second image frame number may be any positive integer greater than or equal to 1. The specific value of the number of second image frames may be set according to practical situations, and is not particularly limited herein. Note that, in the embodiment of the present disclosure, the first image frame number may be the same as or different from the second image frame number, which is not particularly limited herein. And (3) judging whether the color value meets a preset condition or not by reading the color value of the position information (such as coordinate value) of the pixel point corresponding to the target detection position, and if so, determining that the target fluid element reaches the target detection position.

Specifically, whether the color value of the pixel point corresponding to the target detection position reaches a preset value or not may be judged, if so, it is determined whether the target fluid element is detected to be delivered to the target position or not, otherwise, it is determined that the target fluid element is not delivered to the target position. For example, when the target fluid element fluid does not flow to the pixel point corresponding to the target detection position, the color value of the pixel point is 0, and when the target fluid element fluid flows to the pixel point, the color value of the pixel point is changed from 0 to 1, and then whether the target fluid element is delivered to the target position can be determined by reading the color value of the pixel point and judging whether the color value is 1.

In order to facilitate smooth interaction and further improve user interaction experience, on the basis of each optional scheme of the embodiment of the disclosure, optionally, the graphics processing method of the embodiment of the disclosure further includes: and displaying interaction prompt information corresponding to the fluid conveying special effect. The interactive prompt information may be understood as information displayed to the user for prompting the user about content associated with the interactive operation corresponding to the fluid delivery special effect. The display form of the interactive prompt information can be various, for example, the interactive prompt information can be displayed in a static or dynamic picture, small video or text form, can also be displayed through sound information, progress information plug-in or color information of a preset mark, and the like, and can also be displayed in a mode of combining two or two display modes. In the embodiment of the disclosure, the display time of the interaction prompt information can be associated according to the prompt content of the interaction prompt information, specific interaction behaviors and the like. The specific content and the presentation time of the interaction prompt information can be set according to actual situations, and are not particularly limited herein.

Optionally, the displaying the interactive prompt information corresponding to the fluid delivery special effect includes at least one of the following operations:

displaying interactive mode guide information corresponding to the fluid conveying special effect;

displaying interaction initial position prompt information after displaying the special effect scene image corresponding to the fluid conveying special effect;

when the residual interaction time is detected to reach a preset residual time threshold, displaying residual time prompt information;

and when the condition of ending the interaction is detected to be reached, displaying the fluid conveying state information.

The interaction mode guiding information can be understood as prompt information for guiding a user how to interact in a scene of the fluid delivery special effect. For example, the interaction means guidance information may specifically be an interaction operation guidance map of the target interaction object acting on the first interaction object of the scene. Wherein the interoperability guidance map may include examples of correct interactions and/or incorrect interactions. Alternatively, when a preset special effect triggering operation for enabling the special effect of fluid delivery is received, interactive mode guiding information corresponding to the special effect of fluid delivery is displayed, or when a target interactive object is detected, interactive mode guiding information corresponding to the special effect of fluid delivery is displayed. The display sequence of the interactive mode guide information and the special effect scene image is not sequential, the interactive mode guide information and the special effect scene image can be displayed at the same time, the interactive mode guide information can be displayed first and then the special effect scene image can be displayed, and the interactive mode guide information can be displayed first and then the special effect scene image can be displayed.

The remaining time prompt information may be understood as prompt information for prompting the user of the remaining interactive time length. The remaining interaction duration may be understood as the duration between the current time and the end time of the interaction, in other words how long it is possible to interact with the fluid delivery special effects. Alternatively, the remaining interaction time period may be determined according to the interacted time and a preset total interaction time period. It can be appreciated that the preset remaining duration threshold may be set according to actual situations, as long as the preset total interaction duration is less than or equal to the preset total interaction duration. The display mode of the residual time prompt information can be that the residual time prompt information is displayed once every preset time period, or can be continuously displayed in a countdown mode.

Optionally, the detecting that the interaction end condition is reached includes at least one of:

detecting that the total interaction time reaches a preset interaction time threshold;

detecting delivery of the target fluid element to a target end position;

and detecting that a preset ending interaction triggering operation is received.

The preset interaction time threshold may be understood as a critical value for determining an upper limit of the total interaction time. The preset interaction time threshold may be set according to actual requirements, and the specific time is not limited herein. The target end position may be a preset position that triggers the end of fluid delivery after the target fluid element arrives. The target end position may be set according to actual requirements, and the specific position is not limited herein. For example, it may be a lower left corner or a lower right corner position of the effect scene image, etc. Optionally, an end identifier may also be provided at the target end position to prompt the user. Ending the interactive triggering operation may be understood as an operation for ending the interactive operation in the fluid delivery special effect scenario after triggering. Similarly, there are various ways of generating the ending interactive trigger operation, for example, by acting on an interactive ending control set in advance for ending the interactive operation in the fluid delivery special effect scene, or by acting on an special effect ending control set in advance for ending the fluid delivery special effect, or by switching the fluid delivery special effect to the operation trigger generation in the background.

The fluid delivery status information may be understood as a prompt for prompting completion of fluid delivery. The fluid delivery status information may be, for example, a prompt indicating that the delivery task of the target fluid element is completed, or may be, for example, a prompt indicating that the delivery task of the target fluid element is not completed.

According to the technical scheme, when the preset special effect triggering operation for starting the fluid conveying special effect is received, a special effect scene image corresponding to the fluid conveying special effect is displayed, the special effect scene image comprises a scene first interaction main body, a basic interaction scene is provided for a user, a target fluid element corresponding to the fluid conveying special effect is displayed in a first display mode, the initial scene of fluid conveying is displayed, further, when the relative motion of a target interaction object and the scene first interaction main body is detected, a fluid channel is generated in the scene first interaction main body according to the motion information of the target interaction object, interaction between the target interaction object and the scene first interaction main body is realized, the display mode of the scene first interaction main body is changed through the motion information of the target interaction object, the fluid channel is generated, further, a second display mode for determining the target fluid element according to the fluid channel is used, the second display mode is used for establishing association between the display mode of the target fluid element and the interaction behavior of the target interaction object, the problem that the short-video display mode is poor in interaction performance, the lack of interest and the interaction effect is relatively single is solved, the interaction effect is simulated, the interaction effect is improved, and the display effect of the interaction is improved, and the user is shown.

Example two

Fig. 2 is a schematic flow chart of an image processing method provided in a second embodiment of the present disclosure, where, on the basis of any one of the optional technical solutions in the embodiments of the present disclosure, a scene interaction body of a special effect scene image may be further enriched, and while focusing on a display manner of a target fluid element, a display manner of the scene interaction body of the special effect scene image is enriched.

Optionally, the special effects scene image may further include a scene second interaction body, and the method further includes: and when the target fluid element is detected to flow through the second interaction body of the scene, the second interaction body of the scene is transformed from the first display position to the second display position for display.

On the basis of the above-mentioned optional technical solutions, optionally, the special effect scene image may further include a third interaction body of the scene, and the method further includes: and when the target fluid element is detected to flow to the third interaction body of the scene, switching the third interaction body of the scene from the first display state to the second display state for display.

Wherein, the technical terms identical to or corresponding to the above embodiments are not repeated herein.

As shown in fig. 2, the method of this embodiment may specifically include:

and S210, when a preset special effect triggering operation for starting the fluid conveying special effect is received, displaying a special effect scene image corresponding to the fluid conveying special effect, and displaying a target fluid element corresponding to the fluid conveying special effect in a first display mode, wherein the special effect scene image comprises a scene first interaction body.

As previously described, the special effects scene image may include a plurality of scene interaction subjects. Optionally, the special effect scene image may further include a scene second interaction subject and/or a scene third interaction subject on the basis of including the scene first interaction subject. The main forms of the second interaction main body of the scene and the third interaction main body of the scene can be the same or different. In this embodiment, the second interaction entity of the scene and the third interaction entity of the scene may be distinguished according to different interaction effects generated when the second interaction entity of the scene and the third interaction entity of the scene interact with the target fluid element. For example, the second interaction principal of the scene may be a process interaction principal that interacts with the target fluid element, and the third interaction principal of the scene may be an interaction node principal that characterizes the end of the interaction.

S220, when the relative movement of the target interaction object and the first interaction body of the scene is detected, generating a fluid channel in the first interaction body of the scene according to the movement information of the target interaction object.

S230, determining a second display mode of the target fluid element according to the fluid channel, and displaying the target fluid element in the second display mode.

S240, when the target fluid element is detected to flow through a scene second interaction body of the special effect scene image, the scene second interaction body is transformed from a first display position to a second display position to be displayed.

The second interaction subject of the scene can be understood as a scene interaction subject which is distinguished from the first interaction subject of the scene in the special effect scene image and is used for interaction with the target fluid element. Illustratively, the scene second interaction entity may be a scene interaction entity through which a pre-set target fluid element may theoretically pass, but is not necessarily passed. The second interactive body of the scene can be displayed by an identification distinguished from the first interactive body of the scene. The second interaction subject of the scene may be a preset virtual interaction prop, or an identifier for a location point through which a preset target fluid element needs to flow. The virtual interactive prop can be a prop which can interact with the target fluid element in the display and application program interface. For example, when the target fluid element is water, a virtual interactive prop boat, mermaid, or small animal in water, etc. The boat may drift with the water as it flows through the boat. The virtual interactive prop may also be a prop that exposes an evaluation index in the application interface that determines the fluid delivery status by whether to interact with the target fluid element. For example, as the target fluid element flows through the virtual interactive prop, the virtual interactive prop may be displayed in a predetermined area for displaying an evaluation index of the fluid delivery state. For example, the virtual interactive prop is a star logo, which can be displayed in the upper left or upper right corner of the special effect scene image when the target fluid element flows through the star logo, and is used for representing the star level or score of fluid delivery.

The first display position may be a preset position for displaying the second interaction body of the scene. It should be noted that, the preset position for displaying the second interaction body of the scene may be a fixed position or a position that changes according to a preset rule. For example, it may be a location generated by a random algorithm. The preset position for displaying the second interaction body of the scene can also be switched among a plurality of positions according to a preset switching rule. The second display position is different from the first display position, and can be understood as a position obtained by updating the first display position due to the triggering of the target fluid element flowing through the second interaction body of the scene. Generally, the second display position is different from the first display position.

Optionally, the detecting whether the target fluid element flows through the second interaction subject of the special effect scene image may specifically be determining whether the target fluid element flows through the second interaction subject of the special effect scene image by detecting a color value of a pixel point corresponding to a display position of the second interaction subject of the scene. In other words, the display position of the second interaction body of the scene may be taken as the target detection position. For detection of the target position, reference is made to the foregoing and will not be repeated here.

S250, when the target fluid element is detected to flow to a third interaction subject of the special effect scene image, switching the third interaction subject of the scene from a first display state to a second display state for display.

The third interaction subject of the scene is a scene interaction subject which is different from the first interaction subject of the scene and the second interaction subject of the scene in the special effect scene image and can interact with the target fluid element. Specifically, when the target fluid element is detected to flow to the third interaction body of the scene, the display state of the third interaction body of the scene will be changed. Illustratively, the third interactive body of the scene may be a special effect prop for holding or loading the target fluid element. The first display state may be understood as a preset display state of the third interaction subject of the scene, and the second display state may be a state after the target fluid element flows to the third interaction subject of the scene and then interacts with the third interaction subject of the scene. For example, the target fluid element is water, the third interaction body of the scene may be a bottle, and when water flows into the bottle, the bottle and the water level information in the bottle are displayed, and further, sound in the water filling bottle can be played.

Similarly, the display position of the second interaction body of the scene may also be taken as the target detection position. And further, determining whether the target fluid element flows to the third interaction subject of the special effect scene image by detecting color values of pixel points corresponding to the display positions of the third interaction subject of the scene. For detection of the target position, reference is made to the foregoing and will not be repeated here.

According to the technical scheme, the first interaction subject of the scene in the special effect scene image interacts with the target interaction object to form a three-dimensional channel for the target fluid element to flow, and the second interaction object of the scene and the third interaction object of the scene interact with the target fluid element to change the display information, so that the interaction interestingness is further improved, and the integral display effect of the image is richer.

Example III

Fig. 3 is a schematic flow chart of an image processing method according to a third embodiment of the present disclosure, where a specific way of generating a fluid channel is further provided on the basis of any one of the optional technical solutions in the embodiments of the present disclosure. Optionally, the motion information includes location information and radius information; the generating a fluid channel in the first interaction body of the scene according to the motion information of the target interaction object comprises the following steps: determining a binarized image of the special effect scene image according to the first interaction subject of the scene, and determining a directed distance field image of the special effect scene image according to the binarized image; determining whether the target interaction object collides with the first interaction object of the scene according to the directed distance field image; if so, updating the binarized image according to the position information and the radius information of the target interaction object so as to generate a fluid channel in the first interaction body of the scene.

As shown in fig. 3, the method of this embodiment may specifically include:

and S310, when a preset special effect triggering operation for starting the fluid delivery special effect is received, displaying a special effect scene image corresponding to the fluid delivery special effect, and displaying a target fluid element corresponding to the fluid delivery special effect in a first display mode, wherein the special effect scene image comprises a scene first interaction body.

S320, when the relative motion between the target interactive object and the first interactive main body of the scene is detected, determining a binarized image of the special effect scene image according to the first interactive main body of the scene, and determining a directed distance field image of the special effect scene image according to the binarized image.

Optionally, the binarized image is an image with a pixel value of 0 or 255, or 0 or 1, of each pixel point in the image. In an exemplary embodiment, in the binarized image determined according to the first interaction subject of the scene, the pixel value of each pixel point corresponding to the first interaction subject of the scene is 255 or 1, and the pixel points corresponding to the other areas except for the first interaction subject are one pixel value bit 0.

A directed-distance field image is understood to mean, among other things, a two-dimensional directed-distance field, which represents the nearest distance of individual pixel points in the image area to the obstacle boundary. In the embodiment of the present disclosure, the first interaction body of the scene may be used as an obstacle, whereas an area other than the first interaction body may be used as an obstacle. Thus, the nearest distance value corresponding to each pixel point in the whole image in the target display area can be calculated. The advantage of this arrangement is that after calculating the corresponding nearest distance of each pixel, the motion information of the target fluid element after collision can be determined according to each distance value. On the basis of the above, the normalization processing can be further performed on the nearest distances corresponding to each pixel point in the directed distance field image, so as to obtain a normalized directed distance field image. Optionally, determining the directed distance field image of the special effect scene image through a jump flood algorithm iterative calculation mode and the binarization map.

S330, determining whether the target interaction object collides with the first interaction object of the scene according to the directed distance field image.

Optionally, determining a minimum distance between the target fluid element and the first interaction object of the scene according to the distance value corresponding to each pixel point in the directed distance field image, and further determining whether the target interaction object collides with the first interaction object of the scene according to the minimum distance and a preset collision distance threshold.

Specifically, a position of the target interaction object may be determined, and a distance value corresponding to a pixel point at the position in the directed distance field image is taken as a minimum distance between the target fluid element and the first interaction object of the scene.

For example, the minimum relative distance may be compared with a preset collision distance threshold, and if the minimum relative distance is less than or equal to the collision distance threshold, it is determined that the scene target element collides with the weather presentation element; and if the minimum relative distance is greater than the collision distance threshold, determining that the scene target element and the weather display element do not collide.

The preset collision distance threshold may be set with reference to the normalized directional distance field image, or may be set according to an empirical value, for example, the collision distance threshold may be set to 0.5.

And S340, if so, updating the binarized image according to the position information and the radius information of the target interaction object so as to generate a fluid channel in the first interaction body of the scene.

Specifically, if the target interactive object collides with the first interactive object of the scene, the binarized image is updated according to the position information and the radius information of the target interactive object. Optionally, determining a target action area of the target interaction object in the first interaction body of the scene according to the position information and the radius information of the target interaction object, and changing the pixel value corresponding to each pixel point in the target action area into the pixel value corresponding to the fluid channel.

The target interaction zone may be understood as the collision zone of the target interaction object and the first interaction object of the scene. Specifically, the target action area may be a boundary point with a coordinate value corresponding to the position information of the target interaction object as a center point and a point with a distance from the center point in a direction perpendicular to the movement direction of the target interaction object as radius information as a boundary point.

Optionally, after generating the fluid channel in the first interaction body of the scene, the method further comprises: corroding the updated binarized image to obtain a scene corrosion image; and performing expansion processing on the scene corrosion image to obtain a target scene image, and updating the fluid channel into the fluid channel in the target scene image. The advantage of setting up like this is that can make fluid channel more smooth in visual display effect for follow-up operation is succinct more, promotes image processing efficiency when promoting image display effect.

The updated binary image is corroded, and the purpose is to corrode redundant edges by performing convolution operation according to a preset convolution check. For example, each pixel point in the updated binary image is traversed by the convolution kernel, and when traversing to a certain pixel point, if all surrounding pixel points of the pixel point taking the kernel as a unit are white, the color of the pixel point remains unchanged and remains white; if this pixel point has a black point within the range of the kernel, this point is set to black.

The expansion processing and the corrosion processing of the scene corrosion image are opposite, and the situation that pixel values are added to the edge of the scene corrosion image can be understood, so that the whole pixel values are expanded, and the expansion effect of the image is achieved. Visually, dilation is an operation of "lengthening" or "thickening" in a binarized image. Specifically, the dilation kernel is convolved with the scene erosion image, i.e., the maximum value of the pixel points of the coverage area of the dilation kernel is calculated, and the maximum value is assigned to the pixel specified by the reference point, so that the highlight area in the image is gradually increased, and the image dilation is realized.

For example, when the target interactive object is a face part, the position information of the target interactive object may be implemented based on a face detection technique. Alternatively, the position information of the target interaction object may be determined from the position information of the key points corresponding to the respective face parts noted in the standard face image. Specifically, an interaction face image corresponding to the target interaction object may be collected, the interaction face image is aligned with the standard face image, and then position information of a key point corresponding to the target interaction object, which is marked in the standard face image, is used as position information of the target interaction object.

S350, determining a second display mode of the target fluid element according to the fluid channel, and displaying the target fluid element in the second display mode.

Optionally, determining fluid collision information of the target fluid element and the first interaction object of the scene according to the directed distance field image; and determining a second display mode of the target fluid element according to the fluid collision information, wherein the second display mode is a current display mode for displaying the target fluid element or the target fluid element along the fluid channel.

The fluid collision information may include, but is not limited to, at least one of collision position information, a movement direction, and pre-collision velocity information of the target fluid element. The fluid collision information may also include scene constraints, such as gravity information of the target fluid element, and friction coefficients of the first interactive object of the scene, etc. The scene constraint conditions may be set according to actual situations, and are not particularly limited herein. The determining of the second display mode of the target fluid element according to the fluid collision information may specifically include updating the fluid motion information of the target fluid element in the next image frame according to the fluid motion information of the target fluid element in the current image frame and the scene constraint condition.

On the basis of each optional scheme in the embodiment of the disclosure, the image processing method further comprises the following steps: when fixed obstacles except for the first interaction main body of the scene exist in the special effect scene image, binarizing the special effect scene image according to the fixed obstacles, and calculating a directed distance field image of the binarized special effect scene image so as to determine whether the target fluid element collides with the fixed obstacles according to the obtained distance field image and the position information of the target fluid element. If so, determining the display mode of the target fluid element according to the collision information of the target fluid element and the fixed obstacle.

On the basis of each optional embodiment of the embodiments of the disclosure, optionally, the image processing method may further include: combining the binarized images of the special effect scene image and the directed distance field image to obtain a four-channel target texture image corresponding to the special effect scene image; the special effect scene image comprises a scene obstacle main body, a scene second interaction main body and a scene third interaction main body, wherein the scene first interaction main body comprises the scene first interaction main body, the image information of the scene first interaction main body is stored in a channel, the image information of the scene second interaction main body and the scene third interaction main body comprises the image information of each pixel point in the directed distance field image is stored in a channel. The method has the advantages that when related information is acquired, only one target texture map is needed to be loaded, multiple texture maps are not needed to be loaded respectively, data reading efficiency is improved, and therefore interactive operation can be responded quickly.

Specifically, a directed distance field map, a special effect scene image (including deformable collision volume information capable of interacting with a target interaction object, namely a scene first interaction object, and fixed obstacle information incapable of interacting with the target interaction object), and an image containing target detection position information (a scene second interaction object and the scene third interaction object) are combined into one texture map as a target texture map.

It should be noted that, the binary images may be determined according to the first interaction subject of the specific scene image and the fixed obstacle information that cannot interact with the target interaction object, so that the image information corresponding to the two binary images is written into different channels.

According to the technical scheme, whether the target interaction object collides with the first interaction object of the scene or not is determined rapidly by determining the directed distance field image of the special effect scene image according to the first interaction subject of the scene and further determining whether the target interaction object collides with the first interaction object of the scene or not according to the directed distance field image. After the target interaction object collides with the first interaction object of the scene, the binarization image is updated according to the position information and the radius information of the target interaction object so as to generate a fluid channel in the first interaction body of the scene, so that the interaction effect between the target interaction object and the first interaction object of the scene can be fully displayed, a user has substitution sense, and the user experience is improved.

Example IV

FIG. 4 is a schematic view showing the effects of soil and water removal of a fluid delivery effect according to an embodiment of the present disclosure; fig. 5 is a flowchart of an alternative interaction example of an image processing method according to an embodiment of the disclosure. As an alternative example of the above embodiment, assume that the target fluid element is water, the scene special effect image is an image containing soil and a building, wherein the soil is the first interaction object of the scene, and the building is a fixed obstacle. The target interactive object is the nose of the target user who uses the fluid to deliver the special effects.

As shown in fig. 4, as the nose of the target user moves in the display area of the earth, a fluid channel is generated so that water can flow along the fluid channel. Wherein, the small star is the second interaction element of the scene, and when water flows through the small star, the small star is displayed at the upper right corner for representing the completion status of the special effect. The small bottle with the duckling at the lower right corner can be used as a third interaction object of a scene, and when water flows into the small bottle or the water level in the small bottle reaches a preset water level, the fluid delivery is determined to be successful, and a word such as 'challenge success' can be displayed at the moment to remind a user of the fluid delivery state.

As shown in fig. 5, the specific implementation procedure may include:

before the interaction starts, interactive mode guiding information is displayed, for example, an operation demonstration animation of a hand-shaped icon which strokes from top to bottom or a demonstration animation of nasal tip earth is displayed;

the "start" button is in effect, i.e. interaction may be started by triggering the "start" button, wherein the "start" button is in effect may be the presentation "start" button, or the presentation state of the "start" button will be switched, indicating that the "start" button has been activated;

if yes, playing the sequence frame in the appointed area, and guiding the user to start from the appointed area;

judging whether the nose reaches a designated area, if so, responding to the input interactive operation based on the image processing method, and if not, returning to execute the operation of playing the sequence frame in the designated area;

judging whether the fluid is within a preset interaction time threshold range, if so, judging whether water flows to a target end position, such as a small bottle with a small duck in fig. 4, if not, ending interaction, and displaying a prompt message of fluid delivery failure, such as a word of 'challenge failure' and/or displaying a small duck rescue failure animation;

If not, judging whether water flows to the small star score points, if so, adding the small star score in the upper right corner; if not, returning to execute the operation of the interactive operation based on the response input of the image processing method;

if so, determining that the fluid delivery is successful, and displaying prompt information of the fluid delivery success, for example, displaying a word of 'challenge success', displaying animation of successful rescue of the duckling, and/or displaying user delivery completion level information according to the score of the star.

When the remaining interaction time is detected to reach the preset remaining time threshold, the remaining time prompt information is displayed, for example, a prompt can be given when the interaction time is 5 seconds left, so as to increase interaction urgency.

According to the technical scheme, multi-element interaction processing in the image is achieved, the whole interaction flow is perfected, and the interaction experience of a user is improved.

Example five

Fig. 6 is a schematic structural diagram of an image processing apparatus according to a fifth embodiment of the present disclosure, where the image processing apparatus according to the present embodiment may be implemented by software and/or hardware, and may be configured in a terminal and/or a server to implement an image processing method according to an embodiment of the present disclosure. The device specifically can include: a scene image presentation module 610, a fluid channel generation module 620, and a fluid element presentation module 630.

The scene image display module 610 is configured to display a special effect scene image corresponding to a special effect of fluid delivery when a preset special effect triggering operation for enabling the special effect of fluid delivery is received, and display a target fluid element corresponding to the special effect of fluid delivery in a first display manner, where the special effect scene image includes a scene first interaction body; a fluid channel generating module 620, configured to generate a fluid channel in the first interaction body of the scene according to the motion information of the target interaction object when detecting that the target interaction object moves relative to the first interaction body of the scene; and the fluid element display module 630 is configured to determine a second display manner of the target fluid element according to the fluid channel, and display the target fluid element in the second display manner.

According to the technical scheme, when a preset special effect triggering operation for starting a fluid delivery special effect is received through the scene image display module, a special effect scene image corresponding to the fluid delivery special effect is displayed, the special effect scene image comprises a scene first interaction main body, a basic interaction scene is provided for a user, a target fluid element corresponding to the fluid delivery special effect is displayed in a first display mode, an initial scene of fluid delivery is displayed, further, when the relative motion between a target interaction object and the scene first interaction main body is detected through the fluid channel generation module, a fluid channel is generated in the scene first interaction main body according to the motion information of the target interaction object, interaction between the target interaction object and the scene first interaction main body is realized, the display form of the scene first interaction main body is changed through the motion information of the target interaction object, the fluid channel is generated, further, the target fluid element is displayed in the second display mode according to the fluid channel, the relationship between the display mode of the target fluid element and the interaction action of the target interaction object is built, the problem that the interaction is poor in interaction performance, the interaction performance is displayed in the short video mode, the interaction performance is lack of the interaction is improved, the interaction effect is improved, the user is simulated, and the fluid is delivered.

Optionally, on the basis of any optional technical solution of the embodiments of the present disclosure, the special effect scene image includes a scene second interaction body, and the apparatus may further include:

and the first main body display module is used for changing the second interaction main body of the scene from the first display position to the second display position to display when the target fluid element is detected to flow through the second interaction main body of the scene.

Optionally, on the basis of any optional technical solution of the embodiments of the present disclosure, the special effect scene image includes a third interaction subject of a scene, and the apparatus may further include:

and the second main body display module is used for switching the third interaction main body of the scene from the first display state to the second display state to display when the target fluid element is detected to flow to the third interaction main body of the scene.

On the basis of any optional technical scheme of the embodiments of the disclosure, optionally, the apparatus further includes:

and the prompt information display module is used for displaying interactive prompt information corresponding to the fluid conveying special effect.

Optionally, on the basis of any optional technical solution of the embodiments of the present disclosure, the prompt information display module is configured to perform at least one of the following operations:

Optionally, on the basis of any optional technical solution of the embodiments of the present disclosure, the detecting that the interaction end condition is reached includes at least one of the following:

detecting delivery of the target fluid element to a target end position;

Optionally, on the basis of any optional technical solution of the embodiments of the present disclosure, the target interaction object includes a face portion or a limb portion, where the face portion includes a forehead, a nose, a mouth, a cheek, an eye, a tongue, or a chin; the limb portion includes a shoulder, a finger, an elbow, an arm, a leg, or a toe.

Optionally, on the basis of any optional technical solution of the embodiments of the present disclosure, the motion information includes position information and radius information; the fluid channel generation module may include: a distance field image determining unit, a collision judging unit, and a channel generating unit.

The distance field image determining unit is used for determining a binarized image of the special effect scene image according to the scene first interaction main body and determining a directed distance field image of the special effect scene image according to the binarized image; a collision judging unit, configured to determine whether the target interaction object collides with the first interaction object of the scene according to the directed distance field image; and the channel generating unit is used for updating the binary image according to the position information and the radius information of the target interaction object if the target interaction object is in the first interaction body of the scene so as to generate a fluid channel.

On the basis of any optional technical solution of the embodiments of the present disclosure, optionally, the channel generating unit is configured to:

and determining a target action area of the target interaction object in the first interaction main body of the scene according to the position information and the radius information of the target interaction object, and changing the pixel value corresponding to each pixel point in the target action area into the pixel value corresponding to the fluid channel.

On the basis of any optional technical scheme of the embodiments of the disclosure, optionally, the apparatus further includes: an image erosion module and an image dilation module.

The image corrosion module is used for carrying out corrosion treatment on the updated binary image after generating a fluid channel in the first interaction main body of the scene to obtain a scene corrosion image; and the image expansion module is used for carrying out expansion processing on the scene corrosion image to obtain a target scene image, and updating the fluid channel into the fluid channel in the target scene image.

On the basis of any optional technical scheme of the embodiments of the disclosure, optionally, the apparatus further includes: the system comprises a collision information determining module and a display mode determining module.

The collision information determining module is used for determining fluid collision information of the target fluid element and the first interaction object of the scene according to the directed distance field image; and the display mode determining module is used for determining a second display mode of the target fluid element according to the fluid collision information, wherein the second display mode is a current display mode for displaying the target fluid element or the target fluid element along the fluid channel.

The texture map synthesis module is used for merging the binarized image of the special effect scene image and the directed distance field map to obtain a four-channel target texture map corresponding to the special effect scene image; the special effect scene image comprises a scene obstacle main body, a scene second interaction main body and a scene third interaction main body, wherein the scene first interaction main body comprises the scene first interaction main body, the image information of the scene first interaction main body is stored in a channel, the image information of the scene second interaction main body and the scene third interaction main body comprises the image information of each pixel point in the directed distance field image is stored in a channel.

And when the switched image frames reach a preset first image frame number threshold value, acquiring the motion information of the target interactive object.

On the basis of any optional technical scheme of the embodiments of the disclosure, optionally, the apparatus further includes: a detection position determination module and a fluid position detection module.

The detection position determining module is used for determining a target detection position in the special effect scene image; and the fluid position detection module is used for detecting whether the target fluid element is conveyed to the target position or not according to the color value of the pixel point corresponding to the target detection position.

Optionally, on the basis of any optional technical solution of the embodiments of the present disclosure, the fluid position detection module is specifically configured to:

and detecting whether the target fluid element is conveyed to the target position or not according to the color value of the pixel point corresponding to the target detection position when the switched image frame reaches the preset second image frame number threshold value.

The image processing device can execute the image processing method provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of executing the image processing method.

It should be noted that each unit and module included in the image processing apparatus are only divided according to the functional logic, but are not limited to the above-described division, as long as the corresponding functions can be realized; in addition, the specific names of the functional units are also only for convenience of distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

Example six

Fig. 7 is a schematic structural diagram of an electronic device according to a seventh embodiment of the disclosure. Referring now to fig. 7, a schematic diagram of an electronic device (e.g., a terminal device or server in fig. 7) 700 suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 7 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 7, the electronic device 700 may include a processing means (e.g., a central processor, a graphics processor, etc.) 701, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 702 or a program loaded from a storage means 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the electronic device 700 are also stored. The processing device 701, the ROM 702, and the RAM 703 are connected to each other through a bus 705. An edit/output (I/O) interface 704 is also connected to bus 705.

In general, the following devices may be connected to the I/O interface 704: input devices 706 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 707 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 708 including, for example, magnetic tape, hard disk, etc.; and a communication device 709. The communication means 709 may allow the electronic device 700 to communicate wirelessly or by wire with other devices to exchange data. While fig. 7 shows an electronic device 700 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via communication device 709, or installed from storage 708, or installed from ROM 702. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 701.

The electronic device provided by the embodiment of the present disclosure and the image processing method provided by the foregoing embodiment belong to the same inventive concept, and technical details not described in detail in the present embodiment can be referred to the foregoing embodiment, and the present embodiment has the same beneficial effects as the foregoing embodiment.

Example seven

The present disclosure provides a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the image processing method provided by the above embodiments.

It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The name of the unit does not in any way constitute a limitation of the unit itself, for example the first acquisition unit may also be described as "unit acquiring at least two internet protocol addresses".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, there is provided an image processing method, the method including:

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example two ], the method further comprising:

optionally, the special effect scene image includes a scene second interaction body, and the method further includes:

and when the target fluid element is detected to flow through the second interaction body of the scene, the second interaction body of the scene is transformed from the first display position to the second display position for display.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example three ], the method further comprising:

optionally, the special effects scene image includes a third interaction body of the scene, the method further comprising:

and when the target fluid element is detected to flow to the third interaction body of the scene, switching the third interaction body of the scene from the first display state to the second display state for display.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example four ], the method further comprising:

optionally, displaying interactive prompt information corresponding to the fluid delivery special effect.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example five ], the method further comprising:

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example six ], the method further comprising:

detecting delivery of the target fluid element to a target end position;

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example seventh ], the method further comprising:

optionally, the target interactive object comprises a facial part or a limb part, wherein the facial part comprises a forehead, a nose, a mouth, cheeks, eyes, a tongue or a chin; the limb portion includes a shoulder, a finger, an elbow, an arm, a leg, or a toe.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example eight ], the method further comprising:

optionally, the motion information includes position information and radius information; the generating a fluid channel in the first interaction body of the scene according to the motion information of the target interaction object comprises the following steps:

Determining a binarized image of the special effect scene image according to the first interaction subject of the scene, and determining a directed distance field image of the special effect scene image according to the binarized image;

determining whether the target interaction object collides with the first interaction object of the scene according to the directed distance field image;

if so, updating the binarized image according to the position information and the radius information of the target interaction object so as to generate a fluid channel in the first interaction body of the scene.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example nine ], the method further comprising:

optionally, the updating the binarized image according to the position information and the radius information of the target interactive object includes:

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example ten ], the method further comprising:

Optionally, after the generating the fluid channel in the first interaction body of the scene, the method further includes:

corroding the updated binarized image to obtain a scene corrosion image;

and performing expansion processing on the scene corrosion image to obtain a target scene image, and updating the fluid channel into the fluid channel in the target scene image.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example eleven ], the method further comprising:

optionally, determining fluid collision information of the target fluid element and the first interaction object of the scene according to the directed distance field image;

and determining a second display mode of the target fluid element according to the fluid collision information, wherein the second display mode is a current display mode for displaying the target fluid element or the target fluid element along the fluid channel.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example twelve ], the method further comprising:

optionally, combining the binarized image of the special effect scene image and the directed distance field image to obtain a four-channel target texture image corresponding to the special effect scene image;

The special effect scene image comprises a scene obstacle main body, a scene second interaction main body and a scene third interaction main body, wherein the scene first interaction main body comprises the scene first interaction main body, the image information of the scene first interaction main body is stored in a channel, the image information of the scene second interaction main body and the scene third interaction main body comprises the image information of each pixel point in the directed distance field image is stored in a channel.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example thirteenth ], the method further comprising:

optionally, when the switched image frames are detected to reach a preset first image frame number threshold, motion information of the target interactive object is acquired.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example fourteen ], the method further comprising:

optionally, determining a target detection position in the special effect scene image;

and detecting whether the target fluid element is conveyed to the target position or not according to the color value of the pixel point corresponding to the target detection position.

According to one or more embodiments of the present disclosure, there is provided an image processing method [ example fifteen ], the method further comprising:

Optionally, the detecting whether the target fluid element is delivered to the target position according to the color value of the pixel point corresponding to the target detection position includes:

According to one or more embodiments of the present disclosure, there is provided an element presentation apparatus [ example sixteen ], the apparatus comprising:

The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).

Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims

1. An image processing method, comprising:

when detecting that a target interaction object and the first interaction body of the scene relatively move, generating a fluid channel in the first interaction body of the scene according to the movement information of the target interaction object, wherein the movement information comprises position information and radius information;

determining a second display mode of the target fluid element according to the fluid channel, and displaying the target fluid element in the second display mode;

The generating a fluid channel in the first interaction body of the scene according to the motion information of the target interaction object comprises the following steps:

2. The method of claim 1, wherein the special effects scene image includes a scene second interactive body, the method further comprising:

3. The method of claim 1, wherein the special effects scene image includes a scene third interactive body, the method further comprising:

4. The method as recited in claim 1, further comprising:

and displaying interaction prompt information corresponding to the fluid conveying special effect.

5. The method of claim 4, wherein the presenting interactive cues corresponding to the fluid delivery special effects comprises at least one of:

6. The method of claim 5, wherein the detecting that an interaction end condition is reached comprises at least one of:

Detecting delivery of the target fluid element to a target end position;

7. The method of claim 1, wherein the target interactive object comprises a facial portion or a limb portion, wherein the facial portion comprises a forehead, nose, mouth, cheek, eye, tongue, or chin; the limb portion includes a shoulder, a finger, an elbow, an arm, a leg, or a toe.

8. The method of claim 1, wherein updating the binary image based on the location information and the radius information of the target interactive object comprises:

9. The method of claim 1, further comprising, after the generating a fluid channel in the first interactive body of the scene:

corroding the updated binarized image to obtain a scene corrosion image;

10. The method as recited in claim 1, further comprising:

determining fluid collision information of the target fluid element and the first interaction object of the scene according to the directed distance field image;

11. The method as recited in claim 1, further comprising:

combining the binarized images of the special effect scene image and the directed distance field image to obtain a four-channel target texture image corresponding to the special effect scene image;

12. The method as recited in claim 1, further comprising:

13. The method as recited in claim 1, further comprising:

determining a target detection position in the special effect scene image;

14. The method of claim 13, wherein detecting whether the target fluid element is delivered to the target location based on the color value of the pixel corresponding to the target detection location comprises:

15. An image processing apparatus, comprising:

The fluid channel generation module is used for generating a fluid channel in the first interaction body of the scene according to the motion information of the target interaction object when the relative motion between the target interaction object and the first interaction body of the scene is detected, wherein the motion information comprises position information and radius information;

the fluid element display module is used for determining a second display mode of the target fluid element according to the fluid channel, and displaying the target fluid element in the second display mode;

the fluid channel generation module includes: a distance field image determining unit, a collision judging unit, and a channel generating unit;

the distance field image determining unit is used for determining a binarized image of the special effect scene image according to the first interaction subject of the scene and determining a directed distance field image of the special effect scene image according to the binarized image;

the collision judging unit is used for determining whether the target interaction object collides with the first interaction object of the scene according to the directed distance field image;

and the channel generating unit is used for updating the binary image according to the position information and the radius information of the target interaction object if the target interaction object is in the first interaction body of the scene so as to generate a fluid channel.

16. An electronic device, the electronic device comprising:

one or more processors;

storage means for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the image processing method of any of claims 1-14.

17. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the image processing method as claimed in any one of claims 1-14.