CN115359167A

CN115359167A - Target material manufacturing method and device and electronic equipment

Info

Publication number: CN115359167A
Application number: CN202210800734.2A
Authority: CN
Inventors: 陈天成
Original assignee: Netease Hangzhou Network Co Ltd
Current assignee: Netease Hangzhou Network Co Ltd
Priority date: 2022-07-06
Filing date: 2022-07-06
Publication date: 2022-11-18

Abstract

The application provides a manufacturing method and device of a target material and electronic equipment, and relates to the technical field of holographic projection. The method comprises the step of manufacturing a PBR material according to a first display effect, wherein the PBR material comprises a plurality of PBR material nodes, and the PBR material nodes are used for controlling the output of the stainer. The output of the stainer is used to determine the display effect of the screen pixels. And establishing a holographic material node according to a second display effect, wherein the second display effect is a holographic grid projection special effect. And adding holographic material nodes in the PBR material to obtain the target material. Wherein, the holographic material node is used for controlling the output of the stainer. The target material is then assigned to the object to be exposed. Therefore, when the object is displayed, the nodes of the target material can be controlled to switch from the PBR material to the holographic material, so that different display effects are presented.

Description

Target material manufacturing method and device and electronic equipment

Technical Field

The present disclosure relates to the field of holographic projection technologies, and in particular, to a method and an apparatus for manufacturing a target material, and an electronic device.

Background

The holographic projection technology is also called virtual imaging technology, belongs to one of 3D technologies, and refers to a technology for recording and reproducing a real three-dimensional image of an object by using the principles of interference and diffraction. The holographic technology can record all information of the amplitude and phase of the object light wave, so that the reconstructed virtual images of the object at multiple angles can be restored. The hologram thus obtained has a viewing effect and a depth of field sensation, and the user can see different sides of the object from the hologram.

In the holographic projection technology, different display effects of the holographic image are generally controlled by using different materials. The PBR material is a material rendered based on physical properties. The material can process the shot object image according to the visual property of the object, and then display the obtained image result. The visual properties include, among others, color, texture, smoothness, transparency, reflectivity, refractive index, luminosity, etc. of the surface of the object. It can be understood that in many movie or game scenes, the pictures often need to be switched between different presentation effects to improve the richness of the pictures.

At present, a plurality of materials are designed based on a holographic picture, then a transition function is customized to switch a plurality of special-effect materials, and the holographic picture presents different effects by using different materials. It can be understood that, to blend multiple materials in the processing algorithm of the hologram and to include a specific program script for switching the transition, the complexity of the processing algorithm will be greatly increased. Meanwhile, the display effects of different materials interfere with each other, and the picture display effect and performance are affected. Therefore, how to realize the natural transition of the holographic image between different presentation effects and improve the display effect of the holographic projection becomes an urgent problem to be solved.

Disclosure of Invention

In view of this, the present application provides a method and an apparatus for manufacturing a target material, and an electronic device. Firstly, the PBR material is manufactured according to the first display effect, and then holographic material nodes are added into the PBR material according to the second display effect, so that the target material is obtained. The target material is then assigned to the object to be exposed. Therefore, when the object is displayed, the nodes of the target material can be controlled to switch from the PBR material to the holographic material, so that different display effects are presented.

A first aspect of the embodiments of the present application provides a method for manufacturing a target material, where the method includes:

and manufacturing the PBR material according to the first display effect. The PBR material comprises a plurality of PBR material nodes, the PBR material nodes are used for controlling the output of the stainer, and the output of the stainer is used for determining the display effect of the screen pixel points.

And establishing a holographic material node according to a second display effect, wherein the second display effect is a holographic grid projection special effect.

And adding holographic material nodes in the PBR material to obtain the target material. Wherein, the holographic material node is used for controlling the output of the stainer.

In an alternative embodiment, the stainer includes a light emitting node, and the holographic material node is established according to the second display effect, including:

and calculating world coordinates of the screen pixel points.

And determining pixel points to be lighted which form the holographic grid in the screen pixel points according to the second display effect and the world coordinates of the screen pixel points.

And determining the holographic material node according to the pixel point to be emitted. The holographic material node is connected with the light-emitting node and used for indicating the light-emitting node to control the pixel point to be emitted to emit light.

In an alternative embodiment, the holographic material node comprises one or more of: a first control node, a second control node, a third control node, and a fourth control node.

The first control node is used for controlling the size of the holographic grid.

The second control node is used for controlling the grid thickness of the holographic grid.

The third control node is used for controlling the grid luminous intensity of the holographic grid.

The fourth control node is used for controlling the grid color of the holographic grid.

In an alternative embodiment, calculating world coordinates of screen pixel points includes:

and acquiring the screen position coordinates of the screen pixel points.

And determining the depth distance of the screen pixel points according to the screen position coordinates of the screen pixel points.

And determining a three-dimensional control vector corresponding to the screen pixel point according to the screen position coordinate and the depth distance of the screen pixel point.

And determining the world coordinates of the screen pixel points according to the world coordinates and the three-dimensional control vectors of the virtual cameras.

In an optional embodiment, the method further comprises:

and establishing a hidden control node according to the world coordinate of the screen pixel point and the PBR material node, wherein the hidden control node is used for displaying the hidden holographic grid.

In an optional embodiment, the method further comprises:

and determining a three-dimensional vector according to the world coordinates of the screen pixel points and the world coordinates of the virtual camera.

And determining the brightness value of the Fresnel effect according to the three-dimensional vector.

And determining a Fresnel effect node according to the brightness value of the Fresnel effect, wherein the Fresnel effect node corresponds to a Fresnel effect node parameter.

And connecting the Fresnel effect node with the luminous node.

In an alternative embodiment, the method further comprises:

and establishing a first light breathing fluctuation node, a second light breathing fluctuation node and/or a third light breathing fluctuation node according to the world coordinates of the screen pixel points.

And respectively connecting the first light breathing fluctuation node, the second light breathing fluctuation node and/or the third light breathing fluctuation node with the light-emitting node.

The first light breathing fluctuation node is used for controlling the shape of pulses in light breathing fluctuation. And the second light breathing fluctuation node is used for controlling the frequency of pulses in the light breathing fluctuation. And the third light breathing fluctuation node is used for controlling the brightness value of light in the light breathing fluctuation.

In an optional embodiment, the method further comprises:

and determining edge pixel points according to the world coordinates of the screen pixel points.

And establishing a delineation node according to the edge pixel point.

And connecting the stroke nodes with the luminous nodes.

In an alternative embodiment, the method further comprises:

and establishing a display model according to the display object.

And adding the target material to the display model, and displaying the display object according to the target material.

In an optional embodiment, the method further comprises:

and connecting the hidden control node with the luminous node.

And displaying the display object according to the connected target material. And the display object displayed by the target material corresponds to the PBR material.

A second aspect of the embodiments of the present application provides a device for manufacturing a target material, the device including:

and the manufacturing unit is used for manufacturing the PBR material according to the first display effect. The PBR material comprises a plurality of PBR material nodes, and the PBR material nodes are used for controlling the output of the stainer. The output of the stainer is used to determine the display effect of the screen pixels.

And the establishing unit is used for establishing the holographic material node according to the second display effect. The second display effect is a holographic grid projection special effect.

And the processing unit is used for adding the holographic material node in the PBR material to obtain the target material. Wherein, the holographic material node is used for controlling the output of the stainer.

In an alternative embodiment, the stainer comprises a light emitting node, and the building unit is specifically used for calculating the world coordinates of the screen pixel points. And determining pixel points to be lighted which form the holographic grid in the screen pixel points according to the second display effect and the world coordinates of the screen pixel points. And determining the holographic material node according to the pixel point to be emitted. The holographic material node is connected with the light-emitting node and used for indicating the light-emitting node to control the pixel point to be emitted to emit light.

In an alternative embodiment, the production device further comprises an acquisition unit.

And the acquisition unit is used for acquiring the screen position coordinates of the screen pixel points.

And the establishing unit is specifically used for determining the depth distance of the screen pixel point according to the screen position coordinate of the screen pixel point. And determining a three-dimensional control vector corresponding to the screen pixel point according to the screen position coordinate and the depth distance of the screen pixel point. And determining the world coordinates of the screen pixel points according to the world coordinates and the three-dimensional control vectors of the virtual camera.

In an optional embodiment, the establishing unit is further configured to establish a hidden control node according to the world coordinate of the screen pixel and the PBR material node, where the hidden control node is used to hide display of the holographic grid.

In an optional embodiment, the processing unit is further configured to determine a three-dimensional vector according to the world coordinates of the screen pixel points and the world coordinates of the virtual camera. And determining the brightness value of the Fresnel effect according to the three-dimensional vector. And determining a Fresnel effect node according to the brightness value of the Fresnel effect, wherein the Fresnel effect node corresponds to a Fresnel effect node parameter. And connecting the Fresnel effect node with the luminous node.

In an optional embodiment, the establishing unit is further configured to establish a first lighting breathing fluctuation node, a second lighting breathing fluctuation node, and/or a third lighting breathing fluctuation node according to the world coordinates of the screen pixel points. And respectively connecting the first light breathing fluctuation node, the second light breathing fluctuation node and/or the third light breathing fluctuation node with the light-emitting node.

In an optional embodiment, the processing unit is further configured to determine edge pixel points according to world coordinates of the screen pixel points. And establishing a delineation node according to the edge pixel point. And connecting the stroke nodes with the luminous nodes.

In an optional embodiment, the building unit is further configured to build a display model according to the display object.

And the processing unit is also used for adding the target material to the display model and displaying the display object according to the target material.

In an optional embodiment, the processing unit is further configured to connect the hidden control node with the light emitting node. And displaying the display object according to the connected target material. And the display object displayed by the target material corresponds to the PBR material.

A third aspect of embodiments of the present application further provides an electronic device, including: a memory and a processor, the memory and the processor being coupled.

Wherein the memory is configured to store one or more computer instructions.

The processor is configured to execute one or more computer instructions to implement the method for manufacturing a target material according to the first aspect.

A fourth aspect of the present embodiment further provides a computer-readable storage medium, on which one or more computer instructions are stored, where the computer instructions are executed by a processor to implement the method for manufacturing a target material according to any one of the above technical solutions.

According to the technical scheme provided by the embodiment of the application, the PBR material is firstly established according to the planned first picture display effect. And then adding holographic material nodes on the PBR material according to the planned second picture display effect. Thus, the target material with both PBR material nodes and holographic material nodes can be obtained. The PBR material nodes and the holographic material nodes have independent functions and jointly control the output result of the stainer aiming at the picture pixel points, thereby controlling the display effect of the picture pixel points. Therefore, when the holographic image needs to realize different display effects, the target material is firstly endowed to the display object, and then various outputs of the stainer are determined by controlling the control states of the PBR material nodes and the holographic material nodes, so that the display effect of the display object corresponding to the holographic material is switched from the display effect corresponding to the PBR material.

According to the embodiment of the application, the material nodes corresponding to the holographic material are added on the original PBR material, so that the composite material capable of presenting multiple display effects is obtained. The output of the stainer is controlled by using different material nodes with independent functions, so that the holographic image is switched from one display special effect to another display special effect. The nodes of all the materials have independent functions, and the effects of the two materials cannot interfere with each other, so that the special display effect performance of the holographic projection is greatly improved. And the holographic material node is added in the original PBR material as a whole, so that the picture display effect can be controlled only by controlling the output aimed by the holographic material node. Therefore, the switching difficulty of the display effect is reduced, and the switching flexibility of the display effect is greatly enhanced. Meanwhile, the target material is usually added in front of the virtual camera lens, so that the normal luminescence of the holographic image can be ensured, and the display performance of the target object is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.

FIG. 1 is a schematic diagram illustrating an effect of a holographic material according to an embodiment of the present disclosure;

FIG. 2 is a schematic flow chart illustrating a method for fabricating a target material according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a method for establishing a holographic material node according to an embodiment of the present disclosure;

fig. 4 is a schematic flowchart of a method for displaying a holographic image according to an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of an apparatus for creating a target material according to an embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The embodiment of the application provides a manufacturing method and device of a target material and electronic equipment. Firstly, the PBR material is manufactured according to the first display effect, and then holographic material nodes are added into the PBR material according to the second display effect, so that the target material is obtained. The target material is then assigned to the object to be exposed. Therefore, when the object is displayed, the nodes of the target material can be controlled to switch from the PBR material to the holographic material, so that different display effects are presented.

In order to enable those skilled in the art to better understand the technical solution of the present application, the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. This application is capable of embodiments in many different forms than those described above and it is therefore intended that all such other embodiments, which would be within the scope of the present application and which are obtained by a person of ordinary skill in the art based on the embodiments provided herein without the exercise of inventive faculty, be covered by the present application.

It should be noted that the terms "first," "second," "third," and the like in the claims, the description, and the drawings of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. The data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or otherwise described herein. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The holographic projection technology is also called virtual imaging technology, belongs to a 3D technology, and refers to a technology for recording and reproducing a real three-dimensional image of an object by using interference and diffraction principles. The holographic technology can record all information of the amplitude and phase of the object light wave, so that the reconstructed virtual images of the object at multiple angles can be restored. The holographic image obtained by utilizing the holographic projection technology has a visual effect and a depth of field sense, and a user can see different side surfaces of an object from the holographic image.

In the field of holographic projection, different materials are generally used to achieve different display effects of holographic images. Different materials correspond to different image processing methods and image rendering modes. The PBR material is a material rendered based on physical properties. The material can process the shot object image according to the visual property of the object, and then display the obtained image result. The visual properties include, among others, color, texture, smoothness, transparency, reflectivity, refractive index, luminosity of the object surface.

The holographic material is a material rendered by using holographic lines. The holographic line refers to a line that flows up and down layer by layer in the holographic projection itself, and may be, for example, a luminous grid or a luminous stripe. Fig. 1 is a schematic diagram illustrating an effect of a holographic material according to an embodiment of the present disclosure. Wherein a grid of light emissions is present at some specific pixel locations. Wherein, the position, the size, the luminous intensity, the luminous color and the like of the grid can be adjusted and controlled.

It can be understood that the holographic image in the PBR material is closer to the real appearance of the real object, and the holographic image in the holographic material describes and renders an object by using the luminous holographic lines. In actual movie or game scenes, the projection images are often required to present different display effects. At this time, switching between different materials is required.

Currently, the following methods are generally adopted to change the display effect of the holographic image:

the first is to design a mixed material for the same holographic picture, i.e. multiple materials are fused in the image processing algorithm corresponding to the holographic picture, and a transition function is further customized in the image processing algorithm to switch between multiple display effects. When the holographic picture needs to be transited from the first display effect to the second display effect, the server controls the algorithm step corresponding to one material to start running by using the transition function, and the algorithm step corresponding to the other material stops executing. In the method, due to the fact that algorithms corresponding to a plurality of materials are fused with each other and meanwhile specific program scripts for transition switching are included, the complexity of the whole image processing algorithm is greatly increased, and the calculation amount of the image processing algorithm is also greatly increased. Meanwhile, the algorithm steps corresponding to different materials interfere with each other, so that the presentation effect and performance of the holographic picture are influenced.

The second approach is to design multiple materials for multiple objects in the same hologram, where each object is given a different material. And all special-effect materials have the dissolving and switching function. Assume that there are two objects in a holographic picture, the first object corresponding to a first material and the second object corresponding to a second material. Then, when the display effect of the whole hologram needs to be switched, for example, when the hologram needs to be switched from the display effect corresponding to the first material to the display effect corresponding to the second material, it is necessary to control the second object under the second material to be in the display state, and the first object under the first material is dissolved and hidden. It will be appreciated that the final rendered holographic picture will have only the second object, the first object being hidden. In the above method, the first material and the second material are made to be specific to a single object, although functions are independent. Each object still corresponds to only one display effect. Although the holographic picture appears to switch presentation effects, it is not possible for a particular one of the objects to switch from one presentation effect to another.

The third method is to switch the rendering effect by adding a filter. In this method, the material corresponding to the display object is not replaced, but a layer of filter is selected to be superimposed on the original material, so that the final display effect looks like the presentation effect of another material. However, in the Messiah engine, the order of adding filters is fixed and unchangeable. The filter can only be added in post-processing, namely, the server firstly gives the original material to the display object and then superimposes a layer of filter on the obtained holographic image. It can be understood that the filter can only process the whole picture, and the addition of the filter can cause the holographic picture not to emit light.

In view of the above problems, embodiments of the present application provide a method and an apparatus for manufacturing a target material, and an electronic device. According to the embodiment of the application, the PBR material is manufactured according to the first display effect, and then the holographic material node is added into the PBR material according to the second display effect, so that the target material is obtained. The target material is then assigned to the object to be exposed. Therefore, when the object is displayed, the nodes of the target material can be controlled to switch from the PBR material to the holographic material, so that different display effects are presented. The PBR material node and the holographic material node are independent in function and cannot generate interference before each other. Therefore, different display special effects of the holographic image can be obtained only by changing the control states of the nodes made of different materials. The switching difficulty of the display special effect is reduced, and meanwhile, the switching flexibility of the display special effect is greatly enhanced. Meanwhile, the target material is in front of the virtual camera lens, so that the normal luminescence of the holographic image can be ensured. The method, apparatus, terminal, and computer-readable storage medium described in this application are described in further detail below with reference to specific embodiments and accompanying drawings.

Fig. 2 is a schematic flow chart illustrating a method for manufacturing a target material according to an embodiment of the present disclosure. It should be noted that the steps shown in the flowchart may be performed in a computer system such as a set of computer-executable instructions, and in some cases, the steps shown may be performed in a different logical order than that shown in the flowchart.

As shown in fig. 2, the method for manufacturing the target material includes the following steps:

201. and manufacturing the PBR material according to the first display effect.

First, the PBR material needs to be formulated based on specific display requirements. The PBR material is a material rendered based on physical properties. The material can process the shot object image according to the visual property of the object, and then display the obtained image result. The visual properties include, among others, color, texture, smoothness, transparency, reflectivity, refractive index, luminosity, etc. of the surface of the object. The developer can adjust parameters such as color, texture, smoothness, transparency and the like according to the specific display effect of the display object.

In particular, the PBR material may be fabricated according to a programmable rendering pipeline SRP and a visualization Shader tool, sharergraph. Wherein, the ShaderGraph can provide a plurality of material nodes. Including mathematical nodes, input nodes, channel nodes, artistic effect nodes, and the like. These nodes are all used to send control instructions to the stainers. And the stainer determines the state of the picture pixel point according to the control instruction. Wherein, the PBR material comprises a plurality of PBR material nodes. It is understood that the PBR material node may be a range node, a light emitting node, a transparency node, etc. The PBR material nodes are connected with each other to jointly form a PBR material, and the PBR material corresponds to the first display effect.

202. And establishing a holographic material node according to the second display effect.

To switch the display effect, another material is required to be made. In the embodiment of the present application, a developer needs to add an independent holographic material node to an original PBR material according to the second display effect. The types of the holographic material nodes can be coordinate nodes, light-emitting nodes, brightness adjusting nodes, color adjusting nodes and the like. The plurality of holographic material nodes are connected with each other to be used as an integral control stainer, so that the picture is corresponding to the holographic grid projection special effect.

203. And adding holographic material nodes in the PBR material to obtain a target material.

After the holographic material node is established, the holographic material node needs to be added into the original PBR material. The PBR material node is an independent module, and the holographic material node is an independent module. The two modules have independent functions and send control signals to the stainer together. Therefore, when the holographic picture needs to switch the display effect, the target material can be given to the display object. Then, the output of the PBR material node and the output of the holographic material node are controlled, so that the switching of different materials can be realized, and the switching of the display effect can be realized.

According to the technical scheme provided by the embodiment of the application, the PBR material is firstly established according to the planned first picture display effect. And then adding holographic material nodes on the PBR material according to the planned second picture display effect. Thus, the target material with both PBR material nodes and holographic material nodes can be obtained. The PBR material node and the holographic material node have independent functions and jointly control the output result of the stainer aiming at the picture pixel point, thereby controlling the display effect of the picture pixel point. Therefore, when the holographic image needs to realize different display effects, the target material is firstly endowed to the display object, and then various outputs of the stainer are determined by controlling the control states of the PBR material node and the holographic material node, so that the display effect of the display object corresponding to the PBR material is switched to the display effect corresponding to the holographic material.

According to the embodiment of the application, the material nodes corresponding to the holographic material are added on the original PBR material, so that the composite material capable of presenting multiple display effects is obtained. The output of the stainer is controlled by using nodes made of different materials with independent functions, so that the holographic image is switched from one display special effect to another display special effect. The nodes of all the materials are independent in function, and the effects of the two materials cannot interfere with each other, so that the special effect display performance of the holographic projection is greatly improved. And the holographic material node is added in the original PBR material as a whole, so that the picture display effect can be controlled only by controlling the output aimed by the holographic material node. Therefore, the switching flexibility of the display effect is greatly enhanced while the switching difficulty of the display effect is reduced. Meanwhile, the target material is added in front of the virtual camera lens, so that the normal luminescence of the holographic image can be ensured, and the display performance of the target object is improved.

The following describes the process of establishing the holographic material node in detail.

Fig. 3 is a schematic structural diagram of a method for establishing a holographic material node according to an embodiment of the present disclosure. As shown in fig. 3, the establishing method includes:

301. and calculating world coordinates of the screen pixel points.

Before each holographic material is established, the world coordinates of the screen pixel points need to be calculated. And then planning a pixel point range according to the world coordinates of the pixel points, and finally rendering based on the pixel point range. Specifically, the screen position coordinates of the screen pixel points are acquired first, and the depth distance of the screen pixel points is determined according to the screen position coordinates of the screen pixel points. And then determining a three-dimensional control vector corresponding to the screen pixel point according to the screen position coordinate and the depth distance of the screen pixel point. And finally, determining the world coordinates of the screen pixel points according to the world coordinates and the three-dimensional control vectors of the virtual camera.

For example, the server may put the screen position coordinates of the pixel as parameters into a depth function node of the engine to obtain the depth distance of the pixel, then put the depth distance and the screen space coordinates as parameters into a custom node function to calculate a three-dimensional space vector from a camera in a game to the pixel in the game world space, and add the space vector to the world coordinates of the camera to obtain the world space coordinates of the pixel.

302. And determining pixel points to be lighted which form the holographic grid in the screen pixel points according to the second display effect and the world coordinates of the screen pixel points.

Then, the position of the holographic grid needs to be determined according to the planned second display effect and the world coordinates of the screen pixel points, and then the pixel points to be emitted are found according to the position of the holographic grid. Specifically, the server needs to access the calculated world space coordinates of the pixels to the R, G, and B masks respectively to obtain values on the X, Y, and Z axes under the world space coordinates. These values are then modulo divided by a float parameter (named fmod _ value, default 3.3) and the remainder of these three numbers are combined into a three-dimensional number whose xyz values are in the same order as before. Then, according to the three-dimensional book with the luminous pixel points, holographic nodes with luminous grid special effects can be established.

303. And establishing a holographic material node according to the pixel point to be luminous.

The holographic material node comprises at least one control node, the control node is connected with the light emitting node, and the light emitting node is indicated to control the pixel point to be emitted to emit light. The holographic material node may include the following control nodes: the nodes for controlling the size of the holographic mesh, the nodes for controlling the mesh thickness of the holographic mesh, the nodes for controlling the mesh luminous intensity of the holographic mesh, and the nodes for controlling the mesh color of the holographic mesh.

In a specific example, the three-dimensional number may be connected to the ABS node to obtain its absolute value, and then the absolute value is subtracted from the ABS node by a constant 1, and the result is added with a float parameter, and then named Scale _ add (default may be-0.5), which is the node used to control the thickness of the holographic mesh. Then, the value corresponding to Scale _ add is further subjected to a Clamp function (the output result of the function is 1 when the value exceeds 1 and 0 when the value is below 0) and then the obtained value is subjected to point multiplication (dot) by 1 with a constant 1. And finally multiplying the value obtained by point multiplication by a float parameter, and naming the value as Overallintensity, wherein the Overallintensity is a node for controlling the grid luminous intensity. Then, multiplying the value corresponding to the Overallintensity by a Color parameter (named Color _ output) of float3, wherein the Color _ output is a node for controlling the Color of the grid, and finally, connecting all nodes to a light-emitting node (Emissive Color) to obtain the holographic grid projection.

304. And establishing a hidden control node.

And then, establishing a hidden control node according to the world coordinate of the screen pixel point and the PBR material node, wherein the hidden control node is used for displaying the hidden holographic grid. I.e. the hidden control node is used to control the output of the holographic material node. When the hidden control node does not work, the holographic material node controls the stainer to display the holographic grid. At this time, the display effect of the holographic picture is a mixed effect of the PBR material display effect and the holographic mesh display effect. After the hidden control node acts, the holographic grid can be hidden and dissolved, and the display effect of the holographic picture only has the display effect corresponding to the PBR material. Therefore, by controlling the hidden control node, the switching of different display effects can be realized.

In one specific example, the function is a transitional effect based on alpha node fabrication of a translucent material. In the following, transition in the Y-axis (vertical direction) direction in the world space coordinate system is taken as an example. The calculated world space position is filtered through a G-channel mask, and a float parameter (named hidefrom) is subtracted from the result, and hidefrom is the hidden control node. The node can control the display and the hiding of the whole holographic grid projection special effect. Specifically, all parts of the world space coordinate system, of which the y axis is smaller than the hidefrom parameter, are hidden, so that the original PBR material of the scene is exposed. And finally, connecting the calculation result to sign function nodes (the parameters of the function are greater than 0 and return to 1, less than 0 and return to-1, and 0 is returned if the parameters of the function are equal to 0), adding a constant 1, multiplying by 0.5 to obtain a final value, and finally connecting only alpha output nodes of the material.

305. And determining a three-dimensional vector according to the world coordinates of the screen pixel points and the world coordinates of the virtual camera.

Illustratively, after the holographic grid special effect is established, the Fresnel effect can be added to the original PBR semitransparent material. First, the server may subtract the world space coordinate position from the camera world space coordinate position to obtain a three-dimensional vector of the pixel to the camera in the world space. And then establishing a node corresponding to the Fresnel effect based on the three-dimensional vector.

306. And determining the brightness value of the Fresnel effect according to the three-dimensional vector.

Specifically, the three-dimensional vector obtained in the above steps may be normalized and then point-multiplied by a normal vector in world space of the planning pixel point, so that an absolute value of a result is subtracted from a constant 1, and the result is a basic fresnel effect brightness value. The value can be connected to a power node, and the power parameter can be used for controlling the edge visual expression of the Fresnel effect.

307. And determining the Fresnel effect node according to the brightness value of the Fresnel effect.

And finally, adding the result obtained in the step to the final value corresponding to the holographic grid special effect through the add node, and then connecting the result to the EmssiveColor light-emitting node to finish effect output.

308. And establishing a light breathing fluctuation node according to the world coordinates of the screen pixel points.

For example, the fluctuating breathing light effect can be added to the original PBR translucent material. And establishing a light breathing fluctuation node according to the world coordinates of the screen pixel points. The light breathing fluctuation node can comprise a node for controlling the shape of a pulse in the light breathing fluctuation, a node for controlling the frequency of the pulse in the light breathing fluctuation and a node for controlling the brightness value of light in the light breathing fluctuation. The nodes are respectively connected with the light-emitting nodes to present the fluctuating breathing light effect.

For example, the world space coordinate position can be filtered by a G-channel mask to obtain a G-channel value (i.e. the value of the world coordinate axis in the horizontal upward direction), and then multiplied by a float parameter (named wave _ gradient _ u), where wave _ gradient _ u is a node that can control the shape of the pulse in the lamp breathing wave. Then, a game time variable (GameTime node) is added to the value corresponding to the wave _ gradient _ u, and then a product result with a float parameter (named wave _ timescale) is obtained, wherein the variable corresponding to the wave _ timescale can control the frequency of fluctuation. And then accessing the variable result as a parameter x into a sin function to obtain a result A, multiplying the parameter x by a 0.5 access sin function, connecting to a saturrate node (through the parameter of the function, the output result of the function is changed into 1 when exceeding 1 and is changed into 0 when being lower than 0) to obtain a result B, and finally taking the value obtained by multiplying the A and the B as the brightness value of the fluctuating respiration lamp light.

309. And determining edge pixel points according to the world coordinates of the screen pixel points.

And finally, determining edge pixel points according to the world coordinates of the screen pixel points, then specifying the display effect of the edge pixel points, and establishing the edge tracing nodes aiming at the edge pixel points. So that the final display effect has the phenomenon of edge light.

310. And establishing a delineation node according to the edge pixel point.

Illustratively, the result of dividing the constant 1 by the View _ Size node is multiplied by two-dimensional constants [1,0], [ -1,0], [0,1], [0, -1], respectively, and the obtained results are added to the UV position of the screen space to obtain the adjacent pixel positions in four directions of the pixel point. And then the four pixel positions are respectively used as parameters to be connected into a scene depth node to obtain the depth information of the scene depth node. Then, the depth value of the central pixel is subtracted from the depths in the four directions to obtain 4 values, and the 4 values are accumulated. The result is multiplied by float parameter (named DepthLine) to control the thickness of the stroke, then the result is divided by the actual distance between the camera lens and the pixel point world space, and the obtained result is accessed into the Clamp function, so that the stroke effect of the game object can be obtained.

For example, other special effect functions may be added to the target material, which is not described herein. After the special effect material is determined, a simple plane model can be manufactured by utilizing modeling software, and then the screen model is led into the Messiah game engine. And then, replacing the original material of the plane model with the material manufactured by the server. And then opening a target scene, placing the plane model in front of a lens in a way that the plane model faces the game camera, and adjusting material parameters to enable the shooting effect to meet the target requirement.

In combination with the above establishment process of the target material, after the target material including both the PBR material node and the holographic material node is obtained, the target material needs to be given to the display object, and the target material is used to realize the switching between the two display effects. Fig. 4 is a schematic flowchart of a method for displaying a holographic image according to an embodiment of the present disclosure. As shown in fig. 4, the demonstration method includes the following steps:

401. a display switching instruction for the holographic image is received.

When a display switching instruction for a holographic image is received or a display switching trigger event of the holographic image is detected, the display special effect of the holographic image needs to be changed. The display switching instruction may indicate a display object in the holographic image, which needs to be switched to a special display effect. That is, in the embodiment of the present application, display special effect switching may be directed to a single display object in a holographic image.

402. And determining the target object and the target material corresponding to the target object according to the display switching instruction.

After the server acquires the display switching instruction, the target object and the target special effect corresponding to the target object need to be determined. It is understood that the target material is the target material of the PBR material node shown in the above embodiments, which includes the holographic material node.

403. And determining the control state of the hidden control node in the target material.

Then, the current display effect of the target object and the target display effect which needs to be switched need to be obtained. If the current display effect has no holographic grid and is only the display effect corresponding to the PBR material, the hidden control node is needed to control the holographic material node. The holographic material nodes are controlled to display the holographic grids, and other display effects can be accompanied at the same time, and the method is not limited specifically. Otherwise, the hidden holographic grid needs to be dissolved by using the hidden control node, so that the display object only shows the effect corresponding to the PBR material.

404. And displaying the display object according to the target material.

According to the technical scheme provided by the embodiment of the application, the PBR material is firstly established according to the planned first picture display effect. And then adding holographic material nodes on the PBR material according to the planned second picture display effect. Thus, the target material with both PBR material nodes and holographic material nodes can be obtained. The PBR material nodes and the holographic material nodes have independent functions and jointly control the output result of the stainer aiming at the picture pixel points, thereby controlling the display effect of the picture pixel points. Therefore, when the holographic image needs to realize different display effects, the target material is firstly endowed to the display object, and then various outputs of the stainer are determined by controlling the control states of the PBR material node and the holographic material node, so that the display effect of the display object corresponding to the PBR material is switched to the display effect corresponding to the holographic material.

According to the embodiment of the application, the material nodes corresponding to the holographic material are added on the original PBR material, so that the composite material capable of presenting multiple display effects is obtained. The output of the stainer is controlled by using different material nodes with independent functions, so that the holographic image is switched from one display special effect to another display special effect. The nodes of all the materials are independent in function, and the effects of the two materials cannot interfere with each other, so that the special effect display performance of the holographic projection is greatly improved. And the holographic material node is added in the original PBR material as a whole, so that the picture display effect can be controlled only by controlling the output aimed by the holographic material node. Therefore, the switching difficulty of the display effect is reduced, and the switching flexibility of the display effect is greatly enhanced. Meanwhile, the target material is added in front of the virtual camera lens, so that the normal luminescence of the holographic image can be ensured, and the display performance of the target object is improved.

Fig. 5 is a schematic structural diagram of a device for creating a target material according to an embodiment of the present disclosure, and the following describes the embodiment in detail with reference to fig. 5. The following description refers to examples for explaining the technical solution of the present application, and is not intended to limit the practical use.

The target material establishing device comprises:

the manufacturing unit 501 is configured to manufacture the PBR material according to the first display effect. The PBR material comprises a plurality of PBR material nodes, and the PBR material nodes are used for controlling the output of the stainer. The output of the stainer is used to determine the display effect of the screen pixels.

The establishing unit 502 is configured to establish a holographic material node according to the second display effect. The second display effect is a holographic grid projection special effect.

A processing unit 503, configured to add a holographic material node to the PBR material to obtain a target material. Wherein, the holographic material node is used for controlling the output of the stainer.

In an alternative embodiment, the stainer includes a light emitting node, and the creating unit 502 is specifically configured to calculate world coordinates of pixels on the screen. And determining pixel points to be lighted which form the holographic grid in the screen pixel points according to the second display effect and the world coordinates of the screen pixel points. And determining the holographic material node according to the pixel point to be emitted. The holographic material node is connected with the light-emitting node and used for indicating the light-emitting node to control the pixel point to be emitted to emit light.

In an alternative embodiment, the holographic material nodes comprise one or more of: a first control node, a second control node, a third control node, and a fourth control node.

The second control node is used for controlling the mesh thickness of the holographic mesh.

In an optional embodiment, the manufacturing apparatus further comprises an obtaining unit 504.

The obtaining unit 504 is configured to obtain screen position coordinates of the screen pixel.

The establishing unit 502 is specifically configured to determine a depth distance of a screen pixel according to a screen position coordinate of the screen pixel. And determining a three-dimensional control vector corresponding to the screen pixel point according to the screen position coordinate and the depth distance of the screen pixel point. And determining the world coordinates of the screen pixel points according to the world coordinates and the three-dimensional control vectors of the virtual cameras.

In an optional embodiment, the establishing unit 502 is further configured to establish a hidden control node according to the world coordinates of the screen pixel points and the PBR material node, where the hidden control node is used for displaying the hidden holographic mesh.

In an optional embodiment, the processing unit 503 is further configured to determine a three-dimensional vector according to the world coordinates of the screen pixel and the world coordinates of the virtual camera. And determining the brightness value of the Fresnel effect according to the three-dimensional vector. And determining a Fresnel effect node according to the brightness value of the Fresnel effect, wherein the Fresnel effect node corresponds to a Fresnel effect node parameter. And connecting the Fresnel effect node with the luminous node.

In an optional embodiment, the establishing unit 502 is further configured to establish a first lighting breathing fluctuation node, a second lighting breathing fluctuation node, and/or a third lighting breathing fluctuation node according to the world coordinates of the screen pixel points. And respectively connecting the first light breathing fluctuation node, the second light breathing fluctuation node and/or the third light breathing fluctuation node with the light-emitting node.

In an optional embodiment, the processing unit 503 is further configured to determine edge pixel points according to world coordinates of the screen pixel points. And establishing a delineation node according to the edge pixel point. And connecting the stroke nodes with the luminous nodes.

In an optional embodiment, the creating unit 502 is further configured to create a presentation model according to the presentation object.

The processing unit 503 is further configured to add the target material to the display model, and display the display object according to the target material.

In an alternative embodiment, the processing unit 503 is further configured to connect the hidden control node with the light emitting node. And displaying the display object according to the connected target material. And the display object displayed by the target material corresponds to the PBR material.

In an alternative embodiment, the first target material and the second target material further include at least one of a grid projection effect, a lighting effect, and a delineation effect.

According to the technical scheme provided by the embodiment of the application, the manufacturing unit firstly needs to establish the PBR material according to the planned first picture display effect. And then the establishing unit adds holographic material nodes on the PBR material according to the planned second picture display effect. Thus, the target material with both PBR material nodes and holographic material nodes can be obtained. The PBR material nodes and the holographic material nodes have independent functions and jointly control the output result of the stainer aiming at the picture pixel points, thereby controlling the display effect of the picture pixel points. Therefore, when the holographic image needs to realize different display effects, the target material is firstly endowed to the display object, and then various outputs of the stainer are determined by controlling the control states of the PBR material node and the holographic material node, so that the display effect of the display object corresponding to the PBR material is switched to the display effect corresponding to the holographic material.

According to the embodiment of the application, the material nodes corresponding to the holographic material are added on the original PBR material, so that the composite material capable of presenting multiple display effects is obtained. The output of the stainer is controlled by using different material nodes with independent functions, so that the holographic image is switched from one display special effect to another display special effect. The nodes of all the materials are independent in function, and the effects of the two materials cannot interfere with each other, so that the special effect display performance of the holographic projection is greatly improved. And the holographic material node is added in the original PBR material as a whole, so that the picture display effect can be controlled only by controlling the output aimed at by the holographic material node. Therefore, the switching flexibility of the display effect is greatly enhanced while the switching difficulty of the display effect is reduced. Meanwhile, the target material is added in front of the virtual camera lens, so that the normal luminescence of the holographic image can be ensured, and the display performance of the target object is improved.

It should be noted that, the information interaction, execution process, and other contents between the modules/units in the apparatus are based on the same concept as that of the method embodiments corresponding to fig. 1 in the present application, and specific contents may refer to the description in the foregoing method embodiments in the present application, and are not described herein again.

Next, an electronic device provided in an embodiment of the present application is introduced, please refer to fig. 6, and fig. 6 is a schematic structural diagram of the electronic device provided in the embodiment of the present application. The electronic device 800 may be disposed with a switching device for displaying special effects related to holographic projection, which is described in the embodiment corresponding to fig. 5, for implementing the functions in the embodiments corresponding to fig. 2 to fig. 4. Specifically, the electronic device 800 includes: a receiver 801, a transmitter 802, a processor 803 and a memory 804 (wherein the number of processors 803 in the execution device 800 may be one or more, for example, one processor in fig. 6), wherein the processor 803 may include an application processor 8031 and a communication processor 8032. In some embodiments of the present application, the receiver 801, the transmitter 802, the processor 803, and the memory 804 may be connected by a bus or other means.

The memory 804 may include a read-only memory and a random access memory, and provides instructions and data to the processor 803. A portion of the memory 804 may also include non-volatile random access memory (NVRAM). The memory 804 stores the processor and operating instructions, executable modules or data structures, or a subset or an expanded set thereof, wherein the operating instructions may include various operating instructions for performing various operations.

The processor 803 controls the operation of the execution apparatus. In a particular application, the various components of the execution device are coupled together by a bus system that may include a power bus, a control bus, a status signal bus, etc., in addition to a data bus. For clarity of illustration, the various buses are referred to in the figures as a bus system.

The method disclosed in the embodiments of the present application can be applied to the processor 803 or implemented by the processor 803. The processor 803 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 803. The processor 803 may be a general-purpose processor, a Digital Signal Processor (DSP), a microprocessor or a microcontroller, and may further include an Application Specific Integrated Circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, or discrete hardware components. The processor 803 may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present application. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may be located in ram, flash, rom, prom, or eprom, registers, etc. as is well known in the art. The storage medium is located in the memory 804, and the processor 803 reads the information in the memory 804 to complete the steps of the method in combination with the hardware thereof.

Receiver 801 may be used to receive input numeric or character information and generate signal inputs related to performing device related settings and function control. The transmitter 802 may be configured to output numeric or character information via a first interface; the transmitter 802 may also be configured to send instructions to the disk pack through the first interface to modify data in the disk pack; the transmitter 802 may also include a display device such as a display screen.

In the embodiment of the present application, the application processor 8031 in the processor 803 is configured to execute the methods in the embodiments corresponding to fig. 2 to fig. 4. It should be noted that, the specific manner of executing each step by the application processor 8031 is based on the same concept as that of each method embodiment corresponding to fig. 2 to 4 in the present application, and the technical effect brought by the method embodiment is the same as that of each method embodiment corresponding to fig. 2 to 4 in the present application, and specific contents may refer to descriptions in the foregoing method embodiments in the present application, and are not described again here.

The embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium includes computer instructions, and the computer instructions, when executed by a processor, are used to implement a technical solution of a manufacturing method of any one target material in the embodiment of the present application.

An embodiment of the present application further provides a computer program product, which when executed on a computer causes the computer to execute the steps in the method described in the foregoing embodiments shown in fig. 2 to 4.

The execution device and the training device provided by the embodiment of the application may specifically be chips, and the chips include: a processing unit, which may be, for example, a processor, and a communication unit, which may be, for example, an input/output interface, a pin or a circuit, etc. The processing unit may execute the computer executable instructions stored by the storage unit to cause the chip to perform the method described in the embodiment of fig. 1 above. Alternatively, the storage unit may be a storage unit in the chip, such as a register, a cache, and the like, and the storage unit may also be a storage unit located outside the chip in the wireless access device, such as a read-only memory (ROM) or another type of static storage device that can store static information and instructions, a Random Access Memory (RAM), and the like.

Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.

Claims

1. A method of making a target material, the method comprising:

manufacturing a PBR material according to the first display effect; the PBR material comprises a plurality of PBR material nodes, and the PBR material nodes are used for controlling the output of the stainer; the output of the stainer is used for determining the display effect of the screen pixel point;

establishing a holographic material node according to the second display effect; the second display effect is a holographic grid projection special effect;

adding the holographic material node in the PBR material to obtain a target material; wherein the holographic material node is used for controlling the output of the stainer.

2. The method of claim 1, wherein the stainer includes a light node, and wherein creating the holographic material node according to the second display effect includes:

calculating world coordinates of the screen pixel points;

determining pixel points to be lighted, which form a holographic grid, in the screen pixel points according to the second display effect and the world coordinates of the screen pixel points;

determining the holographic material node according to the pixel point to be lighted; the holographic material node is connected with the light-emitting node and used for indicating the light-emitting node to control the pixel point to be emitted to emit light.

3. The method of claim 2, wherein the holographic material node comprises one or more of: a first control node, a second control node, a third control node and a fourth control node;

the first control node is used for controlling the size of the holographic grid;

the second control node is used for controlling the grid thickness of the holographic grid;

the third control node is used for controlling the grid luminous intensity of the holographic grid;

the fourth control node is configured to control a grid color of the holographic grid.

4. The method of claim 3, wherein said calculating world coordinates of said screen pixel points comprises:

acquiring screen position coordinates of the screen pixel points;

determining the depth distance of the screen pixel point according to the screen position coordinate of the screen pixel point;

determining a three-dimensional control vector corresponding to the screen pixel point according to the screen position coordinate of the screen pixel point and the depth distance;

and determining the world coordinates of the screen pixel points according to the world coordinates of the virtual camera and the three-dimensional control vector.

5. The method of claim 4, further comprising:

and establishing a hidden control node according to the world coordinates of the screen pixel points and the PBR material node, wherein the hidden control node is used for hiding the display of the holographic grid.

6. The method of claim 5, further comprising:

determining a three-dimensional vector according to the world coordinates of the screen pixel points and the world coordinates of the virtual camera;

determining the brightness value of the Fresnel effect according to the three-dimensional vector;

determining a Fresnel effect node according to the brightness value of the Fresnel effect; the Fresnel effect node corresponds to a Fresnel effect node parameter;

and connecting the Fresnel effect node with the light-emitting node.

7. The method of any of claims 2 to 6, further comprising:

establishing a first lighting breathing fluctuation node, a second lighting breathing fluctuation node and/or a third lighting breathing fluctuation node according to the world coordinates of the screen pixel points;

respectively connecting the first light breathing fluctuation node, the second light breathing fluctuation node and/or the third light breathing fluctuation node with the light-emitting node;

the first light breathing fluctuation node is used for controlling the shape of pulses in light breathing fluctuation; the second light breathing fluctuation node is used for controlling the frequency of pulses in the light breathing fluctuation; and the third light breathing fluctuation node is used for controlling the brightness value of the light in the light breathing fluctuation.

8. The method of claim 7, further comprising:

determining edge pixel points according to the world coordinates of the screen pixel points;

establishing a delineation node according to the edge pixel point;

and connecting the stroke nodes with the luminous nodes.

9. The method of claim 8, further comprising:

establishing a display model according to the display object;

10. The method of claim 9, further comprising:

connecting the hidden control node with the light-emitting node;

displaying the display object according to the connected target material; and the display object displayed by the target material corresponds to the PBR material.

11. A device for producing a target material, the device comprising:

the manufacturing unit is used for manufacturing the PBR material according to the first display effect; the PBR material comprises a plurality of PBR material nodes, and the PBR material nodes are used for controlling the output of the stainer; the output of the stainer is used for determining the display effect of the screen pixel points;

the establishing unit is used for establishing a holographic material node according to the second display effect; the second display effect is a holographic grid projection special effect;

the processing unit is used for adding the holographic material node in the PBR material to obtain a target material; wherein the holographic material node is used for controlling the output of the stainer.

12. An electronic device, comprising: a memory and a processor, the memory and the processor coupled;

the memory is to store one or more computer instructions;

the processor is configured to execute the one or more computer instructions to implement the method for manufacturing the target material according to any one of claims 1 to 10.

13. A computer-readable storage medium having one or more computer instructions stored thereon, wherein the instructions are executable by a processor to implement a method for fabricating a target material according to any one of claims 1-10.