CN117496038A

CN117496038A - Picture texture stitching method and device, electronic equipment and storage medium

Info

Publication number: CN117496038A
Application number: CN202311549876.7A
Authority: CN
Inventors: 卢燕青
Original assignee: Guangdong 3vjia Information Technology Co Ltd
Current assignee: Guangdong 3vjia Information Technology Co Ltd
Priority date: 2023-11-20
Filing date: 2023-11-20
Publication date: 2024-02-02

Abstract

The embodiment of the application provides a texture stitching method, a texture stitching device, electronic equipment and a storage medium of a picture, wherein the method comprises the following steps: acquiring picture data; intercepting the picture data to obtain a target texture image; recombining the target texture image to obtain a seamless texture image containing splicing marks; and performing trace restoration on the seamless texture image containing the splicing trace to obtain a target image. By implementing the embodiment of the application, the irregular textures in the image can be spliced, so that splicing marks of the textures can be perfected better, and the processing efficiency of splicing the marks of the image is improved.

Description

Picture texture stitching method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of image processing technologies, and in particular, to a method and apparatus for texture stitching of a picture, an electronic device, and a storage medium.

Background

Computer three-dimensional image texture mapping is a necessary way to enhance expressive force in rendering, in a three-dimensional model, since the resolution of the texture part of an image is large or small, a stitching part of the texture has obvious traces, and if the texture map with large resolution is directly stored, the consumption of calculation and storage resources is directly affected, so that it is necessary to generate maps with arbitrary resolution and number by using seamless textures.

The generation mode of the seamless texture in the prior art comprises the following steps: the method is realized by geometrically searching for repeated texture clipping and splicing and image filtering, and the method has repeated textures or regular texture map effects on an input map, but has no effect on maps with irregular textures.

Disclosure of Invention

An object of the embodiment of the application is to provide a texture stitching method, a device, electronic equipment and a storage medium for pictures, which can stitch irregular textures in images, perfect stitching traces of the textures better and improve trace stitching processing efficiency of the images.

In a first aspect, an embodiment of the present application provides a method for texture stitching of a picture, where the method includes:

acquiring picture data;

intercepting the picture data to obtain a target texture image;

recombining the target texture image to obtain a seamless texture image containing splicing marks;

and performing trace restoration on the seamless texture image containing the splicing trace to obtain a target image.

In the implementation process, by reorganizing and trace repairing the texture part of the image, irregular textures in the image can be spliced, splicing traces of the textures can be perfected better, and trace splicing processing efficiency of the image is improved.

Further, the step of reorganizing the target texture image to obtain a seamless texture image including stitching traces includes:

cutting the target texture image to obtain a plurality of sub-target texture images;

performing up-down, left-right mirror image processing on the plurality of sub-target texture images to obtain a plurality of mirror image processed sub-target texture images;

and re-stitching the multiple sub-target texture images subjected to the mirror image processing to obtain a seamless texture image containing stitching traces.

In the implementation process, after the target texture image is segmented, mirroring and re-stitching are performed, so that the stitching trace of the stitched seamless texture image is more regular, the stitching trace is convenient to optimize, the resolution of the image can be balanced, and the seamless texture image containing the stitching trace can be better subjected to trace restoration.

Further, the step of performing trace restoration on the seamless texture image containing the stitching trace to obtain a target image includes:

constructing a mask image corresponding to the splicing trace according to the seamless texture image containing the splicing trace;

and repairing the trace of the target area of the mask map to obtain the target image.

In the implementation process, trace restoration is performed on the target area according to the mask image, so that the image resolution of the target area can be balanced, textures of the target area are easier to identify, and trace restoration efficiency is improved.

Further, the step of constructing a mask map corresponding to the stitching trace according to the seamless texture image containing the stitching trace includes:

acquiring pixel values of the seamless texture image containing the splicing trace;

constructing a base graph consistent with the pixel value;

and reconstructing the basic graph according to the splicing trace to obtain the mask graph.

In the implementation process, a base graph is constructed according to the pixel values of the seamless texture image, and then the splicing trace is reconstructed according to the base graph, so that a mask graph can be constructed by taking the base graph as a reference in the splicing process, and the mask graph is ensured to correspond to the seamless texture image.

Further, the step of reconstructing the base map according to the splicing trace to obtain the mask map includes:

respectively constructing a vertical line and a horizontal line with the widths of a preset value and the pixel value of 0 in the basic diagram to obtain an initial mask diagram;

and adjusting the vertical lines and the horizontal lines in the initial mask graph according to the positions of the splicing marks to obtain the mask graph.

In the implementation process, the lines of the initial mask image are adjusted according to the positions of the splicing marks, so that the initial mask image can be attached to the splicing marks of the textures more, the accuracy of the mask image is ensured, and the accuracy of the splicing of the marks is improved.

Further, the step of repairing the trace of the target area of the mask map to obtain the target image includes:

redrawing a target area of the mask map according to a pre-constructed diffusion model to obtain an initial target image;

and performing trace restoration on the spliced part of the initial target image according to the reference image information to obtain the target image.

In the implementation process, redrawing is carried out on the target area of the mask image according to the diffusion model constructed in advance, and trace restoration is carried out on the spliced part according to the reference image information, so that the obtained target image can be more real, and the spliced trace is reduced.

In a second aspect, an embodiment of the present application further provides a texture stitching device for a picture, where the device includes:

the acquisition module is used for acquiring the picture data;

the intercepting module is used for intercepting the picture data to obtain a target texture image;

the reorganization module is used for reorganizing the target texture image to obtain a seamless texture image containing stitching traces;

and the trace restoration module is used for carrying out trace restoration on the seamless texture image containing the splicing trace to obtain a target image.

Further, the reorganization module is further configured to:

In a third aspect, an electronic device provided in an embodiment of the present application includes: a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the method according to any one of the first aspects when the computer program is executed.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium having stored thereon instructions that, when executed on a computer, cause the computer to perform the method according to any of the first aspects.

In a fifth aspect, embodiments of the present application provide a computer program product, which when run on a computer, causes the computer to perform the method according to any one of the first aspects.

Additional features and advantages of the disclosure will be set forth in the description which follows, or in part will be obvious from the description, or may be learned by practice of the techniques of the disclosure.

And may be practiced in accordance with the disclosure as hereinafter described in detail with reference to the preferred embodiments of the present application.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and should not be considered as limiting the scope values, and other related drawings may be obtained according to these drawings without inventive effort for a person of ordinary skill in the art.

Fig. 1 is a flow chart of a texture stitching method of a picture according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a texture stitching device for a picture according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only to distinguish the description, and are not to be construed as indicating or implying relative importance.

The detailed description of the present application is further described in detail below with reference to the drawings and examples. The following examples are illustrative of the present application but are not intended to limit the scope of the values of the present application.

Example 1

Fig. 1 is a flow chart of a texture stitching method of a picture according to an embodiment of the present application, as shown in fig. 1, the method includes:

s1, acquiring picture data;

s2, intercepting the picture data to obtain a target texture image;

s3, recombining the target texture image to obtain a seamless texture image containing splicing marks;

s4, performing trace restoration on the seamless texture image containing the splicing trace to obtain a target image.

In S1, the input image is subjected to image angle correction, and since the input image may be a non-frontal image, the image angle needs to be corrected by using an image perspective transformation method, and the image correction may be performed by using an opencv perspective transformation algorithm.

In S2, since the input picture may contain other backgrounds of the non-texture map, the texture area needs to be truncated, the interference background is removed, and the opencv contour detection or image segmentation mode may be adopted.

Further, the step of reorganizing the target texture image to obtain a seamless texture image containing stitching traces includes:

dividing the target texture image to obtain a plurality of sub-target texture images;

and re-stitching the multiple sub-target texture images after the mirror image processing to obtain a seamless texture image containing stitching traces.

The target texture image is cut into four equal parts on average, the target texture image can be cut into any equal parts, the cut images are sequentially mirrored up and down and left and right, and then spliced to obtain a seamless texture image containing splicing marks.

Further, the step of performing trace restoration on the seamless texture image containing the stitching trace to obtain a target image comprises the following steps:

constructing a mask diagram corresponding to the splicing trace according to the seamless texture image containing the splicing trace;

and repairing the trace of the target area of the mask map to obtain a target image.

Further, the step of constructing a mask map corresponding to the stitching trace according to the seamless texture image containing the stitching trace comprises the following steps:

acquiring pixel values of a seamless texture image containing a splicing trace;

constructing a base graph consistent with the pixel value;

and reconstructing the basic image according to the splicing trace to obtain a mask image.

Further, reconstructing the base graph according to the splicing trace to obtain a mask graph, which comprises the following steps:

Firstly, generating a basic image with the same pixel value as that of a spliced image, wherein the basic image is a pure white image with the pixel value of 255, drawing a black vertical line and a black horizontal line with the pixel value of 0 at the center by using opencv, setting the widths of the black vertical line and the black horizontal line to be 30% of the length or the width of a seamless texture image containing a spliced trace, and obtaining a mask image, wherein the mask image is a black frame white background image at the spliced position of the coverage image.

Further, the step of repairing the trace of the target area of the mask image to obtain a target image includes:

redrawing a target area of the mask image according to a pre-constructed diffusion model to obtain an initial target image;

According to the embodiment of the application, the spliced part is redrawn by using the pretrained diffusion model, so that smooth transition fusion at the spliced part is realized.

Because the diffusion algorithm uses a large amount of texts and images to train the data, corresponding images can be generated by inputting the texts and the reference images, and the generated images can refer to the input reference image information, namely the map generation images.

Example two

In order to implement a corresponding method of the above embodiment to achieve the responsive function and technical effect, a texture stitching device for a picture is provided below, as shown in fig. 2, where the device includes:

the acquisition module 1 is used for acquiring picture data;

the intercepting module 2 is used for intercepting the picture data to obtain a target texture image;

the reorganization module 3 is used for reorganizing the target texture image to obtain a seamless texture image containing stitching traces;

and the trace restoration module 4 is used for carrying out trace restoration on the seamless texture image containing the splicing trace to obtain a target image.

Further, the reorganization module 3 is further configured to:

Further, the trace restoration module 4 is further configured to:

acquiring pixel values of a seamless texture image containing a splicing trace;

constructing a base graph consistent with the pixel value;

Further, the trace restoration module 4 is further configured to:

The above-mentioned texture stitching device for pictures can implement the method of the first embodiment. The options in the first embodiment described above also apply to this embodiment, and are not described in detail here.

The rest of the embodiments of the present application may refer to the content of the first embodiment, and in this embodiment, no further description is given.

Example III

The embodiment of the application provides an electronic device, which comprises a memory and a processor, wherein the memory is used for storing a computer program, and the processor runs the computer program to enable the electronic device to execute the texture stitching method of the picture in the first embodiment.

Alternatively, the electronic device may be a server.

Referring to fig. 3, fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device may include a processor 31, a communication interface 32, a memory 33, and at least one communication bus 34. Wherein the communication bus 34 is used to enable direct connection communication of these components. The communication interface 32 of the device in the embodiment of the present application is used for performing signaling or data communication with other node devices. The processor 31 may be an integrated circuit chip with signal processing capabilities.

The processor 31 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but may also be a Digital Signal Processor (DSP), application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present application may be implemented or performed. The general purpose processor may be a microprocessor or the processor 31 may be any conventional processor or the like.

The Memory 33 may be, but is not limited to, random access Memory (Random Access Memory, RAM), read Only Memory (ROM), programmable Read Only Memory (Programmable Read-Only Memory, PROM), erasable Read Only Memory (Erasable Programmable Read-Only Memory, EPROM), electrically erasable Read Only Memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc. The memory 33 has stored therein computer readable instructions which, when executed by the processor 31, enable the apparatus to perform the various steps described above in relation to the embodiment of the method of fig. 1.

Optionally, the electronic device may further include a storage controller, an input-output unit. The memory 33, the memory controller, the processor 31, the peripheral interface, and the input/output unit are electrically connected directly or indirectly to each other, so as to realize data transmission or interaction. For example, the components may be electrically coupled to each other via one or more communication buses 34. The processor 31 is arranged to execute executable modules stored in the memory 33, such as software functional modules or computer programs comprised by the device.

The input-output unit is used for providing the user with the creation task and creating the starting selectable period or the preset execution time for the task so as to realize the interaction between the user and the server. The input/output unit may be, but is not limited to, a mouse, a keyboard, and the like.

It will be appreciated that the configuration shown in fig. 3 is merely illustrative, and that the electronic device may also include more or fewer components than shown in fig. 3, or have a different configuration than shown in fig. 3. The components shown in fig. 3 may be implemented in hardware, software, or a combination thereof.

In addition, the embodiment of the present application further provides a computer readable storage medium storing a computer program, where the computer program when executed by a processor implements the texture stitching method of the picture of the first embodiment.

The present application also provides a computer program product which, when run on a computer, causes the computer to perform the method described in the method embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners as well. The apparatus embodiments described above are merely illustrative, for example, flow diagrams and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based devices which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In addition, the functional modules in the embodiments of the present application may be integrated together to form a single part, or each module may exist alone, or two or more modules may be integrated to form a single part.

The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.

The foregoing is merely exemplary embodiments of the present application and is not intended to limit the scope of the present application, and various modifications and variations may be suggested to one skilled in the art. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application are intended to be included within the scope of the present application. It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.

The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the scope of the present application, and the changes or substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be defined by the protection scope of the claims.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Claims

1. A method for texture stitching of pictures, the method comprising:

acquiring picture data;

intercepting the picture data to obtain a target texture image;

2. The method for stitching texture of a picture according to claim 1, wherein the step of reorganizing the target texture image to obtain a seamless texture image including stitching traces comprises:

3. The method for stitching textures of a picture according to claim 1, wherein the step of performing trace restoration on the seamless texture image containing stitching traces to obtain a target image comprises the steps of:

4. A method of texture stitching for a picture according to claim 3, wherein the step of constructing a mask map corresponding to the stitching trace from the seamless texture image including the stitching trace comprises:

constructing a base graph consistent with the pixel value;

5. The method for texture stitching of a picture according to claim 4, wherein the step of reconstructing the base map according to the stitching trace to obtain the mask map includes:

6. The method for stitching textures of a picture according to claim 3, wherein the step of repairing a trace of a target area of the mask map to obtain the target image comprises:

7. A texture stitching device for a picture, the device comprising:

the acquisition module is used for acquiring the picture data;

8. The apparatus for texture stitching of a picture according to claim 7, wherein the reorganization module is further configured to:

9. An electronic device comprising a memory for storing a computer program and a processor that runs the computer program to cause the electronic device to perform the method of texture stitching of pictures according to any one of claims 1 to 6.

10. A storage medium storing a computer program which, when executed by a processor, implements the method of texture stitching of pictures according to any one of claims 1 to 6.