CN107194878A - Image split-joint method and device - Google Patents
Image split-joint method and device Download PDFInfo
- Publication number
- CN107194878A CN107194878A CN201710473121.1A CN201710473121A CN107194878A CN 107194878 A CN107194878 A CN 107194878A CN 201710473121 A CN201710473121 A CN 201710473121A CN 107194878 A CN107194878 A CN 107194878A
- Authority
- CN
- China
- Prior art keywords
- msub
- image
- mrow
- summit
- mapping graph
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000013507 mapping Methods 0.000 claims abstract description 60
- 238000005304 joining Methods 0.000 claims abstract description 4
- 230000008859 change Effects 0.000 claims description 5
- 238000009826 distribution Methods 0.000 claims description 5
- 230000001186 cumulative effect Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 description 76
- 238000010586 diagram Methods 0.000 description 9
- 238000003860 storage Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 230000002093 peripheral effect Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 208000001491 myopia Diseases 0.000 description 1
- 238000004549 pulsed laser deposition Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the present invention provides image split-joint method and device.In one embodiment, described image joining method includes：At least two width original images are projected in object space coordinate system, it is pre-splicing to be carried out at least two width original images in the object space coordinate system, to obtain mapping graph picture；Obtain the set of characteristic points of the mapping graph picture；Strain energy of distortion function is generated according to set of characteristic points；The deformation parameter of characteristic point when calculating the strain energy of distortion functional value for minimum value in corresponding each mapping graph picture；And the mapping graph picture progress is handled according to the deformation parameter obtain target distortion image, and by the target distortion image mosaic together.
Description
Technical field
The present invention relates to technical field of image processing, in particular to a kind of image split-joint method and device.
Background technology
Virtual reality technology be it is a kind of can create the computer simulation system with the experiencing virtual world, it utilizes computer
A kind of simulated environment is generated, is that the system of a kind of Multi-source Information Fusion, interactive Three-Dimensional Dynamic what comes into a driver's and entity behavior is imitated
Really user is set to be immersed in the environment.Because the visual angle of the image of the equipment such as video camera shooting is effective, therefore, virtual reality is presented
Need to be spliced multiple images before image to realize more wide viewing angle.Therefore, a kind of effective image mosaic mode is
Urgent problem to be solved.
The content of the invention
In view of this, the purpose of the embodiment of the present invention is to provide a kind of image split-joint method and device.
A kind of image split-joint method provided in an embodiment of the present invention, described image joining method includes：
At least two width original images are projected in object space coordinate system, with least two width original images in the mesh
Space coordinates progress is marked pre-splicing, to obtain mapping graph picture；
Obtain the set of characteristic points of the mapping graph picture；
Strain energy of distortion function is generated according to set of characteristic points；
The change of characteristic point when calculating the strain energy of distortion functional value for minimum value in corresponding each mapping graph picture
Shape parameter；And
The mapping graph picture progress is handled according to the deformation parameter and obtains target distortion image, and the target is become
Shape image mosaic is together.
The embodiment of the present invention also provides a kind of image splicing device, and described image splicing apparatus includes：
Pre-splicing connection module, for that at least two width original images will be projected in object space coordinate system, with least two width
Original image is pre-splicing in object space coordinate system progress, to obtain mapping graph picture；
Acquisition module, the set of characteristic points for obtaining the mapping graph picture；
First generation module, for generating strain energy of distortion function according to set of characteristic points；
Computing module, during for calculating the strain energy of distortion functional value for minimum value in corresponding each mapping graph picture
Characteristic point deformation parameter；
Concatenation module, target distortion image is obtained for being handled according to the deformation parameter the mapping graph picture progress,
And by the target distortion image mosaic together.
Compared with prior art, image split-joint method and device of the invention, are first projected to coordinates of targets by original image
Carry out pre-splicing in system, image after further will be pre-splicing is calculated by energy function and obtains deformation parameter with again
Accurately spliced, improve the effect of the splicing of image.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be attached to what is used required in embodiment
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, therefore is not construed as pair
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this
A little accompanying drawings obtain other related accompanying drawings.
The block diagram for the electric terminal that Fig. 1 provides for present pre-ferred embodiments.
The flow chart for the image split-joint method that Fig. 2 provides for present pre-ferred embodiments.
The flow chart for the image split-joint method that Fig. 3 provides for another preferred embodiment of the invention.
The high-level schematic functional block diagram for the image splicing device that Fig. 4 provides for present pre-ferred embodiments.
Embodiment
Below in conjunction with accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Ground is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Generally exist
The component of the embodiment of the present invention described and illustrated in accompanying drawing can be arranged and designed with a variety of configurations herein.Cause
This, the detailed description of the embodiments of the invention to providing in the accompanying drawings is not intended to limit claimed invention below
Scope, but it is merely representative of the selected embodiment of the present invention.Based on embodiments of the invention, those skilled in the art are not doing
The every other embodiment obtained on the premise of going out creative work, belongs to the scope of protection of the invention.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined in individual accompanying drawing, then it further need not be defined and explained in subsequent accompanying drawing.Meanwhile, the present invention's
In description, term " first ", " second " etc. are only used for distinguishing description, and it is not intended that indicating or implying relative importance.
As shown in figure 1, being the block diagram of an electric terminal 100.The electric terminal 100 includes image splicing device
110th, memory 111, storage control 112, processor 113, Peripheral Interface 114, input-output unit 115, display unit
116。
The memory 111, storage control 112, processor 113, Peripheral Interface 114, input-output unit 115 and aobvious
Show that each element of unit 116 is directly or indirectly electrically connected with each other, to realize the transmission or interaction of data.For example, these
Element can be realized by one or more communication bus or signal wire be electrically connected with each other.Described image splicing apparatus 110
The electricity can be stored in the memory 111 or be solidificated in including at least one in the form of software or firmware (firmware)
Software function module in the operating system (operating system, OS) of sub- terminal 100.The processor 113 is used to hold
Software function module or computer that the executable module stored in line storage, such as described image splicing apparatus 110 include
Program.
Wherein, the memory 111 may be, but not limited to, random access memory (Random Access
Memory, RAM), read-only storage (Read Only Memory, ROM), programmable read only memory (Programmable
Read-Only Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only
Memory, EPROM), electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only
Memory, EEPROM) etc..Wherein, memory 111 be used for storage program, the processor 113 after execute instruction is received,
Described program is performed, the method performed by electric terminal 100 that the process that any embodiment of the embodiment of the present invention is disclosed is defined can
To be realized applied in processor 113, or by processor 113.
The processor 113 is probably a kind of IC chip, the disposal ability with signal.Above-mentioned processor
113 can be general processor, including central processing unit (Central Processing Unit, abbreviation CPU), network processes
Device (Network Processor, abbreviation NP) etc.；It can also be digital signal processor (DSP), application specific integrated circuit
(ASIC), field programmable gate array (FPGA) or other PLDs, discrete gate or transistor logic,
Discrete hardware components.It can realize or perform disclosed each method, step and the logic diagram in the embodiment of the present invention.It is general
Processor can be microprocessor or the processor can also be any conventional processor etc..
Various input/output devices are coupled to processor 113 and memory 111 by the Peripheral Interface 114.At some
In embodiment, Peripheral Interface 114, processor 113 and storage control 112 can be realized in one single chip.Other one
In a little examples, they can be realized by independent chip respectively.
The input-output unit 115 is used to be supplied to user input data.The input-output unit 115 can be,
But it is not limited to, mouse and keyboard etc..
The display unit 116 provides an interactive interface between the electric terminal 100 and user, and (for example user grasps
Make interface) or for display image data give user reference.In the present embodiment, the display unit can be liquid crystal display
Or touch control display.If touch control display, it can be support single-point and the capacitance type touch control screen or resistance of multi-point touch operation
Formula touch screen etc..Single-point and multi-point touch operation is supported to refer to that touch control display can sense on the touch control display one
Or the touch control operation produced simultaneously at multiple positions, and transfer to processor to be calculated and located the touch control operation that this is sensed
Reason.
It is understood that the electric terminal 100 of the present embodiment shown in Fig. 1 not to be limited, the electronics in the present embodiment
Terminal 100 can be than more or less parts shown in Fig. 1, part that can also be different from the part shown in Fig. 1.
Referring to Fig. 2, being that the image for being applied to the electric terminal 100 shown in Fig. 1 that present pre-ferred embodiments are provided is spelled
Connect the flow chart of method.The idiographic flow shown in Fig. 2 will be described in detail below.
Step S201, at least two width original images will be projected in object space coordinate system, with least two width original graphs
It is pre-splicing as being carried out in the object space coordinate system, to obtain mapping graph picture.
In one embodiment, the original image is carried out deformation splicing to realize virtual reality by the electric terminal
Picture show that now, the object space coordinate system can be spheric coordinate system.
In other embodiments, the original image can be 3-D view, and the target-based coordinate system can be correspondence
In the deformation coordinate system of three-dimensional system of coordinate, for example, the target-based coordinate system can be near-sighted angle relative to long sight angle displaying ratio
Bigger coordinate system；For another example the target-based coordinate system can be three-dimensional coordinate system of visual angle presentation to overlook the earth etc..
Step S202, obtains the set of characteristic points of the mapping graph picture.
In the present embodiment, the characteristic point can embody some points of characteristics of image in the mapping graph picture.
For example, the mapping graph picture is a streetscape figure, the streetscape figure includes the features such as personage A, house B.The set of characteristic points
In can include mark personage A human eye feature point, people's shoulder characteristic point, people's pin characteristic point etc.；It may also include the mark room
Multiple characteristic points on room the B left drift angle characteristic point in house, the right drift angle characteristic point in house, window corner characteristic point and door etc..When
So, more points can also be included in the set of characteristic points.
Step S203, strain energy of distortion function is generated according to set of characteristic points.
In one embodiment, as shown in figure 3, after step S201, described image joining method may also include：Step
S206, generation is with the net region for specifying size and number, the region that the net region is covered by the mapping graph picture.
Step S203 may include：Institute is generated according to the summit of each grid in the set of characteristic points and the net region
State strain energy of distortion function.
In the present embodiment, the strain energy of distortion function is to include the spy according to each width mapping graph picture and neighbor mapping image
Levy the global energy function of the summit generation of the local energy function of point set generation and the net region of the mapping graph picture.This
The local energy function in embodiment is used to align to the characteristic point in the set of characteristic points, the global energy
Function is used to further be alignd the other parts of the mapping graph picture in addition to characteristic point.In the present embodiment, according to
Local energy function and global energy function carry out dual alignment, to improve the effect of image mosaic, effectively reduce image mosaic
When the ghost image that produces or vision bend the possibility of distortion.
In one embodiment, the local energy function is calculated by below equation and obtained：
Wherein,
Wherein, EpThe local energy function is represented, n represents the quantity of the characteristic point for alignment,Reflected described in representing
The corresponding summit of grid of the corresponding net region of the corresponding target distortion image of image is penetrated,Represent describedSummit pair
In the grid answered a bit, αj,kBilinear combinations parameter is represented,For mapping graph picture to be aligned reference picture described
In set of characteristic points a bit；
Wherein, what calculating was obtained is describedValue represent a part in the deformation parameter.
In the present embodiment, it is appreciated that as the EpValue it is smaller, the corresponding grid regions of the target distortion image
The corresponding summit of grid in domain and some distance in the set of characteristic points of the reference picture are nearer.When described
EpThe corresponding summit of grid of the corresponding net region of the target distortion image and the reference picture are represented when being zero
A little overlapping in the set of characteristic points.Therefore, the EpThe smaller characteristic point for mapping graph picture of value at splice effect
Fruit is better.
In one embodiment, the global energy function is calculated by below equation and obtained：
Wherein,Represent the mapping graph as the grid corresponding one of the corresponding net region of corresponding target distortion image
Summit,Represent the summit of grid in the net region, τiA two-value is represented, when the point in the set of characteristic points existsSpecified range in when, τi=1, it is otherwise τi=0, wherein, it is described that calculating is obtainedValue represent in the deformation parameter
A part.In the present embodiment, the global energy function is used to align to other grid vertexes in addition to characteristic point.
Step S204, calculates the spy in corresponding each mapping graph picture when the strain energy of distortion functional value is minimum value
Levy deformation parameter a little.
In one embodiment, the strain energy of distortion function includes the local energy function and global energy function.
In an example, the strain energy of distortion function is the local energy function and global energy function according to default weight distribution
Sum afterwards.For example, E=Ep+αEg, wherein, the E represents strain energy of distortion function, the EpRepresent the local energy function, Eg
The global energy function is represented, the α is the weight of the global energy function, and those skilled in the art can be according to demand
It is configured, for example, α=0.01.
Step S205, handles the mapping graph picture progress according to the deformation parameter and obtains target distortion image, and will
The target distortion image mosaic is together.
In the present embodiment, the deformation parameter can be each corresponding coordinate of point in the mapping graph picture, will be described
Mapping graph picture carries out deformation process with target distortion image, the target distortion image according to the corresponding coordinate of the deformation parameter
It is shown in the object space coordinate system to realize the splicing of image.
Image split-joint method in the present embodiment, first original image is projected in target-based coordinate system carry out it is pre-splicing
Connect, the image after further will be pre-splicing is calculated by energy function to be obtained deformation parameter accurately to be spelled again
Connect, improve the effect of the splicing of image.
In other embodiments, the strain energy of distortion function also includes being calculated according to the summit of grid in the net region
Obtained smoothed energy function, the strain energy of distortion function is the local energy function, global energy function and smoothed energy
Function is according to the sum after default weight distribution.For example, E=Ep+αEg+βEs, wherein, the E represents strain energy of distortion function, described
EpRepresent the local energy function, EgRepresent the global energy function, EsThe smoothed energy function is represented, the α is institute
The weight of global energy function is stated, the β is the weight of the smoothed energy function.In an example, the α, β default values
Can be respectively 0.01,0.001.In another example, method of the those skilled in the art in using the present embodiment is carried out
The α, β can also be configured before image mosaic.It is understood that because the feature point set of selection is combined into more
The main contents that the original image is presented can be represented, therefore, can be by the weight of the local energy function in the present embodiment
The weight for being disposed relative to the global energy function and smoothed energy function is bigger.
In one embodiment, the smoothed energy function is calculated in the following manner obtains：
The energy function on the summit of one of grid in the net region is calculated,
Wherein, the triangle that the summit of the grid in the net region is formedInCan be by two other
Vertex representation：
Wherein, u, v areByCoordinate in the coordinate system of definition.
Calculate the energy function on the summit of the gridThe cumulative sum of all vector entries obtains the smoothed energy
Function Es。
In the present embodiment, by further increasing the smoothed energy function one in the strain energy of distortion function,
It can further use and deform that obtained image is softer according to the deformation parameter, more adapt to the process that user sees
The image that method in the present embodiment is spliced is more life-like.
Referring to Fig. 4, being the functional module of the image splicing device 110 shown in Fig. 1 of present pre-ferred embodiments offer
Schematic diagram.Modules or unit in the image splicing device 110 of the present embodiment are used to perform above-mentioned image split-joint method
In each step.Described image splicing apparatus 110 includes pre-splicing connection module 1101, acquisition module 1102, the first generation module
1103rd, computing module 1104 and concatenation module 1105.
The pre-splicing connection module 1101, for that at least two width original images will be projected in object space coordinate system, with right
At least two width original images are pre-splicing in object space coordinate system progress, to obtain mapping graph picture.
The acquisition module 1102, the set of characteristic points for obtaining the mapping graph picture.
First generation module 1103, for generating strain energy of distortion function according to set of characteristic points.
The computing module 1104, it is corresponding during for calculating the strain energy of distortion functional value for minimum value each described to reflect
The deformation parameter for the characteristic point penetrated in image.
The concatenation module 1105, target change is obtained for being handled according to the deformation parameter the mapping graph picture progress
Shape image, and by the target distortion image mosaic together.
In the present embodiment, described image splicing apparatus 110 also includes：Second generation module 1106, refers to for generating to have
Determine the net region of size and number, the region that the net region is covered by the mapping graph picture.
First generation module 1103 is additionally operable to according to each grid in the set of characteristic points and the net region
Summit generate the strain energy of distortion function.
In the present embodiment, the strain energy of distortion function is to include the spy according to each width mapping graph picture and neighbor mapping image
Levy the global energy function of the summit generation of the local energy function of point set generation and the net region of the mapping graph picture.
In the present embodiment, the local energy function is calculated by below equation and obtained：
Wherein,
Wherein, EpThe local energy function is represented, n represents the quantity of the characteristic point for alignment,Reflected described in representing
The corresponding summit of grid of the corresponding net region of the corresponding target distortion image of image is penetrated,Represent describedSummit pair
In the grid answered a bit, αj,kBilinear combinations parameter is represented,For mapping graph picture to be aligned reference picture described
In set of characteristic points a bit；
Wherein, what calculating was obtained is describedValue represent a part in the deformation parameter.
In the present embodiment, the global energy function is calculated by below equation and obtained：
Wherein,Represent the mapping graph as the grid corresponding one of the corresponding net region of corresponding target distortion image
Summit,Represent the summit of grid in the net region, τiA two-value is represented, when the point in the set of characteristic points existsSpecified range in when, τi=1, it is otherwise τi=0, wherein, it is described that calculating is obtainedValue represent in the deformation parameter
A part.
In the present embodiment, the strain energy of distortion function, which also includes being calculated according to the summit of grid in the net region, to be obtained
Smoothed energy function, the strain energy of distortion function be the local energy function, global energy function and smoothed energy function
According to the sum after default weight distribution.
In the present embodiment, the smoothed energy function is calculated in the following manner to be obtained：
The energy function on the summit of one of grid in the net region is calculated,
Wherein, the triangle that the summit of the grid in the net region is formedInCan be by two other
Vertex representation：
Wherein, u, v areByCoordinate in the coordinate system of definition；
Calculate the energy function on the summit of the gridThe cumulative sum of all vector entries obtains the smoothed energy
Function Es。
In the present embodiment, the object space coordinate system is spheric coordinate system.
Other details on the present embodiment can be further with reference to retouching in above-mentioned image split-joint method embodiment
State, will not be repeated here.
Image splicing device in the present embodiment, first original image is projected in target-based coordinate system carry out it is pre-splicing
Connect, the image after further will be pre-splicing is calculated by energy function to be obtained deformation parameter accurately to be spelled again
Connect, improve the effect of the splicing of image.
In several embodiments provided herein, it should be understood that disclosed apparatus and method, it can also pass through
Other modes are realized.Device embodiment described above is only schematical, for example, flow chart and block diagram in accompanying drawing
Show according to the device of multiple embodiments of the present invention, the architectural framework in the cards of method and computer program product,
Function and operation.At this point, each square frame in flow chart or block diagram can represent the one of a module, program segment or code
Part a, part for the module, program segment or code is used to realize holding for defined logic function comprising one or more
Row instruction.It should also be noted that in some implementations as replacement, the function of being marked in square frame can also with different from
The order marked in accompanying drawing occurs.For example, two continuous square frames can essentially be performed substantially in parallel, they are sometimes
It can perform in the opposite order, this is depending on involved function.It is also noted that every in block diagram and/or flow chart
The combination of individual square frame and block diagram and/or the square frame in flow chart, can use the special base for performing defined function or action
Realize, or can be realized with the combination of specialized hardware and computer instruction in the system of hardware.
In addition, each functional module in each embodiment of the invention can integrate to form an independent portion
Point or modules individualism, can also two or more modules be integrated to form an independent part.
If the function is realized using in the form of software function module and is used as independent production marketing or in use, can be with
It is stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are to cause a computer equipment (can be individual
People's computer, server, or network equipment etc.) perform all or part of step of each of the invention embodiment methods described.
And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.Need
Illustrate, herein, such as second and first or the like relational terms be used merely to by an entity or operation with
Another entity or operation make a distinction, and not necessarily require or imply between these entities or operation there is any this reality
The relation or order on border.Moreover, term " comprising ", "comprising" or its any other variant are intended to the bag of nonexcludability
Contain, so that process, method, article or equipment including a series of key elements are not only including those key elements, but also including
Other key elements being not expressly set out, or also include for this process, method, article or the intrinsic key element of equipment.
In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including the key element
Process, method, article or equipment in also there is other identical element.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should be included in the scope of the protection.It should be noted that：Similar label and letter exists
Similar terms is represented in following accompanying drawing, therefore, once being defined in a certain Xiang Yi accompanying drawing, is then not required in subsequent accompanying drawing
It is further defined and explained.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained
Cover within protection scope of the present invention.Therefore, protection scope of the present invention described should be defined by scope of the claims.
Claims (16)
1. a kind of image split-joint method, it is characterised in that described image joining method includes：
At least two width original images are projected in object space coordinate system, with least two width original images in the target empty
Between coordinate system carry out it is pre-splicing, to obtain mapping graph picture；
Obtain the set of characteristic points of the mapping graph picture；
Strain energy of distortion function is generated according to set of characteristic points；
The change parameter of characteristic point when calculating the strain energy of distortion functional value for minimum value in corresponding each mapping graph picture
Number；And
The mapping graph picture progress is handled according to the deformation parameter and obtains target distortion image, and by the target distortion figure
As being stitched together.
2. image split-joint method as claimed in claim 1, it is characterised in that at least will be projected to target empty by two width original images
Between in coordinate system, it is pre-splicing to be carried out at least two width original images in the object space coordinate system, to obtain mapping graph picture
The step of after, methods described also includes：
Generation is with the net region for specifying size and number, the region that the net region is covered by the mapping graph picture；
The step of generation strain energy of distortion function according to set of characteristic points, includes：
The strain energy of distortion function is generated according to the summit of each grid in the set of characteristic points and the net region.
3. image split-joint method as claimed in claim 2, it is characterised in that the strain energy of distortion function is to include according to each
The local energy function of the set of characteristic points generation of width mapping graph picture and neighbor mapping image and the grid regions of the mapping graph picture
The global energy function of the summit generation in domain.
4. image split-joint method as claimed in claim 3, it is characterised in that the local energy function passes through below equation meter
Obtain：
<mrow>
<msub>
<mi>E</mi>
<mi>p</mi>
</msub>
<mo>=</mo>
<munderover>
<mo>&Sigma;</mo>
<mrow>
<mi>j</mi>
<mo>=</mo>
<mn>1</mn>
</mrow>
<mi>n</mi>
</munderover>
<mo>|</mo>
<mo>|</mo>
<msub>
<mi>&Sigma;&alpha;</mi>
<mrow>
<mi>j</mi>
<mo>,</mo>
<mi>k</mi>
</mrow>
</msub>
<msub>
<mover>
<mi>V</mi>
<mo>^</mo>
</mover>
<mrow>
<mi>j</mi>
<mo>,</mo>
<mi>k</mi>
</mrow>
</msub>
<mo>-</mo>
<msub>
<mover>
<mi>P</mi>
<mo>~</mo>
</mover>
<mi>j</mi>
</msub>
<mo>|</mo>
<msup>
<mo>|</mo>
<mn>2</mn>
</msup>
<mo>;</mo>
</mrow>
Wherein,
Wherein, EpThe local energy function is represented, n represents the quantity of the characteristic point for alignment,Represent the mapping graph
As the corresponding summit of grid of the corresponding net region of corresponding target distortion image,Represent describedThe net of vertex correspondence
In lattice a bit, αj,kBilinear combinations parameter is represented,For mapping graph picture to be aligned reference picture in the characteristic point
In set a bit；
Wherein, what calculating was obtained is describedValue represent a part in the deformation parameter.
5. image split-joint method as claimed in claim 3, it is characterised in that the global energy function passes through below equation meter
Obtain：
<mrow>
<msub>
<mi>E</mi>
<mi>g</mi>
</msub>
<mo>=</mo>
<munder>
<mo>&Sigma;</mo>
<mi>i</mi>
</munder>
<mrow>
<msub>
<mi>&tau;</mi>
<mi>i</mi>
</msub>
<mo>|</mo>
<mo>|</mo>
<msub>
<mover>
<mi>V</mi>
<mo>^</mo>
</mover>
<mi>i</mi>
</msub>
<mo>-</mo>
<msub>
<mover>
<mi>V</mi>
<mo>&OverBar;</mo>
</mover>
<mi>i</mi>
</msub>
<mo>|</mo>
<msup>
<mo>|</mo>
<mn>2</mn>
</msup>
</mrow>
<mo>;</mo>
</mrow>
Wherein,The mapping graph is represented as the corresponding summit of grid of the corresponding net region of corresponding target distortion image,Represent the summit of grid in the net region, τiA two-value is represented, when the point in the set of characteristic points existsFinger
When determining in scope, τi=1, it is otherwise τi=0, wherein, it is described that calculating is obtainedValue represent one in the deformation parameter
Point.
6. image split-joint method as claimed in claim 3, it is characterised in that the strain energy of distortion function is also included according to described
The summit of grid calculates obtained smoothed energy function in net region, and the strain energy of distortion function is the local energy letter
Number, global energy function and smoothed energy function are according to the sum after default weight distribution.
7. image split-joint method as claimed in claim 6, it is characterised in that the smoothed energy function is counted in the following manner
Obtain：
The energy function on the summit of one of grid in the net region is calculated,
Wherein, the triangle that the summit of the grid in the net region is formedInCan be by two other summit
Represent：
Wherein, u, v areByCoordinate in the coordinate system of definition；
Calculate the energy function on the summit of the gridThe cumulative sum of all vector entries obtains the smoothed energy function
Es。
8. the image split-joint method as described in claim 1-7 any one, it is characterised in that the object space coordinate system is
Spheric coordinate system.
9. a kind of image splicing device, it is characterised in that described image splicing apparatus includes：
Pre-splicing connection module, for that at least two width original images will be projected in object space coordinate system, with original at least two
Image is pre-splicing in object space coordinate system progress, to obtain mapping graph picture；
Acquisition module, the set of characteristic points for obtaining the mapping graph picture；
First generation module, for generating strain energy of distortion function according to set of characteristic points；
Computing module, spy during for calculating the strain energy of distortion functional value for minimum value in corresponding each mapping graph picture
Levy deformation parameter a little；
Concatenation module, target distortion image is obtained for being handled according to the deformation parameter the mapping graph picture progress, and will
The target distortion image mosaic is together.
10. image splicing device as claimed in claim 9, it is characterised in that described device also includes：
Second generation module, for generating with the net region for specifying size and number, the net region is the mapping
The region that image is covered；
First generation module is additionally operable to the summit life according to each grid in the set of characteristic points and the net region
Into the strain energy of distortion function.
11. image splicing device as claimed in claim 10, it is characterised in that the strain energy of distortion function is to include according to every
The local energy function and the grid of the mapping graph picture of the set of characteristic points generation of one width mapping graph picture and neighbor mapping image
The global energy function of the summit generation in region.
12. image splicing device as claimed in claim 11, it is characterised in that the local energy function passes through below equation
Calculating is obtained：
<mrow>
<msub>
<mi>E</mi>
<mi>p</mi>
</msub>
<mo>=</mo>
<munderover>
<mo>&Sigma;</mo>
<mrow>
<mi>j</mi>
<mo>=</mo>
<mn>1</mn>
</mrow>
<mi>n</mi>
</munderover>
<mo>|</mo>
<mo>|</mo>
<msub>
<mi>&Sigma;&alpha;</mi>
<mrow>
<mi>j</mi>
<mo>,</mo>
<mi>k</mi>
</mrow>
</msub>
<msub>
<mover>
<mi>V</mi>
<mo>^</mo>
</mover>
<mrow>
<mi>j</mi>
<mo>,</mo>
<mi>k</mi>
</mrow>
</msub>
<mo>-</mo>
<msub>
<mover>
<mi>P</mi>
<mo>~</mo>
</mover>
<mi>j</mi>
</msub>
<mo>|</mo>
<msup>
<mo>|</mo>
<mn>2</mn>
</msup>
<mo>;</mo>
</mrow>
Wherein,
Wherein, EpThe local energy function is represented, n represents the quantity of the characteristic point for alignment,Represent the mapping graph
As the corresponding summit of grid of the corresponding net region of corresponding target distortion image,Represent describedVertex correspondence
In grid a bit, αj,kBilinear combinations parameter is represented,For mapping graph picture to be aligned reference picture in the feature
In point set a bit；
Wherein, what calculating was obtained is describedValue represent a part in the deformation parameter.
13. image splicing device as claimed in claim 11, it is characterised in that the global energy function passes through below equation
Calculating is obtained：
<mrow>
<msub>
<mi>E</mi>
<mi>g</mi>
</msub>
<mo>=</mo>
<munder>
<mo>&Sigma;</mo>
<mi>i</mi>
</munder>
<mrow>
<msub>
<mi>&tau;</mi>
<mi>i</mi>
</msub>
<mo>|</mo>
<mo>|</mo>
<msub>
<mover>
<mi>V</mi>
<mo>^</mo>
</mover>
<mi>i</mi>
</msub>
<mo>-</mo>
<msub>
<mover>
<mi>V</mi>
<mo>&OverBar;</mo>
</mover>
<mi>i</mi>
</msub>
<mo>|</mo>
<msup>
<mo>|</mo>
<mn>2</mn>
</msup>
</mrow>
<mo>;</mo>
</mrow>
Wherein,The mapping graph is represented as the corresponding summit of grid of the corresponding net region of corresponding target distortion image,Represent the summit of grid in the net region, τiA two-value is represented, when the point in the set of characteristic points existsFinger
When determining in scope, τi=1, it is otherwise τi=0, wherein, it is described that calculating is obtainedValue represent one in the deformation parameter
Point.
14. image splicing device as claimed in claim 11, it is characterised in that the strain energy of distortion function also includes according to institute
The summit for stating grid in net region calculates obtained smoothed energy function, and the strain energy of distortion function is the local energy letter
Number, global energy function and smoothed energy function are according to the sum after default weight distribution.
15. image splicing device as claimed in claim 14, it is characterised in that the smoothed energy function is in the following manner
Calculating is obtained：
The energy function on the summit of one of grid in the net region is calculated,
Wherein, the triangle that the summit of the grid in the net region is formedInCan be by two other summit
Represent：
Wherein, u, v areByCoordinate in the coordinate system of definition；
Calculate the energy function on the summit of the gridThe cumulative sum of all vector entries obtains the smoothed energy function
Es。
16. the image splicing device as described in claim 9-15 any one, it is characterised in that the object space coordinate system
For spheric coordinate system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710473121.1A CN107194878A (en) | 2017-06-21 | 2017-06-21 | Image split-joint method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710473121.1A CN107194878A (en) | 2017-06-21 | 2017-06-21 | Image split-joint method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107194878A true CN107194878A (en) | 2017-09-22 |
Family
ID=59879744
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710473121.1A Pending CN107194878A (en) | 2017-06-21 | 2017-06-21 | Image split-joint method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107194878A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112950468A (en) * | 2021-02-01 | 2021-06-11 | 咪咕文化科技有限公司 | Image splicing method, electronic device and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105389787A (en) * | 2015-09-30 | 2016-03-09 | 华为技术有限公司 | Panorama image stitching method and device |
| US20160088287A1 (en) * | 2014-09-22 | 2016-03-24 | Samsung Electronics Company, Ltd. | Image stitching for three-dimensional video |
| CN105678687A (en) * | 2015-12-29 | 2016-06-15 | 天津大学 | Stereo image stitching method based on content of images |
| CN105976324A (en) * | 2016-05-19 | 2016-09-28 | 温州大学城市学院 | Vehicle image splicing method |
| CN106651767A (en) * | 2016-12-30 | 2017-05-10 | 北京星辰美豆文化传播有限公司 | Panoramic image obtaining method and apparatus |
-
2017
- 2017-06-21 CN CN201710473121.1A patent/CN107194878A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160088287A1 (en) * | 2014-09-22 | 2016-03-24 | Samsung Electronics Company, Ltd. | Image stitching for three-dimensional video |
| CN105389787A (en) * | 2015-09-30 | 2016-03-09 | 华为技术有限公司 | Panorama image stitching method and device |
| CN105678687A (en) * | 2015-12-29 | 2016-06-15 | 天津大学 | Stereo image stitching method based on content of images |
| CN105976324A (en) * | 2016-05-19 | 2016-09-28 | 温州大学城市学院 | Vehicle image splicing method |
| CN106651767A (en) * | 2016-12-30 | 2017-05-10 | 北京星辰美豆文化传播有限公司 | Panoramic image obtaining method and apparatus |
Non-Patent Citations (2)
| Title |
|---|
| LIU F 等: "Content-Preserving Warps for 3D Video Stabilization", 《ACM TRANSACTIONS ON GRAPHICS》 * |
| XIN PAN 等: "Parallax-tolerant Image Stitching Based on Mesh Optimization", 《2017 IEEE 2ND ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC)》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112950468A (en) * | 2021-02-01 | 2021-06-11 | 咪咕文化科技有限公司 | Image splicing method, electronic device and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9384596B2 (en) | Visualization of obscured objects in 3D space | |
| US7983473B2 (en) | Transparency adjustment of a presentation | |
| US9817248B2 (en) | Method of virtually trying on eyeglasses | |
| US20070165050A1 (en) | Method and system for geographically-based and time-based online advertising | |
| CN105913478A (en) | 360-degree panorama display method and display module, and mobile terminal | |
| Knabb et al. | Scientific visualization, 3D immersive virtual reality environments, and archaeology in Jordan and the Near East | |
| CN108304075A (en) | A kind of method and apparatus carrying out human-computer interaction in augmented reality equipment | |
| CN101784980B (en) | Remote control apparatus and remote control method | |
| CN102955794A (en) | Method and device for displaying click condition of web page | |
| Naritomi et al. | CalorieCaptorGlass: Food calorie estimation based on actual size using hololens and deep learning | |
| Fu et al. | Tunnel vision optimization method for VR flood scenes based on Gaussian blur | |
| CN110460827A (en) | The determination method, apparatus and computer storage medium of galvanometer working condition | |
| KR20200136723A (en) | Method and apparatus for generating learning data for object recognition using virtual city model | |
| CN104461690A (en) | Power equipment operation simulation system | |
| CN104503725B (en) | A kind of information processing method and electronic equipment | |
| CN107481309A (en) | Three-dimensional reflection rendering intent and device | |
| CN106683152B (en) | 3D visual effect analogy method and device | |
| CN106973283A (en) | A kind of method for displaying image and device | |
| Trapp et al. | Strategies for visualising 3D points-of-interest on mobile devices | |
| CN113838217A (en) | Information display method and device, electronic equipment and readable storage medium | |
| CN107194878A (en) | Image split-joint method and device | |
| CN106131533A (en) | A kind of method for displaying image and terminal | |
| US20230260218A1 (en) | Method and apparatus for presenting object annotation information, electronic device, and storage medium | |
| CN103440036A (en) | Three-dimensional image display and interactive operation method and device | |
| EP3594906A1 (en) | Method and device for providing augmented reality, and computer program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170922 |
|
| RJ01 | Rejection of invention patent application after publication |