CN110427847A - A kind of method and apparatus of the Image Acquisition of transparent substance - Google Patents
A kind of method and apparatus of the Image Acquisition of transparent substance Download PDFInfo
- Publication number
- CN110427847A CN110427847A CN201910667492.2A CN201910667492A CN110427847A CN 110427847 A CN110427847 A CN 110427847A CN 201910667492 A CN201910667492 A CN 201910667492A CN 110427847 A CN110427847 A CN 110427847A
- Authority
- CN
- China
- Prior art keywords
- curved surface
- dimension curved
- shooting
- image
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Image Processing (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention discloses a kind of methods and apparatus of the Image Acquisition of transparent substance, to solve the threedimensional model acquisition problems to transparent substance or containing transparent wrapper object.Three-dimensional conversion is carried out at least one set of image of ultraviolet device for shooting shooting in the embodiment of the present invention, obtains at least one set of first three-dimension curved surface, first three-dimension curved surface is obtained after the ultraviolet device for shooting shoots the object for carrying out the irradiation of ultraviolet irradiation device；And three-dimensional conversion is carried out at least one set of image of common device for shooting shooting, and texture generation is carried out at least one set of image, obtain at least one set of second three-dimension curved surface and at least one set of three-D grain；The threedimensional model of the object is obtained according to first three-dimension curved surface, the second three-dimension curved surface and the three-D grain.The automatic disposable threedimensional model acquisition to transparent substance or the object for having transparent overwrap is successfully realized by the above method.
Description
Technical field
The present invention relates to image identification technical field, in particular to a kind of method of the Image Acquisition of transparent substance and set
It is standby.
Background technique
With the rapid development of artificial intelligence technology, image recognition technology also becomes the hot spot direction of current research, wherein
Image recognition technology refers to that the image obtained using computer to shooting is handled, analyzed and understood, to identify various differences
The target of mode and technology to picture.
At present in image acquisition process, generalling use infrared light or other radiation of visible light cargos, and use camera shooting
Article under head shooting infrared light or other radiation of visible light recycles software to carry out three-dimensional conversion to the image that shooting obtains,
Do further identifying processing, to obtain the threedimensional model of cargo, if but cargo be pellucidity or have a transparent overwrap,
Because infrared light or other visible lights can penetrate the characteristic of object, then the true shape of cargo can not be got.
In conclusion being adopted currently without the automatic disposable threedimensional model for transparent substance or containing transparent wrapper object
Set method.
Summary of the invention
The present invention provides a kind of method of the Image Acquisition of transparent substance, to solve currently without for containing hyalomere
The problem of dividing or packing the automatic disposable threedimensional model acquisition method of object.
In a first aspect, a kind of method of the Image Acquisition of transparent substance provided in an embodiment of the present invention includes:
Three-dimensional conversion is carried out at least one set of image of ultraviolet device for shooting shooting, obtains at least one set of first three-dimension curved surface,
Wherein first three-dimension curved surface is obtained after the ultraviolet device for shooting shoots the object for carrying out the irradiation of ultraviolet irradiation device
's；And three-dimensional conversion is carried out at least one set of image of common device for shooting shooting, and line is carried out at least one set of image
Reason generates, and obtains at least one set of second three-dimension curved surface and at least one set of three-D grain, wherein the three-D grain includes color letter
Breath and/or luminance information；The object is obtained according to first three-dimension curved surface, the second three-dimension curved surface and the three-D grain
Threedimensional model；It wherein, include the figure of at least one object different spatial in the image of every group of ultraviolet device for shooting shooting
Picture includes the image of at least two object different spatials in the image of every group of common device for shooting shooting.
The above method utilizes purple in carrying out the subject image collection process that transparent substance either has transparent overwrap
The feature of outer light carries out three-dimensional conversion at least one set of image of ultraviolet device for shooting shooting, it is three-dimensional bent to obtain at least one set first
Face, so as to obtain transparent substance or the object transparent overwrap threedimensional model, and by common shooting
At least one set of image of device shooting carries out three-dimensional conversion and texture generates, and obtains at least one set of second three-dimension curved surface and at least one
Group three-D grain, so as to be obtained according to first three-dimension curved surface, second three-dimension curved surface and the three-D grain
The complete model of the object is successfully realized the automatic disposable three-dimensional mould for transparent substance or containing transparent wrapper object
Type acquisition.
In one possible implementation, described according to first three-dimension curved surface, second three-dimension curved surface and institute
It states three-D grain and obtains the threedimensional model of the object, comprising: will be described at least one set of first three-dimension curved surface, at least one set
Second three-dimension curved surface and at least one set of three-D grain carry out processing synthesis and obtain the threedimensional model of the object；Or it will at least
First three-dimension curved surface described in one group, at least one set of second three-dimension curved surface, at least one set of three-D grain and at least one
Group third three-dimension curved surface processing synthesis obtains the model of the object；Wherein, the third three-dimension curved surface is by infrared bat
It is obtained after the three-dimensional conversion of image progress for the object that at least one set for taking the photograph device shooting carries out the irradiation of infrared radiation device.
The above method, by increasing infrared equipment, to keep the threedimensional model of obtained object more accurate.
In one possible implementation, the ultraviolet light of the ultraviolet irradiation device irradiation is ultraviolet light or the spy of striated
Assemble-publish code spot ultraviolet.
The above method, the ultraviolet light gone out that ultraviolet irradiation device is irradiated are arranged to striated or feature coding spot ultraviolet light
Light, thus easier when the image obtained to shooting carries out three-dimensional conversion.
In one possible implementation, it is described by least one set of first three-dimension curved surface, at least one set of described the
Two three-dimension curved surfaces, at least one set of three-D grain and at least one set of third three-dimension curved surface processing synthesis obtain the object
Model, comprising: match first three-dimension curved surface in such a way that unified coordinate system maps with the third three-dimension curved surface
Quasi- fusion, obtains the 4th three-dimension curved surface；According to the 4th three-dimension curved surface, second three-dimension curved surface and the three-D grain into
Row Construction of A Model.
The above method, it is specific how to introduce according to the first three-dimension curved surface, the second three-dimension curved surface, three-D grain and the three or three
Dimension curved surface processing synthesis obtains the threedimensional model of the object.
In one possible implementation, described according to the 4th three-dimension curved surface, second three-dimension curved surface and institute
It states after three-D grain carries out Construction of A Model, further includes: by the tectonic model and first three-dimension curved surface, second three-dimensional bent
After face, third three-dimension curved surface are compared by three-dimensional space position relationship, however, it is determined that lack part in the tectonic model, then
Auxiliary completion, counterweight are carried out to the lack part in the tectonic model according to first three-dimension curved surface, the second three-dimension curved surface
Part is closed to be merged；For the curvature portion that the first three-dimension curved surface is not overlapped with second, third three-dimension curved surface, the one or three is determined
Dimension curved surface is transparent region, does corresponding threedimensional model completion and three-dimensional transparent material label, and the model after completion is determined
For the model of the object.
The above method, when constructing the threedimensional model of the object, by the threedimensional model of construction constantly according to institute
It states the first three-dimension curved surface, the second three-dimension curved surface, third three-dimension curved surface to be compared, so that the threedimensional model to construction carries out
Verification, determines whether the threedimensional model has transparent region, and determines whether the threedimensional model of construction has missing, improves
The accuracy and integrity degree of model.
Second aspect, the embodiment of the invention also provides a kind of equipment of the Image Acquisition of transparent substance, which includes:
At least one processing unit and at least one storage unit, wherein the storage unit is stored with program code, when the journey
When sequence code is executed by the processing unit, so that the processing unit executes the function of each embodiment of above-mentioned first aspect.
The third aspect, the embodiment of the present invention also provide a kind of equipment of the Image Acquisition of transparent substance, which includes: to clap
Conversion module, processing module are taken the photograph, which has the function of realizing each embodiment of above-mentioned first aspect.
Fourth aspect, the application also provide a kind of computer storage medium, are stored thereon with computer program, the program quilt
The step of first aspect the method is realized when processor executes.
In addition, second aspect technical effect brought by any one implementation into fourth aspect can be found in first party
Technical effect brought by different implementations in face, details are not described herein again.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly introduced, it should be apparent that, drawings in the following description are only some embodiments of the invention, for this
For the those of ordinary skill in field, without any creative labor, it can also be obtained according to these attached drawings
His attached drawing.
Fig. 1 is the schematic diagram of a scenario of the Image Acquisition of the first transparent substance of the embodiment of the present invention；
Fig. 2 is a kind of method schematic diagram of the Image Acquisition of transparent substance of the embodiment of the present invention；
Fig. 3 is the schematic diagram of a scenario of the Image Acquisition of second of transparent substance of the embodiment of the present invention；
Fig. 4 is a kind of method flow schematic diagram of the Image Acquisition of transparent substance of the embodiment of the present invention；
Fig. 5 is the equipment schematic diagram of the Image Acquisition of the first transparent substance of the embodiment of the present invention；
Fig. 6 is the equipment schematic diagram of the Image Acquisition of second of transparent substance of the embodiment of the present invention.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention make into
It is described in detail to one step, it is clear that the described embodiments are only some of the embodiments of the present invention, rather than whole implementation
Example.Based on the embodiments of the present invention, obtained by those of ordinary skill in the art without making creative efforts
All other embodiment, shall fall within the protection scope of the present invention.
The some words occurred in text are explained below:
(1) term " multiple " refers to two or more in the embodiment of the present application, and other quantifiers are similar therewith.
(2) term "and/or" in the embodiment of the present application describes the incidence relation of affiliated partner, indicates may exist three kinds
Relationship, for example, A and/or B, can indicate: individualism A exists simultaneously A and B, these three situations of individualism B.Character "/"
Typically represent the relationship that forward-backward correlation object is a kind of "or".
(3) " infrared light " in the embodiment of the present invention is called infrared ray, is the wavelength electromagnetic wave (light) longer than visible light,
Wavelength is between 770 nanometers to 1 millimeter, in the outside of red light above spectrum.
(4) " thermal camera " in the embodiment of the present invention refers to the video camera made using infrared ray principle, can receive
Spectrum is obtained between 770 nanometers to 1 millimeter, can be imaged under Infrared irradiation.
(5) range of wavelength in electromagnetic spectrum of " ultraviolet light " in the embodiment of the present invention is 10-400nm, shorter than visible light,
But the electromagnetic radiation longer than X-ray, especially wavelength are less than the ultraviolet light of 300nm.In all electronics that can generate electromagnetic radiation
In wave, ultraviolet radiation energy is low, and penetration power is weak, and light quantum simple glass cannot all penetrate, to paper, organic glass and one
As transparent plastic film transmitance it is also very low.
In the prior art, when carrying out Image Acquisition, the object generally is irradiated using infrared radiation device, and pass through infrared bat
It takes the photograph device to shoot the object for carrying out the irradiation of infrared radiation device, obtains at least one set of object shot by infrared shooting device
The image of body, so that the striped or coding hot spot that are irradiated by infrared radiation device handle described image to obtain the three of the object
Dimension module；Or it is handled to obtain the object in conjunction with the image of at least one set of object shot by common device for shooting
Threedimensional model.But the object if desired acquired is the object that transparent substance either has transparent overwrap, then because it is infrared
Light peneration is strong, can not identify the shape of transparent substance, meanwhile, by the image of the object that common camera is shot into
The integrity degree of the threedimensional model of object described in row processing reconstructed is not high, and error is larger, therefore, it is impossible to successfully realize to for transparent
The Image Acquisition of the automatic disposable threedimensional model of object.
The present invention is directed to the Image Acquisition problem of transparent substance, proposes a kind of method of the Image Acquisition of transparent substance,
Wherein, image collecting device described in the embodiment of the present invention includes ultraviolet equipment and common device for shooting, and the ultraviolet equipment is purple
The combination of external exposure device and ultraviolet device for shooting is referred to as, the ultraviolet irradiation device in ultraviolet equipment described in described image acquisition device with
The position of the ultraviolet device for shooting is fixed, and the position of the ultraviolet equipment and common device for shooting is relatively fixed.
For example, main application scenarios are as shown in Figure 1 in the embodiment of the present invention, it is assumed that need to carry out Image Acquisition at present
It is an outside for transparent plastic bag, inside is filled with the object of bread.Wherein, the equipment for carrying out Image Acquisition includes one
Rotating mechanism can be rotated to for acquiring object to target, and cooperate acquisition shooting work, and the rotation disc mechanism can be defeated
Rotation angle information out assists each three-dimension curved surface that must be synthesized.When carrying out Image Acquisition, the object is placed on rotating disk
On, the rotating disk can carry out 360 degree rotation, then irradiate the object using ultraviolet irradiation device, and pass through ultraviolet shooting
Device shoots the object for carrying out the irradiation of ultraviolet irradiation device, and is shot by common device for shooting to the object.From
And the image of at least one set of object shot by ultraviolet device for shooting is obtained, and obtain at least one set of by commonly shooting
The image of the object of device shooting, handles to obtain the threedimensional model of the object finally by the picture is carried out synthesis.
As shown in Fig. 2, the embodiment of the present invention provides a kind of method of the Image Acquisition of transparent substance, this method comprises:
Step 200 carries out three-dimensional conversion at least one set of image of ultraviolet device for shooting shooting, obtains at least one set the one or three
Curved surface is tieed up, wherein first three-dimension curved surface is that the ultraviolet device for shooting shoots the object for carrying out the irradiation of ultraviolet irradiation device
It obtains afterwards；And three-dimensional conversion is carried out at least one set of image of common device for shooting shooting, and at least one set of image
Texture generation is carried out, at least one set of second three-dimension curved surface and at least one set of three-D grain are obtained, wherein the three-D grain includes
Color information and/or luminance information；
Step 201 obtains the object according to first three-dimension curved surface, the second three-dimension curved surface and the three-D grain
Threedimensional model.
Pass through the above method, in carrying out the subject image collection process that transparent substance either has transparent overwrap, benefit
The characteristics of with ultraviolet light, carries out three-dimensional conversion at least one set of image of ultraviolet device for shooting shooting, obtains at least one set the one or three
Tie up curved surface, so as to obtain transparent substance or the object transparent overwrap threedimensional model, and by common
At least one set of image of device for shooting shooting carries out three-dimensional conversion and texture generates, and obtains at least one set of second three-dimension curved surface and extremely
Few one group of three-D grain, so as to according to first three-dimension curved surface, second three-dimension curved surface and the three-D grain
The complete model of the object is obtained, the automatic disposable threedimensional model acquisition for transparent substance is successfully realized.
Further, when carrying out Image Acquisition for transparent substance in the embodiment of the present invention, for example Image Acquisition is carried out
It is an outside for transparent plastic bag, inside is filled with the object of bread, then in order to keep obtained object model more accurate, such as
Shown in Fig. 3, may also include infrared equipment in described image acquisition device, wherein the infrared equipment be infrared radiation device with it is red
The combination of outer device for shooting is referred to as, and the infrared radiation device and the position of infrared shooting device in the infrared equipment are fixed.Described image
Infrared equipment, the ultraviolet equipment in acquisition device, the position of common device for shooting are relatively fixed.
Specifically, carrying out three-dimensional conversion at least one set of image of ultraviolet device for shooting shooting, at least one set the one or three is obtained
Curved surface is tieed up, wherein first three-dimension curved surface is that the ultraviolet device for shooting shoots the object for carrying out the irradiation of ultraviolet irradiation device
It obtains afterwards；Three-dimensional conversion is carried out at least one set of image of infrared shooting device shooting, obtains at least one set of third three-dimension curved surface,
Wherein described image is obtained after the infrared shooting device shoots the object for carrying out the irradiation of infrared radiation device；To common
At least one set of image of device for shooting shooting carries out three-dimensional conversion, and carries out texture generation at least one set of image, obtain to
Few one group of second three-dimension curved surface and at least one set of three-D grain；It will be described at least one set of first three-dimension curved surface, at least one set
Second three-dimension curved surface, at least one set of three-D grain and at least one set of third three-dimension curved surface processing synthesis obtain the object
Model.
It should be noted that clapping above by the ultraviolet device for shooting the object for carrying out the irradiation of ultraviolet irradiation device
It takes the photograph, shooting is carried out to the object for carrying out the irradiation of infrared radiation device by the infrared shooting device and is shot by common device for shooting
The step of shooting to the object does not distinguish sequencing.
Further, the ultraviolet light of the ultraviolet irradiation device irradiation is the ultraviolet light or feature coding spot ultraviolet light of striated
Light, thus easier when the image obtained to shooting carries out three-dimensional conversion.
Wherein, when carry out Image Acquisition be an outside is transparent plastic bag, inside is when being filled with the object of bread, mainly
Three-dimensional conversion is carried out by at least one set of image shot to ultraviolet device for shooting, obtains the three-dimensional mould of the outer packing of the object
The profile of type, especially transparent overwrap；Three-dimensional conversion is mainly carried out by at least one set of image shot to infrared shooting device,
Obtain the profile of the non-transparent part of the object, the i.e. profile of internal bread；And extremely by common camera shooting
Few one group of image carries out three-dimensional conversion and carries out texture generation at least one set of image, and it is three-dimensional to obtain at least one set second
Curved surface and at least one set of three-D grain carry out model checking to assist.
Further, at least one set of first three-dimension curved surface, at least one set described second in the embodiment of the present invention
Three-dimension curved surface, at least one set of third three-dimension curved surface and at least one set of three-D grain processing synthesis obtain the object
Threedimensional model when, because described image acquisition device middle infrared gear is different from the placement position of ultraviolet equipment, so passing through institute
State the seat of the third three-dimension curved surface that infrared equipment obtains Yu first three-dimension curved surface obtained by the ultraviolet equipment
Mark system is different, the side that therefore, it is necessary to be mapped by unified coordinate system first three-dimension curved surface and the third three-dimension curved surface
Formula carries out registration fusion, to obtain the threedimensional model of the object.
Specifically, by first three-dimension curved surface and the third three-dimension curved surface in such a way that unified coordinate system maps into
Row registration fusion, obtains the 4th three-dimension curved surface；According to the 4th three-dimension curved surface, second three-dimension curved surface and the three-dimensional pattern
Reason carries out Construction of A Model.
Further, institute is constructed according to the 4th three-dimension curved surface, second three-dimension curved surface and the texture information
When stating object model, the tectonic model and first three-dimension curved surface, the second three-dimension curved surface, third three-dimension curved surface are passed through three
After dimension space positional relationship is compared, however, it is determined that lack part in the tectonic model, then according to the first three-dimension curved surface, second
Three-dimension curved surface carries out auxiliary completion to the lack part in the tectonic model, merges to intersection.
Further, it after the intersection to the tectonic model merges, also needs to judge in the tectonic model
It whether include transparent region.
Specifically, if first three-dimension curved surface has the curvature portion not being overlapped with second, third described three-dimension curved surface,
Then determine that first three-dimension curved surface is transparent region.
Further, after determining that first three-dimension curved surface is transparent region, corresponding threedimensional model completion and three are
Transparent material label is tieed up, and the threedimensional model after completion and label is determined as to the threedimensional model of the object.
If it is determined that the tectonic model does not have lack part, then according to second three-dimension curved surface to the tectonic model into
Row verification, so that the threedimensional model accuracy of the object finally obtained is higher.
Further, can be furnished with PL polariscope in the common device for shooting, help to further decrease ambient light process
The light interference that surface of package emits, to improve the accuracy of model.
Further, in order to enable the model of the object arrived is more accurate, according in ultraviolet equipment ultraviolet irradiation device with
The position of the ultraviolet device for shooting, and according in infrared equipment infrared radiation device and infrared shooting device position to the mould
Type is demarcated, using the threedimensional model that calibrated threedimensional model is final as the object.
Which kind of it should be noted that above-named mode is merely illustrative, can specifically be set by user using mode
It sets.To make the objectives, technical solutions, and advantages of the present invention clearer, the present invention is made further below in conjunction with attached drawing
Detailed description, it is clear that the described embodiments are only some of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts all other
Embodiment shall fall within the protection scope of the present invention.
With reference to the accompanying drawings of the specification, to a kind of method flow selection of the Image Acquisition of transparent substance provided by the invention
A kind of scene is introduced.
As shown in figure 4, a kind of method of the Image Acquisition of transparent substance provided in an embodiment of the present invention, specifically includes following
Step:
Step 400 carries out the irradiation of ultraviolet irradiation device by the way that the ultraviolet device for shooting shooting in image collecting device is at least one set of
Object image；
Step 401 carries out the irradiation of infrared radiation device by the way that the infrared shooting device shooting in image collecting device is at least one set of
Object image；
Step 402, the image that at least one set of object is shot by the common device for shooting in image collecting device；
It should be noted that point of above-mentioned steps 400, step 401, step 402 without sequencing；
Step 403 carries out three-dimensional conversion at least one set of image of ultraviolet device for shooting shooting, obtains at least one set the one or three
Tie up curved surface；
Step 404 carries out three-dimensional conversion at least one set of image of infrared shooting device shooting, obtains at least one set the three or three
Tie up curved surface；
Step 405 carries out three-dimensional conversion at least one set of image of common device for shooting shooting, and at least one set of figure
As carrying out texture generation, at least one set of second three-dimension curved surface and at least one set of three-D grain are obtained；
It should be noted that point of above-mentioned steps 403, step 404, step 405 without sequencing；
Step 406, by first three-dimension curved surface and the third three-dimension curved surface in such a way that unified coordinate system maps
Registration fusion is carried out, the 4th three-dimension curved surface is obtained；
Step 407 carries out model structure according to the 4th three-dimension curved surface, second three-dimension curved surface and the three-D grain
It makes；
Step 408 leads to the tectonic model and first three-dimension curved surface, the second three-dimension curved surface, third three-dimension curved surface
Three-dimensional space position relationship is crossed to be compared；
Step 409, if it is determined that lack part in the tectonic model, then according to first three-dimension curved surface, second three-dimensional
Curved surface carries out auxiliary completion to the lack part in the tectonic model, merges to intersection；It is three-dimensional for first bent
The curvature portion that face is not overlapped with second, third three-dimension curved surface determines that the first three-dimension curved surface is transparent region, does corresponding three-dimensional
Model completion and three-dimensional transparent material mark, and the model after completion is determined as to the model of the object.
In some possible embodiments, the method for the Image Acquisition of a kind of transparent substance provided in an embodiment of the present invention
Various aspects be also implemented as the form of program product a kind of comprising program code, when said program code is calculating
When running on machine equipment, said program code is described in this specification according to the present invention for making the computer equipment execution
Step in the method for the Image Acquisition of the transparent substance of various illustrative embodiments.
Described program product can be using any combination of one or more readable mediums.Readable medium can be readable letter
Number medium or readable storage medium storing program for executing.Readable storage medium storing program for executing for example may be-but not limited to-electricity, magnetic, optical, electromagnetic, red
The system of outside line or semiconductor, device or device, or any above combination.The more specific example of readable storage medium storing program for executing
(non exhaustive list) includes: the electrical connection with one or more conducting wires, portable disc, hard disk, random access memory
(RAM), read-only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc
Read memory (CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.
The program product of the Image Acquisition for transparent substance of embodiment according to the present invention can use portable
Formula compact disk read-only memory (CD-ROM) and including program code, and can be run on server apparatus.However, of the invention
Program product it is without being limited thereto, in this document, readable storage medium storing program for executing can be it is any include or storage program tangible medium,
The program can be transmitted by information, device or device use or in connection.
Readable signal medium may include in a base band or as the data-signal that carrier wave a part is propagated, wherein carrying
Readable program code.The data-signal of this propagation can take various forms, including --- but being not limited to --- electromagnetism letter
Number, optical signal or above-mentioned any appropriate combination.Readable signal medium can also be other than readable storage medium storing program for executing it is any can
Medium is read, which can send, propagates or transmit for being used by periodic network moving system, device or device
Or program in connection.
The program code for including on readable medium can transmit with any suitable medium, including --- but being not limited to ---
Wirelessly, wired, optical cable, RF etc. or above-mentioned any appropriate combination.
The program for executing operation of the present invention can be write with any combination of one or more programming languages
Code, described program design language include object oriented program language-Java, C++ etc., further include conventional
Procedural programming language-such as " C " language or similar programming language.Program code can be fully in user
It calculates and executes in equipment, partly executes on a user device, being executed as an independent software package, partially in user's calculating
Upper side point is executed on a remote computing or is executed in remote computing device or server completely.It is being related to far
Journey calculates in the situation of equipment, and remote computing device can pass through the network of any kind --- including local area network (LAN) or extensively
Domain net (WAN)-be connected to user calculating equipment, or, it may be connected to external computing device.
As shown in figure 5, the embodiment of the present invention provides a kind of equipment of the Image Acquisition of transparent substance, the equipment include: to
A few processing unit 500 and at least one storage unit 501, wherein the storage unit 501 is stored with program code,
When said program code is executed by the processing unit 500, so that the processing unit 500 executes following process:
Three-dimensional conversion is carried out at least one set of image of ultraviolet device for shooting shooting, obtains at least one set of first three-dimension curved surface,
Wherein described image is obtained after the ultraviolet device for shooting shoots the object for carrying out the irradiation of ultraviolet irradiation device；And it is right
At least one set of image of common device for shooting shooting carries out three-dimensional conversion, and carries out texture generation at least one set of image, obtains
To at least one set of second three-dimension curved surface and at least one set of three-D grain, wherein the three-D grain includes colour information and/or bright
Spend information；
The three-dimensional mould of the object is obtained according to first three-dimension curved surface, the second three-dimension curved surface and the three-D grain
Type；
It wherein, include the figure of at least one object different spatial in the image of every group of ultraviolet device for shooting shooting
Picture includes the image of at least two object different spatials in the image of every group of common device for shooting shooting.
Optionally, the processing unit 500 is specifically used for:
By at least one set of first three-dimension curved surface, at least one set of second three-dimension curved surface and at least one set of three-dimensional
Texture carries out processing synthesis and obtains the threedimensional model of the object；Or
By at least one set of first three-dimension curved surface, at least one set of second three-dimension curved surface, at least one set of three-dimensional
Texture and at least one set of third three-dimension curved surface processing synthesis obtain the model of the object；
Wherein, the third three-dimension curved surface is at least one set of progress infrared radiation device photograph by shooting to infrared shooting device
It is obtained after the three-dimensional conversion of image progress for the object penetrated.
Optionally, the ultraviolet light of the ultraviolet irradiation device irradiation is the ultraviolet light or feature coding spot ultraviolet light of striated
Light.
Optionally, the processing unit 500 is specifically used for:
First three-dimension curved surface is registrated in such a way that unified coordinate system maps with the third three-dimension curved surface
Fusion, obtains the 4th three-dimension curved surface；
Construction of A Model is carried out according to the 4th three-dimension curved surface, second three-dimension curved surface and the three-D grain.
Optionally, the processing unit 500 is also used to:
The tectonic model and first three-dimension curved surface, the second three-dimension curved surface, third three-dimension curved surface are passed through into three-dimensional space
Between after positional relationship is compared, however, it is determined that lack part in the tectonic model, then according to first three-dimension curved surface, second
Three-dimension curved surface carries out auxiliary completion to the lack part in the tectonic model, merges to intersection；And for
The curvature portion that one three-dimension curved surface is not overlapped with second, third three-dimension curved surface, after determining the first three-dimension curved surface for transparent region,
Threedimensional model completion and three-dimensional transparent material label are carried out, and the model after completion is determined as to the threedimensional model of the object.
Optionally, the equipment includes a rotating mechanism, for rotating to target acquisition object, and cooperates acquisition
Shooting；Wherein, the rotating mechanism can export rotation angle information, and each three-dimension curved surface is assisted to be synthesized.
As shown in fig. 6, the embodiment of the present invention provides a kind of equipment of the Image Acquisition of transparent substance, including conversion module
600 and processing module 601:
Conversion module 600: at least one set of image for shooting to ultraviolet device for shooting carries out three-dimensional conversion, obtains at least one
The first three-dimension curved surface of group, wherein described image is that the ultraviolet device for shooting shoots the object for carrying out the irradiation of ultraviolet irradiation device
It obtains afterwards；And three-dimensional conversion is carried out at least one set of image of common device for shooting shooting, and at least one set of image
Texture generation is carried out, at least one set of second three-dimension curved surface and at least one set of three-D grain are obtained, wherein the three-D grain includes
Colour information and/or luminance information；
Processing module 601: for obtaining institute according to first three-dimension curved surface, the second three-dimension curved surface and the three-D grain
State the threedimensional model of object；
It wherein, include the figure of at least one object different spatial in the image of every group of ultraviolet device for shooting shooting
Picture includes the image of at least two object different spatials in the image of every group of common device for shooting shooting.
Optionally, the processing module 601 is specifically used for:
By at least one set of first three-dimension curved surface, at least one set of second three-dimension curved surface and at least one set of three-dimensional
Texture carries out processing synthesis and obtains the threedimensional model of the object；Or
By at least one set of first three-dimension curved surface, at least one set of second three-dimension curved surface, at least one set of three-dimensional
Texture and at least one set of third three-dimension curved surface processing synthesis obtain the model of the object；
Wherein, the third three-dimension curved surface is at least one set of progress infrared radiation device photograph by shooting to infrared shooting device
It is obtained after the three-dimensional conversion of image progress for the object penetrated.
Optionally, the ultraviolet light of the ultraviolet irradiation device irradiation is the ultraviolet light or feature coding spot ultraviolet light of striated
Light.
Optionally, the processing module 601 is specifically used for:
First three-dimension curved surface is registrated in such a way that unified coordinate system maps with the third three-dimension curved surface
Fusion, obtains the 4th three-dimension curved surface；
Construction of A Model is carried out according to the 4th three-dimension curved surface, second three-dimension curved surface and the three-D grain.
Optionally, the processing module 601 is also used to:
The tectonic model and first three-dimension curved surface, the second three-dimension curved surface, third three-dimension curved surface are passed through into three-dimensional space
Between after positional relationship is compared, however, it is determined that lack part in the tectonic model, then according to first three-dimension curved surface, second
Three-dimension curved surface carries out auxiliary completion to the lack part in the tectonic model, merges to intersection；And for
The curvature portion that one three-dimension curved surface is not overlapped with second, third three-dimension curved surface, after determining the first three-dimension curved surface for transparent region,
Threedimensional model completion and three-dimensional transparent material label are carried out, and the model after completion is determined as to the threedimensional model of the object.
Optionally, the equipment includes a rotating mechanism, for rotating to target acquisition object, and cooperates acquisition
Shooting；Wherein, the rotating mechanism can export rotation angle information, and each three-dimension curved surface is assisted to be synthesized.
The embodiment of the present invention also provides a kind of computer-readable non-volatile memory medium, including program code, when described
When program code is run on the computing device, said program code is for making the calculating equipment execute the embodiments of the present invention
The step of image-pickup method of transparent substance.
Above by reference to showing according to the method, apparatus (system) of the embodiment of the present application and/or the frame of computer program product
Figure and/or flow chart describe the application.It should be understood that can realize that block diagram and or flow chart is shown by computer program instructions
The combination of the block of a block and block diagram and or flow chart diagram for figure.These computer program instructions can be supplied to logical
With computer, the processor of special purpose computer and/or other programmable data processing units, to generate machine, so that via meter
The instruction that calculation machine processor and/or other programmable data processing units execute creates for realizing block diagram and or flow chart block
In specified function action method.
Correspondingly, the application can also be implemented with hardware and/or software (including firmware, resident software, microcode etc.).More
Further, the application can take computer usable or the shape of the computer program product on computer readable storage medium
Formula has the computer realized in the medium usable or computer readable program code, to be made by instruction execution system
It is used with or in conjunction with instruction execution system.In the present context, computer can be used or computer-readable medium can be with
It is arbitrary medium, may include, stores, communicates, transmits or transmit program, is made by instruction execution system, device or equipment
With, or instruction execution system, device or equipment is combined to use.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (11)
1. a kind of method of the Image Acquisition of transparent substance, which is characterized in that the described method includes:
Three-dimensional conversion is carried out at least one set of image of ultraviolet device for shooting shooting, obtains at least one set of first three-dimension curved surface, wherein
First three-dimension curved surface is obtained after the ultraviolet device for shooting shoots the object for carrying out the irradiation of ultraviolet irradiation device；
And three-dimensional conversion is carried out at least one set of image of common device for shooting shooting, and line is carried out at least one set of image
Reason generates, and obtains at least one set of second three-dimension curved surface and at least one set of three-D grain, wherein the three-D grain includes color letter
Breath and/or luminance information；
The threedimensional model of the object is obtained according to first three-dimension curved surface, the second three-dimension curved surface and the three-D grain；
It wherein, include the image of at least one object different spatial in the image of every group of ultraviolet device for shooting shooting, often
It include the image of at least two object different spatials in the image of the common device for shooting shooting of group.
2. the method as described in claim 1, which is characterized in that it is described according to first three-dimension curved surface, it is described second three-dimensional
Curved surface and the three-D grain obtain the threedimensional model of the object, comprising:
By at least one set of first three-dimension curved surface, at least one set of second three-dimension curved surface and at least one set of three-D grain
It carries out processing synthesis and obtains the threedimensional model of the object；Or it will be described at least one set of first three-dimension curved surface, at least one set
Second three-dimension curved surface, at least one set of three-D grain and at least one set of third three-dimension curved surface processing synthesis obtain the object
Model；
Wherein, the third three-dimension curved surface is at least one set of progress infrared radiation device irradiation by shooting to infrared shooting device
It is obtained after the three-dimensional conversion of image progress of object.
3. the method as described in claim 1, which is characterized in that the ultraviolet light of the ultraviolet irradiation device irradiation is the purple of striated
Outer light or feature coding spot ultraviolet.
4. method according to claim 2, which is characterized in that described by least one set of first three-dimension curved surface, at least one
Group second three-dimension curved surface, at least one set of three-D grain and at least one set of third three-dimension curved surface processing synthesis obtain institute
State the threedimensional model of object, comprising:
First three-dimension curved surface is carried out being registrated fusion with the third three-dimension curved surface in such a way that unified coordinate system maps,
Obtain the 4th three-dimension curved surface；
Construction of A Model is carried out according to the 4th three-dimension curved surface, second three-dimension curved surface and the three-D grain.
5. method as claimed in claim 4, which is characterized in that it is described according to the 4th three-dimension curved surface, it is described second three-dimensional
Curved surface and the three-D grain carry out after Construction of A Model, further includes:
The tectonic model and first three-dimension curved surface, the second three-dimension curved surface, third three-dimension curved surface are passed through into three-dimensional space meta position
After the relationship of setting is compared, however, it is determined that lack part in the tectonic model, then according to first three-dimension curved surface, the second three-dimensional
Curved surface carries out auxiliary completion to the lack part in the tectonic model, merges to intersection；It is three-dimensional for first bent
The curvature portion that face is not overlapped with second, third three-dimension curved surface determines that the first three-dimension curved surface is transparent region, does corresponding three-dimensional
Model completion and three-dimensional transparent material mark, and the model after completion is determined as to the model of the object.
6. a kind of equipment of the Image Acquisition of transparent substance, which is characterized in that the equipment include: at least one processing unit and
At least one storage unit, wherein the storage unit is stored with program code, when said program code is by the processing unit
When execution, so that the processing unit executes following process:
Three-dimensional conversion is carried out at least one set of image of ultraviolet device for shooting shooting, obtains at least one set of first three-dimension curved surface, wherein
Described image is obtained after the ultraviolet device for shooting shoots the object for carrying out the irradiation of ultraviolet irradiation device；And to common
At least one set of image of device for shooting shooting carries out three-dimensional conversion, and carries out texture generation at least one set of image, obtain to
Few one group of second three-dimension curved surface and at least one set of three-D grain, wherein the three-D grain includes colour information and/or brightness letter
Breath；
The threedimensional model of the object is obtained according to first three-dimension curved surface, the second three-dimension curved surface and the three-D grain；
It wherein, include the image of at least one object different spatial in the image of every group of ultraviolet device for shooting shooting, often
It include the image of at least two object different spatials in the image of the common device for shooting shooting of group.
7. equipment as claimed in claim 6, which is characterized in that the processing unit is specifically used for:
By at least one set of first three-dimension curved surface, at least one set of second three-dimension curved surface and at least one set of three-D grain
It carries out processing synthesis and obtains the threedimensional model of the object；Or
By at least one set of first three-dimension curved surface, at least one set of second three-dimension curved surface, at least one set of three-D grain
And at least one set of third three-dimension curved surface processing synthesis obtains the model of the object；
Wherein, the third three-dimension curved surface is at least one set of progress infrared radiation device irradiation by shooting to infrared shooting device
It is obtained after the three-dimensional conversion of image progress of object.
8. equipment as claimed in claim 6, which is characterized in that the ultraviolet light of the ultraviolet irradiation device irradiation is the purple of striated
Outer light or feature coding spot ultraviolet.
9. equipment as claimed in claim 7, which is characterized in that the processing unit is specifically used for:
First three-dimension curved surface is carried out being registrated fusion with the third three-dimension curved surface in such a way that unified coordinate system maps,
Obtain the 4th three-dimension curved surface；
Construction of A Model is carried out according to the 4th three-dimension curved surface, second three-dimension curved surface and the three-D grain.
10. equipment as claimed in claim 9, which is characterized in that the processing unit is also used to:
The tectonic model and first three-dimension curved surface, the second three-dimension curved surface, third three-dimension curved surface are passed through into three-dimensional space meta position
After the relationship of setting is compared, however, it is determined that lack part in the tectonic model, then according to first three-dimension curved surface, the second three-dimensional
Curved surface carries out auxiliary completion to the lack part in the tectonic model, merges to intersection；And for the one or three
The curvature portion that dimension curved surface is not overlapped with second, third three-dimension curved surface carries out after determining the first three-dimension curved surface for transparent region
Threedimensional model completion and three-dimensional transparent material mark, and the model after completion is determined as to the threedimensional model of the object.
11. the equipment as described in claim 6-10 is any, which is characterized in that the equipment includes a rotating mechanism, is used for
Target acquisition object is rotated, and acquisition is cooperated to shoot；Wherein, the rotating mechanism can export rotation angle information, auxiliary
Each three-dimension curved surface is helped to be synthesized.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910667492.2A CN110427847B (en) | 2019-07-23 | 2019-07-23 | Method and equipment for acquiring three-dimensional model |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910667492.2A CN110427847B (en) | 2019-07-23 | 2019-07-23 | Method and equipment for acquiring three-dimensional model |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110427847A true CN110427847A (en) | 2019-11-08 |
| CN110427847B CN110427847B (en) | 2022-05-06 |
Family
ID=68411939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910667492.2A Active CN110427847B (en) | 2019-07-23 | 2019-07-23 | Method and equipment for acquiring three-dimensional model |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110427847B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6858826B2 (en) * | 1996-10-25 | 2005-02-22 | Waveworx Inc. | Method and apparatus for scanning three-dimensional objects |
| CN101034467A (en) * | 2006-03-06 | 2007-09-12 | 赵国珍 | Photographic static solid model machine |
| CN101872485A (en) * | 2009-04-27 | 2010-10-27 | 鸿富锦精密工业（深圳）有限公司 | Conversion method for curved surface coordinate value |
| CN102855626A (en) * | 2012-08-09 | 2013-01-02 | 深圳先进技术研究院 | Methods and devices for light source direction calibration and human information three-dimensional collection |
| CN104407441A (en) * | 2014-05-31 | 2015-03-11 | 福州大学 | Integrated imaging 3D display micro-lens array and manufacturing method thereof |
| CN104657708A (en) * | 2015-02-02 | 2015-05-27 | 郑州酷派电子设备有限公司 | Novel device and method for identifying three-dimensional object |
| US20160232709A1 (en) * | 2015-02-09 | 2016-08-11 | U.S. Army Research Laboratory Attn: Rdrl-Loc-I | Method for Modeling a Three-Dimensional Topological Surface of an Object from Long-Wave-Infrared Radiation Emitted from the Object |
| CN106827545A (en) * | 2017-02-04 | 2017-06-13 | 山东大学 | Based on the transparent pervious concrete test specimen 3D printing method of CT scan |
| CN107240148A (en) * | 2017-04-11 | 2017-10-10 | 中国人民解放军国防科学技术大学 | Transparent substance three-dimensional surface rebuilding method and device based on background stration technique |
| CN108008259A (en) * | 2017-11-14 | 2018-05-08 | 国网江西省电力有限公司电力科学研究院 | Based on infrared, the integrated detection method of Uv and visible light image co-registration and device |
| CN108921926A (en) * | 2018-07-02 | 2018-11-30 | 广州云从信息科技有限公司 | A kind of end-to-end three-dimensional facial reconstruction method based on single image |
| US10149958B1 (en) * | 2015-07-17 | 2018-12-11 | Bao Tran | Systems and methods for computer assisted operation |
-
2019
- 2019-07-23 CN CN201910667492.2A patent/CN110427847B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6858826B2 (en) * | 1996-10-25 | 2005-02-22 | Waveworx Inc. | Method and apparatus for scanning three-dimensional objects |
| CN101034467A (en) * | 2006-03-06 | 2007-09-12 | 赵国珍 | Photographic static solid model machine |
| CN101872485A (en) * | 2009-04-27 | 2010-10-27 | 鸿富锦精密工业（深圳）有限公司 | Conversion method for curved surface coordinate value |
| CN102855626A (en) * | 2012-08-09 | 2013-01-02 | 深圳先进技术研究院 | Methods and devices for light source direction calibration and human information three-dimensional collection |
| CN104407441A (en) * | 2014-05-31 | 2015-03-11 | 福州大学 | Integrated imaging 3D display micro-lens array and manufacturing method thereof |
| CN104657708A (en) * | 2015-02-02 | 2015-05-27 | 郑州酷派电子设备有限公司 | Novel device and method for identifying three-dimensional object |
| US20160232709A1 (en) * | 2015-02-09 | 2016-08-11 | U.S. Army Research Laboratory Attn: Rdrl-Loc-I | Method for Modeling a Three-Dimensional Topological Surface of an Object from Long-Wave-Infrared Radiation Emitted from the Object |
| US10149958B1 (en) * | 2015-07-17 | 2018-12-11 | Bao Tran | Systems and methods for computer assisted operation |
| CN106827545A (en) * | 2017-02-04 | 2017-06-13 | 山东大学 | Based on the transparent pervious concrete test specimen 3D printing method of CT scan |
| CN107240148A (en) * | 2017-04-11 | 2017-10-10 | 中国人民解放军国防科学技术大学 | Transparent substance three-dimensional surface rebuilding method and device based on background stration technique |
| CN108008259A (en) * | 2017-11-14 | 2018-05-08 | 国网江西省电力有限公司电力科学研究院 | Based on infrared, the integrated detection method of Uv and visible light image co-registration and device |
| CN108921926A (en) * | 2018-07-02 | 2018-11-30 | 广州云从信息科技有限公司 | A kind of end-to-end three-dimensional facial reconstruction method based on single image |
Non-Patent Citations (2)
| Title |
|---|
| RINDRA RANTOSON 等: "Optimization of transparent objects digitization from visible fluorescence UV-induced", 《RESEARCHGATE》 * |
| 刘敬 等: "透明物体面形偏振成像测量技术综述", 《红 外 技 术》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110427847B (en) | 2022-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10733745B2 (en) | Methods, systems, and computer readable media for deriving a three-dimensional (3D) textured surface from endoscopic video | |
| CN106981098A (en) | The visual angle of virtual scene component is represented | |
| US10235606B2 (en) | Method and system for convolutional neural network regression based 2D/3D image registration | |
| Arellano et al. | Fast back-projection for non-line of sight reconstruction | |
| CN104398240B (en) | Methods, devices and systems for analyzing image | |
| US20200268339A1 (en) | System and method for patient positioning | |
| US10507002B2 (en) | X-ray system and method for standing subject | |
| US11576578B2 (en) | Systems and methods for scanning a patient in an imaging system | |
| CN107169475B (en) | A kind of face three-dimensional point cloud optimized treatment method based on kinect camera | |
| US8363926B2 (en) | Systems and methods for modeling three-dimensional objects from two-dimensional images | |
| CN109583285A (en) | Object identifying method | |
| US20130190602A1 (en) | 2d3d registration for mr-x ray fusion utilizing one acquisition of mr data | |
| Hołowko et al. | Application of multi-resolution 3D techniques in crime scene documentation with bloodstain pattern analysis | |
| CN107209007A (en) | Method, circuit, equipment, accessory, system and the functionally associated computer-executable code of IMAQ are carried out with estimation of Depth | |
| US10410348B2 (en) | Online learning enhanced atlas-based auto-segmentation | |
| CN106705849B (en) | Calibrating Technique For The Light-strip Sensors | |
| JP2018522622A (en) | Method and system for simultaneous scene analysis and model fusion for endoscopic and laparoscopic navigation | |
| CN108846830A (en) | The method, apparatus and storage medium be automatically positioned to lumbar vertebrae in CT | |
| CN108805016A (en) | A kind of head and shoulder method for detecting area and device | |
| JP7038857B2 (en) | Medical image conversion | |
| US20130044190A1 (en) | Three-dimensional model acquisition using planar mirrors | |
| CN110051434A (en) | AR operation piloting method and terminal in conjunction with endoscope | |
| CN107633247A (en) | The determination method and device of image-region | |
| CN110133014A (en) | A kind of chip interior defect inspection method and system | |
| Zhu et al. | Spatially-varying outdoor lighting estimation from intrinsics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221102 Address after: 476000 shop 301, office building, northeast corner, intersection of Bayi Road and Pingyuan Road, Liangyuan District, Shangqiu City, Henan Province Patentee after: Shenlan robot industry development (Henan) Co.,Ltd. Address before: Unit 1001, 369 Weining Road, Changning District, Shanghai, 200336 (9th floor of actual floor) Patentee before: DEEPBLUE TECHNOLOGY (SHANGHAI) Co.,Ltd. |
|
| TR01 | Transfer of patent right |