WO2009094042A1 - Image combining - Google Patents
Image combining Download PDFInfo
- Publication number
- WO2009094042A1 WO2009094042A1 PCT/US2008/068777 US2008068777W WO2009094042A1 WO 2009094042 A1 WO2009094042 A1 WO 2009094042A1 US 2008068777 W US2008068777 W US 2008068777W WO 2009094042 A1 WO2009094042 A1 WO 2009094042A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- space data
- projection
- weapon
- data
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/003—Reconstruction from projections, e.g. tomography
- G06T11/005—Specific pre-processing for tomographic reconstruction, e.g. calibration, source positioning, rebinning, scatter correction, retrospective gating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30112—Baggage; Luggage; Suitcase
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
Definitions
- security at airports and/or in other travel related realms may be enhanced by providing a more realistic image of an item under inspection (e g , a piece of luggage), as well as providing a mechanism for monitoring the aptitude of an individual charged with screening for threat items That is, a computed tomography (CT) image of an object under inspection is presented to a screener, for example, and an image of one or more threat items (e g , gun, knife, explosive device and/or other type of weapon) may be randomly placed into the image of the item under inspection to enable a determination to be made as to whether the screener picks up on these items
- CT computed tomography
- the images of the threat items are made to look as if they were actually in the item under inspection when the item under inspection was scanned by the CT scanner That is, images of the threat items are manipulated to have artifacts consistent with artifacts in the image under inspection, where such artifacts are function of, among other things, the particular mechanical and/or electrical components of the CT scanner used to scan the item under inspection Until now, such Threat Image Projection has been unsuccessful for numerous reasons, such as imaging cues that the screeners pick up on, which make it easy for screeners to discern the presence of an artificial or virtually inserted threat image, thus defeating the intended purpose
- imaging cues may comprise diminished artifacts where they would otherwise be expected/present and/or unnatural looking artifacts which blend into the normal bag background where there have been obvious visual discontinuities at the boundaries
- the image combining and/or image insertion techniques provided herein provide improved results generally because sinogram or projection space data is primarily manipulated instead of CT or image space data That is, measured line integrals are primarily used instead of backprojected data which comprises the CT image Working primarily in sinogram space allows for more plausible threat insertion
- manipulating sinogram data also allows "ideal" images of threat objects or weapons to be created, so that a repository of substantially artifact free threat items can be populated
- This provides a cost effective mechanism for producing and storing images of threat items so that different threat items can be randomly placed into images of different suitcases, for example, regardless of the CT scanners used to obtain the images of the items under inspection That is, since the threat items are ideal or substantially artifact free, they can be readily adapted or corrupted to have artifacts consistent with artifacts generated by the particular CT scanners being used to scan the suitcases, for example.
- the object locator is configured to determine at least one of a desired position in the image of the second object to insert the image of the first object and a desired orientation of the image of the first object in the image of the second object.
- the forward projector is configured to convert image space data of the image of the first object into first projection space data.
- the combiner is configured to combine the first projection space data with second projection space data of the image of the second object to generate composite projection space data.
- the reconstructor is configured to convert the composite projection space data into image space data. In this example, the resulting image space data can be displayed on a monitor for viewing by a human observer.
- a system configured to generate substantially artifact free images of a weapon for later insertion into an image of a piece of luggage, may comprise a projection data corrector, and a reconstructor.
- the projection data corrector can be configured to correct projection data of the image of the weapon based on: the orientation of the weapon when it was scanned, and/or one or more characteristics of a scanner used to acquire the image.
- the reconstructor can be configured to convert projection space data of the weapon image into image space data.
- Fig 1 is a schematic block diagram illustrating an environment wherein three dimensional (3D) image combining may be implemented as provided herein
- Fig 2 is a schematic block diagram illustrating one or more components of an environment wherein three dimensional (3D) image combining may be implemented as provided herein
- Fig 3 is a schematic block diagram illustrating one or more components of an environment wherein a substantially artifact free image of an object may be obtained as provided herein
- Fig 4 is a flow chart diagram of an example method for inserting an image of a performance measurement object into an image of an object under examination
- Fig 5 is a flow chart diagram of one embodiment of an example method for inserting an image of a performance measurement object into an image of an object under examination
- Fig 6 is a flow chart diagram of an example method for generating a substantially artifact free image of a weapon
- Fig 7 is a flow chart diagram of one embodiment of an example method for generating a substantially artifact free image of a weapon
- FIG. 1 is an illustration of an example environment 100 in which a system may be employed to insert an image of a first object into an image of a second object, for example, in such a way as to mitigate visual cues that may alert a human observer as to the insertion.
- an object scanning apparatus 102 such as a security scanning apparatus (e.g., used to scan luggage at an airport), may be used to scan an object 110 (e.g., a suitcase at the airport).
- the scanning apparatus typically comprises radiation source 104 (e.g., an X-ray tube), an array of radiation detectors 106 (e.g., X- ray detectors), and a rotator 1 12 (e.g., a gantry motor) for rotating the radiation source 104 and detectors 106 around the object being scanned 1 10.
- radiation source 104 e.g., an X-ray tube
- an array of radiation detectors 106 e.g., X- ray detectors
- a rotator 1 12 e.g., a gantry motor
- a computer tomography (CT) security scanner 102 that includes an X-ray source 104, such as an X-ray tube, can generate a fan, cone, wedge, or other shaped beam of X-ray radiation that traverses an object 110, such as a suitcase, in an examination region.
- the X-rays are emitted by the source 104, traverse the examination region that contains the object 1 10 to be scanned, and are detected by an X-ray detector 106 across from the X-ray source 104.
- a rotator 1 12 such as a gantry motor drive attached to the scanner, can be used to rotate the X-ray source 104 and detector 106 around the object 110, for example.
- X-ray projections from a variety of perspectives of the suitcase can be collected, for example, creating a set of X-ray projections for the object.
- the radiation source 104 and detector 106 may remain stationary while the object is rotated.
- a data measurement system 114 is operably coupled to the scanning apparatus 102, and is typically configured to collect information and data from the detector 106, and may be used to compile the collected data into projection space data 150 for an object 1 10.
- X-ray projections may be acquired at each of plurality of angular positions with respect to the object 110
- a reconstructor 152 is coupled to the data measurement system 1 14, and is configured to receive the projection space data 150 from the data measurement system 1 14 and generate image space data 154 indicative of the scanned object 110 using a suitable analytical, iterative, and/or other reconstruction technique (e g , backprojecting from projection space to image space)
- a suitable analytical, iterative, and/or other reconstruction technique e g , backprojecting from projection space to image space
- the image space data 154 for a suitcase may ultimately be displayed on a monitor 120 for human observation
- an operator may isolate and manipulate the image, for example, rotating and viewing the suitcase from a variety of angles, zoom levels, and positions
- an appropriate location and orientation of a first object to be inserted into the suitcase may be determined using projection space (instead of image space) data indicative of a suitcase
- a scanning apparatus system 176 may send projection space data indicative of a scanned first object to an object generator 162
- the object generator 162 may be configured to generate substantially artifact free image space data indicative of a first object or threat item 164, such that the first object can be combined with (e g inserted into) a second object to create image space data indicative of the first and second objects combined
- This substantially artifact free image space data indicative of the first object 164 may be considered an ideal object image to be later inserted into a second object for the purpose of testing human visual detection of a threat object or otherwise training the user to identify such objects
- the scanning apparatus system 176 may scan contraband or a weapon such as a gun, knife, explosive or component thereof, and create projection space data for that threat item, as described above
- the object generator 162 can receive the projection space data for the scanned threat item and generate image space data for the threat item 164
- the generated image space data 164 can be substantially free of
- Fig 3 is a component block diagram of an example system 300, which may be configured to generate a substantially artifact free image of a weapon 326 for subsequent corruption and insertion into an image of a piece of luggage, for example, such as the object generator 162 in the example environment 100 of Fig 1.
- the resulting image space data 326 may be considered an ideal object image, in as much as it may be an ideal image of a weapon that can later be used for insertion into another image of an object (e g , similar to that described above with regard to 162)
- the example system 300 may comprise a projection data corrector 302, which can be configured to correct projection data 304 of the weapon based on at least one of orientation 306 of the weapon when it was scanned by a scanner to acquire the image of the weapon, and a characteristic 308 of a scanner used to acquire the image of the weapon
- the image data may include artifacts Moreover, the artifacts may vary depending on factors, such as, the location and orientation of the object in the scanner's examination region, the design and other characteristics of the particular scanner used to acquire the projection data, the selected scan settings, and the like Therefore, in this example, the projection data corrector 302 can correct the projection space data indicative of a threat item 304, as scanned by the scanning apparatus in a particular orientation, resulting in projection space data indicative of the threat item 320 that can yield substantially artifact-free image space data and account for Hounsfield unit restoration
- the example system 300 may also comprise a reconstructor 310, which can be configured to convert projection space data 320 indicative of the weapon into image space data 322, for example, indicative of the weapon
- the reconstructor 310 can be configured to backproject the projection space data 320 indicative of a threat item, into image space data 322 indicative of the threat item
- the example system 300 may also comprise an object isolator 312, which can be configured to substantially isolate the weapon from other objects of the image space data 322.
- an object isolator 312 can be configured to substantially isolate the weapon from other objects of the image space data 322.
- the object isolator 312 can essentially remove substantially all of the non-threat item objects from the image space data indicative of the threat item 322 resulting in image space data indicative of a threat item without substantially any non-threat item objects 324
- the example system 300 may also comprise an object positioner 314, which can be configured to situate in image space the weapon at a desired orientation in the image of the weapon (e g , as if the weapon were at the isocenter of the scanner)
- the image of the weapon such as a gun
- the orientation of the image of the gun may need to be adjusted to fit appropriately into the image of the suitcase
- a true center of the image of the gun may need to be determined (e g , the true center of a three-dimensional representation of the gun), such that, when the orientation of the image of the gun is adjusted, the position of the gun remains substantially unchanged
- the object positioner 314 can find the true center of the image space data
- the example system 300 may also comprise a storage component 316, which can be configured to store the substantially artifact free image, for example, of the weapon
- the storage component 316 may be a hard drive disk located on a computer system at a remote location, which is set up to scan a variety of weapons and other potential threat objects
- the resulting images can be stored in the computer system and later transferred to a facility that has a live threat detection system, such as an airport, where the images of the threat objects can be utilized in the threat detection system
- the image space data indicative of the first object 164 can be stored in a storage component 166 (e g , a hard drive, diskette, CD ROM, flash drive, etc ), for example, in a storage library of image space data of ideal objects
- a storage component 166 e g , a hard drive, diskette, CD ROM, flash drive, etc
- the storage component 166 may be remotely located from other components of the example environment 100
- An ideal image of an object can be relayed 168 (e g , sent over the Internet) to a second storage component 180, for example, to a storage library of image space data of ideal objects at another location
- ideal object images of potential threat items 164 may be generated at a remote location and stored in an electronic database located on a series of hard drives 166 at the remote location 168 (e g , an image scanning facility)
- a scanning apparatus 102 may be located at an airport, used to scan passenger luggage as passengers check in for flights
- the database of ideal object images can be sent 168 to a database located on a series of hard drives 180 at the airport for use in the airport's threat detection system
- the object generator 162 in Fig 1 and the exemplary system 300 are described in terms of system components, the techniques and systems, described herein, are not limited to these embodiments
- the object generator 162 may be computer software that allows a user to generate and/or manipulate images of ideal objects
- a threat object e g , a gun, explosive, knife
- a software program that uses computer graphics to generate images (e g , CGI software)
- the example environment 100 employs an example system for inserting an image of a first object into an image of a second object
- the example system can comprise an object locator 156 that is configured to determine at least one of a desired position in the image of the second object to insert the image of the first object, and a desired orientation of the image of the first object in the image of the second object
- the image of the first object may be a gun and the image of the second object may be a suitcase
- the object locator 156 can receive image space data indicative of the suitcase 154 and image space data indicative of the threat item 182, and use this information to determine an appropriate place in the suitcase to insert the threat item, in image space
- the object locator 156 can use both sets of data 154 and 182 to determine a plausible location for the threat item to fit into the suitcase, and an appropriate orientation for the threat item to fit into the suitcase
- a suitcase may contain a number of benign items typically utilized while travelling
- the object locator 156 may identify a location in the suitcase that could fit the threat item, and orient the threat item in such a way as to fit naturally in that location
- the object locator may be configured to remove items from the suitcase, for example, by manipulating image space data corresponding items to be removed from the suitcase
- the threat item could be oriented to fit naturally into the space in the suitcase created by removal of items
- the object locator 156 can generate image space data for the first object 170 that is indicative of the first object's location and orientation in the image space of second object
- image space data for the first object 170 generated by the object locator 156 may be an ideal object image of a threat item, oriented in such a manner as to fit naturally into an image of a suitcase
- image space data for the first object 170 generated by the object locator 156 may be an ideal object image of a threat item, positioned in such a manner as to fit naturally into an image of a suitcase
- the example system can comprise a forward projector 158 configured to convert image space data 170 of the image of the first object into first projection space data 172 indicative of the first object
- the forward projector 158 can be used to create projection space data indicative of the threat item 172, from the image space data indicative of the threat item 170, as if it had been scanned by the scanning apparatus
- the example system can comprise a combiner 160 configured to combine the first projection space data 172 with second object projection space data 150 of the second object to generate composite projection space data 174, for example, indicative of a combined first and second object
- projection space data indicative of a suitcase 150 may have been generated by scanning the suitcase with a scanning apparatus 102 at an airport, and combining the first 172 and second projection space data 150, for example by adding corresponding projection of the projection space data
- a scanner can use ionizing radiation on the second object, such as a suitcase, to acquire the second projection space data
- the second projection space data corresponds to an interior of the second object (e g , inside the suitcase), and may also include scanner characteristics such as energy of the ionizing radiation and a dose of the ionizing radiation
- Fig 2 is a component block diagram of one embodiment of an example combiner 160
- the example combiner 160 can comprise a first projection data uncorrector 202, which is configured to corrupt the first projection space data 172 so that, when reconstructed from the first projection space data, the image space data of the first object includes artifacts which mimic or otherwise approximate the artifacts that would have been present had the first object actually been scanned by the first scanner 102
- the first object space data may be modified based on one or more of the location or orientation of the first object, had it been actually scanned by the first scanner 102, the design or other characteristics of the first scanner 102, and the scan settings of the first scanner
- projection space data indicative of a first object 172 can be sent to the first projection data uncorrector 202 from the forward projector 158 Recall that projection space data indicative of a first object 172 may be an ideal object, for example, substantially free from artifacts The data is corrupted in such a way that the resulting corrupted projection space data indicative of the first object 210 appears to have been generated by scanning the first object using the scanning apparatus 102
- a threat item that is scanned at an offsite facility, using an offsite scanner can appear as though it was scanned at an onsite facility scanning the suitcase, using an onsite scanner
- the resulting scanning data can typically have characteristics that are unique to individual scanning apparatus These unique characteristics often appear as artifacts in the resulting image of the scanned object
- the first projection data uncorrector 202 if the threat item was scanned using a first scanner and the suitcase was scanned using a second scanner, the resulting combined image of the threat item in the suitcase may not appear natural to a human observer Further, in the case of an ideal image, the absence of artifacts could also be a cue to the operator
- the example combiner 160 can optionally comprise a fan data converter 204, which can be configured to convert parallel projection space data of a first object 210 to fan shaped projection space data of a first object 212
- the fan data converter 204 may optionally be utilized when the second projection space data indicative of the second object 150 was generated using a scanner that utilizes fan-shaped energy beams to create projections of the scanned object, while the first projection space data indicative of the first object 172 is in parallel projection space Therefore, for example, both the first and second projection space data should be fan- shaped in order to be appropriately combined
- the example combiner 160 can comprise a projection space data combiner 206, which may be configured to combine corrupted first projection space data indicative of a first object 210 (or optionally 212) and second projection space data indicative of a second object 150, creating composite projection space data indicative of a combined first and second object 214
- projection space data indicative of a suitcase 150 that was generated by scanning the suitcase using a scanner at an airport
- projection space data indicative of a gun 210 or optionally 212
- the gun can be inserted into the suitcase, in projection space, and they can both appear as though they were scanned by the same scanner at the same time
- the example combiner 160 can comprise a second projection data uncorrector 208, which can be configured to corrupt the composite projection space data 214 so as to generate artifacts for presentation in reconstructed image space data of the corrupted projection space data
- a second projection data uncorrector 208 can be configured to corrupt the composite projection space data 214 so as to generate artifacts for presentation in reconstructed image space data of the corrupted projection space data
- respective object images typically have unique artifacts associated with them
- objects are combined and scanned together (e g , a gun inside a suitcase) the resulting artifacts in the combined objects image may be different than that of the individually scanned objects' images Therefore, in this example, a resulting image of a composite of two individually scanned objects may have different artifacts than an image of object scanned together
- the second projection data uncorrector 208 corrupts the composite projection space data 214 indicative of the combined first object (e g , a gun) and the second object (e g , a suitcase), in such a way, that the resulting corrupted composite projection space data 174 appears to be that of the first and second object scanned together at a same time (e g , the gun and suitcase were scanned together)
- the example system can comprise a reconstructor 118, which can be configured to convert the composite projection space data 174 into composite image space data 178
- the reconstructor 1 18 can backproject the composite projection space data indicative of a threat item in a suitcase 174, into image space data indicative of the threat item in the suitcase 178 (e g , data comprising a three-dimensional image showing the threat item inside the suitcase)
- the image space data indicative of the threat item inside the suitcase 178 may be displayed on a monitor 120 for human observation
- an operator may isolate and manipulate the image, for example, rotating and viewing the image from a variety of angles, zoom levels, and positions, essentially seeing the threat item inside the suitcase from each of these perspectives
- FIG 4 is a flow chart diagram of an example method 400 for inserting an image of a performance measurement object into an image of an object under examination
- the example method 400 begins at 402 and involves determining a desired position in the image of the object under examination to insert the image of the performance measurement object, at 404 For example one can determine an appropriate place inside an image of a suitcase to place an image of a threat item, so that the resulting combined image appears natural (e g as if the threat item was inside the suitcase and they were both scanned by a scanning apparatus together)
- image space data of the image of the performance measurement object is converted into first projection space data (e g , projection space data indicative of the performance measurement object)
- first projection space data e g , projection space data indicative of the performance measurement object
- the image space data of the threat item can be converted to data that may result from the threat item being scanned by a scanning apparatus (e g projection space data resulting from the threat item being scanned).
- the first projection space data (e g , scanning data of the threat item) is combined with second projection space data of the image of the object under examination (e g , scanning data from the suitcase) to generate composite projection space data (e g , scanning data of the threat item inside the suitcase)
- the projection space data of the threat item can be combined with the projection space data of the suitcase, resulting in projection space data of the threat item in the suitcase
- the composite projection space data (e g , indicative of the threat item in the suitcase) is converted into image space data
- the projection space data indicative of the threat item in the suitcase e g , scanning data of a threat item in a suitcase
- image space data can be back projected to image space data, which may be used to render an image on a display Having converted the projection space data to image space data, the example method 400 ends at 412
- Fig 5 is a flow chart diagram of one embodiment of a method 500 for inserting an image of a performance measurement object into an image of an object under examination
- a desired position in the image of the object under examination to insert the image of the performance measurement object is determined, such as in example method 400 at 404
- a desired orientation of the image of the performance measurement object in the image of the object under examination is determined For example, the appropriate orientation of a threat item in a suitcase can be determined, based on the position chosen to place the threat item, and the orientation of the suitcase
- image space data of the image of the performance measurement object is converted into first projection space data, such as in example method 400 at 406
- the first projection space data is corrupted based on a characteristic of a scanner used to acquire the image of the object under examination
- projection space data indicative of a threat item can be corrupted, using one or more scanner characteristics, so that it appears the data was a result of the threat item being scanned by the scanner used to acquire the image of the object under examination
- the first projection space data is corrupted based on the determined orientation of the image of the performance measurement object For example, when the orientation of the threat item was determined at 506, the determined orientation of the threat item can be used to corrupt the projection space data of the threat item, so that it appears that the threat item was scanned in that orientation
- the first projection space data is combined with second projection space data of the image of the object under examination to generate composite projection space data, as in example method 400 at 408
- the composite projection space data is corrupted so as to generate artifacts for presentation in reconstructed image space data of the corrupted composite projection space data
- the composite projection space data can be corrupted in such a way that when converted to image space data, the resulting image can appear as if the threat item was in the suitcase when it was scanned
- the composite projection space data is converted into image space data, as in example method 400 at 410, and the composite image space data is displayed in human perceptible form substantially contemporaneously with the security examination
- a human luggage examiner may be situated at a threat detection system located at an airport
- luggage moves through a scanning apparatus and the examiner views resulting images on a display screen
- an image of a threat item can be inserted into a suitcase that is moving through the scanning system, prior to the image of the suitcase appearing on the display monitor
- the human observer may not detect that the inserted image of the threat item is not a real threat item inside the suitcase under the scanning apparatus
- the example method 500 ends at 522
- a method may be devised for generating a substantially artifact free image of a weapon for subsequent corruption and insertion into an image of a piece of luggage, for example, such that image of the weapon is an ideal object image of a weapon with substantially no non-weapon objects
- the orientation of the gun during scanning can create artifacts in the resulting image that are unique to the specific orientation of the gun during scanning
- individual scanner can have unique characteristics that can manifest themselves as artifacts in the resulting image of a gun scanned by that scanner Therefore, in order to create an ideal object image of the gun, for example, one or more of these artifact creating situations can be accounted for in projection space
- projection space data of the image of the weapon is converted into image space data, for example, indicative of the weapon
- image space data for example, indicative of the weapon
- projection space data that is a result of a gun being scanned can be back projected into image space data indicative of the gun that was scanned Having converted the projection space data the example method 600 ends at 612
- Fig 7 is a flow chart diagram of one embodiment of an example method 700 for generating a substantially artifact free image of a weapon for subsequent corruption and insertion into an image of a piece of luggage, such as in example method 600 of Fig 6
- the example method 700 begins at 701 and involves correcting projection data of the image of the weapon, at 704, based on at least one of the orientation of the weapon when it was scanned by a scanner to acquire the image of the weapon 706, and a characteristic of a scanner used to acquire the image of the weapon 708, as in example method 600
- the weapon is substantially isolated from other objects of the image
- other non- gun objects may be present in the resulting image space data
- the gun can be substantially isolated from the non-gun objects in the projection space data
- the weapon may also be isolated from the non-weapon objects in the image space data indicative of the weapon
- the projection space data of the image of the weapon is converted into image space data, as in example method 600 at 610
- the weapon, in image space is situated at a desired orientation in the image of the weapon
- a true center of an image of a weapon such as a gun can be determined so that, later, the orientation of the image of the gun may be adjusted without changing a position of the image of the gun Having situated the image of the weapon, the example method 700 ends at 716
- one or more of the operations described may constitute computer readable instructions stored on one or more computer readable media, which if executed by a computing device, will cause the computing device to perform the operations described
- the order in which some or all of the operations are described should not be construed as to imply that these operations are necessarily order dependent Alternative ordering will be appreciated by one skilled in the art having the benefit of this description Further, it will be understood that not all operations are necessarily present in each embodiment provided herein
- the word "example” is used herein to mean serving as an example, instance, or illustration Any aspect or design described herein as “example” is not necessarily to be construed as advantageous over other aspects or designs Rather, use of the word example is intended to present concepts in a concrete fashion
- the term “or” is intended to mean an inclusive “or” rather than an exclusive “or” That is, unless specified otherwise, or clear from context, "X employs A or B” is intended to mean any of the natural inclusive permutations That is, if X employs A, X employs B, or X employs both A and B, then "X employs A or B" is satisfied under any of the foregoing instances
- the articles “a” and “an” as used in this application and the appended claims may generally be construed to mean “one or more” unless specified otherwise or clear from context to be directed to a singular form
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
- Analysing Materials By The Use Of Radiation (AREA)
- Image Processing (AREA)
Abstract
Techniques and systems for combining images of objects are disclosed where an image of a first object is to be inserted into an image of a second object in such a manner as to make the insertion substantially undetectable by a human observer of the combined image. An object generator generates a substantially artifact free image of a first object. An object locator orient the first object image according to a desired insertion point in a second object image A forward projector converts the first object image into projection space data of the first object, and a combiner combines the first object projection space data with the second object projection space data. The combined projection space data is converted to image space data by a reconstructor, and the resulting combined image space data can be displayed on a monitor for human observation.
Description
IMAGE COMBINING
BACKGROUND
[0001] Security at airports and in other travel related arenas is an important issue given today's political climate, as well as other considerations One technique used to promote travel safety is through baggage inspection In some instances, luggage is visually inspected and/or manually inspected by screeners In other instances, luggage is initially scanned with some type of instrument, and then inspected further if necessary For example, an x-ray machine may be used to provide security personnel with a substantially two dimensional view of the contents of a bag, thus enabling a determination to be made as to whether further inspection is warranted However, it may, at times, be difficult to make judgments regarding the contents of a three dimensional object based upon a two dimensional image (e g , because the contents of the three dimensional item are collapsed or flattened onto one anther in the two dimensional image) Moreover, the quality of decisions regarding the safety of a piece of luggage, or rather the contents thereof, is a function of the individuals making such decisions, and some individuals may be more adept at identifying threat items (e g , gun, knife, explosive device and/or other type of weapon) than other individuals
SUMMARY
[0002] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description This Summary is not intended to identify key factors or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter
[0003] As provided herein, security at airports and/or in other travel related realms may be enhanced by providing a more realistic image of an item under inspection (e g , a piece of luggage), as well as providing a mechanism for monitoring the aptitude of an individual charged with screening for threat items That is, a computed tomography (CT) image of an object under
inspection is presented to a screener, for example, and an image of one or more threat items (e g , gun, knife, explosive device and/or other type of weapon) may be randomly placed into the image of the item under inspection to enable a determination to be made as to whether the screener picks up on these items
[0004] Moreover, the images of the threat items are made to look as if they were actually in the item under inspection when the item under inspection was scanned by the CT scanner That is, images of the threat items are manipulated to have artifacts consistent with artifacts in the image under inspection, where such artifacts are function of, among other things, the particular mechanical and/or electrical components of the CT scanner used to scan the item under inspection Until now, such Threat Image Projection has been unsuccessful for numerous reasons, such as imaging cues that the screeners pick up on, which make it easy for screeners to discern the presence of an artificial or virtually inserted threat image, thus defeating the intended purpose By way of example, imaging cues may comprise diminished artifacts where they would otherwise be expected/present and/or unnatural looking artifacts which blend into the normal bag background where there have been obvious visual discontinuities at the boundaries
[0005] The image combining and/or image insertion techniques provided herein provide improved results generally because sinogram or projection space data is primarily manipulated instead of CT or image space data That is, measured line integrals are primarily used instead of backprojected data which comprises the CT image Working primarily in sinogram space allows for more plausible threat insertion
[0006] Additionally, manipulating sinogram data also allows "ideal" images of threat objects or weapons to be created, so that a repository of substantially artifact free threat items can be populated This provides a cost effective mechanism for producing and storing images of threat items so that different threat items can be randomly placed into images of different suitcases, for example, regardless of the CT scanners used to obtain the images of the items under inspection That is, since the threat items are ideal or substantially artifact free, they can be readily adapted or corrupted to have
artifacts consistent with artifacts generated by the particular CT scanners being used to scan the suitcases, for example. Working primarily with sinogram or projection space data also allows the images of "ideal" (e.g., substantially artifact free) objects to be rotated or otherwise manipulated, thus making it easier to place the threat item images in suitcases, for example, at convenient locations (e.g., where there may be a void in the bag).
[0007] In one example, a system configured to insert an image of a first object into an image of a second object comprises an object locator, a forward projector, a combiner and a reconstructor. The object locator is configured to determine at least one of a desired position in the image of the second object to insert the image of the first object and a desired orientation of the image of the first object in the image of the second object. The forward projector is configured to convert image space data of the image of the first object into first projection space data. The combiner is configured to combine the first projection space data with second projection space data of the image of the second object to generate composite projection space data. The reconstructor is configured to convert the composite projection space data into image space data. In this example, the resulting image space data can be displayed on a monitor for viewing by a human observer.
[0008] In another example, a system configured to generate substantially artifact free images of a weapon for later insertion into an image of a piece of luggage, may comprise a projection data corrector, and a reconstructor. The projection data corrector can be configured to correct projection data of the image of the weapon based on: the orientation of the weapon when it was scanned, and/or one or more characteristics of a scanner used to acquire the image. The reconstructor can be configured to convert projection space data of the weapon image into image space data.
[0009] To the accomplishment of the foregoing and related ends, the following description and annexed drawings set forth certain illustrative aspects and implementations. These are indicative of but a few of the various ways in which one or more aspects may be employed. Other aspects, advantages, and novel features of the disclosure will become apparent from
the following detailed description when considered in conjunction with the annexed drawings
DESCRIPTION OF THE DRAWINGS
[0010] Fig 1 is a schematic block diagram illustrating an environment wherein three dimensional (3D) image combining may be implemented as provided herein
[0011] Fig 2 is a schematic block diagram illustrating one or more components of an environment wherein three dimensional (3D) image combining may be implemented as provided herein
[0012] Fig 3 is a schematic block diagram illustrating one or more components of an environment wherein a substantially artifact free image of an object may be obtained as provided herein
[0013] Fig 4 is a flow chart diagram of an example method for inserting an image of a performance measurement object into an image of an object under examination
[0014] Fig 5 is a flow chart diagram of one embodiment of an example method for inserting an image of a performance measurement object into an image of an object under examination
[0015] Fig 6 is a flow chart diagram of an example method for generating a substantially artifact free image of a weapon
[0016] Fig 7 is a flow chart diagram of one embodiment of an example method for generating a substantially artifact free image of a weapon
DETAILED DESCRIPTION
[0017] The claimed subject matter is now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the claimed subject matter It may be evident, however, that
the claimed subject matter may be practiced without these specific details. In other instances, structures and devices are illustrated in block diagram form in order to facilitate describing the claimed subject matter. Fig. 1 is an illustration of an example environment 100 in which a system may be employed to insert an image of a first object into an image of a second object, for example, in such a way as to mitigate visual cues that may alert a human observer as to the insertion. In the example environment 100 an object scanning apparatus 102, such as a security scanning apparatus (e.g., used to scan luggage at an airport), may be used to scan an object 110 (e.g., a suitcase at the airport). The scanning apparatus typically comprises radiation source 104 (e.g., an X-ray tube), an array of radiation detectors 106 (e.g., X- ray detectors), and a rotator 1 12 (e.g., a gantry motor) for rotating the radiation source 104 and detectors 106 around the object being scanned 1 10.
[0018] As an example, a computer tomography (CT) security scanner 102 that includes an X-ray source 104, such as an X-ray tube, can generate a fan, cone, wedge, or other shaped beam of X-ray radiation that traverses an object 110, such as a suitcase, in an examination region. In this example, the X-rays are emitted by the source 104, traverse the examination region that contains the object 1 10 to be scanned, and are detected by an X-ray detector 106 across from the X-ray source 104. Further, a rotator 1 12, such as a gantry motor drive attached to the scanner, can be used to rotate the X-ray source 104 and detector 106 around the object 110, for example. In this way, X-ray projections from a variety of perspectives of the suitcase can be collected, for example, creating a set of X-ray projections for the object. While illustrated as a third generation system, those of ordinary skill in the art will understand that fourth generation and other implementations are also contemplated. As yet another example, the radiation source 104 and detector 106 may remain stationary while the object is rotated.
[0019] In the example environment 100, a data measurement system 114 is operably coupled to the scanning apparatus 102, and is typically configured to collect information and data from the detector 106, and may be used to compile the collected data into projection space data 150 for an object 1 10.
As an example, X-ray projections may be acquired at each of plurality of angular positions with respect to the object 110
[0020] In the example environment 100, a reconstructor 152 is coupled to the data measurement system 1 14, and is configured to receive the projection space data 150 from the data measurement system 1 14 and generate image space data 154 indicative of the scanned object 110 using a suitable analytical, iterative, and/or other reconstruction technique (e g , backprojecting from projection space to image space)
[0021] In one embodiment, the image space data 154 for a suitcase , for example may ultimately be displayed on a monitor 120 for human observation In this embodiment, an operator may isolate and manipulate the image, for example, rotating and viewing the suitcase from a variety of angles, zoom levels, and positions
[0022] It will be appreciated that, while the example environment 100 utilizes the reconstructor 152 to convert projection space data to image space data, for example, for a suitcase being scanned, the techniques and systems, described herein, are not limited to this embodiment In another embodiment, for example, an appropriate location and orientation of a first object to be inserted into the suitcase may be determined using projection space (instead of image space) data indicative of a suitcase
[0023] In the example- environment 100, a scanning apparatus system 176 may send projection space data indicative of a scanned first object to an object generator 162 The object generator 162, for example, may be configured to generate substantially artifact free image space data indicative of a first object or threat item 164, such that the first object can be combined with (e g inserted into) a second object to create image space data indicative of the first and second objects combined This substantially artifact free image space data indicative of the first object 164, for example, may be considered an ideal object image to be later inserted into a second object for the purpose of testing human visual detection of a threat object or otherwise training the user to identify such objects
[0024] As an example, the scanning apparatus system 176 may scan contraband or a weapon such as a gun, knife, explosive or component thereof, and create projection space data for that threat item, as described above The object generator 162 can receive the projection space data for the scanned threat item and generate image space data for the threat item 164 In this example, the generated image space data 164 can be substantially free of artifacts that may result from the threat item (e g gun) scanning operation, and can be image space data that substantially isolates the threat item from non-threat item objects in the image space Further, in this example, the image space data for the threat item 164 can be generated so that it may later be inserted into an image of a suitcase, for the purpose of testing human luggage screeners at airports
[0025] Fig 3 is a component block diagram of an example system 300, which may be configured to generate a substantially artifact free image of a weapon 326 for subsequent corruption and insertion into an image of a piece of luggage, for example, such as the object generator 162 in the example environment 100 of Fig 1. In one embodiment, the resulting image space data 326 may be considered an ideal object image, in as much as it may be an ideal image of a weapon that can later be used for insertion into another image of an object (e g , similar to that described above with regard to 162)
[0026] The example system 300 may comprise a projection data corrector 302, which can be configured to correct projection data 304 of the weapon based on at least one of orientation 306 of the weapon when it was scanned by a scanner to acquire the image of the weapon, and a characteristic 308 of a scanner used to acquire the image of the weapon
[0027] In one embodiment, for example, when an object such as a potential threat item (e g , a gun, knife or explosive) is scanned by a scanning apparatus, the image data may include artifacts Moreover, the artifacts may vary depending on factors, such as, the location and orientation of the object in the scanner's examination region, the design and other characteristics of the particular scanner used to acquire the projection data, the selected scan settings, and the like Therefore, in this example, the projection data corrector 302 can correct the projection space data indicative of a threat item
304, as scanned by the scanning apparatus in a particular orientation, resulting in projection space data indicative of the threat item 320 that can yield substantially artifact-free image space data and account for Hounsfield unit restoration
[0028] The example system 300 may also comprise a reconstructor 310, which can be configured to convert projection space data 320 indicative of the weapon into image space data 322, for example, indicative of the weapon As an example, the reconstructor 310 can be configured to backproject the projection space data 320 indicative of a threat item, into image space data 322 indicative of the threat item
[0029] In one embodiment, the example system 300 may also comprise an object isolator 312, which can be configured to substantially isolate the weapon from other objects of the image space data 322. As an example, when a weapon such as a gun is scanned by a scanning apparatus, other objects may be present in the resulting image space data 322 as a result of the scanning process In this example, the object isolator 312 can essentially remove substantially all of the non-threat item objects from the image space data indicative of the threat item 322 resulting in image space data indicative of a threat item without substantially any non-threat item objects 324
[0030] In another embodiment, the example system 300 may also comprise an object positioner 314, which can be configured to situate in image space the weapon at a desired orientation in the image of the weapon (e g , as if the weapon were at the isocenter of the scanner) As an example, the image of the weapon, such as a gun, may later be inserted into another image, such as a suitcase In this example, in order to have the insertion of the gun in the suitcase appear visually natural (e g , as if the gun was in the suitcase and they were scanned together), the orientation of the image of the gun may need to be adjusted to fit appropriately into the image of the suitcase Further, in this example, in order to adjust the orientation of the image of the gun a true center of the image of the gun may need to be determined (e g , the true center of a three-dimensional representation of the gun), such that, when the orientation of the image of the gun is adjusted, the position of the gun remains substantially unchanged In this embodiment, the
object positioner 314 can find the true center of the image space data indicative of the weapon 324, resulting in image space data indicative of the weapon with a true center 326
[0031] In another embodiment, the example system 300 may also comprise a storage component 316, which can be configured to store the substantially artifact free image, for example, of the weapon As an example, the storage component 316 may be a hard drive disk located on a computer system at a remote location, which is set up to scan a variety of weapons and other potential threat objects In this example, the resulting images can be stored in the computer system and later transferred to a facility that has a live threat detection system, such as an airport, where the images of the threat objects can be utilized in the threat detection system
[0032] Turning back to Fig 1 , in the example environment 100, the image space data indicative of the first object 164 (e g , the ideal object image) can be stored in a storage component 166 (e g , a hard drive, diskette, CD ROM, flash drive, etc ), for example, in a storage library of image space data of ideal objects In this example, the storage component 166 may be remotely located from other components of the example environment 100 An ideal image of an object can be relayed 168 (e g , sent over the Internet) to a second storage component 180, for example, to a storage library of image space data of ideal objects at another location
[0033] As an example, ideal object images of potential threat items 164 (e g , guns, explosives, knives) may be generated at a remote location and stored in an electronic database located on a series of hard drives 166 at the remote location 168 (e g , an image scanning facility) A scanning apparatus 102 may be located at an airport, used to scan passenger luggage as passengers check in for flights In this example, the database of ideal object images can be sent 168 to a database located on a series of hard drives 180 at the airport for use in the airport's threat detection system
[0034] It will be appreciated that, while the object generator 162 in Fig 1 and the exemplary system 300 are described in terms of system components, the techniques and systems, described herein, are not limited to these
embodiments In one embodiment, the object generator 162 may be computer software that allows a user to generate and/or manipulate images of ideal objects For example, a threat object (e g , a gun, explosive, knife) may be created using a software program that uses computer graphics to generate images (e g , CGI software)
[0035] In Fig 1 , the example environment 100 employs an example system for inserting an image of a first object into an image of a second object The example system can comprise an object locator 156 that is configured to determine at least one of a desired position in the image of the second object to insert the image of the first object, and a desired orientation of the image of the first object in the image of the second object
[0036] In one embodiment, the image of the first object may be a gun and the image of the second object may be a suitcase In this embodiment, the object locator 156 can receive image space data indicative of the suitcase 154 and image space data indicative of the threat item 182, and use this information to determine an appropriate place in the suitcase to insert the threat item, in image space The object locator 156 can use both sets of data 154 and 182 to determine a plausible location for the threat item to fit into the suitcase, and an appropriate orientation for the threat item to fit into the suitcase As an example, a suitcase may contain a number of benign items typically utilized while travelling In this example, in order to create a combined image of the threat item in the suitcase that appears natural to a human observer, the object locator 156 may identify a location in the suitcase that could fit the threat item, and orient the threat item in such a way as to fit naturally in that location
[0037] In another embodiment, the object locator may be configured to remove items from the suitcase, for example, by manipulating image space data corresponding items to be removed from the suitcase In this example, the threat item could be oriented to fit naturally into the space in the suitcase created by removal of items
[0038] The object locator 156, for example, can generate image space data for the first object 170 that is indicative of the first object's location and
orientation in the image space of second object In this example, image space data for the first object 170 generated by the object locator 156 may be an ideal object image of a threat item, oriented in such a manner as to fit naturally into an image of a suitcase Further, in this example, image space data for the first object 170 generated by the object locator 156 may be an ideal object image of a threat item, positioned in such a manner as to fit naturally into an image of a suitcase
[0039] In the example environment 100, the example system can comprise a forward projector 158 configured to convert image space data 170 of the image of the first object into first projection space data 172 indicative of the first object The forward projector 158 can be used to create projection space data indicative of the threat item 172, from the image space data indicative of the threat item 170, as if it had been scanned by the scanning apparatus
[0040] In the example environment 100, the example system can comprise a combiner 160 configured to combine the first projection space data 172 with second object projection space data 150 of the second object to generate composite projection space data 174, for example, indicative of a combined first and second object As an example, projection space data indicative of a suitcase 150 may have been generated by scanning the suitcase with a scanning apparatus 102 at an airport, and combining the first 172 and second projection space data 150, for example by adding corresponding projection of the projection space data In one embodiment, a scanner can use ionizing radiation on the second object, such as a suitcase, to acquire the second projection space data In this embodiment, the second projection space data corresponds to an interior of the second object (e g , inside the suitcase), and may also include scanner characteristics such as energy of the ionizing radiation and a dose of the ionizing radiation
[0041] Fig 2 is a component block diagram of one embodiment of an example combiner 160 In this embodiment, the example combiner 160 can comprise a first projection data uncorrector 202, which is configured to corrupt the first projection space data 172 so that, when reconstructed from the first projection space data, the image space data of the first object includes artifacts which mimic or otherwise approximate the artifacts that would have
been present had the first object actually been scanned by the first scanner 102 More particularly, for example, the first object space data may be modified based on one or more of the location or orientation of the first object, had it been actually scanned by the first scanner 102, the design or other characteristics of the first scanner 102, and the scan settings of the first scanner
[0042] As an example, projection space data indicative of a first object 172 can be sent to the first projection data uncorrector 202 from the forward projector 158 Recall that projection space data indicative of a first object 172 may be an ideal object, for example, substantially free from artifacts The data is corrupted in such a way that the resulting corrupted projection space data indicative of the first object 210 appears to have been generated by scanning the first object using the scanning apparatus 102
[0043] In this way, for example, a threat item that is scanned at an offsite facility, using an offsite scanner, can appear as though it was scanned at an onsite facility scanning the suitcase, using an onsite scanner When an object is scanned the resulting scanning data can typically have characteristics that are unique to individual scanning apparatus These unique characteristics often appear as artifacts in the resulting image of the scanned object In this example, without the first projection data uncorrector 202, if the threat item was scanned using a first scanner and the suitcase was scanned using a second scanner, the resulting combined image of the threat item in the suitcase may not appear natural to a human observer Further, in the case of an ideal image, the absence of artifacts could also be a cue to the operator
[0044] In Fig 2, the example combiner 160 can optionally comprise a fan data converter 204, which can be configured to convert parallel projection space data of a first object 210 to fan shaped projection space data of a first object 212 In this embodiment, the fan data converter 204 may optionally be utilized when the second projection space data indicative of the second object 150 was generated using a scanner that utilizes fan-shaped energy beams to create projections of the scanned object, while the first projection space data indicative of the first object 172 is in parallel projection space Therefore, for
example, both the first and second projection space data should be fan- shaped in order to be appropriately combined
[0045] In Fig 2, the example combiner 160 can comprise a projection space data combiner 206, which may be configured to combine corrupted first projection space data indicative of a first object 210 (or optionally 212) and second projection space data indicative of a second object 150, creating composite projection space data indicative of a combined first and second object 214 As an example, projection space data indicative of a suitcase 150 that was generated by scanning the suitcase using a scanner at an airport, can be combined with projection space data indicative of a gun 210 (or optionally 212) that has been corrupted to appear as though it was scanned by the scanner at the airport In this way, for example, the gun can be inserted into the suitcase, in projection space, and they can both appear as though they were scanned by the same scanner at the same time
[0046] In Fig 2, the example combiner 160 can comprise a second projection data uncorrector 208, which can be configured to corrupt the composite projection space data 214 so as to generate artifacts for presentation in reconstructed image space data of the corrupted projection space data As an example, when objects are scanned individually and the resulting projection space data is reconstructed into image space data, respective object images typically have unique artifacts associated with them However, when objects are combined and scanned together (e g , a gun inside a suitcase) the resulting artifacts in the combined objects image may be different than that of the individually scanned objects' images Therefore, in this example, a resulting image of a composite of two individually scanned objects may have different artifacts than an image of object scanned together
[0047] In one embodiment, the second projection data uncorrector 208 corrupts the composite projection space data 214 indicative of the combined first object (e g , a gun) and the second object (e g , a suitcase), in such a way, that the resulting corrupted composite projection space data 174 appears to be that of the first and second object scanned together at a same time (e g , the gun and suitcase were scanned together)
[0048] Turning back to Fig 1 , in the example environment 100, the example system can comprise a reconstructor 118, which can be configured to convert the composite projection space data 174 into composite image space data 178 As an example, the reconstructor 1 18 can backproject the composite projection space data indicative of a threat item in a suitcase 174, into image space data indicative of the threat item in the suitcase 178 (e g , data comprising a three-dimensional image showing the threat item inside the suitcase)
[0049] In one embodiment, the image space data indicative of the threat item inside the suitcase 178, for example, may be displayed on a monitor 120 for human observation In this embodiment, an operator may isolate and manipulate the image, for example, rotating and viewing the image from a variety of angles, zoom levels, and positions, essentially seeing the threat item inside the suitcase from each of these perspectives
[0050] A method may be devised for inserting an image of a performance measurement object into an image of an object under examination, such that a human observer of a combined performance measurement object and object under examination may not be able to visually detect the insertion Fig 4 is a flow chart diagram of an example method 400 for inserting an image of a performance measurement object into an image of an object under examination The example method 400 begins at 402 and involves determining a desired position in the image of the object under examination to insert the image of the performance measurement object, at 404 For example one can determine an appropriate place inside an image of a suitcase to place an image of a threat item, so that the resulting combined image appears natural (e g as if the threat item was inside the suitcase and they were both scanned by a scanning apparatus together)
[0051] At 406, image space data of the image of the performance measurement object is converted into first projection space data (e g , projection space data indicative of the performance measurement object) For example the image space data of the threat item can be converted to data that may result from the threat item being scanned by a scanning apparatus (e g projection space data resulting from the threat item being
scanned). At 408, the first projection space data (e g , scanning data of the threat item) is combined with second projection space data of the image of the object under examination (e g , scanning data from the suitcase) to generate composite projection space data (e g , scanning data of the threat item inside the suitcase) As an example, the projection space data of the threat item can be combined with the projection space data of the suitcase, resulting in projection space data of the threat item in the suitcase
[0052] At 410, the composite projection space data (e g , indicative of the threat item in the suitcase) is converted into image space data For example, the projection space data indicative of the threat item in the suitcase (e g , scanning data of a threat item in a suitcase) can be back projected to image space data, which may be used to render an image on a display Having converted the projection space data to image space data, the example method 400 ends at 412
[0053] Fig 5 is a flow chart diagram of one embodiment of a method 500 for inserting an image of a performance measurement object into an image of an object under examination In this embodiment, at 504, a desired position in the image of the object under examination to insert the image of the performance measurement object is determined, such as in example method 400 at 404 At 506, a desired orientation of the image of the performance measurement object in the image of the object under examination is determined For example, the appropriate orientation of a threat item in a suitcase can be determined, based on the position chosen to place the threat item, and the orientation of the suitcase
[0054] At 508, image space data of the image of the performance measurement object is converted into first projection space data, such as in example method 400 at 406 At 510, the first projection space data is corrupted based on a characteristic of a scanner used to acquire the image of the object under examination For example, projection space data indicative of a threat item can be corrupted, using one or more scanner characteristics, so that it appears the data was a result of the threat item being scanned by the scanner used to acquire the image of the object under examination
[0055] At 512, the first projection space data is corrupted based on the determined orientation of the image of the performance measurement object For example, when the orientation of the threat item was determined at 506, the determined orientation of the threat item can be used to corrupt the projection space data of the threat item, so that it appears that the threat item was scanned in that orientation At 514, the first projection space data is combined with second projection space data of the image of the object under examination to generate composite projection space data, as in example method 400 at 408
[0056] At 516, the composite projection space data is corrupted so as to generate artifacts for presentation in reconstructed image space data of the corrupted composite projection space data As an example, when the composite projection space data is converted to image space data and presented as an image, the artifacts that may be present in the image should appear as if the threat item was inside the suitcase when it was scanned Therefore, in this example, the composite projection space data can be corrupted in such a way that when converted to image space data, the resulting image can appear as if the threat item was in the suitcase when it was scanned
[0057] At 518, the composite projection space data is converted into image space data, as in example method 400 at 410, and the composite image space data is displayed in human perceptible form substantially contemporaneously with the security examination As an example, a human luggage examiner may be situated at a threat detection system located at an airport In this example, luggage moves through a scanning apparatus and the examiner views resulting images on a display screen In this embodiment, an image of a threat item can be inserted into a suitcase that is moving through the scanning system, prior to the image of the suitcase appearing on the display monitor In this way, the human observer may not detect that the inserted image of the threat item is not a real threat item inside the suitcase under the scanning apparatus Having displayed the composite image, the example method 500 ends at 522
[0058] A method may be devised for generating a substantially artifact free image of a weapon for subsequent corruption and insertion into an image of a piece of luggage, for example, such that image of the weapon is an ideal object image of a weapon with substantially no non-weapon objects or artifacts present in the image Fig 6 is a flow chart diagram of an example method 600 for generating a substantially artifact free image of a weapon for subsequent corruption and insertion into an image of a piece of luggage The example method 600 begins at 602 and involves correcting projection data of the image of the weapon, at 604, based on at least one of the orientation of the weapon when it was scanned by a scanner to acquire the image of the weapon 606, and a characteristic of a scanner used to acquire the image of the weapon 608
[0059] As an example, when a weapon such as a gun is scanned, the orientation of the gun during scanning can create artifacts in the resulting image that are unique to the specific orientation of the gun during scanning Further, in this example, individual scanner can have unique characteristics that can manifest themselves as artifacts in the resulting image of a gun scanned by that scanner Therefore, in order to create an ideal object image of the gun, for example, one or more of these artifact creating situations can be accounted for in projection space
[0060] In the example method 600, at 610, projection space data of the image of the weapon is converted into image space data, for example, indicative of the weapon For example, projection space data that is a result of a gun being scanned can be back projected into image space data indicative of the gun that was scanned Having converted the projection space data the example method 600 ends at 612
[0061] Fig 7 is a flow chart diagram of one embodiment of an example method 700 for generating a substantially artifact free image of a weapon for subsequent corruption and insertion into an image of a piece of luggage, such as in example method 600 of Fig 6 The example method 700 begins at 701 and involves correcting projection data of the image of the weapon, at 704, based on at least one of the orientation of the weapon when it was scanned by a scanner to acquire the image of the weapon 706, and a characteristic of
a scanner used to acquire the image of the weapon 708, as in example method 600
[0062] At 710, the weapon is substantially isolated from other objects of the image For example, during scanning of a weapon such a gun, other non- gun objects may be present in the resulting image space data In this example, the gun can be substantially isolated from the non-gun objects in the projection space data It will be appreciated that, the weapon may also be isolated from the non-weapon objects in the image space data indicative of the weapon
[0063] At 712, the projection space data of the image of the weapon is converted into image space data, as in example method 600 at 610 At 714, the weapon, in image space, is situated at a desired orientation in the image of the weapon For example, a true center of an image of a weapon such as a gun can be determined so that, later, the orientation of the image of the gun may be adjusted without changing a position of the image of the gun Having situated the image of the weapon, the example method 700 ends at 716
[0064] Various operations of embodiments are provided herein In one embodiment, one or more of the operations described may constitute computer readable instructions stored on one or more computer readable media, which if executed by a computing device, will cause the computing device to perform the operations described The order in which some or all of the operations are described should not be construed as to imply that these operations are necessarily order dependent Alternative ordering will be appreciated by one skilled in the art having the benefit of this description Further, it will be understood that not all operations are necessarily present in each embodiment provided herein
[0065] Moreover, the word "example" is used herein to mean serving as an example, instance, or illustration Any aspect or design described herein as "example" is not necessarily to be construed as advantageous over other aspects or designs Rather, use of the word example is intended to present concepts in a concrete fashion As used in this application, the term "or" is intended to mean an inclusive "or" rather than an exclusive "or" That is,
unless specified otherwise, or clear from context, "X employs A or B" is intended to mean any of the natural inclusive permutations That is, if X employs A, X employs B, or X employs both A and B, then "X employs A or B" is satisfied under any of the foregoing instances In addition, the articles "a" and "an" as used in this application and the appended claims may generally be construed to mean "one or more" unless specified otherwise or clear from context to be directed to a singular form
[0066] Also, although the disclosure has been shown and described with respect to one or more implementations, equivalent alterations and modifications will occur to others skilled in the art based upon a reading and understanding of this specification and the annexed drawings The disclosure includes all such modifications and alterations and is limited only by the scope of the following claims In particular regard to the various functions performed by the above described components (e g , elements, resources, etc ), the terms used to describe such components are intended to correspond, unless otherwise indicated to any component which performs the specified function of the described component (e g , that is functionally equivalent) even though not structurally equivalent to the disclosed structure which performs the function in the herein illustrated example implementations of the disclosure In addition, while a particular feature of the disclosure may have been disclosed with respect to only one of several implementations, such feature may be combined with one or more other features of the other implementations as may be desired and advantageous for any given or particular application Furthermore, to the extent that the terms "includes", "having", "has", "with", or variants thereof are used in either the detailed description or the claims, such terms are intended to be inclusive in a manner similar to the term "comprising "
Claims
1. A system (100) configured to insert an image of a first object into an image of a second object, comprising: an object locator (154) configured to determine at least one of: a desired position in the image of the second object to insert the image of the first object, and a desired orientation of the image of the first object in the image of the second object; a forward projector (158) configured to convert image space data (170) of the image of the first object into first projection space data (172); a combiner (160) configured to combine the first projection space data (172) with second projection space data (150) of the image of the second object to generate composite projection space data (174); and a reconstructor (118) configured to convert the composite projection space data (174) into image space data (178).
2. The system of claim 1 , comprising: a first projection data uncorrector (202) configured to corrupt the first projection space data (172) based on at least one of: the orientation of the image of the first object in the image of the second object; and a characteristic of a scanner used to acquire the image of the second object.
3. The system of claim 2, the scanner applying ionizing radiation to the second object to acquire the second projection space data which corresponds to an interior of the second object, and the characteristic including at least one of an energy of the applied radiation and a dose of the applied radiation.
4. The system of claim 2, comprising: a second projection data uncorrector (208) configured to corrupt the composite projection space data (174) so as to generate artifacts for presentation in reconstructed image space data of the corrupted composite projection space data
5 The system of claim 2, the corrupted first projection space data (172) comprising parallel beam projection data (210) and the system comprising a parallel beam to fan beam converter (210) configured to convert the parallel beam projection data (210) to fan beam projection data (212)
6 The system of claim 5, at least one of the image of the first object comprising an image of a weapon, the image of the second object comprising an image of a piece of luggage, the image of the first object comprising an image of a threat item, and the image of the second object comprising an image of a suitcase
7 The system of claim 6 forming part of a tomographic security scanning apparatus
8 The system of claim 1 , the image of the first object being substantially artifact free
9 A system (300) configured to generate a substantially artifact free image of a weapon for subsequent corruption and insertion into an image of a piece of luggage, comprising a projection data corrector (302) configured to correct projection data (304) of the image of the weapon based on at least one of an orientation (306) of the weapon when it was scanned by a scanner to acquire the image of the weapon, and a characteristic (308) of a scanner used to acquire the image of the weapon, and a reconstructor (310) configured to convert projection space data (320) of the image of the weapon into image space data (322)
10 The system of claim 9 comprising an object isolator (312) configured to substantially isolate the weapon from other objects in the image.
11. The system of claim 10, comprising: an object positioner (314) configured to situate in image space the weapon at a desired orientation in the image of the weapon.
12. The system of claim 1 1 , comprising: a storage component (316) within which to store the substantially artifact free image.
13. The system of claim 1 1 , the image of the weapon comprising an image of a threat item.
14. A method for inserting an image of a performance measurement object into an image of an object under examination, comprising: determining a desired position in the image of the object under examination to insert the image of the performance measurement object; converting image space data (170) of the image of the performance measurement object into first projection space data (172); combining the first projection space data (172) with second projection space data (150) of the image of the object under examination to generate composite projection space data (174); and converting the composite projection space data (174) into image space data (178).
15. The method of claim 14, comprising: determining a desired orientation of the image of the performance measurement object in the image of the object under examination.
16. The method of claim 14, comprising: applying, during a security examination, ionizing radiation to the object under examination to acquire the second projection space data (150) which corresponds to an interior of the object; and displaying the composite image space data (178) in human perceptible form substantially contemporaneously with the security examination.
17. The method of claim 14, comprising: corrupting the first projection space data (172) based on a characteristic of a scanner used to acquire the image of the object under examination.
18. The method of claim 15, comprising: corrupting the first projection space data (172) based on the determined orientation of the image of the performance measurement object.
19. The method of claim 14, comprising: corrupting the composite projection space data (174) so as to generate artifacts for presentation in reconstructed image space data of the corrupted composite projection space data.
20. The method of claim 17, the corrupted first projection space data (172) comprising parallel beam projection data (210) and the method comprising: converting the parallel beam projection data (210) to fan beam projection data (212).
21. The method of claim 14, at least one of: the image of the performance measurement object comprising an image of a threat item; the image of the object under examination comprising an image of a piece of luggage; the image of the performance measurement object comprising an image of a threat item; and the image of the object under examination comprising an image of a suitcase.
22. A method (300) for generating a substantially artifact free image of a weapon for subsequent corruption and insertion into an image of a piece of luggage, comprising: correcting projection data (304) of the image of the weapon based on at least one of: an orientation (306) of the weapon when it was scanned by a scanner to acquire the image of the weapon, and a characteristic (308) of a scanner used to acquire the image of the weapon; and converting projection space data (320) of the image of the weapon into image space data (322).
23. The method of claim 22, comprising: substantially isolating the weapon from other objects of the image.
24. The method of claim 23, comprising: situating in image space the weapon at a desired orientation in the image of the weapon.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200880125566XA CN101933046B (en) | 2008-01-25 | 2008-06-30 | Image combining |
EP08772250.0A EP2235684B1 (en) | 2008-01-25 | 2008-06-30 | Image combining |
US12/864,647 US8942411B2 (en) | 2008-01-25 | 2008-06-30 | Image combining |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US6231108P | 2008-01-25 | 2008-01-25 | |
US61/062,311 | 2008-01-25 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2009094042A1 true WO2009094042A1 (en) | 2009-07-30 |
Family
ID=39823379
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2008/068777 WO2009094042A1 (en) | 2008-01-25 | 2008-06-30 | Image combining |
PCT/US2008/071755 WO2009094044A2 (en) | 2008-01-25 | 2008-07-31 | Edge detection |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2008/071755 WO2009094044A2 (en) | 2008-01-25 | 2008-07-31 | Edge detection |
Country Status (4)
Country | Link |
---|---|
US (2) | US8942411B2 (en) |
EP (2) | EP2235684B1 (en) |
CN (2) | CN101933046B (en) |
WO (2) | WO2009094042A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3451284A1 (en) * | 2017-09-05 | 2019-03-06 | Siemens Healthcare GmbH | Method for automatically recognising artefacts in computed tomography image data |
Families Citing this family (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8594445B2 (en) | 2005-11-29 | 2013-11-26 | Adobe Systems Incorporated | Fast bilateral filtering using rectangular regions |
US8655097B2 (en) * | 2008-08-22 | 2014-02-18 | Adobe Systems Incorporated | Adaptive bilateral blur brush tool |
US8345106B2 (en) * | 2009-09-23 | 2013-01-01 | Microsoft Corporation | Camera-based scanning |
US20110085729A1 (en) * | 2009-10-12 | 2011-04-14 | Miaohong Shi | De-noising method and related apparatus for image sensor |
CN102156996B (en) * | 2011-04-01 | 2013-08-07 | 上海海事大学 | Image edge detection method |
GB201117804D0 (en) | 2011-10-14 | 2011-11-30 | Siemens Medical Solutions | Automatic local contrast quantification tool |
SE1250048A1 (en) * | 2012-01-24 | 2013-07-25 | Wesdyne Sweden Ab | An image enhancement device for noise reduction in digital images |
CN103357672B (en) * | 2012-03-30 | 2015-10-07 | 鞍钢股份有限公司 | Strip steel boundary online detection method |
ITVI20120303A1 (en) * | 2012-11-09 | 2014-05-10 | St Microelectronics Srl | METHOD TO DETECT A STRAIGHT LINE IN A DIGITAL IMAGE |
US9355502B2 (en) * | 2012-12-12 | 2016-05-31 | Analogic Corporation | Synthetic image generation by combining image of object under examination with image of target |
CN103903297B (en) * | 2012-12-27 | 2016-12-28 | 同方威视技术股份有限公司 | Three-dimensional data processes and recognition methods |
CN103900503B (en) | 2012-12-27 | 2016-12-28 | 清华大学 | Extract the method for shape facility, safety detection method and equipment |
CN104240184B (en) * | 2013-06-08 | 2017-09-26 | 通用电气公司 | The evaluation method and system of noise criteria difference |
CN105784731B (en) * | 2014-06-25 | 2019-02-22 | 同方威视技术股份有限公司 | Mesh calibration method and safe examination system in a kind of positioning three-dimensional CT image |
CN105258681B (en) * | 2015-10-08 | 2017-11-03 | 凌云光技术集团有限责任公司 | A kind of control and its localization method for curved edge feature location |
US20190346381A1 (en) * | 2018-05-11 | 2019-11-14 | Voti Inc. | X-ray scanning system and method |
WO2020082171A1 (en) | 2018-10-22 | 2020-04-30 | Voti Inc. | Tray insert for screening tray |
US11885752B2 (en) | 2021-06-30 | 2024-01-30 | Rapiscan Holdings, Inc. | Calibration method and device therefor |
US12019035B2 (en) | 2021-07-16 | 2024-06-25 | Rapiscan Holdings, Inc. | Material detection in x-ray security screening |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1992002892A1 (en) * | 1990-08-10 | 1992-02-20 | Vivid Technologies, Inc. | Device and method for inspection of baggage and other objects |
CA2365062A1 (en) * | 2001-12-14 | 2003-06-14 | Cedara Software Corp. | Fast review of scanned baggage, and visualization and extraction of 3d objects of interest from the scanned baggage 3d dataset |
US20050276468A1 (en) * | 2004-06-09 | 2005-12-15 | Zhengrong Ying | Method of and system for extracting 3D bag images from continuously reconstructed 2D image slices in computed tomography |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5442672A (en) * | 1993-03-31 | 1995-08-15 | Bjorkholm; Paul J. | Three-dimensional reconstruction based on a limited number of X-ray projections |
US6104831A (en) * | 1998-12-10 | 2000-08-15 | Esco Electronics Corporation | Method for rejection of flickering lights in an imaging system |
JP3809818B2 (en) * | 2000-07-06 | 2006-08-16 | セイコーエプソン株式会社 | Image processing method, recording medium, and image processing apparatus |
CN2461017Y (en) * | 2000-10-02 | 2001-11-21 | 陈孝章 | Improved three-D display device |
DE10149254B4 (en) * | 2001-10-05 | 2006-04-20 | Smiths Heimann Gmbh | Method and device for detecting a specific material in an object by means of electromagnetic radiation |
US7003161B2 (en) * | 2001-11-16 | 2006-02-21 | Mitutoyo Corporation | Systems and methods for boundary detection in images |
WO2004045377A2 (en) * | 2002-11-14 | 2004-06-03 | Visionmed, Llc | Method for using a fixator device |
WO2004074871A1 (en) * | 2003-02-24 | 2004-09-02 | Philips Intellectual Property & Standards Gmbh | Automatic material discrimination by using computer tomography |
US20050058242A1 (en) * | 2003-09-15 | 2005-03-17 | Peschmann Kristian R. | Methods and systems for the rapid detection of concealed objects |
US7356174B2 (en) * | 2004-05-07 | 2008-04-08 | General Electric Company | Contraband detection system and method using variance data |
JP4659388B2 (en) * | 2004-05-13 | 2011-03-30 | キヤノン株式会社 | Image processing device |
JP4683994B2 (en) * | 2005-04-28 | 2011-05-18 | オリンパス株式会社 | Image processing apparatus, image processing method, electronic camera, scanner |
US7692650B2 (en) * | 2005-06-01 | 2010-04-06 | Analogic Corporation | Method of and system for 3D display of multi-energy computed tomography images |
CN101071109B (en) * | 2006-05-08 | 2010-05-12 | 清华大学 | Multi-segment linear trace imaging cargo safety inspection system |
EP2156408B1 (en) * | 2007-05-30 | 2021-03-17 | Koninklijke Philips N.V. | Pet local tomography |
US7801264B2 (en) * | 2007-12-19 | 2010-09-21 | General Electric Company | Method for calibrating a dual -spectral computed tomography (CT) system |
-
2008
- 2008-06-30 US US12/864,647 patent/US8942411B2/en active Active
- 2008-06-30 WO PCT/US2008/068777 patent/WO2009094042A1/en active Application Filing
- 2008-06-30 CN CN200880125566XA patent/CN101933046B/en active Active
- 2008-06-30 EP EP08772250.0A patent/EP2235684B1/en active Active
- 2008-07-31 EP EP08796953.1A patent/EP2235678B1/en not_active Not-in-force
- 2008-07-31 WO PCT/US2008/071755 patent/WO2009094044A2/en active Application Filing
- 2008-07-31 US US12/864,645 patent/US8548252B2/en not_active Expired - Fee Related
- 2008-07-31 CN CN2008801254370A patent/CN101933042B/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1992002892A1 (en) * | 1990-08-10 | 1992-02-20 | Vivid Technologies, Inc. | Device and method for inspection of baggage and other objects |
CA2365062A1 (en) * | 2001-12-14 | 2003-06-14 | Cedara Software Corp. | Fast review of scanned baggage, and visualization and extraction of 3d objects of interest from the scanned baggage 3d dataset |
US20050276468A1 (en) * | 2004-06-09 | 2005-12-15 | Zhengrong Ying | Method of and system for extracting 3D bag images from continuously reconstructed 2D image slices in computed tomography |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3451284A1 (en) * | 2017-09-05 | 2019-03-06 | Siemens Healthcare GmbH | Method for automatically recognising artefacts in computed tomography image data |
Also Published As
Publication number | Publication date |
---|---|
EP2235684B1 (en) | 2018-12-26 |
WO2009094044A3 (en) | 2009-11-26 |
CN101933042B (en) | 2013-11-13 |
CN101933046A (en) | 2010-12-29 |
CN101933046B (en) | 2012-10-03 |
US8548252B2 (en) | 2013-10-01 |
WO2009094044A2 (en) | 2009-07-30 |
EP2235678A2 (en) | 2010-10-06 |
US8942411B2 (en) | 2015-01-27 |
US20110085695A1 (en) | 2011-04-14 |
US20110033118A1 (en) | 2011-02-10 |
EP2235684A1 (en) | 2010-10-06 |
CN101933042A (en) | 2010-12-29 |
EP2235678B1 (en) | 2018-11-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2235684B1 (en) | Image combining | |
US10697903B2 (en) | Combined image generation of article under examination and image of test item | |
US7466790B2 (en) | Systems and methods for improving a resolution of an image | |
US8306180B2 (en) | Image reconstruction method for high-energy, dual-energy CT system | |
JP5734664B2 (en) | Image Restoration Method Using Dilution Constraint Correction | |
CN102844793B (en) | For gating the sparse data reconstruction of X ray CT imaging | |
EP2005394B1 (en) | Method for reconstruction images and reconstruction system for reconstructing images | |
US20110150178A1 (en) | Method for processing tomosynthesis acquisitions in order to obtain a representation of the contents of an organ | |
WO2013056733A1 (en) | Out of plane artifact reduction in digital breast tomosynthesis and ct | |
CN209841738U (en) | CT detection device | |
US20080123895A1 (en) | Method and system for fast volume cropping of three-dimensional image data | |
CN105659296A (en) | Image visualization | |
US9355502B2 (en) | Synthetic image generation by combining image of object under examination with image of target | |
US11103198B2 (en) | Projection of objects in CT X-ray images | |
Herl et al. | Metal artifact reduction by fusion of ct scans from different positions using the unfiltered backprojection | |
Megherbi et al. | Fully automatic 3D threat image projection: application to densely cluttered 3D computed tomography baggage images | |
US8184887B2 (en) | System and method for image reconstruction | |
CN105612433A (en) | Synthesized imaging of chromatographic X-ray photographing | |
EP2366103B1 (en) | Measurement of the position of the center detector for geometrically calibrating a ct scanner based on a complex phantom | |
US8854355B2 (en) | System and method of visualizing features in an image | |
Cho et al. | Metal artifact removal (MAR) analysis for the security inspections using the X-ray computed tomography | |
JP6718448B2 (en) | Image reconstruction for computed tomography | |
Yildiz et al. | 3D threat image projection | |
WO2013190435A1 (en) | Image reconstruction in interleaved multi-energy imaging |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200880125566.X Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 08772250 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2008772250 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12864647 Country of ref document: US |