US20200197129A1 - Selection and locking of intraoral images - Google Patents
Selection and locking of intraoral images Download PDFInfo
- Publication number
- US20200197129A1 US20200197129A1 US16/810,726 US202016810726A US2020197129A1 US 20200197129 A1 US20200197129 A1 US 20200197129A1 US 202016810726 A US202016810726 A US 202016810726A US 2020197129 A1 US2020197129 A1 US 2020197129A1
- Authority
- US
- United States
- Prior art keywords
- intraoral
- scan data
- intraoral scan
- model
- dental site
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000002360 preparation method Methods 0.000 claims abstract description 123
- 238000012545 processing Methods 0.000 claims abstract description 73
- 238000000034 method Methods 0.000 claims abstract description 54
- 230000015654 memory Effects 0.000 claims description 12
- 238000010801 machine learning Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 4
- 210000000214 mouth Anatomy 0.000 description 15
- 238000003860 storage Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 12
- 230000009466 transformation Effects 0.000 description 9
- 210000002455 dental arch Anatomy 0.000 description 7
- 239000011800 void material Substances 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 239000008280 blood Substances 0.000 description 5
- 210000004369 blood Anatomy 0.000 description 5
- 210000003296 saliva Anatomy 0.000 description 5
- 238000000844 transformation Methods 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 238000009877 rendering Methods 0.000 description 4
- 239000002131 composite material Substances 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 2
- 238000002591 computed tomography Methods 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 238000003708 edge detection Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 239000007943 implant Substances 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 210000001847 jaw Anatomy 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 239000000523 sample Substances 0.000 description 2
- 210000004872 soft tissue Anatomy 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 239000003826 tablet Substances 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 208000002925 dental caries Diseases 0.000 description 1
- 230000037123 dental health Effects 0.000 description 1
- 210000004513 dentition Anatomy 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000013213 extrapolation Methods 0.000 description 1
- -1 for example saliva Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 208000024693 gingival disease Diseases 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 210000004283 incisor Anatomy 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000005291 magnetic effect Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000012913 prioritisation Methods 0.000 description 1
- 201000002859 sleep apnea Diseases 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
- 230000036346 tooth eruption Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000014616 translation Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/0002—Operational features of endoscopes provided with data storages
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00039—Operational features of endoscopes provided with input arrangements for the user
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/24—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the mouth, i.e. stomatoscopes, e.g. with tongue depressors; Instruments for opening or keeping open the mouth
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61C—DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
- A61C13/00—Dental prostheses; Making same
- A61C13/0003—Making bridge-work, inlays, implants or the like
- A61C13/0004—Computer-assisted sizing or machining of dental prostheses
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61C—DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
- A61C13/00—Dental prostheses; Making same
- A61C13/0024—Repairing or adjusting dentures; Location of irritating zones
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61C—DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
- A61C5/00—Filling or capping teeth
- A61C5/70—Tooth crowns; Making thereof
- A61C5/77—Methods or devices for making crowns
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61C—DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
- A61C9/00—Impression cups, i.e. impression trays; Impression methods
- A61C9/004—Means or methods for taking digitized impressions
- A61C9/0046—Data acquisition means or methods
- A61C9/0053—Optical means or methods, e.g. scanning the teeth by a laser or light beam
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0007—Image acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G06T15/205—Image-based rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000095—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope for image enhancement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30036—Dental; Teeth
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2021—Shape modification
Definitions
- Embodiments of the present invention relate to the field of intraoral scanning and, in particular, to a system and method for improving the results of intraoral scanning.
- the intraoral site at which the prosthesis is to be implanted in many cases should be measured accurately and studied carefully, so that a prosthesis such as a crown, denture or bridge, for example, can be properly designed and dimensioned to fit in place.
- a good fit enables mechanical stresses to be properly transmitted between the prosthesis and the jaw, and can prevent infection of the gums and tooth decay via the interface between the prosthesis and the intraoral site, for example.
- the intraoral site may be scanned to provide three-dimensional (3D) data of the intraoral site.
- 3D three-dimensional
- FIG. 1 illustrates one embodiment of a system for performing intraoral scanning and generating a virtual three-dimensional model of an intraoral site.
- FIG. 2 illustrates a flow diagram for a method of automatically locking an image set of an intraoral site, in accordance with embodiments of the present invention.
- FIG. 3 illustrates a flow diagram for a method of locking multiple image sets of one or more intraoral sites, in accordance with embodiments of the present invention.
- FIG. 4 illustrates a flow diagram for a method of stitching together multiple image sets of one or more intraoral sites, in accordance with embodiments of the present invention.
- FIG. 5 illustrates a flow diagram for a method of detecting an anomaly in an image set of an intraoral site and replacing the anomaly with data from an additional intraoral image, in accordance with embodiments of the present invention.
- FIG. 6 illustrates a flow diagram for a method of extending a model of an intraoral site where an incomplete edge is detected, in accordance with embodiments of the present invention.
- FIG. 7A illustrates a portion of an example dental arch during an intraoral scan session after a first set of intraoral images of a preparation tooth have been generated.
- FIG. 7B illustrates the example dental arch of FIG. 7A during the intraoral scan session after a second set of intraoral images of a tooth adjacent to the preparation tooth have been generated.
- FIG. 7C illustrates the first set of intraoral images of FIG. 7A , wherein the first set of intraoral images includes an anomaly.
- FIG. 7D illustrates a model created from the first set of intraoral images of FIG. 7C with data from an additional intraoral image.
- FIG. 7E illustrates a set intraoral images of a preparation tooth, wherein the set of intraoral images fails to capture all of the preparation tooth.
- FIG. 7F illustrates a model created from the first set of intraoral images of FIG. 7E with data from an additional intraoral image.
- FIG. 8 illustrates a block diagram of an example computing device, in accordance with embodiments of the present invention.
- a method and apparatus for improving the quality of scans such as intraoral scans taken of intraoral sites (e.g., dental sites) for patients.
- a user e.g., a dental practitioner
- a scanner may generate multiple different images (also referred to as scans) of an intraoral site, model of an intraoral site, or other object.
- the images may be discrete images (e.g., point-and-shoot images) or frames from a video (e.g., a continuous scan).
- the practitioner may take a first set of intraoral images of a first tooth after readying the first tooth for scanning.
- first tooth is a preparation tooth (also referred to as a preparation)
- one or more operations may be performed prior to generating the first set of intraoral images to ensure that a quality of the first set of intraoral images is high.
- these operations briefly expose a finish line of the preparation tooth to ensure that the finish line will show up in the first set of intraoral images.
- the practitioner may take additional sets of intraoral images of one or more adjacent teeth.
- the additional sets of intraoral images may include data for portions of the first tooth that was the focus of the first set of intraoral images.
- the data from the additional sets of intraoral images combines with (e.g., is averaged with) the data for the first tooth from the first set of intraoral images to degrade a quality of that first tooth in the 3D model.
- the first set of images is automatically locked after the first set of intraoral images is created. Additionally, portions of the first set of intraoral images that depict the first tooth may be exclusively used for the generation of the 3D model of that first tooth. Thus, the additional sets of intraoral images do not alter or add noise to a region of the 3D model depicting the first tooth as a result of the first set of intraoral image being locked.
- an identity of the first tooth is determined, and the first portions of the first set of intraoral images are selected based at least in part on the identity of the first tooth.
- the lower quality data from the additional sets of intraoral images that depict the first tooth may not be applied when generating the 3D model of the first tooth. This may improve an image quality of the first tooth in the 3D model of an intraoral site (e.g., of a portion of a jaw).
- Embodiments described herein are discussed with reference to intraoral scanners, intraoral images, intraoral scan sessions, and so forth. However, it should be understood that embodiments also apply to other types of scanners than intraoral scanners. Embodiments may apply to any type of scanner that takes multiple images and stitches these images together to form a combined image or virtual model. For example, embodiments may apply to desktop model scanners, computed tomography (CT) scanners, and so forth. Additionally, it should be understood that the intraoral scanners or other scanners may be used to scan objects other than intraoral sites in an oral cavity. For example, embodiments may apply to scans performed on physical models of an intraoral site or any other object.
- CT computed tomography
- embodiments describing intraoral images should be understood as being generally applicable to any types of images generated by a scanner
- embodiments describing intraoral scan sessions should be understood as being applicable to scan sessions for any type of object
- embodiments describing intraoral scanners should be understood as being generally applicable to many types of scanners.
- FIG. 1 illustrates one embodiment of a system 100 for performing intraoral scanning and/or generating a virtual three-dimensional model of an intraoral site.
- system 100 carries out one or more operations described below with reference to FIGS. 2-6 .
- System 100 includes a computing device 105 that may be coupled to a scanner 150 and/or a data store 110 .
- Computing device 105 may include a processing device, memory, secondary storage, one or more input devices (e.g., such as a keyboard, mouse, tablet, and so on), one or more output devices (e.g., a display, a printer, etc.), and/or other hardware components.
- the computing device 105 may be integrated into the scanner 150 in some embodiments to improve performance and/or mobility.
- Computing device 105 may be connected to data store 110 either directly or via a network.
- the network may be a local area network (LAN), a public wide area network (WAN) (e.g., the Internet), a private WAN (e.g., an intranet), or a combination thereof.
- data store 110 may be an internal data store. Examples of network data stores include a storage area network (SAN), a network attached storage (NAS), and a storage service provided by a cloud computing service provider.
- Data store 110 may include a file system, a database, or other data storage arrangement.
- a scanner 150 for obtaining three-dimensional (3D) data of an intraoral site in a patient's oral cavity is operatively connected to the computing device 105 .
- Scanner 150 may include a probe (e.g., a hand held probe) for optically capturing three-dimensional structures (e.g., by confocal focusing of an array of light beams).
- a probe e.g., a hand held probe
- three-dimensional structures e.g., by confocal focusing of an array of light beams.
- intraoral scanners include the 3MTM True Definition Scanner and the Apollo DI intraoral scanner and CEREC AC intraoral scanner manufactured by Sirona®.
- the scanner 150 may be used to perform an intraoral scan of a patient's oral cavity.
- An intraoral scan application 108 running on computing device 105 may communicate with the scanner 150 to effectuate the intraoral scan.
- a result of the intraoral scan may be one or more sets of intraoral images that have been discretely generated (e.g., by pressing on a “generate image” button of the scanner for each image).
- a result of the intraoral scan may be one or more videos of the patient's oral cavity.
- An operator may start recording the video with the scanner 150 at a first position in the oral cavity, move the scanner 150 within the oral cavity to a second position while the video is being taken, and then stop recording the video.
- the scanner 150 may transmit the discrete intraoral images or intraoral video (referred to collectively as intraoral image data sets 135 A- 135 N) to the computing device 105 .
- Computing device 105 may store the intraoral image data sets 135 A- 135 N in data store 110 .
- scanner 150 may be connected to another system that stores the intraoral image data sets 135 A- 135 N in data store 110 . In such an embodiment, scanner 150 may not be connected to computing device 105 .
- intraoral scan application 108 includes an anomaly identifying module 115 , a flagging module 118 , a model generation module 125 , an image locking module 128 , an eraser module 132 and an expansion module 134 .
- the operations of one or more of the anomaly identifying module 115 , flagging module 118 , model generation module 125 , image locking module 128 , eraser module 132 and/or expansion module 134 may be combined into a single module or separated into further modules.
- a user may subject a patient to intraoral scanning.
- the user may apply scanner 150 to one or more patient intraoral locations.
- the scanning may be divided into one or more segments.
- the segments may include a lower buccal region of the patient, a lower lingual region of the patient, a upper buccal region of the patient, an upper lingual region of the patient, one or more preparation teeth of the patient (e.g., teeth of the patient to which a dental device such as a crown or other dental prosthetic will be applied), one or more teeth which are contacts of preparation teeth (e.g., teeth not themselves subject to a dental device but which are located next to one or more such teeth or which interface with one or more such teeth upon mouth closure), and/or patient bite (e.g., scanning performed with closure of the patient's mouth with the scan being directed towards an interface area of the patient's upper and lower teeth).
- the scanner 150 may provide image data (also referred to as scan data) to computing device 105 .
- the image data may be provided in the form of intraoral image data sets 135 A- 135 N, each of which may include 2D intraoral images and/or 3D intraoral images of particular teeth and/or regions of an intraoral site.
- intraoral image data sets 135 A- 135 N may include 2D intraoral images and/or 3D intraoral images of particular teeth and/or regions of an intraoral site.
- separate image data sets are created for the maxillary arch, for the mandibular arch, for a patient bite, and for each preparation tooth.
- Such images may be provided from the scanner to the computing device 105 in the form of one or more points (e.g., one or more pixels and/or groups of pixels).
- the scanner 150 may provide such a 3D image as one or more point clouds.
- the manner in which the oral cavity of a patient is to be scanned may depend on the procedure to be applied thereto. For example, if an upper or lower denture is to be created, then a full scan of the mandibular or maxillary edentulous arches may be performed. In contrast, if a bridge is to be created, then just a portion of a total arch may be scanned which includes an edentulous region, the neighboring preparation teeth (e.g., abutment teeth) and the opposing arch and dentition. Thus, the dental practitioner may input the identity of a procedure to be performed into intraoral scan application 108 .
- the dental practitioner may choose the procedure from a number of preset options on a drop-down menu or the like, from icons or via any other suitable graphical user interface.
- the identity of the procedure may be input in any other suitable way; for example by means of preset code, notation or any other suitable, manner, intraoral scan application 108 having been suitably programmed to recognize the choice made by the user.
- dental procedures may be broadly divided into prosthodontic (restorative) and orthodontic procedures, and then further subdivided into specific forms of these procedures. Additionally, dental procedures may include identification and treatment of gum disease, sleep apnea, and intraoral conditions.
- prosthodontic procedure refers, inter alia, to any procedure involving the oral cavity and directed to the design, manufacture or installation of a dental prosthesis at a dental site within the oral cavity (intraoral site), or a real or virtual model thereof, or directed to the design and preparation of the intraoral site to receive such a prosthesis.
- a prosthesis may include any restoration such as crowns, veneers, inlays, onlays, implants and bridges, for example, and any other artificial partial or complete denture.
- orthodontic procedure refers inter alia, to any procedure involving the oral cavity and directed to the design, manufacture or installation of orthodontic elements at a intraoral site within the oral cavity, or a real or virtual model thereof, or directed to the design and preparation of the intraoral site to receive such orthodontic elements.
- These elements may be appliances including but not limited to brackets and wires, retainers, clear aligners, or functional appliances.
- an existing tooth of a patient is ground down to a stump.
- the ground tooth is referred to herein as a preparation tooth, or simply a preparation.
- the preparation tooth has a finish line (also referred to as a margin line), which is a border between a natural (unground) portion of the preparation tooth and the prepared (ground) portion of the preparation tooth.
- the preparation tooth is typically created so that a crown or other prosthesis can be mounted or seated on the preparation tooth.
- the finish line of the preparation tooth is below the gum line.
- preparation typically refers to the stump of a preparation tooth, including the finish line and shoulder that remains of the tooth
- preparation herein also includes artificial stumps, pivots, cores and posts, or other devices that may be implanted in the intraoral cavity so as to receive a crown or other prosthesis.
- Embodiments described herein with reference to a preparation tooth also apply to other types of preparations, such as the aforementioned artificial stumps, pivots, and so on.
- a practitioner performs operations to ready that preparation tooth for scanning. Readying the preparation tooth for scanning may include wiping blood, saliva, etc. off of the preparation tooth and/or separating a patient's gum from the preparation tooth to expose the finish line.
- a practitioner will insert a cord around the preparation tooth between the preparation tooth and the patient's gum. The practitioner will then remove the cord before generating a set of intraoral scans of the preparation tooth. The soft tissue of the gum will then revert back to its natural position, and in many cases collapses back over the finish line, after a brief time period. Accordingly, the practitioner uses the scanner 150 to scan the readied preparation tooth and generate a set of intraoral images (e.g., intraoral image data set 135 A) of the preparation tooth before the soft tissue reverts back to its natural position.
- a set of intraoral images e.g., intraoral image data set 135 A
- the practitioner may preview the set of intraoral images (or a 3D model crated therefrom) to determine if the set of intraoral images have satisfactory quality.
- the practitioner may then either rescan the preparation tooth (or a portion thereof) if the quality is not satisfactory, or may proceed to generate additional sets of intraoral images (e.g., intraoral image sets 135 B- 135 N) for adjacent teeth and other areas around the preparation tooth if the quality is satisfactory.
- additional sets of intraoral images for the adjacent areas may be taken, for example, to ensure that a dental prosthesis will fit in the patient's mouth.
- the additional sets of intraoral images may also capture portions of the preparation tooth after the gum has collapsed back over the finish line and/or after blood and/or saliva has accumulated on the preparation tooth.
- image locking module 128 automatically locks that first set of intraoral images.
- the locked first set of intraoral images may be associated with a preparation tooth of a patient.
- image locking module 128 automatically locks image data sets associated with preparation teeth, but does not automatically lock other image data sets. Accordingly, image locking module 128 may determine whether a new image data set is associated with a preparation tooth, and if so lock that image data set.
- the identity of the preparation tooth may be used by image locking module 128 to automatically select portions of the locked first set of intraoral images that will be applied for the preparation tooth in a 3D model.
- a practitioner may use a graphical user interface (GUI) to mark the portions of the locked set of intraoral images that will be applied for the preparation tooth in the 3D model.
- GUI graphical user interface
- the image locking module 128 may update the locked image data set so that only portions of the locked image data set that depict the preparation tooth are locked, while the portions of the image data set that depict gums, other teeth, etc. are unlocked.
- image locking module 128 performs image processing to determine a contour of the preparation tooth as well as the finish line.
- All data representing the preparation tooth inside of the finish line may be locked, while all data representing other intraoral features outside of the finish line may be unlocked.
- a buffer is applied, and all data within the finish line plus the buffer is locked.
- the buffer may be, for example, a 1-3 mm offset from the finish line.
- image locking module 128 may algorithmically determine what data to keep in the locked image data set.
- a user may manually determine what data to keep in the locked image data set. For example, the user may outline the area that he or she wishes to keep via the graphical user interface. This locked image data set can later be unlocked at any time by a user.
- the data from additional sets of intraoral images may be ignored by model generation module 125 during creation of the preparation tooth in the 3D model.
- the finish line captured in the first image data set is not degraded by further image data.
- additional intraoral image data sets may be generated for additional preparation teeth and/or other teeth, such as teeth that are adjacent to a scanned preparation tooth.
- Image locking module 128 may automatically (e.g., algorithmically and/or without user input) lock some or all image data sets after the image data sets have been created and before additional intraoral images are taken.
- Image locking module 128 may assign each locked intraoral image data set 135 A- 135 N a separate layer or group identifier. These layers may be used to refer to entire image data sets, and may be used to display or hide image data sets and/or to prioritize data from image data sets for stitching together such image data sets.
- a first image data set may be associated with a first tooth and a second image data set may be associated with an adjacent second tooth.
- Data from the first image data set may overlap data from the second image data set, and may diverge from the data from the second image data set.
- One technique of remedying the discrepancies is to average the data of the first image data set with the data of the second image data set for the overlapping regions.
- a weight may be assigned to each image data set, and the averaging of the image data sets may be a weighted average.
- Model generation module 125 may then weight the first image data set more heavily than the second image data set when averaging the differences between the image data sets.
- Image locking module 128 may associate each intraoral image data set 135 A- 135 N with a particular tooth and/or may otherwise identify an intraoral site associated with each intraoral image data set 135 A- 135 N.
- a user indicates which tooth he or she is scanning before generating an image data set.
- a user may first take an image data set, and may subsequently indicate a tooth imaged in the image data set.
- intraoral scan application 108 may instruct the user to scan a particular tooth, and may associate an identity of that particular tooth with the image data set.
- each locked intraoral image data set 135 A- 135 N may be associated with a particular tooth, which may or may not be a preparation tooth.
- model generation module 125 may generate a virtual 3D model of the scanned intraoral site.
- model generation module 125 may register (i.e., “stitch” together) the intraoral images generated from the intraoral scan session.
- performing image registration includes capturing 3D data of various points of a surface in multiple images (views from a camera), and registering the images by computing transformations between the images. The images may then be integrated into a common reference frame by applying appropriate transformations to points of each registered image.
- image registration is performed for each pair of adjacent or overlapping intraoral images (e.g., each successive frame of an intraoral video).
- Image registration algorithms are carried out to register two adjacent intraoral images, which essentially involves determination of the transformations which align one image with the other.
- Image registration may involve identifying multiple points in each image (e.g., point clouds) of an image pair, surface fitting to the points of each image, and using local searches around points to match points of the two adjacent images.
- model generation module 125 may match points of one image with the closest points interpolated on the surface of the other image, and iteratively minimize the distance between matched points.
- Model generation module 125 may also find the best match of curvature features at points of one image with curvature features at points interpolated on the surface of the other image, without iteration. Model generation module 125 may also find the best match of spin-image point features at points of one image with spin-image point features at points interpolated on the surface of the other image, without iteration. Other techniques that may be used for image registration include those based on determining point-to-point correspondences using other features and minimization of point-to-surface distances, for example. Other image registration techniques may also be used.
- a single surface patch may be fit to all points of an image, or alternatively, separate surface patches may be fit to any number of a subset of points of the image. Separate surface patches may be fit to have common boundaries or they may be fit to overlap. Surfaces or surface patches may be fit to interpolate multiple points by using a control-point net having the same number of points as a grid of points being fit, or the surface may approximate the points by using a control-point net which has fewer number of control points than the grid of points being fit.
- Various matching techniques may also be employed by the image registration algorithms.
- model generation module 125 may determine a point match between images, which may take the form of a two dimensional (2D) curvature array.
- a local search for a matching point feature in a corresponding surface patch of an adjacent image may be carried out by computing features at points sampled in a region surrounding the parametrically similar point.
- determination of the transformation between the two sets of corresponding points in two coordinate frames can be solved.
- an image registration algorithm may compute a transformation between two adjacent images that will minimize the distances between points on one surface, and the closest points to them found in the interpolated region on the other image surface used as a reference.
- Model generation module 125 repeats image registration for all adjacent image pairs of a sequence of intraoral images to obtain a transformation between each pair of images, to register each image with the previous one. Model generation module 125 then integrates all images into a single virtual 3D model by applying the appropriate determined transformations to each of the images.
- Each transformation may include rotations about one to three axes and translations within one to three planes.
- image locking module 128 may use the identity of the associated tooth to determine what portions of that image data set will be used exclusively for creation of a particular region of a 3D model (e.g., for creation of the associated tooth in the 3D model).
- the image locking module 128 may analyze the image data in each intraoral image data set.
- the image locking module 128 may use stored information about an associated tooth to determine from the analysis which portions or areas of that image data set represent that tooth and which portions or areas of that image data set represent other intraoral objects such as gums and other teeth.
- the selection module 130 may then generate a contour of that tooth in the image data set.
- the generated contour may act as a border.
- Data from the image data set that is within the contour may be exclusively used by model generation module 125 to generate the specific associated tooth in a 3D model.
- Data from the image data set that is outside of the contour may or may not be used to generate additional features or objects in the 3D model. Additionally, data outside the contour may be combined with data from other image data sets to generate the additional features or objects in the 3D model.
- the operation of contouring the tooth in a locked image data set is performed by image locking module (as described above).
- Image locking module 128 may then update the locked image data set to lock portions of the image data set inside of the contour and unlock portions of the image data set outside of the contour.
- Anomaly identifying module 115 is responsible for identifying anomalies and/or other areas of interest (AOIs) from intraoral scan data (e.g., intraoral images in an intraoral image data set) and/or virtual 3D models generated from intraoral scan data.
- Such anomalies may include voids (e.g., areas for which scan data is missing), areas of conflict or flawed scan data (e.g., areas for which overlapping surfaces of multiple intraoral images fail to match), areas indicative of foreign objects (e.g., studs, bridges, etc.), unclear margin line (e.g., margin line of one or more preparation teeth), noisy information, and so forth.
- An identified void may be a void in a surface of an image.
- the anomaly identifying module 115 may, in identifying an anomaly, analyze patient image data (e.g., 3D image point clouds) and/or one or more virtual 3D models of the patient alone and/or relative to reference data 138 .
- the analysis may involve direct analysis (e.g., pixel-based and/or other point-based analysis), the application of machine learning, and/or the application of image recognition.
- reference data 138 may include past data regarding the at-hand patient (e.g., intraoral images and/or virtual 3D models), pooled patient data, and/or pedagogical patient data, some or all of which may be stored in data store 110 .
- Anomaly identifying module 115 to identify anomalies by performing image processing to identify an unexpected shape, a region with low clarity, a region missing data, color discrepancies, and so forth. Different criteria may be used to identify different classes of anomalies.
- an area of missing image data is used to identify anomalies that might be voids. For example, voxels at areas that were not captured by the intraoral images may be identified.
- anomaly identifying module interpolates a shape for the anomaly based on geometric features surrounding the anomaly and/or based on geometric features of the anomaly (if such features exist). Such geometric features may be determined by using edge detection, corner detection, blob detection, ridge detection, Hough transformations, structure tensors, and/or other image processing techniques.
- the data regarding the at-hand patient may include X-rays, 2D intraoral images, 3D intraoral images, 2D models, and/or virtual 3D models corresponding to the patient visit during which the scanning occurs.
- the data regarding the at-hand patient may additionally include past X-rays, 2D intraoral images, 3D intraoral images, 2D models, and/or virtual 3D models of the patient (e.g., corresponding to past visits of the patient and/or to dental records of the patient).
- the pooled patient data may include X-rays, 2D intraoral images, 3D intraoral images, 2D models, and/or virtual 3D models regarding a multitude of patients. Such a multitude of patients may or may not include the at-hand patient.
- the pooled patient data may be anonymized and/or employed in compliance with regional medical record privacy regulations (e.g., the Health Insurance Portability and Accountability Act (HIPAA)).
- HIPAA Health Insurance Portability and Accountability Act
- the pooled patient data may include data corresponding to scanning of the sort discussed herein and/or other data.
- the pedagogical patient data may include X-rays, 2D intraoral images, 3D intraoral images, 2D models, virtual 3D models, and/or medical illustrations (e.g., medical illustration drawings and/or other images) employed in educational contexts.
- the pedagogical patient data may include volunteer data and/or cadaveric data.
- Anomaly identifying module 115 may analyze patient scan data from later in a patient visit during which the scanning occurs (e.g., one or more later-in-the-visit 3D image point clouds and/or one or more later-in-the-visit virtual 3D models of the patient) relative to additional patient scan data in the form of data from earlier in that patient visit (e.g., one or more earlier-in-the-visit 3D image point clouds and/or one or more earlier-in-the-visit virtual 3D models of the patient).
- patient scan data from later in a patient visit during which the scanning occurs e.g., one or more later-in-the-visit 3D image point clouds and/or one or more later-in-the-visit virtual 3D models of the patient.
- Anomaly identifying module 115 may additionally or alternatively analyze patient scan data relative to reference data in the form of dental record data of the patient and/or data of the patient from prior to the patient visit (e.g., one or more prior-to-the-visit 3D image point clouds and/or one or more prior-to-the-visit virtual 3D models of the patient). Anomaly identifying module 115 may additionally or alternatively analyze patient scan data relative to pooled patient data and/or pedagogical patient data.
- Identifying of anomalies concerning missing and/or flawed scan data may involve the anomaly identifying module 115 performing direct analysis, for instance determining one or more pixels or other points to be missing from patient scan data and/or one or more virtual 3D models of the patient. Identification of anomalies concerning missing and/or flawed scan data may additionally or alternatively involve employing pooled patient data and/or pedagogical patient data to ascertain patient scan data and/or virtual 3D models as being incomplete (e.g., possessing discontinuities) relative to that which is indicated by the pooled patient data and/or pedagogical patient data.
- Flagging module 118 is responsible for determining how to present and/or call out the identified anomalies. Flagging module 118 may provide indications or indicators of anomalies. The indications may be presented (e.g., via a user interface) to a user (e.g., a practitioner) in connection with and/or apart from one or more depictions of teeth and/or gingivae of a patient (e.g., in connection with one or more X-rays, 2D intraoral images, 3D intraoral images, 2D models, and/or virtual 3D models of the patient). Indication presentation in connection with depictions of patient teeth and/or gingivae may involve the indications being placed so as to correlate an indication with the corresponding portion of the teeth and/or gingivae.
- the indications may be provided in the form of flags, markings, contours, text, images, and/or sounds (e.g., in the form of speech).
- a contour may be placed (e.g., via contour fitting) so as to follow an extant tooth contour and/or gingival contour (e.g., as a border).
- a contour corresponding to a void may be placed so as to follow a contour of the missing data.
- Such a contour may be placed (e.g., via contour extrapolation) with respect to a missing tooth contour and/or gingival contour so as to follow a projected path of the missing contour.
- a contour corresponding to missing tooth scan data may be placed so as to follow the projected path of the tooth portion which is missing, or a contour corresponding to missing gingival scan data may be placed so as to follow the projected path of the gingival portion which is missing.
- Data for portions of the intraoral image data set that is within the contoured anomaly may be unlocked or removed from the locked intraoral image data set.
- the anomaly may be identified to a user, and the user may then generate a new intraoral image that captures the area of the anomaly in the intraoral site.
- the portion of the new intraoral image that corresponds to an inside of the contour of the anomaly is then used to replace the original data from the intraoral image data set for the anomaly.
- This data may then be added to the locked image data set.
- anomalies may be automatically detected in a set of intraoral images, and an additional intraoral image may be taken to overwrite the anomaly without affecting the rest of the intraoral image data set.
- anomaly identifying module 115 may then determine whether there are any additional image data sets that include data covering the area at which the anomaly was identified. Anomaly identifying module 115 may compare this area from the one or more additional image data sets to the data of the locked image data set. Based on this comparison, anomaly identifying module 115 may determine that the data of the locked image data set covering the contour is to be replaced by data from another image data set. The portion of the other image data set that corresponds to an inside of the contour of the anomaly may then be used to replace the original data from the intraoral image data set for the anomaly. This data may then be added to the locked image data set.
- a different replacement option is presented to a user for each additional image data set.
- anomaly identifying module 115 may replace the anomaly with image data covering the contour of the anomaly from that additional image data set.
- Each of the replacement options may be presented to the user, who may then select which of the replacement options to apply. Once a user selection has been received, the data from the additional image data set associated with the user selection may be used to replace the anomaly in the locked image data set.
- a 3D model created by model generation module 125 may be displayed to a user via a user interface of intraoral scan application.
- the 3D model can then be checked visually by the user.
- the user can virtually manipulate the 3D model via the user interface with respect to up to six degrees of freedom (i.e., translated and/or rotated with respect to one or more of three mutually orthogonal axes) using suitable user controls (hardware and/or virtual) to enable viewing of the 3D model from any desired direction.
- a user may review (e.g., visually inspect) the generated 3D model of an intraoral site and determine that one or more areas of the 3D model are unacceptable.
- the user may determine that part of the 3D model is unsuitable or undesired, and that a remainder of the 3D model is acceptable.
- the unacceptable portion of the 3D model can correspond, for example, to a part of a real dental surface of a scanned intraoral site that was not sufficiently clearly defined in the 3D model.
- the corresponding part of the physical dental surface may have been covered with foreign material, such as for example saliva, blood, or debris.
- the corresponding part of the physical dental surface may also have been obscured by another element such as for example part of the gums, cheek, tongue, dental instruments, artifacts, etc.
- the unacceptable portion may be distorted or otherwise defective and may not properly correspond to a physical dental surface (e.g., due to some defect in the actual scanning process).
- a user may mark or otherwise demarcate the unacceptable portion of the 3D model.
- Eraser module 132 may then delete or otherwise remove the marked portion from the 3D model (and the associated portions of a locked image data set and/or other image data set used to create the unacceptable portion).
- the dental procedure of interest may be providing a dental prosthesis, and the deleted or removed part of the 3D model may be part of a finish line of a tooth preparation that exists in a real dental surface, but was not clearly represented in the 3D model (or in the intraoral image data sets 135 A- 135 N used to create the 3D model).
- Intraoral scan application 108 may direct a user to generate one or more additional intraoral images of the dental site corresponding to the portion of the 3D model (and corresponding set or sets of intraoral images) that was deleted or removed. The user may then use the scanner 150 to generate the one or more additional intraoral images, which at least partially overlaps with previously generated intraoral images.
- the one or more additional intraoral images may be registered with the 3D model and/or with the intraorai image data sets used to create the 3D model) to provide a composite of the 3D model and the one or more additional intraoral images. In the composite, the part of the 3D model that was previously deleted/removed is at least partially replaced with a corresponding part of the one or more additional intraoral images.
- the portions of the one or more additional images that are outside of the deleted or removed part of the 3D model are not applied to the composite or updated 3D model.
- the portion of the new intraoral image that corresponds to the erased portion of a locked image data set is added to the locked image data set.
- Expansion module 134 may perform operations similar to those of anomaly identifying module 115 and/or eraser module 132 . However, rather than identifying and correcting anomalies or unacceptable portions within a 3D model, expansion module 134 may identify and/or correct portions of the 3D model at an edge of the 3D model. For example, an intraoral image data set 135 A may have missed a portion of a tooth such that the tooth is cut off in the 3D model (e.g., a portion of the tooth is not shown in the 3D model). Expansion module 134 may algorithmically detect an edge of the 3D model where a tooth appears to be clipped. Alternatively, a user may indicate via the user interface that a portion of the tooth is not represented in the 3D model. The user may or may not mark a portion of edge of the 3D model where the model is incomplete.
- a user may then use scanner 150 to generate one or more additional intraoral images of the intraoral site (e.g., tooth) corresponding to the area of the 3D model where data was missing.
- the one or more additional intraoral images may be registered to the 3D model.
- Expansion module 134 may then determine that a portion of the one or more additional intraoral images represents a region of the intraoral site (e.g., tooth) that was missing from the initial 3D model. This portion of the one or more additional intraoral images may then be added to the 3D model to expand the 3D model for the intraoral site (e.g., tooth). Additionally, the portion of the one or more additional intraoral images may be appended to a locked image data set.
- a practitioner may have generated a full or partial scan of one or more dental arches of a patient.
- the patient may experience a change in dental health, and may require a bridge or other prosthodontic to be applied where there used to be a health tooth.
- the dental practitioner may leverage the previously completed scan.
- the practitioner may generate a preparation tooth, and may then scan that preparation tooth to generate a locked intraoral image data set of the preparation tooth.
- This locked intraoral image data set may then be combined with the previously generated scan data to create a new 3D model of the patient's dental arch. Most of the arch in the new 3D model will be based on data from the original scan, while the data for the preparation tooth will be based on the locked image data set.
- FIGS. 2-6 illustrate flow diagrams for methods of processing sets of intraoral images and generating virtual 3D models therefrom. These methods may be performed by processing logic that comprises hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (such as instructions run on a processing device), or a combination thereof.
- processing logic corresponds to computing device 105 of FIG. 1 (e.g., to a computing device 105 executing an intraoral scan application 108 ).
- FIG. 2 illustrates a flow diagram for a method 200 of automatically locking an image set of an intraoral site, in accordance with embodiments of the present invention.
- an intraoral scan session is started.
- a dental practitioner uses an intraoral scanner to create a set of intraoral images focused on a particular intraoral site (e.g., focused on a particular tooth).
- Processing logic may direct the dental practitioner as to which intraoral site (e.g., which tooth) is to be scanned or the dental practitioner may indicate which intraoral site is to be scanned or has been scanned.
- processing logic may automatically (e.g., algorithmically) identify the intraoral site based on data from the set of intraoral images and/or based on one or more additional sets of intraoral images (e.g., that focus on other intraoral sites).
- processing logic receives a set of intraoral images of the intraoral site.
- processing logic locks the intraoral image data set. This ensures that portions of the intraoral image data set that depict particular areas of the intraoral site (e.g., that depict a particular preparation tooth, including its margin line) will not later be modified or degraded by additional intraoral images.
- the dental arch 700 includes two preparation teeth 708 , 710 and adjacent teeth 704 , 706 , 712 as well as a patient's gums 702 .
- preparation teeth 708 , 710 have been ground down to stumps so as to act as abutments and receive a bridge.
- Preparation tooth 708 includes a finish line 709
- preparation tooth 710 includes a finish line 711 .
- the illustrated finish lines 709 , 711 are above the gum line to improve visibility for this example. However, in many instances the finish lines are below the gum line.
- cord may have been packed between the preparation tooth 708 and surrounding gums and then removed to cause the finish line 709 to be briefly exposed for scanning.
- An intraoral image data set 713 including intraoral image 714 , intraoral image 716 and intraoral image 718 is shown.
- Each of the intraoral images 714 - 718 may have been generated by an intraoral scanner having a particular distance from the dental surface being imaged. At the particular distance, the intraoral images 714 - 718 have a particular scan area and scan depth. The shape and size of the scan area will generally depend on the scanner, and is herein represented by a rectangle.
- Each image may have its own reference coordinate system and origin.
- Each intraoral image may be generated by a scanner at a particular position (scanning station). The location and orientation of scanning stations may be selected such that together the intraoral images adequately cover an entire target zone.
- scanning stations are selected such that there is overlap between the intraoral images 714 - 718 as shown.
- the selected scanning stations will differ when different scanners are used for the same target area, depending on the capture characteristics of the scanner used.
- a scanner capable of scanning a larger dental area with each scan e.g., having a larger field of view
- the number and disposition of scanning stations for a scanner having a rectangular scanning grid (and thus providing projected scanning areas in the form of corresponding rectangles) will typically be different from those for a scanner having a circular or triangular scanning grid (which would provide projected scanning areas in the form of corresponding circles or triangles, respectively).
- the intraoral image data set 713 is locked automatically, and may be assigned to a first layer.
- portions of the first set of intraoral images are selected algorithmically by processing logic.
- the selected portions may correspond to a contour of a tooth or other feature of the intraoral site.
- the selected portions may be determined based on performing image analysis and applying object recognition techniques, such as edge detection, edge matching, greyscale matching, gradient matching, bag of words models, and so on.
- Reference data may be used to train processing logic to detect particular objects such as teeth.
- the known identity of the tooth or intraorai site is used to assist the object detection process and to select the portions of the intraoral images.
- a contour of the preparation tooth 708 may be generated. All portions of the intraoral images 714 - 718 of the intraoral image data set 713 that are inside of the contour may be secured from further alteration.
- the locked image data set is updated so that the area inside of the contour is locked in the image data set and the area outside of the contour is unlocked.
- processing logic receives one or more additional intraorai images that depict the intraoral site (e.g., that depict a tooth that was the focus of the locked set of intraoral images). These additional intraoral images may be part of one or more additional intraoral image data sets for one or more additional teeth, for example.
- processing logic generates a virtual 3D model that includes the intraoral site.
- the selected portions of the locked intraoral image e.g., that are inside of the determined contour
- the selected portions may be used to create a particular preparation tooth in the 3D model.
- Data from the additional intraoral images are not used to create the region of the 3D model.
- Intraoral image data set 721 includes intraoral images 722 - 728 , which focus on adjacent tooth 706 .
- an area of intraoral image 726 in the second intraoral image data set 721 also depicts preparation tooth 708 and finish line 709 .
- the first intraoral image data set 713 has been locked, data from the second intraoral image data set 721 will not be used when creating a virtual representation of preparation tooth 708 in a 3D model.
- FIG. 3 illustrates a flow diagram for a method 300 of locking multiple image sets of one or more intraoral sites, in accordance with embodiments of the present invention.
- processing logic starts an intraoral scan session.
- processing logic receives a first set of intraoral images of a preparation tooth.
- processing logic determines an identity of the preparation tooth.
- processing logic locks the first set of intraoral images as a first layer.
- processing logic receives a second set of intraoral images of another tooth that is adjacent to the preparation tooth.
- the adjacent tooth may or may not be another preparation tooth.
- processing logic determines an identity of the adjacent tooth.
- processing logic locks the second set of intraoral images as a second layer.
- processing logic selects portions of the first set of intraoral images. This selection may be made based at least in part on the identity of the preparation tooth. Selecting the portions may include contouring the preparation tooth in the first set of intraoral images and selecting those portions that are within the contour.
- processing logic selects portions of the second set of intraoral images. This selection may be made based at least in part on the identity of the adjacent tooth. Selecting the portions may include contouring the adjacent tooth in the second set of intraoral images and selecting those portions that are within the contour.
- processing logic generates a virtual 3D model of an intraoral site that includes the preparation tooth, the adjacent tooth and surrounding tissue.
- intraoral image data set 713 may correspond to the first set of intraoral images of the preparation tooth in method 300 .
- intraoral image data set 721 may correspond to the second set of intraoral images of the adjacent tooth in method 300 . Accordingly, those portions of intraoral image data set 713 that depict adjacent tooth 706 would not be used to recreate the adjacent tooth in the 3D model and those portions of intraoral image data set 721 that depict preparation tooth 708 would not be used to recreate the preparation tooth in the 3D model.
- FIG. 4 illustrates a flow diagram for a method 400 of stitching together multiple image sets of one or more intraoral sites, in accordance with embodiments of the present invention.
- Processing logic may receive a first set if intraoral images (e.g., that focus on a preparation tooth) and a second set of intraoral images (e.g., that focus on an adjacent tooth or a full or partial arch).
- processing logic identifies one or more discrepancies of overlapping data between the first set of intraoral images and the second set of intraoral images.
- the first set of intraoral images and second set of intraoral images may each depict the gums between the preparation tooth and the adjacent tooth. However, the depictions of the gums in these intraoral image data sets may not line up perfectly.
- blood and/or saliva may have accumulated on the gums between generation of the first intraoral image data set and the second intraoral image data set, or the positioning of the gums may be slightly different in the two intraoral image data sets.
- the data from the two intraoral image data sets should be merged, and the conflicts in the data remedied.
- processing logic receives an indication of priorities of the first set of images and the second set of images.
- the first set of images may be known to have a higher quality or be more important, and so a higher priority may be assigned to the first set of images.
- processing logic uses the received indications of priority to prioritize the image data sets.
- processing logic applies a weighted average of the overlapping data between the first set of images and the second set of images to merge the overlapping data.
- the weights that are applied to the image data sets may be based on their priority. For example, the first image data set assigned the higher priority may be assigned a weight of 70% and the second set of intraoral images may be assigned a weight of 30%.
- the merged result will look more like the depiction from the first image data set and less like the depiction from the second image data set.
- processing logic may render different versions of the 3D model, each version showing a different prioritization and/or different weightings of the intraoral image data sets.
- the user may visually inspect the different renderings and select which rendering looks the most accurate.
- Processing logic may then prioritize the image data sets accordingly and then apply the appropriate weighted average associated with the user selection to create the 3D model.
- FIG. 5 illustrates a flow diagram for a method 500 of correcting an anomaly in an intraoral image data set and/or in a 3D virtual model generated from such an intraoral image data set, in accordance with embodiments of the present invention.
- the intraoral image data set may be a set of discrete images (e.g., taken from a point-and-shoot model or multiple frames of an intraoral video (e.g., taken in a continuous scanning or video mode).
- the intraoral image data set may have been for a particular dental site (e.g., tooth) of a patient, and may be locked to preserve the intraoral image data set.
- processing logic identifies an anomaly within the locked set of intraoral images and/or in a 3D model generated from the locked set of intraoral images.
- the anomaly may be identified by performing image processing on the intraoral image data set and applying a set of criteria thereto.
- processing logic determines if any voxels or sets of voxels in the intraoral images or 3D model satisfy the one or more criteria. Different criteria may be used to identify different classes of anomalies.
- missing image data is used to identify anomalies that might be voids. For example, voxels at areas that were not captured by the intraoral images may be identified.
- processing logic determines a border of the anomaly, such as by generating a contour of the anomaly.
- processing logic interpolates a shape for the anomaly based on geometric features surrounding the anomaly and/or based on geometric features of the anomaly (if such features exist). For example, if the anomaly is a void, then the regions around the void may be used to interpolate a surface shape of the void. The shape of the anomaly may then be used to create the contour. All data outside of the contour may remain locked and unchangeable, while data inside of the contour may be replaced with data from new intraoral images.
- Processing logic may provide an indication of the anomaly via a user interface.
- the contour of the anomaly may be displayed in manner to contrast the anomaly from surrounding imagery. For example, teeth may be shown in white, while the anomaly may be shown in red, black, blue, green, or another color.
- an indicator such as a flag may be used as an indication of the anomaly.
- the indicator may be remote from the anomaly but include a pointer to the anomaly.
- the anomaly may be hidden or occluded in many views of the intraoral site. However, the indicator may be visible in all or many such views.
- a set of intraoral images 730 is shown that includes a preparation tooth 708 having a finish line 709 and an anomaly 732 . As shown, the anomaly 732 has been contoured and has a particular shape (of an oval in this instance).
- the set of intraoral images 730 includes intraoral images 714 - 718 .
- processing logic receives an additional image of the intraoral site.
- the additional image may include data for the region of the 3D model or initial set of intraoral images where the anomaly was detected.
- processing logic updates the virtual 3D model based on replacing the data of the original set of intraoral images within the border or contour with additional data from the additional image of the intraoral site. Thus, the anomaly may be corrected without affecting a remainder of the virtual 3D model.
- a virtual 3D model 740 created from the set of intraoral images 730 and data from an additional intraoral image 709 is shown.
- the rendering of the preparation tooth 708 outside of the contour of the anomaly 742 is unaffected by image data from the additional intraoral image 741 .
- the portion of the preparation tooth 708 that is inside the contour of the anomaly 742 is rendered based on data from the additional intraoral image 709 .
- FIG. 6 illustrates a flow diagram for a method 600 of extending a model of an intraoral site where an incomplete tooth or other object is detected, in accordance with embodiments of the present invention.
- processing logic determines that data for a preparation tooth (or other intraoral site) in a 3D model is incomplete. For example, processing logic may determine that an edge of the preparation tooth has been cut off. This determination may be made, for example, based on comparing an expected contour of the preparation tooth or other tooth with a contour of the preparation tooth or other tooth in a computed 3D model. If the computed contour varies from the expected contour by more than a threshold amount, processing logic may determine that the preparation tooth or other tooth is cut off in the model.
- such a determination is made responsive to a user indication that the preparation tooth or other tooth in the 3D model is incomplete. For example, a user may review the 3D model, determine that a portion of a tooth is cut off, and manually enter an expansion mode to add data for the area that was cut off. Alternatively, such a determination may be made algorithmically without first receiving user input (e.g., based on performing image processing).
- a set of intraoral images 750 includes intraoral images 714 and 752 .
- the set of intraoral images 750 depicts a preparation tooth 708 having a finish line 709 . However, an edge 754 of the preparation tooth 708 is cut off.
- processing logic receives an additional intraoral image of the preparation tooth (or other tooth).
- processing logic may identify a border for the edge of the preparation tooth. In one embodiment, this includes generating a contour of the edge of the preparation tooth at the border. In some instances this may already have been performed at block 605 . The shape of the edge may be used to create the contour or border. All data inside of the contour may remain locked and unchangeable.
- processing logic updates the model based on replacing data outside the border with additional data from the additional intraoral image.
- Processing logic determines what portion of the additional intraoral image of the preparation tooth depicts the portion of the preparation tooth that was cut off in the initial set of intraoral images (e.g., outside the border of the edge where data was cut off).
- the identified portion of the additional intraoral image may then be appended to the initial set of intraoral image and used to extend the preparation tooth (or other tooth) in the model.
- FIG. 7F a virtual 3D model 760 created from the set of intraoral images 750 of FIG. 7E with data from an additional intraoral image 762 is shown.
- the rendering of the preparation tooth 708 inside of a contour of the preparation tooth 708 is unaffected by image data from the additional intraoral image 762 .
- a portion of the intraoral image 762 showing the cut off region outside of the edge 754 is used to extend the preparation tooth 708 in the 3D model 760 .
- FIG. 8 illustrates a diagrammatic representation of a machine in the example form of a computing device 800 within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed.
- the machine may be connected (e.g., networked) to other machines in a Local Area Network (LAN), an intranet, an extranet, or the Internet.
- LAN Local Area Network
- the machine may operate in the capacity of a server or a client machine in a client-server network environment, or as a peer machine in a peer-to-peer (or distributed) network environment.
- the machine may be a personal computer (PC), a tablet computer, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a web appliance, a server, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
- PC personal computer
- PDA Personal Digital Assistant
- STB set-top box
- WPA Personal Digital Assistant
- a cellular telephone e.g., a web appliance
- server e.g., a server
- network router e.g., switch or bridge
- machine may also be taken to include any collection of machines (e.g., computers) that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
- the term machine shall also refer to an integrated all-in-one device that includes an intraoral scanner and a computing device (e.g., scanner 150 and computing device 105 of FIG. 1 ).
- the example computing device 800 includes a processing device 802 , a main memory 804 (e.g., read-only memory (ROM), flash memory, dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM), etc.), a static memory 806 (e.g., flash memory, static random access memory (SRAM), etc.), and a secondary memory (e.g., a data storage device 828 ), which communicate with each other via a bus 808 .
- main memory 804 e.g., read-only memory (ROM), flash memory, dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM), etc.
- DRAM dynamic random access memory
- SDRAM synchronous DRAM
- static memory 806 e.g., flash memory, static random access memory (SRAM), etc.
- secondary memory e.g., a data storage device 828
- Processing device 802 represents one or more general-purpose processors such as a microprocessor, central processing unit, or the like. More particularly, the processing device 802 may be a complex instruction set computing (CISC) microprocessor, reduced instruction set computing (RISC) microprocessor, very long instruction word (VLIW) microprocessor, processor implementing other instruction sets, or processors implementing a combination of instruction sets. Processing device 802 may also be one or more special-purpose processing devices such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), network processor, or the like. Processing device 802 is configured to execute the processing logic (instructions 826 ) for performing operations and steps discussed herein.
- CISC complex instruction set computing
- RISC reduced instruction set computing
- VLIW very long instruction word
- Processing device 802 may also be one or more special-purpose processing devices such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DS
- the computing device 800 may further include a network interface device 822 for communicating with a network 864 .
- the computing device 800 also may include a video display unit 810 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)), an alphanumeric input device 812 (e.g., a keyboard), a cursor control device 814 (e.g., a mouse), and a signal generation device 820 (e.g., a speaker).
- a video display unit 810 e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)
- an alphanumeric input device 812 e.g., a keyboard
- a cursor control device 814 e.g., a mouse
- a signal generation device 820 e.g., a speaker
- the data storage device 828 may include a machine-readable storage medium (or more specifically a non-transitory computer-readable storage medium) 824 on which is stored one or more sets of instructions 826 embodying any one or more of the methodologies or functions described herein.
- a non-transitory storage medium refers to a storage medium other than a carrier wave.
- the instructions 826 may also reside, completely or at least partially, within the main memory 804 and/or within the processing device 802 during execution thereof by the computer device 800 , the main memory 804 and the processing device 802 also constituting computer-readable storage media.
- the computer-readable storage medium 824 may also be used to store an intraoral scan application 850 , which may correspond to the similarly named component of FIG. 1 .
- the computer readable storage medium 824 may also store a software library containing methods for an intraoral scan application 850 . While the computer-readable storage medium 824 is shown in an example embodiment to be a single medium, the term “computer-readable storage medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions.
- computer-readable storage medium shall also be taken to include any medium other than a carrier wave that is capable of storing or encoding a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present invention.
- computer-readable storage medium shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media.
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Surgery (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Epidemiology (AREA)
- Computer Graphics (AREA)
- Pathology (AREA)
- Medical Informatics (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- Radiology & Medical Imaging (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Architecture (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Dental Tools And Instruments Or Auxiliary Dental Instruments (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Image Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
- The present application is a continuation of U.S. patent application Ser. No. 16/435,348, filed Jun. 7, 2019, which is in turn a continuation of U.S. patent application Ser. No. 15/993,504, filed May 30, 2018, now U.S. Pat. No. 10,470,846 issued Nov. 12, 2019, which is in turn a continuation of U.S. patent application Ser. No. 15/222,525, filed Jul. 28, 2016, now U.S. Pat. No. 10,004,572 issued Jun. 26, 2018, which is in turn a continuation of U.S. patent application Ser. No. 14/640,909, filed Mar. 6, 2015, now U.S. Pat. No. 9,451,873 issued Sep. 27, 2016, all of which are incorporated by reference herein. The present application is also related to U.S. patent application Ser. No. 16/204,632, filed Nov. 29, 2018, now U.S. Pat. No. 10,219,875 issued Mar. 5, 2019.
- Embodiments of the present invention relate to the field of intraoral scanning and, in particular, to a system and method for improving the results of intraoral scanning.
- In prosthodontic procedures designed to implant a dental prosthesis in the oral cavity, the intraoral site at which the prosthesis is to be implanted in many cases should be measured accurately and studied carefully, so that a prosthesis such as a crown, denture or bridge, for example, can be properly designed and dimensioned to fit in place. A good fit enables mechanical stresses to be properly transmitted between the prosthesis and the jaw, and can prevent infection of the gums and tooth decay via the interface between the prosthesis and the intraoral site, for example. The intraoral site may be scanned to provide three-dimensional (3D) data of the intraoral site. However, if the area of a preparation tooth containing a finish line lacks definition, it may not be possible to properly determine the finish line, and thus the margin of a restoration may not be properly designed.
- The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings.
-
FIG. 1 illustrates one embodiment of a system for performing intraoral scanning and generating a virtual three-dimensional model of an intraoral site. -
FIG. 2 illustrates a flow diagram for a method of automatically locking an image set of an intraoral site, in accordance with embodiments of the present invention. -
FIG. 3 illustrates a flow diagram for a method of locking multiple image sets of one or more intraoral sites, in accordance with embodiments of the present invention. -
FIG. 4 illustrates a flow diagram for a method of stitching together multiple image sets of one or more intraoral sites, in accordance with embodiments of the present invention. -
FIG. 5 illustrates a flow diagram for a method of detecting an anomaly in an image set of an intraoral site and replacing the anomaly with data from an additional intraoral image, in accordance with embodiments of the present invention. -
FIG. 6 illustrates a flow diagram for a method of extending a model of an intraoral site where an incomplete edge is detected, in accordance with embodiments of the present invention. -
FIG. 7A illustrates a portion of an example dental arch during an intraoral scan session after a first set of intraoral images of a preparation tooth have been generated. -
FIG. 7B illustrates the example dental arch ofFIG. 7A during the intraoral scan session after a second set of intraoral images of a tooth adjacent to the preparation tooth have been generated. -
FIG. 7C illustrates the first set of intraoral images ofFIG. 7A , wherein the first set of intraoral images includes an anomaly. -
FIG. 7D illustrates a model created from the first set of intraoral images ofFIG. 7C with data from an additional intraoral image. -
FIG. 7E illustrates a set intraoral images of a preparation tooth, wherein the set of intraoral images fails to capture all of the preparation tooth. -
FIG. 7F illustrates a model created from the first set of intraoral images ofFIG. 7E with data from an additional intraoral image. -
FIG. 8 illustrates a block diagram of an example computing device, in accordance with embodiments of the present invention. - Described herein are a method and apparatus for improving the quality of scans, such as intraoral scans taken of intraoral sites (e.g., dental sites) for patients. During a scan session, a user (e.g., a dental practitioner) of a scanner may generate multiple different images (also referred to as scans) of an intraoral site, model of an intraoral site, or other object. The images may be discrete images (e.g., point-and-shoot images) or frames from a video (e.g., a continuous scan). The practitioner may take a first set of intraoral images of a first tooth after readying the first tooth for scanning. For example, if the first tooth is a preparation tooth (also referred to as a preparation), then one or more operations may be performed prior to generating the first set of intraoral images to ensure that a quality of the first set of intraoral images is high. In one example, these operations briefly expose a finish line of the preparation tooth to ensure that the finish line will show up in the first set of intraoral images.
- After completing the first set of intraoral images, the practitioner may take additional sets of intraoral images of one or more adjacent teeth. The additional sets of intraoral images may include data for portions of the first tooth that was the focus of the first set of intraoral images. In some instances during creation of a 3D model using the intraoral images, the data from the additional sets of intraoral images combines with (e.g., is averaged with) the data for the first tooth from the first set of intraoral images to degrade a quality of that first tooth in the 3D model.
- In embodiments, to prevent the data from the additional sets of intraoral images from degrading a quality of the first tooth in the 3D model, the first set of images is automatically locked after the first set of intraoral images is created. Additionally, portions of the first set of intraoral images that depict the first tooth may be exclusively used for the generation of the 3D model of that first tooth. Thus, the additional sets of intraoral images do not alter or add noise to a region of the 3D model depicting the first tooth as a result of the first set of intraoral image being locked. In one embodiment, an identity of the first tooth is determined, and the first portions of the first set of intraoral images are selected based at least in part on the identity of the first tooth. Thus, the lower quality data from the additional sets of intraoral images that depict the first tooth may not be applied when generating the 3D model of the first tooth. This may improve an image quality of the first tooth in the 3D model of an intraoral site (e.g., of a portion of a jaw).
- Embodiments described herein are discussed with reference to intraoral scanners, intraoral images, intraoral scan sessions, and so forth. However, it should be understood that embodiments also apply to other types of scanners than intraoral scanners. Embodiments may apply to any type of scanner that takes multiple images and stitches these images together to form a combined image or virtual model. For example, embodiments may apply to desktop model scanners, computed tomography (CT) scanners, and so forth. Additionally, it should be understood that the intraoral scanners or other scanners may be used to scan objects other than intraoral sites in an oral cavity. For example, embodiments may apply to scans performed on physical models of an intraoral site or any other object. Accordingly, embodiments describing intraoral images should be understood as being generally applicable to any types of images generated by a scanner, embodiments describing intraoral scan sessions should be understood as being applicable to scan sessions for any type of object, and embodiments describing intraoral scanners should be understood as being generally applicable to many types of scanners.
-
FIG. 1 illustrates one embodiment of asystem 100 for performing intraoral scanning and/or generating a virtual three-dimensional model of an intraoral site. In one embodiment,system 100 carries out one or more operations described below with reference toFIGS. 2-6 . -
System 100 includes acomputing device 105 that may be coupled to ascanner 150 and/or adata store 110.Computing device 105 may include a processing device, memory, secondary storage, one or more input devices (e.g., such as a keyboard, mouse, tablet, and so on), one or more output devices (e.g., a display, a printer, etc.), and/or other hardware components. Thecomputing device 105 may be integrated into thescanner 150 in some embodiments to improve performance and/or mobility. -
Computing device 105 may be connected todata store 110 either directly or via a network. The network may be a local area network (LAN), a public wide area network (WAN) (e.g., the Internet), a private WAN (e.g., an intranet), or a combination thereof. Alternatively,data store 110 may be an internal data store. Examples of network data stores include a storage area network (SAN), a network attached storage (NAS), and a storage service provided by a cloud computing service provider.Data store 110 may include a file system, a database, or other data storage arrangement. - In some embodiments, a
scanner 150 for obtaining three-dimensional (3D) data of an intraoral site in a patient's oral cavity is operatively connected to thecomputing device 105.Scanner 150 may include a probe (e.g., a hand held probe) for optically capturing three-dimensional structures (e.g., by confocal focusing of an array of light beams). One example of such ascanner 150 is the iTero® intraoral digital scanner manufactured by Align Technology, Inc. Other examples of intraoral scanners include the 3M™ True Definition Scanner and the Apollo DI intraoral scanner and CEREC AC intraoral scanner manufactured by Sirona®. - The
scanner 150 may be used to perform an intraoral scan of a patient's oral cavity. Anintraoral scan application 108 running oncomputing device 105 may communicate with thescanner 150 to effectuate the intraoral scan. A result of the intraoral scan may be one or more sets of intraoral images that have been discretely generated (e.g., by pressing on a “generate image” button of the scanner for each image). Alternatively, a result of the intraoral scan may be one or more videos of the patient's oral cavity. An operator may start recording the video with thescanner 150 at a first position in the oral cavity, move thescanner 150 within the oral cavity to a second position while the video is being taken, and then stop recording the video. Thescanner 150 may transmit the discrete intraoral images or intraoral video (referred to collectively as intraoral image data sets 135A-135N) to thecomputing device 105.Computing device 105 may store the intraoral image data sets 135A-135N indata store 110. Alternatively,scanner 150 may be connected to another system that stores the intraoral image data sets 135A-135N indata store 110. In such an embodiment,scanner 150 may not be connected tocomputing device 105. - In one embodiment,
intraoral scan application 108 includes ananomaly identifying module 115, aflagging module 118, a model generation module 125, animage locking module 128, aneraser module 132 and anexpansion module 134. Alternatively, the operations of one or more of theanomaly identifying module 115, flaggingmodule 118, model generation module 125,image locking module 128,eraser module 132 and/orexpansion module 134 may be combined into a single module or separated into further modules. - According to an example, a user (e.g., a practitioner) may subject a patient to intraoral scanning. In doing so, the user may apply
scanner 150 to one or more patient intraoral locations. The scanning may be divided into one or more segments. As an example, the segments may include a lower buccal region of the patient, a lower lingual region of the patient, a upper buccal region of the patient, an upper lingual region of the patient, one or more preparation teeth of the patient (e.g., teeth of the patient to which a dental device such as a crown or other dental prosthetic will be applied), one or more teeth which are contacts of preparation teeth (e.g., teeth not themselves subject to a dental device but which are located next to one or more such teeth or which interface with one or more such teeth upon mouth closure), and/or patient bite (e.g., scanning performed with closure of the patient's mouth with the scan being directed towards an interface area of the patient's upper and lower teeth). Via such scanner application, thescanner 150 may provide image data (also referred to as scan data) tocomputing device 105. The image data may be provided in the form of intraoral image data sets 135A-135N, each of which may include 2D intraoral images and/or 3D intraoral images of particular teeth and/or regions of an intraoral site. In one embodiment, separate image data sets are created for the maxillary arch, for the mandibular arch, for a patient bite, and for each preparation tooth. Such images may be provided from the scanner to thecomputing device 105 in the form of one or more points (e.g., one or more pixels and/or groups of pixels). For instance, thescanner 150 may provide such a 3D image as one or more point clouds. - The manner in which the oral cavity of a patient is to be scanned may depend on the procedure to be applied thereto. For example, if an upper or lower denture is to be created, then a full scan of the mandibular or maxillary edentulous arches may be performed. In contrast, if a bridge is to be created, then just a portion of a total arch may be scanned which includes an edentulous region, the neighboring preparation teeth (e.g., abutment teeth) and the opposing arch and dentition. Thus, the dental practitioner may input the identity of a procedure to be performed into
intraoral scan application 108. For this purpose, the dental practitioner may choose the procedure from a number of preset options on a drop-down menu or the like, from icons or via any other suitable graphical user interface. Alternatively, the identity of the procedure may be input in any other suitable way; for example by means of preset code, notation or any other suitable, manner,intraoral scan application 108 having been suitably programmed to recognize the choice made by the user. - By way of non-limiting example, dental procedures may be broadly divided into prosthodontic (restorative) and orthodontic procedures, and then further subdivided into specific forms of these procedures. Additionally, dental procedures may include identification and treatment of gum disease, sleep apnea, and intraoral conditions. The term prosthodontic procedure refers, inter alia, to any procedure involving the oral cavity and directed to the design, manufacture or installation of a dental prosthesis at a dental site within the oral cavity (intraoral site), or a real or virtual model thereof, or directed to the design and preparation of the intraoral site to receive such a prosthesis. A prosthesis may include any restoration such as crowns, veneers, inlays, onlays, implants and bridges, for example, and any other artificial partial or complete denture. The term orthodontic procedure refers inter alia, to any procedure involving the oral cavity and directed to the design, manufacture or installation of orthodontic elements at a intraoral site within the oral cavity, or a real or virtual model thereof, or directed to the design and preparation of the intraoral site to receive such orthodontic elements. These elements may be appliances including but not limited to brackets and wires, retainers, clear aligners, or functional appliances.
- For many prosthodontic procedures (e.g., to create a crown, bridge, veneer, etc.), an existing tooth of a patient is ground down to a stump. The ground tooth is referred to herein as a preparation tooth, or simply a preparation. The preparation tooth has a finish line (also referred to as a margin line), which is a border between a natural (unground) portion of the preparation tooth and the prepared (ground) portion of the preparation tooth. The preparation tooth is typically created so that a crown or other prosthesis can be mounted or seated on the preparation tooth. In many instances, the finish line of the preparation tooth is below the gum line. While the term preparation typically refers to the stump of a preparation tooth, including the finish line and shoulder that remains of the tooth, the term preparation herein also includes artificial stumps, pivots, cores and posts, or other devices that may be implanted in the intraoral cavity so as to receive a crown or other prosthesis. Embodiments described herein with reference to a preparation tooth also apply to other types of preparations, such as the aforementioned artificial stumps, pivots, and so on.
- After the preparation tooth is created, a practitioner performs operations to ready that preparation tooth for scanning. Readying the preparation tooth for scanning may include wiping blood, saliva, etc. off of the preparation tooth and/or separating a patient's gum from the preparation tooth to expose the finish line. In some instances, a practitioner will insert a cord around the preparation tooth between the preparation tooth and the patient's gum. The practitioner will then remove the cord before generating a set of intraoral scans of the preparation tooth. The soft tissue of the gum will then revert back to its natural position, and in many cases collapses back over the finish line, after a brief time period. Accordingly, the practitioner uses the
scanner 150 to scan the readied preparation tooth and generate a set of intraoral images (e.g., intraoral image data set 135A) of the preparation tooth before the soft tissue reverts back to its natural position. - After generating the set of intraoral images for the preparation tooth, the practitioner may preview the set of intraoral images (or a 3D model crated therefrom) to determine if the set of intraoral images have satisfactory quality. The practitioner may then either rescan the preparation tooth (or a portion thereof) if the quality is not satisfactory, or may proceed to generate additional sets of intraoral images (e.g., intraoral image sets 135B-135N) for adjacent teeth and other areas around the preparation tooth if the quality is satisfactory. These additional sets of intraoral images for the adjacent areas may be taken, for example, to ensure that a dental prosthesis will fit in the patient's mouth. The additional sets of intraoral images may also capture portions of the preparation tooth after the gum has collapsed back over the finish line and/or after blood and/or saliva has accumulated on the preparation tooth.
- Accordingly, in one embodiment after a first set of intraoral images (e.g., intraoral image data set 135A) is taken (e.g., of a preparation tooth),
image locking module 128 automatically locks that first set of intraoral images. The locked first set of intraoral images may be associated with a preparation tooth of a patient. In one embodiment,image locking module 128 automatically locks image data sets associated with preparation teeth, but does not automatically lock other image data sets. Accordingly,image locking module 128 may determine whether a new image data set is associated with a preparation tooth, and if so lock that image data set. - The identity of the preparation tooth may be used by
image locking module 128 to automatically select portions of the locked first set of intraoral images that will be applied for the preparation tooth in a 3D model. Alternatively, a practitioner may use a graphical user interface (GUI) to mark the portions of the locked set of intraoral images that will be applied for the preparation tooth in the 3D model. In either case, theimage locking module 128 may update the locked image data set so that only portions of the locked image data set that depict the preparation tooth are locked, while the portions of the image data set that depict gums, other teeth, etc. are unlocked. In one embodiment,image locking module 128 performs image processing to determine a contour of the preparation tooth as well as the finish line. All data representing the preparation tooth inside of the finish line may be locked, while all data representing other intraoral features outside of the finish line may be unlocked. In one embodiment, a buffer is applied, and all data within the finish line plus the buffer is locked. The buffer may be, for example, a 1-3 mm offset from the finish line. Thus,image locking module 128 may algorithmically determine what data to keep in the locked image data set. Alternatively, a user may manually determine what data to keep in the locked image data set. For example, the user may outline the area that he or she wishes to keep via the graphical user interface. This locked image data set can later be unlocked at any time by a user. - The data from additional sets of intraoral images, which may also include lower quality depictions of the preparation tooth, may be ignored by model generation module 125 during creation of the preparation tooth in the 3D model. Thus, the finish line captured in the first image data set is not degraded by further image data.
- In a further embodiment, additional intraoral image data sets may be generated for additional preparation teeth and/or other teeth, such as teeth that are adjacent to a scanned preparation tooth.
Image locking module 128 may automatically (e.g., algorithmically and/or without user input) lock some or all image data sets after the image data sets have been created and before additional intraoral images are taken.Image locking module 128 may assign each locked intraoral image data set 135A-135N a separate layer or group identifier. These layers may be used to refer to entire image data sets, and may be used to display or hide image data sets and/or to prioritize data from image data sets for stitching together such image data sets. - In an example, a first image data set may be associated with a first tooth and a second image data set may be associated with an adjacent second tooth. Data from the first image data set may overlap data from the second image data set, and may diverge from the data from the second image data set. To stitch together the image data sets, the discrepancies between overlapping regions of an intraoral site depicted in these two image data sets should be remedied. One technique of remedying the discrepancies is to average the data of the first image data set with the data of the second image data set for the overlapping regions. With the use of layers, a weight may be assigned to each image data set, and the averaging of the image data sets may be a weighted average. For example, if a user knows that data for a particular overlapping region from a first image data set is superior in quality to data for the particular overlapping region of the second image data set, the user may select the first image data set as having a higher priority. Model generation module 125 may then weight the first image data set more heavily than the second image data set when averaging the differences between the image data sets.
-
Image locking module 128 may associate each intraoral image data set 135A-135N with a particular tooth and/or may otherwise identify an intraoral site associated with each intraoral image data set 135A-135N. In one embodiment, a user indicates which tooth he or she is scanning before generating an image data set. Alternatively, a user may first take an image data set, and may subsequently indicate a tooth imaged in the image data set. In another implementation,intraoral scan application 108 may instruct the user to scan a particular tooth, and may associate an identity of that particular tooth with the image data set. Thus, each locked intraoral image data set 135A-135N may be associated with a particular tooth, which may or may not be a preparation tooth. - When a scan session is complete (e.g., all images for an intraoral site have been captured), model generation module 125 may generate a virtual 3D model of the scanned intraoral site. To generate the virtual 3D model, model generation module 125 may register (i.e., “stitch” together) the intraoral images generated from the intraoral scan session. In one embodiment, performing image registration includes capturing 3D data of various points of a surface in multiple images (views from a camera), and registering the images by computing transformations between the images. The images may then be integrated into a common reference frame by applying appropriate transformations to points of each registered image.
- In one embodiment, image registration is performed for each pair of adjacent or overlapping intraoral images (e.g., each successive frame of an intraoral video). Image registration algorithms are carried out to register two adjacent intraoral images, which essentially involves determination of the transformations which align one image with the other. Image registration may involve identifying multiple points in each image (e.g., point clouds) of an image pair, surface fitting to the points of each image, and using local searches around points to match points of the two adjacent images. For example, model generation module 125 may match points of one image with the closest points interpolated on the surface of the other image, and iteratively minimize the distance between matched points. Model generation module 125 may also find the best match of curvature features at points of one image with curvature features at points interpolated on the surface of the other image, without iteration. Model generation module 125 may also find the best match of spin-image point features at points of one image with spin-image point features at points interpolated on the surface of the other image, without iteration. Other techniques that may be used for image registration include those based on determining point-to-point correspondences using other features and minimization of point-to-surface distances, for example. Other image registration techniques may also be used.
- Many image registration algorithms perform the fitting of a surface to the points in adjacent images, which can be done in numerous ways. Parametric surfaces such as Bezier and B-Spline surfaces are most common, although others may be used. A single surface patch may be fit to all points of an image, or alternatively, separate surface patches may be fit to any number of a subset of points of the image. Separate surface patches may be fit to have common boundaries or they may be fit to overlap. Surfaces or surface patches may be fit to interpolate multiple points by using a control-point net having the same number of points as a grid of points being fit, or the surface may approximate the points by using a control-point net which has fewer number of control points than the grid of points being fit. Various matching techniques may also be employed by the image registration algorithms.
- In one embodiment, model generation module 125 may determine a point match between images, which may take the form of a two dimensional (2D) curvature array. A local search for a matching point feature in a corresponding surface patch of an adjacent image may be carried out by computing features at points sampled in a region surrounding the parametrically similar point. Once corresponding point sets are determined between surface patches of the two images, determination of the transformation between the two sets of corresponding points in two coordinate frames can be solved. Essentially, an image registration algorithm may compute a transformation between two adjacent images that will minimize the distances between points on one surface, and the closest points to them found in the interpolated region on the other image surface used as a reference.
- Model generation module 125 repeats image registration for all adjacent image pairs of a sequence of intraoral images to obtain a transformation between each pair of images, to register each image with the previous one. Model generation module 125 then integrates all images into a single virtual 3D model by applying the appropriate determined transformations to each of the images. Each transformation may include rotations about one to three axes and translations within one to three planes.
- In many instances, data from one set of intraoral images does not perfectly correspond to data from another set of intraoral images. For each intraoral image data set 135A-135N,
image locking module 128 may use the identity of the associated tooth to determine what portions of that image data set will be used exclusively for creation of a particular region of a 3D model (e.g., for creation of the associated tooth in the 3D model). Theimage locking module 128 may analyze the image data in each intraoral image data set. For each image data set, theimage locking module 128 may use stored information about an associated tooth to determine from the analysis which portions or areas of that image data set represent that tooth and which portions or areas of that image data set represent other intraoral objects such as gums and other teeth. The selection module 130 may then generate a contour of that tooth in the image data set. The generated contour may act as a border. Data from the image data set that is within the contour may be exclusively used by model generation module 125 to generate the specific associated tooth in a 3D model. Data from the image data set that is outside of the contour may or may not be used to generate additional features or objects in the 3D model. Additionally, data outside the contour may be combined with data from other image data sets to generate the additional features or objects in the 3D model. - In one embodiment, the operation of contouring the tooth in a locked image data set is performed by image locking module (as described above).
Image locking module 128 may then update the locked image data set to lock portions of the image data set inside of the contour and unlock portions of the image data set outside of the contour. -
Anomaly identifying module 115 is responsible for identifying anomalies and/or other areas of interest (AOIs) from intraoral scan data (e.g., intraoral images in an intraoral image data set) and/or virtual 3D models generated from intraoral scan data. Such anomalies may include voids (e.g., areas for which scan data is missing), areas of conflict or flawed scan data (e.g., areas for which overlapping surfaces of multiple intraoral images fail to match), areas indicative of foreign objects (e.g., studs, bridges, etc.), unclear margin line (e.g., margin line of one or more preparation teeth), noisy information, and so forth. An identified void may be a void in a surface of an image. Examples of surface conflict include double incisor edge and/or other physiologically unlikely tooth edge, bite line shift, inclusion or lack of blood, saliva and/or foreign objects, differences in depictions of a margin line, and so on. Theanomaly identifying module 115 may, in identifying an anomaly, analyze patient image data (e.g., 3D image point clouds) and/or one or more virtual 3D models of the patient alone and/or relative toreference data 138. The analysis may involve direct analysis (e.g., pixel-based and/or other point-based analysis), the application of machine learning, and/or the application of image recognition.Such reference data 138 may include past data regarding the at-hand patient (e.g., intraoral images and/or virtual 3D models), pooled patient data, and/or pedagogical patient data, some or all of which may be stored indata store 110. -
Anomaly identifying module 115 to identify anomalies by performing image processing to identify an unexpected shape, a region with low clarity, a region missing data, color discrepancies, and so forth. Different criteria may be used to identify different classes of anomalies. In one embodiment, an area of missing image data is used to identify anomalies that might be voids. For example, voxels at areas that were not captured by the intraoral images may be identified. In one embodiment, anomaly identifying module interpolates a shape for the anomaly based on geometric features surrounding the anomaly and/or based on geometric features of the anomaly (if such features exist). Such geometric features may be determined by using edge detection, corner detection, blob detection, ridge detection, Hough transformations, structure tensors, and/or other image processing techniques. - The data regarding the at-hand patient may include X-rays, 2D intraoral images, 3D intraoral images, 2D models, and/or virtual 3D models corresponding to the patient visit during which the scanning occurs. The data regarding the at-hand patient may additionally include past X-rays, 2D intraoral images, 3D intraoral images, 2D models, and/or virtual 3D models of the patient (e.g., corresponding to past visits of the patient and/or to dental records of the patient).
- The pooled patient data may include X-rays, 2D intraoral images, 3D intraoral images, 2D models, and/or virtual 3D models regarding a multitude of patients. Such a multitude of patients may or may not include the at-hand patient. The pooled patient data may be anonymized and/or employed in compliance with regional medical record privacy regulations (e.g., the Health Insurance Portability and Accountability Act (HIPAA)). The pooled patient data may include data corresponding to scanning of the sort discussed herein and/or other data. The pedagogical patient data may include X-rays, 2D intraoral images, 3D intraoral images, 2D models, virtual 3D models, and/or medical illustrations (e.g., medical illustration drawings and/or other images) employed in educational contexts. The pedagogical patient data may include volunteer data and/or cadaveric data.
-
Anomaly identifying module 115 may analyze patient scan data from later in a patient visit during which the scanning occurs (e.g., one or more later-in-the-visit 3D image point clouds and/or one or more later-in-the-visit virtual 3D models of the patient) relative to additional patient scan data in the form of data from earlier in that patient visit (e.g., one or more earlier-in-the-visit 3D image point clouds and/or one or more earlier-in-the-visit virtual 3D models of the patient).Anomaly identifying module 115 may additionally or alternatively analyze patient scan data relative to reference data in the form of dental record data of the patient and/or data of the patient from prior to the patient visit (e.g., one or more prior-to-the-visit 3D image point clouds and/or one or more prior-to-the-visit virtual 3D models of the patient).Anomaly identifying module 115 may additionally or alternatively analyze patient scan data relative to pooled patient data and/or pedagogical patient data. - Identifying of anomalies concerning missing and/or flawed scan data may involve the
anomaly identifying module 115 performing direct analysis, for instance determining one or more pixels or other points to be missing from patient scan data and/or one or more virtual 3D models of the patient. Identification of anomalies concerning missing and/or flawed scan data may additionally or alternatively involve employing pooled patient data and/or pedagogical patient data to ascertain patient scan data and/or virtual 3D models as being incomplete (e.g., possessing discontinuities) relative to that which is indicated by the pooled patient data and/or pedagogical patient data. - Flagging
module 118 is responsible for determining how to present and/or call out the identified anomalies. Flaggingmodule 118 may provide indications or indicators of anomalies. The indications may be presented (e.g., via a user interface) to a user (e.g., a practitioner) in connection with and/or apart from one or more depictions of teeth and/or gingivae of a patient (e.g., in connection with one or more X-rays, 2D intraoral images, 3D intraoral images, 2D models, and/or virtual 3D models of the patient). Indication presentation in connection with depictions of patient teeth and/or gingivae may involve the indications being placed so as to correlate an indication with the corresponding portion of the teeth and/or gingivae. - The indications may be provided in the form of flags, markings, contours, text, images, and/or sounds (e.g., in the form of speech). Such a contour may be placed (e.g., via contour fitting) so as to follow an extant tooth contour and/or gingival contour (e.g., as a border). As an illustration, a contour corresponding to a void may be placed so as to follow a contour of the missing data. Such a contour may be placed (e.g., via contour extrapolation) with respect to a missing tooth contour and/or gingival contour so as to follow a projected path of the missing contour. As an illustration, a contour corresponding to missing tooth scan data may be placed so as to follow the projected path of the tooth portion which is missing, or a contour corresponding to missing gingival scan data may be placed so as to follow the projected path of the gingival portion which is missing.
- Data for portions of the intraoral image data set that is within the contoured anomaly may be unlocked or removed from the locked intraoral image data set. The anomaly may be identified to a user, and the user may then generate a new intraoral image that captures the area of the anomaly in the intraoral site. The portion of the new intraoral image that corresponds to an inside of the contour of the anomaly is then used to replace the original data from the intraoral image data set for the anomaly. This data may then be added to the locked image data set. Thus, anomalies may be automatically detected in a set of intraoral images, and an additional intraoral image may be taken to overwrite the anomaly without affecting the rest of the intraoral image data set.
- In one embodiment, after
anomaly identifying module 115 identifies an anomaly,anomaly identifying module 115 may then determine whether there are any additional image data sets that include data covering the area at which the anomaly was identified.Anomaly identifying module 115 may compare this area from the one or more additional image data sets to the data of the locked image data set. Based on this comparison,anomaly identifying module 115 may determine that the data of the locked image data set covering the contour is to be replaced by data from another image data set. The portion of the other image data set that corresponds to an inside of the contour of the anomaly may then be used to replace the original data from the intraoral image data set for the anomaly. This data may then be added to the locked image data set. - In one embodiment, a different replacement option is presented to a user for each additional image data set. Thus, for each additional image data set,
anomaly identifying module 115 may replace the anomaly with image data covering the contour of the anomaly from that additional image data set. Each of the replacement options may be presented to the user, who may then select which of the replacement options to apply. Once a user selection has been received, the data from the additional image data set associated with the user selection may be used to replace the anomaly in the locked image data set. - A 3D model created by model generation module 125 may be displayed to a user via a user interface of intraoral scan application. The 3D model can then be checked visually by the user. The user can virtually manipulate the 3D model via the user interface with respect to up to six degrees of freedom (i.e., translated and/or rotated with respect to one or more of three mutually orthogonal axes) using suitable user controls (hardware and/or virtual) to enable viewing of the 3D model from any desired direction. In addition to
anomaly identifying module 115 algorithmically identifying anomalies for rescan, a user may review (e.g., visually inspect) the generated 3D model of an intraoral site and determine that one or more areas of the 3D model are unacceptable. - Based on the inspection, the user may determine that part of the 3D model is unsuitable or undesired, and that a remainder of the 3D model is acceptable. The unacceptable portion of the 3D model can correspond, for example, to a part of a real dental surface of a scanned intraoral site that was not sufficiently clearly defined in the 3D model. For example, during the initial 3D data collection step, for example via scanning, that resulted in the first 3D virtual model being generated, the corresponding part of the physical dental surface may have been covered with foreign material, such as for example saliva, blood, or debris. The corresponding part of the physical dental surface may also have been obscured by another element such as for example part of the gums, cheek, tongue, dental instruments, artifacts, etc. Alternatively, for example, during the initial 3D data collection step (e.g., via scanning) that resulted in the first 3D virtual model being generated, the unacceptable portion may be distorted or otherwise defective and may not properly correspond to a physical dental surface (e.g., due to some defect in the actual scanning process).
- Via the user interface, a user may mark or otherwise demarcate the unacceptable portion of the 3D model.
Eraser module 132 may then delete or otherwise remove the marked portion from the 3D model (and the associated portions of a locked image data set and/or other image data set used to create the unacceptable portion). For example, the dental procedure of interest may be providing a dental prosthesis, and the deleted or removed part of the 3D model may be part of a finish line of a tooth preparation that exists in a real dental surface, but was not clearly represented in the 3D model (or in the intraoral image data sets 135A-135N used to create the 3D model). -
Intraoral scan application 108 may direct a user to generate one or more additional intraoral images of the dental site corresponding to the portion of the 3D model (and corresponding set or sets of intraoral images) that was deleted or removed. The user may then use thescanner 150 to generate the one or more additional intraoral images, which at least partially overlaps with previously generated intraoral images. The one or more additional intraoral images may be registered with the 3D model and/or with the intraorai image data sets used to create the 3D model) to provide a composite of the 3D model and the one or more additional intraoral images. In the composite, the part of the 3D model that was previously deleted/removed is at least partially replaced with a corresponding part of the one or more additional intraoral images. However, the portions of the one or more additional images that are outside of the deleted or removed part of the 3D model are not applied to the composite or updated 3D model. In one embodiment, the portion of the new intraoral image that corresponds to the erased portion of a locked image data set is added to the locked image data set. -
Expansion module 134 may perform operations similar to those ofanomaly identifying module 115 and/oreraser module 132. However, rather than identifying and correcting anomalies or unacceptable portions within a 3D model,expansion module 134 may identify and/or correct portions of the 3D model at an edge of the 3D model. For example, an intraoral image data set 135A may have missed a portion of a tooth such that the tooth is cut off in the 3D model (e.g., a portion of the tooth is not shown in the 3D model).Expansion module 134 may algorithmically detect an edge of the 3D model where a tooth appears to be clipped. Alternatively, a user may indicate via the user interface that a portion of the tooth is not represented in the 3D model. The user may or may not mark a portion of edge of the 3D model where the model is incomplete. - A user may then use
scanner 150 to generate one or more additional intraoral images of the intraoral site (e.g., tooth) corresponding to the area of the 3D model where data was missing. The one or more additional intraoral images may be registered to the 3D model.Expansion module 134 may then determine that a portion of the one or more additional intraoral images represents a region of the intraoral site (e.g., tooth) that was missing from the initial 3D model. This portion of the one or more additional intraoral images may then be added to the 3D model to expand the 3D model for the intraoral site (e.g., tooth). Additionally, the portion of the one or more additional intraoral images may be appended to a locked image data set. - In one embodiment, a practitioner may have generated a full or partial scan of one or more dental arches of a patient. At some time after the scan was completed, the patient may experience a change in dental health, and may require a bridge or other prosthodontic to be applied where there used to be a health tooth. In such an instance, the dental practitioner may leverage the previously completed scan. In particular, the practitioner may generate a preparation tooth, and may then scan that preparation tooth to generate a locked intraoral image data set of the preparation tooth. This locked intraoral image data set may then be combined with the previously generated scan data to create a new 3D model of the patient's dental arch. Most of the arch in the new 3D model will be based on data from the original scan, while the data for the preparation tooth will be based on the locked image data set.
-
FIGS. 2-6 illustrate flow diagrams for methods of processing sets of intraoral images and generating virtual 3D models therefrom. These methods may be performed by processing logic that comprises hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (such as instructions run on a processing device), or a combination thereof. In one embodiment, processing logic corresponds tocomputing device 105 ofFIG. 1 (e.g., to acomputing device 105 executing an intraoral scan application 108). -
FIG. 2 illustrates a flow diagram for amethod 200 of automatically locking an image set of an intraoral site, in accordance with embodiments of the present invention. Atblock 205 ofmethod 200 an intraoral scan session is started. During the intraoral scan session, a dental practitioner uses an intraoral scanner to create a set of intraoral images focused on a particular intraoral site (e.g., focused on a particular tooth). Processing logic may direct the dental practitioner as to which intraoral site (e.g., which tooth) is to be scanned or the dental practitioner may indicate which intraoral site is to be scanned or has been scanned. Alternatively, processing logic may automatically (e.g., algorithmically) identify the intraoral site based on data from the set of intraoral images and/or based on one or more additional sets of intraoral images (e.g., that focus on other intraoral sites). Atblock 210, processing logic receives a set of intraoral images of the intraoral site. Atblock 215, processing logic locks the intraoral image data set. This ensures that portions of the intraoral image data set that depict particular areas of the intraoral site (e.g., that depict a particular preparation tooth, including its margin line) will not later be modified or degraded by additional intraoral images. - Referring to
FIG. 7A , a portion of an example dental arch 700 is illustrated during an intraoral scan session. The dental arch includes twopreparation teeth adjacent teeth gums 702. As shown,preparation teeth Preparation tooth 708 includes a finish line 709 andpreparation tooth 710 includes a finish line 711. The illustrated finish lines 709, 711 are above the gum line to improve visibility for this example. However, in many instances the finish lines are below the gum line. In one example, cord may have been packed between thepreparation tooth 708 and surrounding gums and then removed to cause the finish line 709 to be briefly exposed for scanning. - An intraoral
image data set 713 includingintraoral image 714,intraoral image 716 andintraoral image 718 is shown. Each of the intraoral images 714-718 may have been generated by an intraoral scanner having a particular distance from the dental surface being imaged. At the particular distance, the intraoral images 714-718 have a particular scan area and scan depth. The shape and size of the scan area will generally depend on the scanner, and is herein represented by a rectangle. Each image may have its own reference coordinate system and origin. Each intraoral image may be generated by a scanner at a particular position (scanning station). The location and orientation of scanning stations may be selected such that together the intraoral images adequately cover an entire target zone. Preferably, scanning stations are selected such that there is overlap between the intraoral images 714-718 as shown. Typically, the selected scanning stations will differ when different scanners are used for the same target area, depending on the capture characteristics of the scanner used. Thus, a scanner capable of scanning a larger dental area with each scan (e.g., having a larger field of view) will use fewer scanning stations than a scanner that is only capable of capturing 3D data of a relatively smaller dental surface. Similarly, the number and disposition of scanning stations for a scanner having a rectangular scanning grid (and thus providing projected scanning areas in the form of corresponding rectangles) will typically be different from those for a scanner having a circular or triangular scanning grid (which would provide projected scanning areas in the form of corresponding circles or triangles, respectively). The intraoralimage data set 713 is locked automatically, and may be assigned to a first layer. - Referring back to
FIG. 2 , atblock 220 ofmethod 200 portions of the first set of intraoral images are selected algorithmically by processing logic. The selected portions may correspond to a contour of a tooth or other feature of the intraoral site. The selected portions may be determined based on performing image analysis and applying object recognition techniques, such as edge detection, edge matching, greyscale matching, gradient matching, bag of words models, and so on. Reference data may be used to train processing logic to detect particular objects such as teeth. In one embodiment, the known identity of the tooth or intraorai site is used to assist the object detection process and to select the portions of the intraoral images. - For example, in the example intraoral
image data set 713 ofFIG. 7A , a contour of thepreparation tooth 708 may be generated. All portions of the intraoral images 714-718 of the intraoralimage data set 713 that are inside of the contour may be secured from further alteration. In one embodiment, the locked image data set is updated so that the area inside of the contour is locked in the image data set and the area outside of the contour is unlocked. - At
block 225 ofmethod 200, processing logic receives one or more additional intraorai images that depict the intraoral site (e.g., that depict a tooth that was the focus of the locked set of intraoral images). These additional intraoral images may be part of one or more additional intraoral image data sets for one or more additional teeth, for example. At block 230, processing logic generates a virtual 3D model that includes the intraoral site. The selected portions of the locked intraoral image (e.g., that are inside of the determined contour) are used to create a first region of the model. For example, the selected portions may be used to create a particular preparation tooth in the 3D model. Data from the additional intraoral images are not used to create the region of the 3D model. - Referring now to
FIG. 7B , the example dental arch ofFIG. 7A during the intraoral scan session is shown after a second intraoralimage data set 721 has been generated for a tooth 706 adjacent to thepreparation tooth 708. Intraoralimage data set 721 includes intraoral images 722-728, which focus on adjacent tooth 706. However, as illustrated an area of intraoral image 726 in the second intraoralimage data set 721 also depictspreparation tooth 708 and finish line 709. However, since the first intraoralimage data set 713 has been locked, data from the second intraoralimage data set 721 will not be used when creating a virtual representation ofpreparation tooth 708 in a 3D model. -
FIG. 3 illustrates a flow diagram for amethod 300 of locking multiple image sets of one or more intraoral sites, in accordance with embodiments of the present invention. Atblock 302 ofmethod 300 processing logic starts an intraoral scan session. Atblock 304, processing logic receives a first set of intraoral images of a preparation tooth. Atblock 306, processing logic determines an identity of the preparation tooth. Atblock 308, processing logic locks the first set of intraoral images as a first layer. - At
block 310, processing logic receives a second set of intraoral images of another tooth that is adjacent to the preparation tooth. The adjacent tooth may or may not be another preparation tooth. Atblock 312, processing logic determines an identity of the adjacent tooth. Atblock 314, processing logic locks the second set of intraoral images as a second layer. - At
block 316, processing logic selects portions of the first set of intraoral images. This selection may be made based at least in part on the identity of the preparation tooth. Selecting the portions may include contouring the preparation tooth in the first set of intraoral images and selecting those portions that are within the contour. Atblock 318, processing logic selects portions of the second set of intraoral images. This selection may be made based at least in part on the identity of the adjacent tooth. Selecting the portions may include contouring the adjacent tooth in the second set of intraoral images and selecting those portions that are within the contour. - At
block 320, processing logic generates a virtual 3D model of an intraoral site that includes the preparation tooth, the adjacent tooth and surrounding tissue. - Referring back to
FIGS. 7A-7B , intraoralimage data set 713 may correspond to the first set of intraoral images of the preparation tooth inmethod 300. Similarly, intraoralimage data set 721 may correspond to the second set of intraoral images of the adjacent tooth inmethod 300. Accordingly, those portions of intraoralimage data set 713 that depict adjacent tooth 706 would not be used to recreate the adjacent tooth in the 3D model and those portions of intraoralimage data set 721 that depictpreparation tooth 708 would not be used to recreate the preparation tooth in the 3D model. -
FIG. 4 illustrates a flow diagram for amethod 400 of stitching together multiple image sets of one or more intraoral sites, in accordance with embodiments of the present invention. Processing logic may receive a first set if intraoral images (e.g., that focus on a preparation tooth) and a second set of intraoral images (e.g., that focus on an adjacent tooth or a full or partial arch). Atblock 405 ofmethod 400, processing logic identifies one or more discrepancies of overlapping data between the first set of intraoral images and the second set of intraoral images. For example, the first set of intraoral images and second set of intraoral images may each depict the gums between the preparation tooth and the adjacent tooth. However, the depictions of the gums in these intraoral image data sets may not line up perfectly. For example, blood and/or saliva may have accumulated on the gums between generation of the first intraoral image data set and the second intraoral image data set, or the positioning of the gums may be slightly different in the two intraoral image data sets. To create a 3D model that includes both the preparation tooth and the adjacent tooth, the data from the two intraoral image data sets should be merged, and the conflicts in the data remedied. - At
block 410, processing logic receives an indication of priorities of the first set of images and the second set of images. For example, the first set of images may be known to have a higher quality or be more important, and so a higher priority may be assigned to the first set of images. Atblock 415, processing logic uses the received indications of priority to prioritize the image data sets. Atblock 420, processing logic applies a weighted average of the overlapping data between the first set of images and the second set of images to merge the overlapping data. The weights that are applied to the image data sets may be based on their priority. For example, the first image data set assigned the higher priority may be assigned a weight of 70% and the second set of intraoral images may be assigned a weight of 30%. Thus, when the data is averaged, the merged result will look more like the depiction from the first image data set and less like the depiction from the second image data set. - In one embodiment, processing logic may render different versions of the 3D model, each version showing a different prioritization and/or different weightings of the intraoral image data sets. The user may visually inspect the different renderings and select which rendering looks the most accurate. Processing logic may then prioritize the image data sets accordingly and then apply the appropriate weighted average associated with the user selection to create the 3D model.
-
FIG. 5 illustrates a flow diagram for amethod 500 of correcting an anomaly in an intraoral image data set and/or in a 3D virtual model generated from such an intraoral image data set, in accordance with embodiments of the present invention. The intraoral image data set may be a set of discrete images (e.g., taken from a point-and-shoot model or multiple frames of an intraoral video (e.g., taken in a continuous scanning or video mode). The intraoral image data set may have been for a particular dental site (e.g., tooth) of a patient, and may be locked to preserve the intraoral image data set. - At
block 505 ofmethod 500, processing logic identifies an anomaly within the locked set of intraoral images and/or in a 3D model generated from the locked set of intraoral images. The anomaly may be identified by performing image processing on the intraoral image data set and applying a set of criteria thereto. In one embodiment, processing logic determines if any voxels or sets of voxels in the intraoral images or 3D model satisfy the one or more criteria. Different criteria may be used to identify different classes of anomalies. In one embodiment, missing image data is used to identify anomalies that might be voids. For example, voxels at areas that were not captured by the intraoral images may be identified. - At
block 510, processing logic determines a border of the anomaly, such as by generating a contour of the anomaly. In one embodiment, processing logic interpolates a shape for the anomaly based on geometric features surrounding the anomaly and/or based on geometric features of the anomaly (if such features exist). For example, if the anomaly is a void, then the regions around the void may be used to interpolate a surface shape of the void. The shape of the anomaly may then be used to create the contour. All data outside of the contour may remain locked and unchangeable, while data inside of the contour may be replaced with data from new intraoral images. - Processing logic may provide an indication of the anomaly via a user interface. The contour of the anomaly may be displayed in manner to contrast the anomaly from surrounding imagery. For example, teeth may be shown in white, while the anomaly may be shown in red, black, blue, green, or another color. Additionally or alternatively, an indicator such as a flag may be used as an indication of the anomaly. The indicator may be remote from the anomaly but include a pointer to the anomaly. The anomaly may be hidden or occluded in many views of the intraoral site. However, the indicator may be visible in all or many such views.
- Referring to
FIG. 7C , a set of intraoral images 730 is shown that includes apreparation tooth 708 having a finish line 709 and an anomaly 732. As shown, the anomaly 732 has been contoured and has a particular shape (of an oval in this instance). The set of intraoral images 730 includes intraoral images 714-718. - Referring back to
FIG. 5 , atblock 515, processing logic receives an additional image of the intraoral site. The additional image may include data for the region of the 3D model or initial set of intraoral images where the anomaly was detected. Atblock 520, processing logic updates the virtual 3D model based on replacing the data of the original set of intraoral images within the border or contour with additional data from the additional image of the intraoral site. Thus, the anomaly may be corrected without affecting a remainder of the virtual 3D model. - Referring
FIG. 7D , avirtual 3D model 740 created from the set of intraoral images 730 and data from an additional intraoral image 709 is shown. The rendering of thepreparation tooth 708 outside of the contour of theanomaly 742 is unaffected by image data from the additional intraoral image 741. However, the portion of thepreparation tooth 708 that is inside the contour of theanomaly 742 is rendered based on data from the additional intraoral image 709. -
FIG. 6 illustrates a flow diagram for amethod 600 of extending a model of an intraoral site where an incomplete tooth or other object is detected, in accordance with embodiments of the present invention. Atblock 605 ofmethod 600, processing logic determines that data for a preparation tooth (or other intraoral site) in a 3D model is incomplete. For example, processing logic may determine that an edge of the preparation tooth has been cut off. This determination may be made, for example, based on comparing an expected contour of the preparation tooth or other tooth with a contour of the preparation tooth or other tooth in a computed 3D model. If the computed contour varies from the expected contour by more than a threshold amount, processing logic may determine that the preparation tooth or other tooth is cut off in the model. In one embodiment, such a determination is made responsive to a user indication that the preparation tooth or other tooth in the 3D model is incomplete. For example, a user may review the 3D model, determine that a portion of a tooth is cut off, and manually enter an expansion mode to add data for the area that was cut off. Alternatively, such a determination may be made algorithmically without first receiving user input (e.g., based on performing image processing). - Referring to
FIG. 7E , a set ofintraoral images 750 includesintraoral images 714 and 752. The set ofintraoral images 750 depicts apreparation tooth 708 having a finish line 709. However, anedge 754 of thepreparation tooth 708 is cut off. - At
block 610, processing logic receives an additional intraoral image of the preparation tooth (or other tooth). Atblock 615, processing logic may identify a border for the edge of the preparation tooth. In one embodiment, this includes generating a contour of the edge of the preparation tooth at the border. In some instances this may already have been performed atblock 605. The shape of the edge may be used to create the contour or border. All data inside of the contour may remain locked and unchangeable. - At
block 620, processing logic updates the model based on replacing data outside the border with additional data from the additional intraoral image. Processing logic determines what portion of the additional intraoral image of the preparation tooth depicts the portion of the preparation tooth that was cut off in the initial set of intraoral images (e.g., outside the border of the edge where data was cut off). The identified portion of the additional intraoral image may then be appended to the initial set of intraoral image and used to extend the preparation tooth (or other tooth) in the model. - Referring to
FIG. 7F , a virtual 3D model 760 created from the set ofintraoral images 750 ofFIG. 7E with data from an additionalintraoral image 762 is shown. The rendering of thepreparation tooth 708 inside of a contour of thepreparation tooth 708 is unaffected by image data from the additionalintraoral image 762. However, a portion of theintraoral image 762 showing the cut off region outside of theedge 754 is used to extend thepreparation tooth 708 in the 3D model 760. -
FIG. 8 illustrates a diagrammatic representation of a machine in the example form of acomputing device 800 within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed. In alternative embodiments, the machine may be connected (e.g., networked) to other machines in a Local Area Network (LAN), an intranet, an extranet, or the Internet. The machine may operate in the capacity of a server or a client machine in a client-server network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine may be a personal computer (PC), a tablet computer, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a web appliance, a server, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines (e.g., computers) that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein. The term machine shall also refer to an integrated all-in-one device that includes an intraoral scanner and a computing device (e.g.,scanner 150 andcomputing device 105 ofFIG. 1 ). - The
example computing device 800 includes aprocessing device 802, a main memory 804 (e.g., read-only memory (ROM), flash memory, dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM), etc.), a static memory 806 (e.g., flash memory, static random access memory (SRAM), etc.), and a secondary memory (e.g., a data storage device 828), which communicate with each other via abus 808. -
Processing device 802 represents one or more general-purpose processors such as a microprocessor, central processing unit, or the like. More particularly, theprocessing device 802 may be a complex instruction set computing (CISC) microprocessor, reduced instruction set computing (RISC) microprocessor, very long instruction word (VLIW) microprocessor, processor implementing other instruction sets, or processors implementing a combination of instruction sets.Processing device 802 may also be one or more special-purpose processing devices such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), network processor, or the like.Processing device 802 is configured to execute the processing logic (instructions 826) for performing operations and steps discussed herein. - The
computing device 800 may further include anetwork interface device 822 for communicating with anetwork 864. Thecomputing device 800 also may include a video display unit 810 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)), an alphanumeric input device 812 (e.g., a keyboard), a cursor control device 814 (e.g., a mouse), and a signal generation device 820 (e.g., a speaker). - The
data storage device 828 may include a machine-readable storage medium (or more specifically a non-transitory computer-readable storage medium) 824 on which is stored one or more sets ofinstructions 826 embodying any one or more of the methodologies or functions described herein. A non-transitory storage medium refers to a storage medium other than a carrier wave. Theinstructions 826 may also reside, completely or at least partially, within themain memory 804 and/or within theprocessing device 802 during execution thereof by thecomputer device 800, themain memory 804 and theprocessing device 802 also constituting computer-readable storage media. - The computer-
readable storage medium 824 may also be used to store anintraoral scan application 850, which may correspond to the similarly named component ofFIG. 1 . The computerreadable storage medium 824 may also store a software library containing methods for anintraoral scan application 850. While the computer-readable storage medium 824 is shown in an example embodiment to be a single medium, the term “computer-readable storage medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term “computer-readable storage medium” shall also be taken to include any medium other than a carrier wave that is capable of storing or encoding a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present invention. The term “computer-readable storage medium” shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media. - It is to be understood that the above description is intended to be illustrative, and not restrictive. Many other embodiments will be apparent upon reading and understanding the above description. Although embodiments of the present invention have been described with reference to specific example embodiments, it will be recognized that the invention is not limited to the embodiments described, but can be practiced with modification and alteration within the spirit and scope of the appended claims. Accordingly, the specification and drawings are to be regarded in an illustrative sense rather than a restrictive sense. The scope of the invention should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
Claims (20)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/810,726 US11678953B2 (en) | 2015-03-06 | 2020-03-05 | Correction of margin lines in three-dimensional models of dental sites |
US18/141,292 US20230329837A1 (en) | 2015-03-06 | 2023-04-28 | Correction of margin lines in three-dimensional models of dental sites |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/640,909 US9451873B1 (en) | 2015-03-06 | 2015-03-06 | Automatic selection and locking of intraoral images |
US15/222,525 US10004572B2 (en) | 2015-03-06 | 2016-07-28 | Selection and locking of intraoral images |
US15/993,504 US10470846B2 (en) | 2015-03-06 | 2018-05-30 | Selection and locking of intraoral images |
US16/435,348 US10603136B2 (en) | 2015-03-06 | 2019-06-07 | Selection and locking of intraoral images |
US16/810,726 US11678953B2 (en) | 2015-03-06 | 2020-03-05 | Correction of margin lines in three-dimensional models of dental sites |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/435,348 Continuation US10603136B2 (en) | 2015-03-06 | 2019-06-07 | Selection and locking of intraoral images |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/141,292 Continuation US20230329837A1 (en) | 2015-03-06 | 2023-04-28 | Correction of margin lines in three-dimensional models of dental sites |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200197129A1 true US20200197129A1 (en) | 2020-06-25 |
US11678953B2 US11678953B2 (en) | 2023-06-20 |
Family
ID=55521770
Family Applications (8)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/640,909 Ceased US9451873B1 (en) | 2015-03-06 | 2015-03-06 | Automatic selection and locking of intraoral images |
US15/222,525 Active US10004572B2 (en) | 2015-03-06 | 2016-07-28 | Selection and locking of intraoral images |
US15/993,504 Active US10470846B2 (en) | 2015-03-06 | 2018-05-30 | Selection and locking of intraoral images |
US16/204,632 Active US10219875B1 (en) | 2015-03-06 | 2018-11-29 | Selection and locking of intraoral images |
US16/435,348 Active US10603136B2 (en) | 2015-03-06 | 2019-06-07 | Selection and locking of intraoral images |
US16/810,726 Active 2036-05-30 US11678953B2 (en) | 2015-03-06 | 2020-03-05 | Correction of margin lines in three-dimensional models of dental sites |
US17/032,366 Active USRE49605E1 (en) | 2015-03-06 | 2020-09-25 | Automatic selection and locking of intraoral images |
US18/141,292 Pending US20230329837A1 (en) | 2015-03-06 | 2023-04-28 | Correction of margin lines in three-dimensional models of dental sites |
Family Applications Before (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/640,909 Ceased US9451873B1 (en) | 2015-03-06 | 2015-03-06 | Automatic selection and locking of intraoral images |
US15/222,525 Active US10004572B2 (en) | 2015-03-06 | 2016-07-28 | Selection and locking of intraoral images |
US15/993,504 Active US10470846B2 (en) | 2015-03-06 | 2018-05-30 | Selection and locking of intraoral images |
US16/204,632 Active US10219875B1 (en) | 2015-03-06 | 2018-11-29 | Selection and locking of intraoral images |
US16/435,348 Active US10603136B2 (en) | 2015-03-06 | 2019-06-07 | Selection and locking of intraoral images |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/032,366 Active USRE49605E1 (en) | 2015-03-06 | 2020-09-25 | Automatic selection and locking of intraoral images |
US18/141,292 Pending US20230329837A1 (en) | 2015-03-06 | 2023-04-28 | Correction of margin lines in three-dimensional models of dental sites |
Country Status (10)
Country | Link |
---|---|
US (8) | US9451873B1 (en) |
EP (3) | EP3848885B1 (en) |
JP (3) | JP6483273B2 (en) |
KR (5) | KR101999465B1 (en) |
CN (2) | CN111820851A (en) |
AU (4) | AU2016230778B2 (en) |
CA (1) | CA2978681C (en) |
DK (1) | DK3265993T3 (en) |
ES (1) | ES2869961T3 (en) |
WO (1) | WO2016142818A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022191490A1 (en) * | 2021-03-10 | 2022-09-15 | 주식회사 메디트 | Orthodontic information display system |
USRE49605E1 (en) | 2015-03-06 | 2023-08-15 | Align Technology, Inc. | Automatic selection and locking of intraoral images |
Families Citing this family (124)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8108189B2 (en) | 2008-03-25 | 2012-01-31 | Align Technologies, Inc. | Reconstruction of non-visible part of tooth |
US9192305B2 (en) | 2012-09-28 | 2015-11-24 | Align Technology, Inc. | Estimating a surface texture of a tooth |
EP2914200B1 (en) | 2012-10-30 | 2019-05-22 | University of Southern California | Orthodontic appliance with snap fitted, non-sliding archwire |
US8948482B2 (en) | 2012-11-01 | 2015-02-03 | Align Technology, Inc. | Motion compensation in a three dimensional scan |
US9668829B2 (en) | 2012-12-19 | 2017-06-06 | Align Technology, Inc. | Methods and systems for dental procedures |
US11363938B2 (en) * | 2013-03-14 | 2022-06-21 | Ormco Corporation | Feedback control mechanism for adjustment of imaging parameters in a dental imaging system |
US9393087B2 (en) | 2013-08-01 | 2016-07-19 | Align Technology, Inc. | Methods and systems for generating color images |
US10111581B2 (en) | 2014-02-27 | 2018-10-30 | Align Technology, Inc. | Thermal defogging system and method |
US9431887B2 (en) | 2014-06-06 | 2016-08-30 | Align Technology, Inc. | Lens positioning system |
US9491863B2 (en) | 2014-06-26 | 2016-11-08 | Align Technology, Inc. | Mounting system that maintains stability of optics as temperature changes |
US9439568B2 (en) | 2014-07-03 | 2016-09-13 | Align Technology, Inc. | Apparatus and method for measuring surface topography optically |
US10772506B2 (en) | 2014-07-07 | 2020-09-15 | Align Technology, Inc. | Apparatus for dental confocal imaging |
US9675430B2 (en) | 2014-08-15 | 2017-06-13 | Align Technology, Inc. | Confocal imaging apparatus with curved focal surface |
US9724177B2 (en) | 2014-08-19 | 2017-08-08 | Align Technology, Inc. | Viewfinder with real-time tracking for intraoral scanning |
US9660418B2 (en) | 2014-08-27 | 2017-05-23 | Align Technology, Inc. | VCSEL based low coherence emitter for confocal 3D scanner |
US9629698B2 (en) | 2014-11-04 | 2017-04-25 | James R. Glidewell Dental Ceramics, Inc. | Method and apparatus for generation of 3D models with applications in dental restoration design |
US10966614B2 (en) * | 2015-01-18 | 2021-04-06 | Dentlytec G.P.L. Ltd. | Intraoral scanner |
US10108269B2 (en) | 2015-03-06 | 2018-10-23 | Align Technology, Inc. | Intraoral scanner with touch sensitive input |
US9844426B2 (en) | 2015-03-12 | 2017-12-19 | Align Technology, Inc. | Digital dental tray |
EP3288486B1 (en) | 2015-05-01 | 2020-01-15 | Dentlytec G.P.L. Ltd. | System for dental digital impressions |
US10339649B2 (en) * | 2015-09-11 | 2019-07-02 | Carestream Dental Technology Topco Limited | Method and system for hybrid mesh segmentation |
US9629532B1 (en) * | 2016-05-26 | 2017-04-25 | Dental Smartmirror, Inc. | System for in-room use of an intraoral mirror with an integrated camera, and applications thereof |
US10136972B2 (en) | 2016-06-30 | 2018-11-27 | Align Technology, Inc. | Historical scan reference for intraoral scans |
US10507087B2 (en) | 2016-07-27 | 2019-12-17 | Align Technology, Inc. | Methods and apparatuses for forming a three-dimensional volumetric model of a subject's teeth |
WO2018047180A1 (en) | 2016-09-10 | 2018-03-15 | Ark Surgical Ltd. | Laparoscopic workspace device |
US10595966B2 (en) * | 2016-11-04 | 2020-03-24 | Align Technology, Inc. | Methods and apparatuses for dental images |
EP3320877B1 (en) * | 2016-11-14 | 2021-05-26 | Andreas Schwitalla | Implant made from fibre-reinforced plastic |
US11559378B2 (en) | 2016-11-17 | 2023-01-24 | James R. Glidewell Dental Ceramics, Inc. | Scanning dental impressions |
WO2018102588A1 (en) | 2016-12-02 | 2018-06-07 | Swift Health Systems Inc. | Indirect orthodontic bonding systems and methods for bracket placement |
US10888399B2 (en) | 2016-12-16 | 2021-01-12 | Align Technology, Inc. | Augmented reality enhancements for dental practitioners |
US10456043B2 (en) | 2017-01-12 | 2019-10-29 | Align Technology, Inc. | Compact confocal dental scanning apparatus |
WO2018144634A1 (en) | 2017-01-31 | 2018-08-09 | Swift Health Systems Inc. | Hybrid orthodontic archwires |
DE102017203475A1 (en) * | 2017-03-03 | 2018-09-06 | Sirona Dental Systems Gmbh | Method of constructing a restoration |
JPWO2018169086A1 (en) * | 2017-03-17 | 2019-11-07 | 株式会社モリタ製作所 | X-ray CT imaging apparatus, X-ray image processing apparatus, and X-ray image display apparatus |
US11612458B1 (en) | 2017-03-31 | 2023-03-28 | Swift Health Systems Inc. | Method of tongue preconditioning in preparation for lingual orthodontic treatment |
ES2959766T3 (en) | 2017-04-21 | 2024-02-28 | Swift Health Systems Inc | Indirect bonding splint that has several handles |
WO2019008586A1 (en) | 2017-07-04 | 2019-01-10 | Dentlytec G.P.L. Ltd | Dental device with probe |
EP3658069B1 (en) | 2017-07-26 | 2024-06-26 | Dentlytec G.P.L. Ltd. | Intraoral scanner |
EP4278957A3 (en) | 2017-07-27 | 2024-01-24 | Align Technology, Inc. | System and methods for processing an orthodontic aligner by means of an optical coherence tomography |
JP7051371B2 (en) * | 2017-10-31 | 2022-04-11 | 株式会社松風 | Method and program for estimating and restoring abutment tooth morphology changed by scanning |
US10980613B2 (en) | 2017-12-29 | 2021-04-20 | Align Technology, Inc. | Augmented reality enhancements for dental practitioners |
EP3743007A1 (en) | 2018-01-26 | 2020-12-02 | Align Technology, Inc. | Visual prosthetic and orthodontic treatment planning |
AU2019212649A1 (en) | 2018-01-26 | 2020-07-02 | Align Technology, Inc. | Diagnostic intraoral scanning and tracking |
CN108618857B (en) * | 2018-02-06 | 2020-11-27 | 北京大学口腔医学院 | Design and manufacturing method of accurate bionic aesthetic restoration body |
CN112105315B (en) * | 2018-05-08 | 2023-04-18 | 阿莱恩技术有限公司 | Automatic ectopic tooth detection based on scanning |
US10902684B2 (en) * | 2018-05-18 | 2021-01-26 | Microsoft Technology Licensing, Llc | Multiple users dynamically editing a scene in a three-dimensional immersive environment |
US10217237B1 (en) | 2018-06-21 | 2019-02-26 | 3D Med Ag | Systems and methods for forming a desired bend angle in an orthodontic appliance |
US11096765B2 (en) | 2018-06-22 | 2021-08-24 | Align Technology, Inc. | Light field intraoral 3D scanner with structured light illumination |
US10251729B1 (en) | 2018-08-31 | 2019-04-09 | 3D Med Ag | Intra-oral device |
EP3899973A1 (en) | 2018-12-21 | 2021-10-27 | The Procter & Gamble Company | Apparatus and method for operating a personal grooming appliance or household cleaning appliance |
EP3689218B1 (en) * | 2019-01-30 | 2023-10-18 | DENTSPLY SIRONA Inc. | Method and system for guiding an intra-oral scan |
JP7016328B2 (en) * | 2019-02-02 | 2022-02-04 | 株式会社医科歯科ソリューションズ | How to fix the edge of the crown prosthesis |
EP3930622A4 (en) | 2019-03-01 | 2022-11-16 | Swift Health Systems Inc. | Indirect bonding trays with bite turbo and orthodontic auxiliary integration |
US11367192B2 (en) * | 2019-03-08 | 2022-06-21 | Align Technology, Inc. | Foreign object filtering for intraoral scanning |
AU2020254822A1 (en) | 2019-04-05 | 2021-10-07 | Align Technology, Inc. | Intraoral scanner sleeve authentication and identification |
KR102138921B1 (en) * | 2019-04-25 | 2020-07-28 | 오스템임플란트 주식회사 | Method for generating margin line of prep model in prosthesis design and prosthetic CAD apparatus therefor |
US11455727B2 (en) | 2019-05-02 | 2022-09-27 | Align Technology, Inc. | Method and apparatus for excessive materials removal from intraoral scans |
US11238586B2 (en) | 2019-05-02 | 2022-02-01 | Align Technology, Inc. | Excess material removal using machine learning |
US10849723B1 (en) | 2019-05-07 | 2020-12-01 | Sdc U.S. Smilepay Spv | Scanning device |
KR102232043B1 (en) * | 2019-05-09 | 2021-03-25 | 주식회사 디오 | Method and Apparatus for Creating Model for Separating of Teeth and Alveolar Bone in Image Data |
US11563929B2 (en) | 2019-06-24 | 2023-01-24 | Align Technology, Inc. | Intraoral 3D scanner employing multiple miniature cameras and multiple miniature pattern projectors |
US11534271B2 (en) | 2019-06-25 | 2022-12-27 | James R. Glidewell Dental Ceramics, Inc. | Processing CT scan of dental impression |
US11540906B2 (en) | 2019-06-25 | 2023-01-03 | James R. Glidewell Dental Ceramics, Inc. | Processing digital dental impression |
US11622843B2 (en) | 2019-06-25 | 2023-04-11 | James R. Glidewell Dental Ceramics, Inc. | Processing digital dental impression |
EP3979901A1 (en) | 2019-07-29 | 2022-04-13 | Align Technology, Inc. | Full-scanner barrier for an intra-oral device |
EP3788984A1 (en) | 2019-09-03 | 2021-03-10 | ZACK Zahnarztpraxis Christina Krause | Method for operating an intraoral scan system for determining a plaque index |
US11995839B2 (en) | 2019-09-04 | 2024-05-28 | Align Technology, Inc. | Automated detection, generation and/or correction of dental features in digital models |
WO2021050774A1 (en) | 2019-09-10 | 2021-03-18 | Align Technology, Inc. | Dental panoramic views |
US12042124B2 (en) | 2019-10-24 | 2024-07-23 | Align Technology, Inc. | Reflection suppression using fluorescence |
US11937996B2 (en) | 2019-11-05 | 2024-03-26 | Align Technology, Inc. | Face capture and intraoral scanner and methods of use |
US10932890B1 (en) * | 2019-11-14 | 2021-03-02 | Pearl Inc. | Enhanced techniques for determination of dental margins in intraoral scans |
US11273008B2 (en) | 2019-12-04 | 2022-03-15 | Oxilio Ltd | Systems and methods for generating 3D-representation of tooth-specific appliance |
US10717208B1 (en) | 2019-12-04 | 2020-07-21 | Oxilio Ltd | Methods and systems for thermoforming orthodontic aligners |
US10631956B1 (en) | 2019-12-04 | 2020-04-28 | Oxilio Ltd | Methods and systems for making an orthodontic aligner having fixing blocks |
US10631954B1 (en) | 2019-12-04 | 2020-04-28 | Oxilio Ltd | Systems and methods for determining orthodontic treatments |
US10695146B1 (en) | 2019-12-04 | 2020-06-30 | Oxilio Ltd | Systems and methods for determining orthodontic treatments |
US10726949B1 (en) | 2019-12-05 | 2020-07-28 | Oxilio Ltd | Systems and methods for generating 3D-representation of tooth-specific platform for dental appliance |
WO2021145607A1 (en) * | 2020-01-13 | 2021-07-22 | 가톨릭대학교 산학협력단 | Dental medical record device and dental medical record method thereof |
KR20210092371A (en) * | 2020-01-15 | 2021-07-26 | 주식회사 메디트 | Apparatus and method for generating virtual model |
JP7248599B2 (en) | 2020-01-15 | 2023-03-29 | 株式会社モリタ製作所 | Information processing device and data processing method |
US10751149B1 (en) | 2020-02-18 | 2020-08-25 | Oxilio Ltd | Method of determining deformation of gingiva |
JP2021133170A (en) * | 2020-02-28 | 2021-09-13 | 株式会社根本杏林堂 | Medical image processing apparatus, medical image processing method and medical image processing program |
US10898298B1 (en) | 2020-04-08 | 2021-01-26 | Oxilio Ltd | Systems and methods for determining orthodontic treatment |
US20210321872A1 (en) * | 2020-04-15 | 2021-10-21 | Align Technology, Inc. | Smart scanning for intraoral scanners |
KR102432527B1 (en) * | 2020-05-11 | 2022-08-17 | 오스템임플란트 주식회사 | Method For Extraction Teeth Of Interest And Scan Data Processing Apparatus |
CN111700698B (en) * | 2020-05-14 | 2022-07-08 | 先临三维科技股份有限公司 | Dental scanning method, apparatus, system and computer readable storage medium |
US10856954B1 (en) | 2020-05-19 | 2020-12-08 | Oxilio Ltd | Systems and methods for determining tooth center of resistance |
CN111529104B (en) * | 2020-05-19 | 2021-06-15 | 北京联袂义齿技术有限公司 | Digitalization method for manufacturing polyether-ether-ketone support on planting rod clamp |
KR102385076B1 (en) | 2020-07-10 | 2022-04-11 | 주식회사 메디트 | Data Locking System and Method of Locking Data |
US10950061B1 (en) | 2020-07-23 | 2021-03-16 | Oxilio Ltd | Systems and methods for planning an orthodontic treatment |
US11026767B1 (en) | 2020-07-23 | 2021-06-08 | Oxilio Ltd | Systems and methods for planning an orthodontic treatment |
US10945812B1 (en) | 2020-07-24 | 2021-03-16 | Oxilio Ltd | Systems and methods for planning an orthodontic treatment |
US11544846B2 (en) | 2020-08-27 | 2023-01-03 | James R. Glidewell Dental Ceramics, Inc. | Out-of-view CT scan detection |
US10993782B1 (en) | 2020-09-08 | 2021-05-04 | Oxilio Ltd | Systems and methods for determining a tooth trajectory |
USD958170S1 (en) | 2020-09-08 | 2022-07-19 | Arkimos Ltd | Display screen or portion thereof with graphical user interface |
US11858217B2 (en) | 2020-09-17 | 2024-01-02 | Concept Laser Gmbh | Methods of determining an interlace path for an additive manufacturing machine |
KR102460621B1 (en) * | 2020-09-23 | 2022-10-28 | 주식회사 메디트 | An intraoral image processing apparatus, and an intraoral image processing method |
US11806210B2 (en) | 2020-10-12 | 2023-11-07 | Align Technology, Inc. | Method for sub-gingival intraoral scanning |
EP4238534A1 (en) * | 2020-10-28 | 2023-09-06 | Medit Corp. | Method for determining object area from three-dimensional model, and three-dimensional model processing device |
KR102493440B1 (en) * | 2020-10-28 | 2023-01-31 | 주식회사 메디트 | Method for determining region of object from three dimensional model and apparatus for processing three dimensional model |
US12033742B2 (en) | 2020-12-11 | 2024-07-09 | Align Technology, Inc. | Noninvasive multimodal oral assessment and disease diagnoses apparatus and method |
CN112790887A (en) * | 2020-12-31 | 2021-05-14 | 深圳市维新登拓医疗科技有限公司 | Oral imaging method, system and device, and readable storage medium |
US11116606B1 (en) | 2021-01-06 | 2021-09-14 | Arkimos Ltd. | Systems and methods for determining a jaw curve |
US11055850B1 (en) | 2021-01-06 | 2021-07-06 | Oxilio Ltd | Systems and methods for tooth segmentation |
US11058515B1 (en) | 2021-01-06 | 2021-07-13 | Arkimos Ltd. | Systems and methods for forming dental appliances |
US11166787B1 (en) | 2021-01-06 | 2021-11-09 | Arkimos Ltd | Orthodontic attachment systems and methods |
US11197744B1 (en) | 2021-01-06 | 2021-12-14 | Arkimos Ltd | Method and system for generating interdental filler models |
US11191618B1 (en) | 2021-01-06 | 2021-12-07 | Arkimos Ltd | Systems and methods for forming a dental appliance |
US20220233283A1 (en) | 2021-01-26 | 2022-07-28 | Align Technology, Inc. | Device pairing for distributed intraoral scanning system |
USD1026227S1 (en) | 2021-01-29 | 2024-05-07 | Align Technology, Inc. | Intraoral scanning system cart |
CN112972047A (en) * | 2021-02-05 | 2021-06-18 | 深圳美聚和医疗科技有限公司 | Tooth preparation method, device and system for prepared tooth |
WO2022197016A1 (en) * | 2021-03-16 | 2022-09-22 | 주식회사 메디트 | Data processing method |
EP4321128A1 (en) * | 2021-04-07 | 2024-02-14 | Medit Corp. | Data processing device, scanner, and method for operating same |
USD1027186S1 (en) | 2022-02-17 | 2024-05-14 | Align Technology, Inc. | Dental imaging attachment for a smartphone |
KR102583414B1 (en) * | 2021-05-31 | 2023-10-04 | 주식회사 메디트 | Method and apparatus of processing scanned images of 3d scanner |
KR102591976B1 (en) * | 2021-06-24 | 2023-10-23 | 주식회사 메디트 | Method for providing margin line information for oral cavity and electronic apparatus performing the same method |
WO2022270889A1 (en) * | 2021-06-25 | 2022-12-29 | 주식회사 메디트 | Intraoral image processing device and intraoral image processing method |
KR102532535B1 (en) * | 2021-08-04 | 2023-05-17 | 주식회사 메디트 | Method and apparatus for noise filtering in scan image processing of three dimensional scanner |
KR102509772B1 (en) * | 2021-09-10 | 2023-03-15 | 주식회사 메디트 | Electronic device and method for processing scanned image of three dimensional scanner |
WO2023063607A1 (en) * | 2021-10-12 | 2023-04-20 | 주식회사 메디트 | Data processing apparatus and data processing method |
JP2023082325A (en) * | 2021-12-02 | 2023-06-14 | 株式会社モリタ製作所 | Data processing device, data processing method, data processing program, and data processing system |
JP2023082326A (en) * | 2021-12-02 | 2023-06-14 | 株式会社モリタ製作所 | Data processing device, data processing method, data processing program, and data processing system |
CN115156087B (en) * | 2022-09-02 | 2022-12-13 | 深圳云甲科技有限公司 | Denture sorting assisting method and device, computer equipment and readable storage medium |
WO2024136543A1 (en) * | 2022-12-23 | 2024-06-27 | 주식회사 글라우드 | Prosthesis ordering system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6075905A (en) * | 1996-07-17 | 2000-06-13 | Sarnoff Corporation | Method and apparatus for mosaic image construction |
US7112065B2 (en) * | 2002-07-22 | 2006-09-26 | Cadent Ltd. | Method for defining a finish line of a dental prosthesis |
US20090063273A1 (en) * | 2007-05-15 | 2009-03-05 | Jeff Dixon | Pay-for-performance job advertising |
US7600999B2 (en) * | 2003-02-26 | 2009-10-13 | Align Technology, Inc. | Systems and methods for fabricating a dental template |
US20180028294A1 (en) * | 2016-07-27 | 2018-02-01 | James R. Glidewell Dental Ceramics, Inc. | Dental cad automation using deep learning |
Family Cites Families (116)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
ATE232701T1 (en) | 1995-07-21 | 2003-03-15 | Cadent Ltd | METHOD AND SYSTEM FOR THREE-DIMENSIONAL IMAGE CAPTURE OF TEETH |
DE19640495C2 (en) | 1996-10-01 | 1999-12-16 | Leica Microsystems | Device for confocal surface measurement |
US7098435B2 (en) | 1996-10-25 | 2006-08-29 | Frederick E. Mueller | Method and apparatus for scanning three-dimensional objects |
IL120867A0 (en) | 1997-05-20 | 1997-09-30 | Cadent Ltd | Computer user interface for orthodontic use |
IL120892A (en) | 1997-05-22 | 2000-08-31 | Cadent Ltd | Method for obtaining a dental occlusion map |
US7507088B2 (en) | 1997-09-30 | 2009-03-24 | Cadent Ltd. | Method for comparing orthodontic element placement |
US6334772B1 (en) | 1997-09-30 | 2002-01-01 | Cadent Ltd. | Placing an orthodontic element on a tooth surface |
IL125659A (en) * | 1998-08-05 | 2002-09-12 | Cadent Ltd | Method and apparatus for imaging three-dimensional structure |
IL126838A (en) | 1998-11-01 | 2003-04-10 | Cadent Ltd | Dental image processing method and system |
US6542249B1 (en) | 1999-07-20 | 2003-04-01 | The University Of Western Ontario | Three-dimensional measurement method and apparatus |
US6648640B2 (en) | 1999-11-30 | 2003-11-18 | Ora Metrix, Inc. | Interactive orthodontic care system based on intra-oral scanning of teeth |
US7373286B2 (en) | 2000-02-17 | 2008-05-13 | Align Technology, Inc. | Efficient data representation of teeth model |
US6633789B1 (en) | 2000-02-17 | 2003-10-14 | Align Technology, Inc. | Effiicient data representation of teeth model |
US6463344B1 (en) | 2000-02-17 | 2002-10-08 | Align Technology, Inc. | Efficient data representation of teeth model |
US9421074B2 (en) | 2001-04-13 | 2016-08-23 | Orametrix, Inc. | Unified three dimensional virtual craniofacial and dentition model and uses thereof |
WO2003057041A1 (en) | 2002-01-14 | 2003-07-17 | Cadent Ltd. | Method and sytem for imaging a patient's teeth arrangement |
US7255558B2 (en) | 2002-06-18 | 2007-08-14 | Cadent, Ltd. | Dental imaging instrument having air stream auxiliary |
US6979196B2 (en) | 2002-06-21 | 2005-12-27 | Align Technology, Inc. | Systems and methods for automated bite-setting of tooth models |
DE10252298B3 (en) * | 2002-11-11 | 2004-08-19 | Mehl, Albert, Prof. Dr. Dr. | Process for the production of tooth replacement parts or tooth restorations using electronic tooth representations |
US6882894B2 (en) * | 2003-01-06 | 2005-04-19 | Duane Milford Durbin | Method and system for automated mass manufacturing of custom tooth die models for use in the fabrication of dental prosthetics |
US7658610B2 (en) | 2003-02-26 | 2010-02-09 | Align Technology, Inc. | Systems and methods for fabricating a dental template with a 3-D object placement |
WO2004087000A1 (en) * | 2003-04-03 | 2004-10-14 | Cadent Ltd. | Method and system for fabricating a dental coping, and a coping fabricated thereby |
US7695278B2 (en) | 2005-05-20 | 2010-04-13 | Orametrix, Inc. | Method and system for finding tooth features on a virtual three-dimensional model |
AU2004239336A1 (en) | 2003-05-13 | 2004-11-25 | Federal-Mogul Powertrain, Inc. | Sleeve splicing kit and method |
US7030383B2 (en) | 2003-08-04 | 2006-04-18 | Cadent Ltd. | Speckle reduction method and apparatus |
US7202466B2 (en) | 2003-08-25 | 2007-04-10 | Cadent Ltd. | Apparatus and method for providing high intensity non-coherent light and for speckle reduction |
US7333874B2 (en) * | 2004-02-24 | 2008-02-19 | Cadent Ltd. | Method and system for designing and producing dental prostheses and appliances |
ATE406850T1 (en) * | 2004-06-17 | 2008-09-15 | Cadent Ltd | METHOD AND DEVICE FOR COLOR IMAGE FORMING OF A THREE-DIMENSIONAL STRUCTURE |
US7286954B2 (en) | 2005-03-03 | 2007-10-23 | Cadent Ltd. | System and method for scanning an intraoral cavity |
DE102005011066A1 (en) | 2005-03-08 | 2006-09-14 | Sirona Dental Systems Gmbh | Method for establishing the positional match of 3D data sets in a dental CAD / CAM system |
US7555403B2 (en) | 2005-07-15 | 2009-06-30 | Cadent Ltd. | Method for manipulating a dental virtual model, method for creating physical entities based on a dental virtual model thus manipulated, and dental models thus created |
US8035637B2 (en) | 2006-01-20 | 2011-10-11 | 3M Innovative Properties Company | Three-dimensional scan recovery |
US7912257B2 (en) | 2006-01-20 | 2011-03-22 | 3M Innovative Properties Company | Real time display of acquired 3D dental data |
US20090068617A1 (en) | 2006-03-03 | 2009-03-12 | Lauren Mark D | Method Of Designing Dental Devices Using Four-Dimensional Data |
US7599538B2 (en) * | 2006-07-24 | 2009-10-06 | Apteryx, Inc. | Method and system for automatic intra-oral sensor locating for image acquisition |
WO2008051130A1 (en) | 2006-10-27 | 2008-05-02 | Nobel Biocare Services Ag | Method and apparatus for obtaining data for a dental component and a physical dental model |
US7916911B2 (en) | 2007-02-26 | 2011-03-29 | Align Technology, Inc. | System and method for digital tooth imaging |
JP4367514B2 (en) | 2007-04-05 | 2009-11-18 | エプソンイメージングデバイス株式会社 | Input device, electro-optical device, electronic equipment |
US8275180B2 (en) | 2007-08-02 | 2012-09-25 | Align Technology, Inc. | Mapping abnormal dental references |
US7865259B2 (en) | 2007-12-06 | 2011-01-04 | Align Technology, Inc. | System and method for improved dental geometry representation |
JP2011509812A (en) * | 2008-01-23 | 2011-03-31 | センサブル テクノロジーズ インコーポレイテッド | Tactile controllable dental modeling system |
US8108189B2 (en) | 2008-03-25 | 2012-01-31 | Align Technologies, Inc. | Reconstruction of non-visible part of tooth |
WO2010001401A1 (en) | 2008-07-03 | 2010-01-07 | Cadent Ltd. | Method, apparatus and system for use in dental procedures |
DE102008054985B4 (en) | 2008-12-19 | 2012-02-02 | Sirona Dental Systems Gmbh | Method and device for optical measurement of three-dimensional objects by means of a dental 3D camera using a triangulation method |
AT507887B1 (en) * | 2009-03-18 | 2010-09-15 | Steger Heinrich | DEVICE FOR SCANNING A DENTAL MODEL IMAGE WITH ARTICULATOR |
CA2957077C (en) | 2009-06-01 | 2019-07-02 | Gerd Hausler | Method and device for three-dimensional surface detection with a dynamic reference frame |
US8587582B2 (en) | 2009-11-02 | 2013-11-19 | Align Technology, Inc. | Generating a dynamic three-dimensional occlusogram |
US8244028B2 (en) | 2010-04-30 | 2012-08-14 | Align Technology, Inc. | Virtual cephalometric imaging |
FR2960962B1 (en) | 2010-06-08 | 2014-05-09 | Francois Duret | DEVICE FOR THREE DIMENSIONAL AND TEMPORAL MEASUREMENTS BY COLOR OPTICAL FOOTPRINT. |
EP3851069B1 (en) | 2010-06-29 | 2023-01-18 | 3Shape A/S | 2d image arrangement |
WO2012011101A2 (en) | 2010-07-19 | 2012-01-26 | Cadent Ltd. | Methods and systems for creating and interacting with three dimensional virtual models |
DE102011010975A1 (en) * | 2011-02-10 | 2012-08-16 | Martin Tank | Method and analysis system for geometrical analysis of scan data of oral structures |
DE102011077564B4 (en) * | 2011-06-15 | 2016-08-25 | Sirona Dental Systems Gmbh | Method for the optical three-dimensional measurement of a dental object |
PL3401876T5 (en) | 2011-07-15 | 2022-12-05 | 3Shape A/S | Detection of a movable object when 3d scanning a rigid object |
DE102011080180B4 (en) | 2011-08-01 | 2013-05-02 | Sirona Dental Systems Gmbh | Method for registering a plurality of three-dimensional recordings of a dental object |
JP6423273B2 (en) * | 2011-11-28 | 2018-11-14 | 3シェイプ アー/エス | Dental preparation guide |
US9375300B2 (en) | 2012-02-02 | 2016-06-28 | Align Technology, Inc. | Identifying forces on a tooth |
GB2511470B (en) | 2012-04-25 | 2020-07-15 | Univ Sussex | Treatment of fungal infections using alternative oxidase inhibitors |
US9192305B2 (en) | 2012-09-28 | 2015-11-24 | Align Technology, Inc. | Estimating a surface texture of a tooth |
US8948482B2 (en) | 2012-11-01 | 2015-02-03 | Align Technology, Inc. | Motion compensation in a three dimensional scan |
US9717402B2 (en) | 2012-11-21 | 2017-08-01 | Align Technology, Inc. | Confocal imaging using astigmatism |
US10098714B2 (en) | 2012-12-19 | 2018-10-16 | Align Technology, Inc. | Apparatus and method for optically scanning an object in registration with a reference pattern |
US9668829B2 (en) | 2012-12-19 | 2017-06-06 | Align Technology, Inc. | Methods and systems for dental procedures |
CN104955418B (en) * | 2012-12-24 | 2017-10-13 | 牙医技术G·P·L·有限公司 | The device and method measured under gum |
US20140227655A1 (en) | 2013-02-12 | 2014-08-14 | Ormco Corporation | Integration of model data, surface data, and volumetric data |
US20140247260A1 (en) | 2013-03-01 | 2014-09-04 | Indiana University Research & Technology Corporation | Biomechanics Sequential Analyzer |
US10098713B2 (en) | 2013-03-14 | 2018-10-16 | Ormco Corporation | Scanning sequence for an intra-oral imaging system |
US20140308623A1 (en) | 2013-04-12 | 2014-10-16 | Mun Chang | Computer fabrication of dental prosthetics |
US9675428B2 (en) | 2013-07-12 | 2017-06-13 | Carestream Health, Inc. | Video-based auto-capture for dental surface imaging apparatus |
US9393087B2 (en) | 2013-08-01 | 2016-07-19 | Align Technology, Inc. | Methods and systems for generating color images |
US10111714B2 (en) | 2014-01-27 | 2018-10-30 | Align Technology, Inc. | Adhesive objects for improving image registration of intraoral images |
US10111581B2 (en) | 2014-02-27 | 2018-10-30 | Align Technology, Inc. | Thermal defogging system and method |
US9510757B2 (en) | 2014-05-07 | 2016-12-06 | Align Technology, Inc. | Identification of areas of interest during intraoral scans |
US9431887B2 (en) | 2014-06-06 | 2016-08-30 | Align Technology, Inc. | Lens positioning system |
US9491863B2 (en) | 2014-06-26 | 2016-11-08 | Align Technology, Inc. | Mounting system that maintains stability of optics as temperature changes |
US9439568B2 (en) | 2014-07-03 | 2016-09-13 | Align Technology, Inc. | Apparatus and method for measuring surface topography optically |
US9261358B2 (en) | 2014-07-03 | 2016-02-16 | Align Technology, Inc. | Chromatic confocal system |
US9261356B2 (en) | 2014-07-03 | 2016-02-16 | Align Technology, Inc. | Confocal surface topography measurement with fixed focal positions |
US10772506B2 (en) | 2014-07-07 | 2020-09-15 | Align Technology, Inc. | Apparatus for dental confocal imaging |
US9693839B2 (en) | 2014-07-17 | 2017-07-04 | Align Technology, Inc. | Probe head and apparatus for intraoral confocal imaging using polarization-retarding coatings |
US9675430B2 (en) | 2014-08-15 | 2017-06-13 | Align Technology, Inc. | Confocal imaging apparatus with curved focal surface |
US9724177B2 (en) | 2014-08-19 | 2017-08-08 | Align Technology, Inc. | Viewfinder with real-time tracking for intraoral scanning |
US9660418B2 (en) | 2014-08-27 | 2017-05-23 | Align Technology, Inc. | VCSEL based low coherence emitter for confocal 3D scanner |
USD760901S1 (en) | 2014-09-18 | 2016-07-05 | Align Technology, Inc. | Intraoral scanner wand |
USD742518S1 (en) | 2014-09-18 | 2015-11-03 | Align Technology, Inc. | Intraoral scanner wand |
US10453269B2 (en) | 2014-12-08 | 2019-10-22 | Align Technology, Inc. | Intraoral scanning using ultrasound and optical scan data |
US10504386B2 (en) | 2015-01-27 | 2019-12-10 | Align Technology, Inc. | Training method and system for oral-cavity-imaging-and-modeling equipment |
US10076389B2 (en) | 2015-02-13 | 2018-09-18 | Align Technology, Inc. | Three-dimensional tooth modeling using a two-dimensional x-ray image |
USD771817S1 (en) | 2015-03-06 | 2016-11-15 | Align Technology, Inc. | Combined cart-mounted display and computer for intraoral scanner |
US10108269B2 (en) | 2015-03-06 | 2018-10-23 | Align Technology, Inc. | Intraoral scanner with touch sensitive input |
US9451873B1 (en) | 2015-03-06 | 2016-09-27 | Align Technology, Inc. | Automatic selection and locking of intraoral images |
USD768861S1 (en) | 2015-03-06 | 2016-10-11 | Align Technology, Inc. | Combined desktop display and computer for intraoral scanner |
US9844426B2 (en) | 2015-03-12 | 2017-12-19 | Align Technology, Inc. | Digital dental tray |
USD774193S1 (en) | 2015-08-24 | 2016-12-13 | Align Technology, Inc. | Sleeve for an intraoral scanner |
US10136972B2 (en) | 2016-06-30 | 2018-11-27 | Align Technology, Inc. | Historical scan reference for intraoral scans |
KR20230154476A (en) | 2016-07-27 | 2023-11-08 | 얼라인 테크널러지, 인크. | Intraoral scanner with dental diagnostics capabilities |
US10507087B2 (en) | 2016-07-27 | 2019-12-17 | Align Technology, Inc. | Methods and apparatuses for forming a three-dimensional volumetric model of a subject's teeth |
US9917623B1 (en) | 2016-08-01 | 2018-03-13 | Space Systems/Loral, Llc | Digital beamforming architecture |
US10888399B2 (en) | 2016-12-16 | 2021-01-12 | Align Technology, Inc. | Augmented reality enhancements for dental practitioners |
US10456043B2 (en) | 2017-01-12 | 2019-10-29 | Align Technology, Inc. | Compact confocal dental scanning apparatus |
US10499793B2 (en) | 2017-02-17 | 2019-12-10 | Align Technology, Inc. | Longitudinal analysis and visualization under limited accuracy system |
US10708574B2 (en) | 2017-06-15 | 2020-07-07 | Align Technology, Inc. | Three dimensional imaging apparatus with color sensor |
WO2019023461A1 (en) | 2017-07-27 | 2019-01-31 | Align Technology, Inc. | Tooth shading, transparency and glazing |
EP4278957A3 (en) | 2017-07-27 | 2024-01-24 | Align Technology, Inc. | System and methods for processing an orthodontic aligner by means of an optical coherence tomography |
US10980613B2 (en) | 2017-12-29 | 2021-04-20 | Align Technology, Inc. | Augmented reality enhancements for dental practitioners |
EP3743007A1 (en) | 2018-01-26 | 2020-12-02 | Align Technology, Inc. | Visual prosthetic and orthodontic treatment planning |
AU2019212649A1 (en) | 2018-01-26 | 2020-07-02 | Align Technology, Inc. | Diagnostic intraoral scanning and tracking |
US11096765B2 (en) | 2018-06-22 | 2021-08-24 | Align Technology, Inc. | Light field intraoral 3D scanner with structured light illumination |
US11367192B2 (en) | 2019-03-08 | 2022-06-21 | Align Technology, Inc. | Foreign object filtering for intraoral scanning |
AU2020254822A1 (en) | 2019-04-05 | 2021-10-07 | Align Technology, Inc. | Intraoral scanner sleeve authentication and identification |
US11455727B2 (en) | 2019-05-02 | 2022-09-27 | Align Technology, Inc. | Method and apparatus for excessive materials removal from intraoral scans |
US11238586B2 (en) | 2019-05-02 | 2022-02-01 | Align Technology, Inc. | Excess material removal using machine learning |
US11563929B2 (en) | 2019-06-24 | 2023-01-24 | Align Technology, Inc. | Intraoral 3D scanner employing multiple miniature cameras and multiple miniature pattern projectors |
EP3979901A1 (en) | 2019-07-29 | 2022-04-13 | Align Technology, Inc. | Full-scanner barrier for an intra-oral device |
US11995839B2 (en) | 2019-09-04 | 2024-05-28 | Align Technology, Inc. | Automated detection, generation and/or correction of dental features in digital models |
WO2021050774A1 (en) | 2019-09-10 | 2021-03-18 | Align Technology, Inc. | Dental panoramic views |
-
2015
- 2015-03-06 US US14/640,909 patent/US9451873B1/en not_active Ceased
-
2016
- 2016-03-04 EP EP21159730.7A patent/EP3848885B1/en active Active
- 2016-03-04 KR KR1020177027851A patent/KR101999465B1/en active IP Right Grant
- 2016-03-04 KR KR1020247015178A patent/KR20240070699A/en active Search and Examination
- 2016-03-04 AU AU2016230778A patent/AU2016230778B2/en active Active
- 2016-03-04 ES ES16709152T patent/ES2869961T3/en active Active
- 2016-03-04 JP JP2017546765A patent/JP6483273B2/en active Active
- 2016-03-04 KR KR1020227028213A patent/KR102665286B1/en active IP Right Grant
- 2016-03-04 EP EP16709152.9A patent/EP3265993B1/en active Active
- 2016-03-04 KR KR1020217034770A patent/KR102434916B1/en active IP Right Grant
- 2016-03-04 EP EP23176562.9A patent/EP4254304A3/en active Pending
- 2016-03-04 CA CA2978681A patent/CA2978681C/en active Active
- 2016-03-04 CN CN202010564054.6A patent/CN111820851A/en active Pending
- 2016-03-04 KR KR1020197019498A patent/KR102320004B1/en active IP Right Grant
- 2016-03-04 DK DK16709152.9T patent/DK3265993T3/en active
- 2016-03-04 WO PCT/IB2016/051226 patent/WO2016142818A1/en active Application Filing
- 2016-03-04 CN CN201680014230.0A patent/CN107427189B/en active Active
- 2016-07-28 US US15/222,525 patent/US10004572B2/en active Active
-
2018
- 2018-05-30 US US15/993,504 patent/US10470846B2/en active Active
- 2018-11-29 US US16/204,632 patent/US10219875B1/en active Active
-
2019
- 2019-01-14 AU AU2019200225A patent/AU2019200225B2/en active Active
- 2019-02-13 JP JP2019023479A patent/JP6818791B2/en active Active
- 2019-06-07 US US16/435,348 patent/US10603136B2/en active Active
- 2019-12-23 AU AU2019284039A patent/AU2019284039B2/en active Active
-
2020
- 2020-03-05 US US16/810,726 patent/US11678953B2/en active Active
- 2020-09-25 US US17/032,366 patent/USRE49605E1/en active Active
- 2020-12-28 JP JP2020219573A patent/JP7168644B2/en active Active
-
2021
- 2021-07-22 AU AU2021206867A patent/AU2021206867B2/en active Active
-
2023
- 2023-04-28 US US18/141,292 patent/US20230329837A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6075905A (en) * | 1996-07-17 | 2000-06-13 | Sarnoff Corporation | Method and apparatus for mosaic image construction |
US7112065B2 (en) * | 2002-07-22 | 2006-09-26 | Cadent Ltd. | Method for defining a finish line of a dental prosthesis |
US7600999B2 (en) * | 2003-02-26 | 2009-10-13 | Align Technology, Inc. | Systems and methods for fabricating a dental template |
US20090063273A1 (en) * | 2007-05-15 | 2009-03-05 | Jeff Dixon | Pay-for-performance job advertising |
US20180028294A1 (en) * | 2016-07-27 | 2018-02-01 | James R. Glidewell Dental Ceramics, Inc. | Dental cad automation using deep learning |
Non-Patent Citations (1)
Title |
---|
3D finite element mesh generation of complicated tooth model based on CT slices; Gao et al; June 2006 (Year: 2006) * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
USRE49605E1 (en) | 2015-03-06 | 2023-08-15 | Align Technology, Inc. | Automatic selection and locking of intraoral images |
WO2022191490A1 (en) * | 2021-03-10 | 2022-09-15 | 주식회사 메디트 | Orthodontic information display system |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11678953B2 (en) | Correction of margin lines in three-dimensional models of dental sites | |
US11903788B2 (en) | Multifaceted registration of intraoral scans |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ALIGN TECHNOLOGY, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KOPELMAN, AVI;SABINA, MICHAEL;REEL/FRAME:052033/0147 Effective date: 20150320 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |