CN108289722A - 用于观测牙齿情况的方法 - Google Patents

用于观测牙齿情况的方法 Download PDF

Info

Publication number
CN108289722A
CN108289722A CN201680067682.5A CN201680067682A CN108289722A CN 108289722 A CN108289722 A CN 108289722A CN 201680067682 A CN201680067682 A CN 201680067682A CN 108289722 A CN108289722 A CN 108289722A
Authority
CN
China
Prior art keywords
data record
facial
face
tooth
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201680067682.5A
Other languages
English (en)
Other versions
CN108289722B (zh
Inventor
S.施奈德
E.德扎普夫
R.阿洛尼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sirona Dental Systems GmbH
Original Assignee
Sirona Dental Systems GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sirona Dental Systems GmbH filed Critical Sirona Dental Systems GmbH
Publication of CN108289722A publication Critical patent/CN108289722A/zh
Application granted granted Critical
Publication of CN108289722B publication Critical patent/CN108289722B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/24—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the mouth, i.e. stomatoscopes, e.g. with tongue depressors; Instruments for opening or keeping open the mouth
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
    • A61B5/0088—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for oral or dental tissue
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons
    • A61B5/1171—Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • A61B5/1176—Recognition of faces
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/45—For evaluating or diagnosing the musculoskeletal system or teeth
    • A61B5/4538—Evaluating a particular part of the muscoloskeletal system or a particular medical condition
    • A61B5/4542—Evaluating the mouth, e.g. the jaw
    • A61B5/4547—Evaluating teeth
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/7425—Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61C—DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
    • A61C13/00—Dental prostheses; Making same
    • A61C13/0003—Making bridge-work, inlays, implants or the like
    • A61C13/0004—Computer-assisted sizing or machining of dental prostheses
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61C—DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
    • A61C9/00—Impression cups, i.e. impression trays; Impression methods
    • A61C9/004—Means or methods for taking digitized impressions
    • A61C9/0046—Data acquisition means or methods
    • A61C9/0053—Optical means or methods, e.g. scanning the teeth by a laser or light beam
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/101—Computer-aided simulation of surgical operations
    • A61B2034/102—Modelling of surgical devices, implants or prosthesis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/101—Computer-aided simulation of surgical operations
    • A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/107—Visualisation of planned trajectories or target regions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2065—Tracking using image or pattern recognition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2074—Interface software
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/368—Correlation of different images or relation of image positions in respect to the body changing the image on a display according to the operator's position
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00—Medical imaging apparatus involving image processing or analysis
    • A61B2576/02—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Epidemiology (AREA)
  • Biophysics (AREA)
  • Theoretical Computer Science (AREA)
  • Dentistry (AREA)
  • Primary Health Care (AREA)
  • Radiology & Medical Imaging (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Rheumatology (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Dental Tools And Instruments Or Auxiliary Dental Instruments (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

用于观测牙齿情况的方法。本发明涉及一种用于观测牙齿情况的方法，其中将患者面部的图像记录且存储为面部数据记录（1）；借助于面部辨识方法自动地辨识所述面部数据记录（1）内的特征点（3）；基于所述特征点（3）自动地辨识位于嘴唇之间的口部区域（4）；基于所述特征点（3）自动地辨识所述面部数据记录（1）中所述面部的位置和所述面部数据记录（1）中所述面部的定向的三维方向（5）；所述牙齿情况的虚拟牙齿数据记录（2）是根据所述面部的所述定向的所述三维方向（5）而定向且根据所述面部相对于所述面部数据记录（1）的所述位置而定位；所述牙齿数据记录（2）部分叠加和/或叠加于所述面部数据记录（1）内的所述口部区域上和/或所述面部数据记录（1）内的所述口部区域由所述牙齿数据记录（2）替代且将结果作为观测数据记录显示。

Description

用于观测牙齿情况的方法
技术领域
本发明涉及用于观测牙齿情况的方法，其中牙齿情况的虚拟牙齿数据记录是可用的且其中将患者面部的图像记录且存储为面部数据记录。
背景技术
用于观测牙齿情况，例如用于观测患者面部上所计划的假牙的效果的先前方法通常展示患者面部的冻结或至少可旋转图像，通过适当定向和定位将虚拟牙齿情况并入到所述图像中。
已知用于观测牙齿情况的方法例如来自DE 20 2008 014 344 U1、DE 10 2013102 421 A1或US 2012/0095732 A1。
已知用于自动地辨识面部图像中面部的特性或面部的特征点的各种方法例如来自D.Vukadinovic和M.Pantic的“使用基于Gabor特征的升压分类器的自动面部特征点检测（Automatic Facial Feature Point Detection using Gabor Feature Based BoostedClassifiers）”（2005）关于***、人类和控制论的IEEE国际会议；来自M.Dantone等人的“使用条件性回归森林的实时面部特征检测（Real-time Facial Feature Detection usingConditional Regression Forests）”（2012）关于计算机视觉处理和图案辨识的IEEE会议；或来自US 2010/030578 A1。
本发明的目标是进一步开发和改进现有技术。
发明内容
本发明的主题为一种用于观测牙齿情况的方法，其中将患者面部的图像记录且存储为面部数据记录，其中借助于面部辨识方法自动地辨识所述面部数据记录内的特征点，其中基于所述特征点自动地辨识位于嘴唇之间的口部区域，其中基于所述特征点自动地辨识所述面部数据记录中面部的位置和所述面部数据记录中面部的定向的三维方向，其中所述牙齿数据记录根据面部的所述定向的所述三维方向而定向且根据面部相对于所述面部数据记录的所述位置而定位，其中所述面部数据记录内的所述口部区域部分重叠和/或重叠和/或由所述牙齿数据纪录替代，且将结果作为观测数据记录显示。
请注意，所述牙齿情况可为任何牙齿情况，涉及一个牙齿或多个牙齿以及完整一组牙齿的图像。其例如可为完全虚拟计划的数据记录或其可为借助于扫描由模型产生的所计划假牙的数据记录。其还可为例如借助于相机产生的实际牙齿情况的数据记录。举例来说，后者可补充有假牙部分或围绕假牙部分对其进行操控例如以展示畸齿矫正治疗的计划结果。
常常也被称作面部特征点（facial feature point；FFP）或生物统计特征点的特征点为在二维或三维面部辨识方法的框架内面部中可以自动地辨识，即借助于计算机而不用与用户进行互动的点；例如，鼻尖、嘴角、眼睛等等。
根据本发明的方法的一个优点是可为患者或治疗医师或牙科技师观测患者面部内的所计划牙齿情况。表示现实的当前数据与虚拟数据的组合常常被称作扩增现实。具体来说，通过将所计划牙齿情况完整叠加到当前牙齿情况上或由所计划牙齿情况替代当前牙齿情况而展现所计划牙齿情况的效果。可通过将所计划牙齿情况部分叠加到当前牙齿情况上而同时显示所计划牙齿情况和当前牙齿情况。举例来说，所计划牙齿情况和当前牙齿情况，即口部区域内面部数据记录的范围可以不同颜色且透明地显示。因此，例如当准备当前牙齿情况时，可验证与所计划牙齿情况的一致性或偏离。
有利的是，面部数据记录为二维或三维的。二维数据记录易于产生或可借助于例如相机的简单装置而产生，而较好质量的观测数据记录可通过三维数据记录而实现。
有利的是，牙齿数据记录为三维的。牙齿数据记录因此可易于在适于面部数据记录中面部的定向的定向上与面部数据记录组合或在观测数据记录内显示。
有利地以定时间隔对所述方法进行再操作。观测数据记录到面部的更新，即新近记录图像的连续或反复产生会产生面部的一种类型的虚拟镜像。患者可因此转动或移动其头部、张开其口部等等且一致地展示适于当前定向或其面部上的当前表情的其面部的图像，且其中所计划牙齿情况适当地重叠。举例来说，可例如以始终相等的时间间隔自动地执行再操作。然而，还可提供起始再操作的触发器机构。这有可能会导致不同时间间隔。
所述时间间隔有利地不超过42 ms，其结果是实现用于视频的典型24 Hz的帧率且通过其实现实时观测。
为了确保正确辨识，有利地自动识别至少四个特征点以用于口部区域的自动辨识。
至少一个三维额外数据记录有利地根据面部的定向的三维方向而定向且根据面部相对于观测数据记录的位置而定位，其中观测数据记录中面部数据记录和/或牙齿数据记录部分重叠和/或重叠和/或由额外数据记录替代。以此方式，额外信息可易于在观测数据记录内显示且清晰地呈现给用户。
额外数据记录有利地为牙根的图像，与容积数据记录划分开且与关于位置的当前牙齿情况相关；颌部中神经的图像，与磁谐振断层扫描图像划分开且与关于位置的当前牙齿情况相关；下颌关节的图像或钻孔器或钻孔的图像。出于计划或监控的目的，例如钻孔的计划过程或借助于传感器确定的钻孔器的当前位置可在观测数据记录中显示。
附图说明
本发明的设计实例在图式中进行概述。图式展示：
图1根据本发明的方法的第一实施例的示意性图像，
图2经设计用于患者的治疗的假牙的数字数据记录的示意图，
图3患者面部的二维数字数据记录的示意图，
图4A、B用于确定面部数据记录内的面部的定向的具有特征点的面部数据记录的示意图，以及
图5所计划假牙的观测的示意图。
具体实施方式
在图1中概述根据本发明的方法的第一实施例。
根据方法步骤S1提供经设计用于患者的假牙的三维牙齿数据记录1。在图2中概述三维牙齿数据记录1的实例。
为了展示根据方法步骤S2通过给患者的假牙实现的结果，通过记录患者面部的二维图像而提供一个面部数据记录2，或通过以较短时间间隔记录一系列二维图像而提供一系列面部数据记录2，其中针对所述一系列图像中的每个图像产生一个相应面部数据记录2。可通过使用例如相机记录一个或多个二维图像。可例如通过相机拍摄面部。图3中展示面部数据记录3的实例。
借助于面部辨识方法，在方法步骤S3中在面部数据记录2内识别特征点3，即面部的特性点，例如嘴角。在方法步骤S4中，基于经辨识特征点3在面部数据记录2中识别口部或嘴唇。
如两个不同定向面部的图4A和4B中所展示，在方法步骤S5中基于特征点3而确定面部数据记录2中患者面部的定向的三维方向5。举例来说，虽然面部的前向定向的定向的方向5垂直于面部数据记录2的图像平面延伸且延伸到图像平面之外，但轮廓中记录的面部的方向5位于图像平面内。在方法步骤S5中，因此由面部的二维图像推论面部的三维定向。
如图5中所概述，在方法步骤S4之后的方法步骤S6中，将位于嘴唇之间的区域作为面部数据记录2内的口部区域4划分和切割出。
在方法步骤S7中，相对于面部数据记录2的图像平面旋转和定位牙齿数据记录1，以此方式使得牙齿数据记录1的定向与面部的定向的所确定方向5匹配且位置与口部区域4的位置匹配。
为此，在方法步骤S8中例如基于图像平面内牙齿数据记录1的定向与面部数据记录2内面部的定向的方向的关系而建立假牙与面部的相对定向。举例来说，可基于将保留的现有牙齿或待替换的牙齿而建立与面部数据记录2中面部的定向的关系。存储相关数据，以使得在方法步骤S7中借助于存储数据和面部数据记录2内面部的所确定定向5自动地进行牙齿数据记录1的定向。方法步骤S8因此不必针对每一产生的面部数据记录进行再操作，且出于此原因在图1中通过虚线指示。
一旦用手，就还有可能根据方法步骤S8而执行所述定向。随后存储因此产生的牙齿数据记录1与面部数据记录2内面部的定向的方向5的相对定向，以使得接着在面部的定向的改变和方向5的所得改变的情况下，可自动地定位牙齿数据记录。
在方法步骤S9中，经定向三维牙齿数据记录1显示在所述面部数据记录后方。由具有切割出的口部区域4且在图5中示意性地展示的面部数据记录2和牙齿数据记录1组成的数据记录此处被称作观测数据记录。
根据进一步发展，在合并和显示面部数据记录2和牙齿数据记录1之前在方法步骤S10中编辑牙齿数据记录2。所提供牙齿数据记录2通常为使用CAD方法针对CAM方法产生的数据记录，即针对计算机辅助制造方法产生的数据记录。意图用于计算机辅助制造中的数据记录仅必须包含关于形状的信息，即表面的位置。然而，对于根据本发明的方法，使牙齿数据记录1的外观尽可能真实是有利的。出于此目的，根据任选的方法步骤S10编辑根据方法步骤S1提供的牙齿数据记录1。
如果根据方法步骤S2以常规时间间隔反复地提供面部数据记录且针对每个新面部数据记录分别实施至少方法步骤S3、S4、S5、S6、S7和S9，那么显示装置等效于虚拟镜面或连续重新产生的观测数据记录等效于虚拟镜像。患者可移动其头部和/或张开和闭合其口部，且从各种视角看到所计划假牙的效果。具体来说，当以距显示装置最小可能距离布置用于产生患者面部的图像的记录装置时，实现在当前定向上显示患者面部且通过所计划假牙扩增的镜像的效果。
如果在方法步骤S6中并不切割出面部数据记录2的口部区域4，而是仅识别且与牙齿数据记录1部分重叠，那么可观测到当前牙齿情况与所计划牙齿情况的偏离。为此，举例来说，口部区域4和牙齿数据记录1同时且以部分透明方式，例如通过不同颜色显示。此观测准许实时对准备情况进行简单监控或在实施牙齿情况的准备时准许对当前牙齿情况的实时监控。
还有可能通过根据面部的定向的所确定方向5和面部数据记录2中面部的位置定向额外数据记录且在面部数据记录2和/或牙齿数据记录1上叠加所述额外数据记录而将额外数据记录并入到观测数据记录中。
可清晰地显示例如关于颌部中的神经、下颌关节、牙根、所计划钻孔的位置或当前钻孔器在使用期间的位置和定向的额外信息。
参考符号列表
1 牙齿数据记录
2 面部数据记录
3 特征点
4 口部区域
5 面部数据记录内面部的定向的方向
S1 - S9 方法步骤

Claims (11)

1.一种用于观测牙齿情况的方法，其中将患者面部的图像记录和存储为面部数据记录（1），
其特征在于，
借助于面部辨识方法自动地辨识所述面部数据记录（1）内的特征点（3），
基于所述特征点（3）自动地辨识位于嘴唇之间的口部区域（4），
基于所述特征点（3）自动地辨识所述面部数据记录（1）中所述面部的位置和所述面部数据记录（1）中所述面部的定向的三维方向（5），
所述牙齿情况的虚拟牙齿数据记录（2）是根据所述面部的所述定向的所述三维方向（5）而定向且根据所述面部相对于所述面部数据记录（1）的所述位置而定位，
所述面部数据记录（1）内的所述口部区域部分重叠和/或重叠和/或由所述牙齿数据记录（2）替代且将结果作为观测数据记录显示。
2.根据权利要求1所述的方法，其特征在于所述面部数据记录（1）为二维或三维的。
3.根据权利要求1或2所述的方法，其特征在于所述牙齿数据记录（2）为三维的。
4.根据权利要求1到3中任一项所述的方法，其特征在于以定时间隔对所述方法进行再操作。
5. 根据权利要求4所述的方法，其特征在于所述时间间隔不超过42 ms。
6.根据权利要求1到5中任一项所述的方法，其特征在于自动地识别至少四个特征点（3）以供对所述口部区域（4）的自动辨识。
7.根据权利要求1到6中任一项所述的方法，其特征在于至少一个三维额外数据记录是根据所述面部的所述定向的所述三维方向（5）而定向且根据所述面部相对于所述观测数据记录的所述位置而定位，且所述观测数据记录中的所述面部数据记录（1）和/或所述牙齿数据记录（2）部分重叠和/或重叠和/或由所述额外数据记录替代。
8.根据权利要求7所述的方法，其特征在于所述额外数据记录为牙根的图像，其与容积数据记录划分开且与关于所述位置的当前牙齿情况相关。
9.根据权利要求7或8所述的方法，其特征在于所述额外数据记录为颌部中的神经的图像，其与磁谐振断层扫描图像划分开且与关于所述位置的当前牙齿情况相关。
10.根据权利要求7到9中任一项所述的方法，其特征在于所述额外数据记录为下颌关节的图像。
11.根据权利要求7到10中任一项所述的方法，其特征在于所述额外数据记录为钻孔器或钻孔的图像。
CN201680067682.5A 2015-11-18 2016-11-17 用于观测牙齿情况的方法 Active CN108289722B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102015222782.0 2015-11-18
DE102015222782.0A DE102015222782A1 (de) 2015-11-18 2015-11-18 Verfahren zur Visualisierung einer Zahnsituation
PCT/EP2016/077934 WO2017085160A1 (de) 2015-11-18 2016-11-17 Verfahren zur visualisierung einer zahnsituation

Publications (2)

Publication Number Publication Date
CN108289722A true CN108289722A (zh) 2018-07-17
CN108289722B CN108289722B (zh) 2021-08-27

Family

ID=57588948

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680067682.5A Active CN108289722B (zh) 2015-11-18 2016-11-17 用于观测牙齿情况的方法

Country Status (6)

Country Link
US (1) US10980422B2 (zh)
EP (1) EP3376989A1 (zh)
JP (1) JP6857178B2 (zh)
CN (1) CN108289722B (zh)
DE (1) DE102015222782A1 (zh)
WO (1) WO2017085160A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113164237A (zh) * 2019-01-30 2021-07-23 登士柏希罗纳有限公司 用于提议和可视化牙科治疗的方法和***

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10013808B2 (en) 2015-02-03 2018-07-03 Globus Medical, Inc. Surgeon head-mounted display apparatuses
CN109717966B (zh) * 2017-10-27 2021-04-30 华硕电脑股份有限公司 用于牙齿整形的影像仿真方法及其影像仿真装置
US20190254753A1 (en) 2018-02-19 2019-08-22 Globus Medical, Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
DK3530232T3 (da) 2018-02-21 2021-08-02 Ivoclar Vivadent Ag Fremgangsmåde til at justere en tredimensionel model af en tandstilling af en patient til et billede af ansigtet af patienten optaget af et kamera
BG67204B1 (bg) * 2018-05-14 2020-12-15 Schayder Jordao Adriano Система за производство на триизмерни дигитални зъбни модели
CN109124805B (zh) * 2018-07-13 2021-02-26 四川大学 数字化镜像cad/cam临时牙的制作方法
WO2020068681A1 (en) * 2018-09-24 2020-04-02 Surgical Theater Inc. 360 vr volumetric media editor
DK3632369T3 (da) 2018-10-02 2022-03-28 Sirona Dental Systems Gmbh Fremgangsmåde til inkorporering af fotografiske ansigtsbilleder og/eller -film af en person i planlægningen af odontologiske og/eller kosmetiske tandbehandlinger og/eller forberedelse af restaureringer for samme person
USD896254S1 (en) * 2018-10-30 2020-09-15 Perfect Mobile Corp. Display screen with graphical user interface
CN110459083B (zh) * 2019-08-22 2020-08-04 北京众绘虚拟现实技术研究院有限公司 一种视觉-触觉融合的增强现实口腔手术技能训练模拟器
DE102019126111A1 (de) * 2019-09-27 2021-04-01 Urban Technology GmbH Verfahren, Computerprogrammprodukt und Simulationssystem zur Erstellung und Ausgabe eines dreidimensionalen Modells eines Gebisses
US11992373B2 (en) 2019-12-10 2024-05-28 Globus Medical, Inc Augmented reality headset with varied opacity for navigated robotic surgery
US11464581B2 (en) 2020-01-28 2022-10-11 Globus Medical, Inc. Pose measurement chaining for extended reality surgical navigation in visible and near infrared spectrums
US11382699B2 (en) 2020-02-10 2022-07-12 Globus Medical Inc. Extended reality visualization of optical tool tracking volume for computer assisted navigation in surgery
US11207150B2 (en) 2020-02-19 2021-12-28 Globus Medical, Inc. Displaying a virtual model of a planned instrument attachment to ensure correct selection of physical instrument attachment
CN111568397A (zh) * 2020-04-21 2020-08-25 上海上实龙创智慧能源科技股份有限公司 一种人体健康体征数据采集***及方法
US11607277B2 (en) 2020-04-29 2023-03-21 Globus Medical, Inc. Registration of surgical tool with reference array tracked by cameras of an extended reality headset for assisted navigation during surgery
US11510750B2 (en) 2020-05-08 2022-11-29 Globus Medical, Inc. Leveraging two-dimensional digital imaging and communication in medicine imagery in three-dimensional extended reality applications
US11382700B2 (en) 2020-05-08 2022-07-12 Globus Medical Inc. Extended reality headset tool tracking and control
US11153555B1 (en) 2020-05-08 2021-10-19 Globus Medical Inc. Extended reality headset camera system for computer assisted navigation in surgery
US11737831B2 (en) 2020-09-02 2023-08-29 Globus Medical Inc. Surgical object tracking template generation for computer assisted navigation during surgical procedure
KR102512838B1 (ko) * 2020-10-29 2023-03-22 주식회사 메디트 이미지 처리 방법 및 이를 사용한 장치
WO2022092763A1 (ko) * 2020-10-29 2022-05-05 주식회사 메디트 이미지 처리 방법 및 이를 사용한 장치
KR20230163182A (ko) * 2022-05-23 2023-11-30 주식회사 메가젠임플란트 인공지능을 적용한 3차원 얼굴스캔 자동매칭장치 및 그 장치의 구동방법, 그리고 매체에 저장된 컴퓨터프로그램

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004098379A2 (en) * 2003-05-02 2004-11-18 Orametrix, Inc. Method and system for integrated orthodontic treatment planning using unified workstation
US20100145898A1 (en) * 2007-04-18 2010-06-10 Katja Malfliet Computer-assisted creation of a custom tooth set-up using facial analysis
US20120327196A1 (en) * 2010-05-24 2012-12-27 Sony Computer Entertainment Inc. Image Processing Apparatus, Image Processing Method, and Image Communication System
CN103445875A (zh) * 2012-05-15 2013-12-18 株式会社电装 用于支持牙科植入手术的方法及设备
US20140362091A1 (en) * 2013-06-07 2014-12-11 Ecole Polytechnique Federale De Lausanne Online modeling for real-time facial animation
WO2015123759A1 (en) * 2014-02-21 2015-08-27 Trispera Dental Inc. Augmented reality dental design method and system

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7234937B2 (en) * 1999-11-30 2007-06-26 Orametrix, Inc. Unified workstation for virtual craniofacial diagnosis, treatment planning and therapeutics
JP4093273B2 (ja) * 2006-03-13 2008-06-04 オムロン株式会社 特徴点検出装置、特徴点検出方法および特徴点検出プログラム
US8253778B2 (en) * 2008-03-21 2012-08-28 Takahashi Atsushi Three-dimensional digital magnifier operation supporting system
US20100030578A1 (en) 2008-03-21 2010-02-04 Siddique M A Sami System and method for collaborative shopping, business and entertainment
KR100926978B1 (ko) * 2008-04-08 2009-11-17 삼성전자주식회사 영상 수집 제어 방법 및 장치
US8092215B2 (en) 2008-05-23 2012-01-10 Align Technology, Inc. Smile designer
US8108778B2 (en) 2008-09-30 2012-01-31 Yahoo! Inc. System and method for context enhanced mapping within a user interface
US8088551B2 (en) 2008-10-09 2012-01-03 Micron Technology, Inc. Methods of utilizing block copolymer to form patterns
WO2010042990A1 (en) * 2008-10-16 2010-04-22 Seeing Machines Limited Online marketing of facial products using real-time face tracking
DE202008014344U1 (de) 2008-10-28 2010-03-25 Edinger-Strobl, Verena, Mag. DDr. Gebissbild-Simulationsvorrichtung
BRPI1009891B8 (pt) 2009-03-20 2021-06-22 3Shape As sistema e método para planejamento, visualização e otimização de restaurações dentárias
EP3851069B1 (en) 2010-06-29 2023-01-18 3Shape A/S 2d image arrangement
WO2012090211A1 (en) 2010-12-29 2012-07-05 Santiago Jeevan Kumar Augmented reality computer model facebow system for use in dentistry
KR101223937B1 (ko) * 2011-02-22 2013-01-21 주식회사 모르페우스 안면보정 이미지 제공방법 및 그 시스템
DE102012110491A1 (de) * 2012-11-02 2014-05-08 Carsten Dursteler Verfahren und Vorrichtung zur kosmetischen Zahnanalyse und Zahnberatung
WO2014135695A1 (en) 2013-03-08 2014-09-12 3Shape A/S Visualising a 3d dental restoration on a 2d image
DE102013102421A1 (de) 2013-03-11 2014-09-11 Polymetric GmbH Verfahren zur Überlagerung von digitalisierten Darstellungen und Referenzmarkereinrichtung
JP5883816B2 (ja) * 2013-03-11 2016-03-15 株式会社ミウラ 顎変形症術後顔貌予測方法及びシステム
US9808326B2 (en) * 2014-03-18 2017-11-07 President And Fellows Of Harvard College 3D dentofacial system and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004098379A2 (en) * 2003-05-02 2004-11-18 Orametrix, Inc. Method and system for integrated orthodontic treatment planning using unified workstation
US20100145898A1 (en) * 2007-04-18 2010-06-10 Katja Malfliet Computer-assisted creation of a custom tooth set-up using facial analysis
US20120327196A1 (en) * 2010-05-24 2012-12-27 Sony Computer Entertainment Inc. Image Processing Apparatus, Image Processing Method, and Image Communication System
CN103445875A (zh) * 2012-05-15 2013-12-18 株式会社电装 用于支持牙科植入手术的方法及设备
US20140362091A1 (en) * 2013-06-07 2014-12-11 Ecole Polytechnique Federale De Lausanne Online modeling for real-time facial animation
WO2015123759A1 (en) * 2014-02-21 2015-08-27 Trispera Dental Inc. Augmented reality dental design method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113164237A (zh) * 2019-01-30 2021-07-23 登士柏希罗纳有限公司 用于提议和可视化牙科治疗的方法和***

Also Published As

Publication number Publication date
CN108289722B (zh) 2021-08-27
WO2017085160A1 (de) 2017-05-26
JP2018534050A (ja) 2018-11-22
EP3376989A1 (de) 2018-09-26
DE102015222782A1 (de) 2017-05-18
JP6857178B2 (ja) 2021-04-14
US10980422B2 (en) 2021-04-20
US20180249912A1 (en) 2018-09-06

Similar Documents

Publication Publication Date Title
CN108289722A (zh) 用于观测牙齿情况的方法
US11559377B2 (en) Augmented reality enhancements for dental practitioners
US11735306B2 (en) Method, system and computer readable storage media for creating three-dimensional dental restorations from two dimensional sketches
CN109414306B (zh) 用于口内扫描的历史扫描参考
ES2724115T3 (es) Interfaz gráfica de usuario para el marcado de márgenes asistido por ordenador sobre dentaduras
CN115884727A (zh) 用于口内扫描仪的智能扫描
US20230068727A1 (en) Intraoral scanner real time and post scan visualizations
CN112469358B (zh) 用于分析牙齿状况的方法
US11915378B2 (en) Method and system for proposing and visualizing dental treatments
CN112469359B (zh) 用于分析牙齿状况的方法
JP2005349176A (ja) 顎運動解析方法及び顎運動解析システム
CN104603859A (zh) 牙科补缀及赝复体数字建档与制作的方法及其教学训练
US11790532B2 (en) Method for cutting a model of a dental arch
US11488305B2 (en) Segmentation device
KR102612679B1 (ko) 구강 스캐너의 스캔 이미지 처리 방법, 그 장치 및 그 명령을 기록한 기록 매체
US20210386512A1 (en) Method Tool And Method Of Operating A Machine Tool
WO2023028339A1 (en) Intraoral scanner real time and post scan visualizations

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant