TWI771761B - Method and device for processing medical image - Google Patents
Method and device for processing medical image Download PDFInfo
- Publication number
- TWI771761B TWI771761B TW109133391A TW109133391A TWI771761B TW I771761 B TWI771761 B TW I771761B TW 109133391 A TW109133391 A TW 109133391A TW 109133391 A TW109133391 A TW 109133391A TW I771761 B TWI771761 B TW I771761B
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- recorded
- image processing
- similar
- images
- Prior art date
Links
Images
Landscapes
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
Description
本發明為一種影像處理技術,特別是指一種可以從複數張紀錄圖像中比對並校正出與目標圖像近似的相似圖像的醫療影像處理方法及其醫療影像處理裝置。The present invention relates to an image processing technology, in particular to a medical image processing method and a medical image processing device which can compare and correct similar images similar to target images from a plurality of recorded images.
隨著科技的進步,各種影像醫療檢測儀器,例如:使用超音波掃瞄、核磁共振掃瞄(Magnetic Resonance Imaging,MRI)、正子斷層掃描(Positron Emission Tomography,PET)、電腦斷層掃描(Computed Tomography,CT)、***攝影與X光攝影等器材,產生檢測影像。這類影像可用於診斷某些疾病,也可提供醫學研究。With the advancement of science and technology, various imaging medical testing instruments, such as ultrasonic scanning, MRI (Magnetic Resonance Imaging, MRI), Positron Emission Tomography (PET), Computed Tomography (Computed Tomography, CT), mammography and X-ray photography and other equipment to generate detection images. Such images can be used to diagnose certain diseases and also provide medical research.
檢測影像的儲存與傳輸,基本上都是遵循醫療數位影像傳輸協定(Digital Imaging and Communications in Medicine, DICOM)國際醫療影像的標準,其係為應用在醫學影像處理、儲存、列印、傳輸上的標準協定。它包含了檔案格式的定義及網路通信協定。DICOM是以TCP/IP為基礎的應用協定,並以TCP/IP聯繫各個系統。兩個能接受DICOM格式的醫療儀器間,可藉由DICOM格式的檔案,來接收與交換影像及病人資料。The storage and transmission of inspection images basically follow the International Medical Imaging Standard of Digital Imaging and Communications in Medicine (DICOM), which is used in medical image processing, storage, printing, and transmission. Standard agreement. It contains definitions of file formats and network communication protocols. DICOM is an application protocol based on TCP/IP, and uses TCP/IP to communicate with each system. Between two medical instruments that can accept DICOM format, images and patient data can be received and exchanged through DICOM format files.
透過DICOM的影像傳輸協定,使用者可以隨時取得即時與過去檢查所儲存的歷史影像資料,透過適當的觀察與比對可以找出差異之處,進而判斷病人的生理狀態。然在習用技術中,一般醫療人員在取得病人的相關檢測影像之後,通常都是仰賴醫療人員的經驗,透過人眼視覺的方式將過去的影像與現在的影像進行判斷,這種診斷方式容易隨著醫療人員的經驗而定,而且很容易有誤判情形發生。 Through the DICOM image transmission protocol, users can obtain the historical image data stored in real-time and past examinations at any time. Through appropriate observation and comparison, differences can be found, and then the patient's physiological state can be judged. However, in the conventional technology, after obtaining the relevant detection images of the patient, the general medical personnel usually rely on the experience of the medical personnel to judge the past images and the current images through human vision. This diagnosis method is easy to follow. It depends on the experience of the medical staff, and misjudgment is prone to occur.
另一方面,舉例來說,同一待測者,在不同時間點會有胖瘦等體型改變的形況,或者不同機台檢測產生的醫療影像可能會有角度偏差的現象,導致醫療人員檢視前後影像時不容易找到欲比對的圖像,甚至因為視角不同,而難以精確且即時地比對出差異之處。 On the other hand, for example, the same subject may change in body shape such as fat or thin at different time points, or the medical images generated by different machines may have angular deviations, causing medical personnel to inspect before and after inspections. When imaging, it is not easy to find the images to be compared, and even because of different viewing angles, it is difficult to accurately and instantly compare the differences.
綜合上述,因此需要一種醫療影像處理方法及其醫療影像處理裝置來解決習用技術的不足,提升醫療影像比對的效率與降低誤判的情況。 In view of the above, a medical image processing method and a medical image processing device are needed to solve the deficiencies of conventional techniques, improve the efficiency of medical image comparison and reduce misjudgment.
本發明為一種可以進行醫療影像處理的技術,藉由影像輸入端接收檢測裝置的檢測影像,透過影像處理機制由過去之紀錄圖像中選取和檢測圖像最近似的紀錄圖像,並加以處理以產生能和檢測影像進行比較、疊合等程序的相似圖像,並自動產生比較資訊,解決習用技術中,使用者透過視覺比較時的不便利性以及容易產生誤判的問題。其中,於產生相似圖像時,本發明更提供一種藉由內插演算將複數張紀錄圖像內插形成相似圖像,免除了習用透過全3D建模,再進行切片的耗時取像程序,達到提升運算快速的效果。 The present invention is a technology that can perform medical image processing. The image input terminal receives the detection image of the detection device, and through the image processing mechanism, the recorded image that is most similar to the detected image is selected from the past recorded images and processed. To generate similar images that can be compared and superimposed with the detected images, and automatically generate comparison information, it solves the problems of inconvenience and easy misjudgment by users in the conventional technology when comparing visually. Among them, when generating similar images, the present invention further provides a method of interpolating a plurality of recorded images to form similar images by interpolation, which avoids the conventional time-consuming imaging procedure of slicing through full 3D modeling. , to achieve the effect of improving the speed of operation.
在一實施例中,本發明提供一種醫療影像處理方法,包括有以下步驟,首先,接收待測者的檢測圖像。接著,接收待測者的複數個紀錄圖像。之後,再比對檢測圖像與該些紀錄圖像,以從該些紀錄圖像中選擇至少一與檢測圖像相近的紀錄圖像。接著調整至少一紀錄圖像,以產生相似圖像。最後,比對檢測圖像與相似圖像,以判斷取得至少一差異部位。In one embodiment, the present invention provides a medical image processing method, which includes the following steps. First, a detection image of a subject to be tested is received. Next, a plurality of recorded images of the subject is received. Afterwards, the detected image and the recorded images are compared to select at least one recorded image similar to the detected image from the recorded images. Then at least one recorded image is adjusted to generate a similar image. Finally, the detected image and the similar image are compared to determine that at least one different part is obtained.
在另一實施例中,本發明提供一種醫療影像處理裝置,包括有影像處理單元以及第一影像輸出單元。影像處理單元電性連接儲存有複數張紀錄圖像的資料庫,並用以接收複數張記錄圖像與來自影像產生裝置的檢測圖像,其中影像處理單元於檢測圖像上偵測複數個第一區別特徵點,以及分別對複數張紀錄圖像偵測複數個第二區別特徵點,並將檢測圖像的複數個第一區別特徵點分別與複數張紀錄圖像中的第二區別特徵點進行比對,以由複數張紀錄圖像中判斷並選擇至少一與該檢測圖像近似的紀錄圖像,其中影像處理單元對該至少一紀錄圖像調整以產生相似圖像。第一影像輸出單元電性連接影像處理單元,用以輸出相似圖像。In another embodiment, the present invention provides a medical image processing device, which includes an image processing unit and a first image output unit. The image processing unit is electrically connected to a database storing a plurality of recorded images, and is used for receiving a plurality of recorded images and a detection image from the image generating device, wherein the image processing unit detects a plurality of first images on the detection image Distinguishing feature points, and respectively detecting a plurality of second distinguishing feature points on a plurality of recorded images, and performing a comparison between the plurality of first distinguishing feature points in the detected images and the second distinguishing feature points in the plurality of recorded images respectively. The comparison is to determine and select at least one recorded image that is similar to the detected image from the plurality of recorded images, wherein the image processing unit adjusts the at least one recorded image to generate a similar image. The first image output unit is electrically connected to the image processing unit for outputting similar images.
在下文將參考隨附圖式,可更充分地描述各種例示性實施例,在隨附圖式中展示一些例示性實施例。然而,本發明概念可能以許多不同形式來體現,且不應解釋為限於本文中所闡述之例示性實施例。確切而言,提供此等例示性實施例使得本發明將為詳盡且完整,且將向熟習此項技術者充分傳達本發明概念的範疇。類似數字始終指示類似元件。以下將以多種實施例配合圖式來說明醫療影像處理方法及其醫療影像處理裝置,然而,下述實施例並非用以限制本發明。Various illustrative embodiments may be described more fully hereinafter with reference to the accompanying drawings, in which some illustrative embodiments are shown. However, the inventive concepts may be embodied in many different forms and should not be construed as limited to the exemplary embodiments set forth herein. Rather, these illustrative embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the inventive concept to those skilled in the art. Similar numbers always indicate similar elements. The medical image processing method and the medical image processing apparatus thereof will be described below with various embodiments in conjunction with the drawings. However, the following embodiments are not intended to limit the present invention.
首先,請參閱圖1與圖2所示,其中圖1為本發明之醫療影像處理方法之一實施例流程示意圖;圖2為本發明之實現影像擷取手段的醫療影像處理裝置實施例示意圖。醫療影像處理方法2在步驟20中,首先影像產生裝置4接收待測者的檢測圖像。輸出檢測圖像的影像產生裝置4可以為各種醫療檢測設備,例如:超音波掃瞄裝置、核磁共振掃瞄(Magnetic Resonance Imaging,MRI)、正子斷層掃描(Positron Emission Tomography,PET)、電腦斷層掃描(Computed Tomography,CT)、***攝影與X光攝影裝置等。檢測圖像可以為一張或多張的靜態圖像,也可以為連續動態的檢測影像或者是檢測影像中之一張或多張的靜態影像,並無一定限制。在一實施例中,當影像產生裝置4產生關於待測者(例如為受檢者的其中一身體部位)的檢測影像之後,從檢測影像中選取其中之一檢測圖像。藉由影像擷取手段取得檢測影像中的其中之一檢測圖像用來進行後續的比對。在另一實施例中,影像擷取手段是藉由圖2所示的醫療影像處理裝置3來進行,醫療影像處理裝置3包括有圖像擷取單元30、影像處理單元31以及第一影像輸出單元32。其中,圖像擷取單元30,與影像產生裝置4耦接,用以接收影像產生裝置4所輸出的檢測影像,並從檢測影像中擷取出檢測圖像。First, please refer to FIG. 1 and FIG. 2 , wherein FIG. 1 is a schematic flowchart of an embodiment of a medical image processing method of the present invention; FIG. 2 is a schematic diagram of an embodiment of a medical image processing apparatus implementing image capture means of the present invention. In
接著,在步驟21中,從資料庫中取得關於待測者的複數張紀錄圖像,此為儲存於資料庫的過去檢測紀錄圖像,主要用來與檢測圖像進行比對。在本實施例中,醫療影像處理裝置3藉由網路連接單元36,和醫療影像儲傳系統(Picture Archiving and Communication System, PACS)中的雲端伺服器5以及影像處理單元31電性連接。雲端伺服器5內具有資料庫,內存有影像產生裝置4對每個待測者在檢測過程中產生的所有檢測圖像紀錄;另一方面,也會儲存同一待測者,在不同時間點進行檢測的醫療影像紀錄。醫療影像處理裝置3藉由特定的通訊協定以從資料庫50取得該複數張紀錄圖像。在一實施例中,通訊協定可以為醫療數位影像傳輸協定(DICOM)。Next, in
之後,進行步驟22,將檢測圖像與該些紀錄圖像進行比對,以從該些紀錄圖像中選擇與該檢測圖像相近的紀錄圖像。本步驟的比對方式說明如下,如圖1B所示,首先進行步驟220在檢測圖像9上偵測出複數個第一區別特徵點。請同時參閱圖3A,該圖為本發明之檢測圖像的一實施例示意圖,在檢測圖像9中,C0代表第一區別特徵點,其係可以藉由影像處理單元31執行演算法在檢測圖像9上自動定義產生。前述的演算法,在一實施例中,可以為尺度不變特徵轉換演算法(Scale-invariant feature transform, SIFT),但不以此為限制,例如:加速穩健特徵(Speed-Up Robust Feature, SURF)等亦可實施,其為本領域具有通常知識之人所熟知,在此不做贅述。After that, go to
在檢測圖像9偵測複數個第一區別特徵點C0之後,接下來進行步驟221,分別對儲存於資料庫中的複數張紀錄圖像偵測出複數個第二區別特徵點。在本實施例中,醫療影像處理裝置3藉由網路連接單元36,和醫療影像儲傳系統(Picture Archiving and Communication System, PACS)中的雲端伺服器5以及影像處理單元31電性連接。雲端伺服器5內具有資料庫,內存有影像產生裝置4在檢測過程中所產生的檢測影像紀錄。醫療影像處理裝置3藉由特定的通訊協定以從資料庫50取得該複數張紀錄圖像。在一實施例中,通訊協定可以為醫療數位影像傳輸協定(DICOM)。請參閱圖3B,該圖為本發明之複數張紀錄圖像示意圖。在一實施例中,圖3B所示的複數張紀錄圖像9a~9f代表同一受檢者過往在某一次檢查的影像紀錄,每一張紀錄圖像9a~9f代表特定器官上不同掃描層的檢測圖像。步驟221中,也是利用演算法,本實施例為SIFT演算法,在每一張紀錄圖像9a~9f上偵測並產生複數個第二區別特徵點C1~C6,然不以此為限。After the
接下來進行步驟222,將檢測圖像9的複數個第一區別特徵點C0分別與該複數張紀錄圖像9a~9f中的第二區別特徵點C1~C6進行比對,以由複數張紀錄圖像9a~9f中決定出與檢測圖像9最近似的相似圖像。步驟222的一實施例中,透過演算法,例如:SIFT或SURF演算法,本實施例為SIFT演算法,將檢測圖像9與每一張紀錄圖像9a~9f進行演算,也就是每一張紀錄圖像9a~9f所分別具有的第二區別特徵點C1~C6和檢測圖像9所具有的第一區別特徵點C0進行特徵點匹配,並藉由SIFT演算得到每一張紀錄圖像9a~9f相對於檢測圖像的相似濃度,相似濃度越高代表相匹配(match)的第一與第二特徵點數量越多。例如,在圖3B中,以紀錄圖像 9e單張所具有的相似濃度最高,因此經過步驟222的演算之後,以紀錄圖像9e為最相近的紀錄圖像。Next,
再回到圖1A,步驟22之後取得了與檢測圖像最接近的紀錄圖像9e之後,進行步驟23,調整紀錄圖像的輪廓、方位或比例,以產生相似圖像。在本步驟的一實施例中,調整程序主要是將前述比對找出最相近的紀錄圖像進行調整演算,以得到與檢測圖像相同視角方位、輪廓或比例的相似圖像。在一實施例中,經過步驟22所得的紀錄圖像,可能會與檢測圖像之間具有視角方位、輪廓或比例上的差異,例如可能是圖3C所示的狀態。因此透過步驟23的調整程序可以將相似圖像透過調整演算予以修正。在一實施例中,如圖3C與3D所示,其中圖3C的紀錄圖像經過步驟23的演算之後,得到如圖3D所示的圖像狀態。步驟23的演算方式主要藉由步驟22所得到的紀錄圖像9e上的至少四個以上相似的第二特徵點CS1~CS4,產生轉置矩陣,此轉置矩陣可將圖像做出空間(x,y,z)的調整,使得紀錄圖像9e經由轉置矩陣的轉換而變成與檢測圖像9相同視角方位、輪廓或比例的相似圖像9se。從圖3D的相似圖像9se可以看出與圖3A所示的檢測圖像9,有相近的視角。要說明的是,調整之演算法,屬習用之技術,在此不做贅述。Returning to FIG. 1A , after the recorded
接著,回到圖1A,在步驟23得到了最相近於檢測圖像的相似圖像之後,進一步進行步驟24,比對檢測圖像與相似圖像,以判斷取得至少一差異部位。在步驟24的一實施例中,可以分別對相似圖像與檢測圖像以相同比例的方式疊加比例尺在相似圖像與檢測圖像上,以方便使用者識別,如圖3E的第(a)~(b)圖所示,單位長度具有特定數量的像素,例如:圖3E中為100像素(pxls),但不以此為限制。在步驟24的另一實施例中,如圖3E的第(c)圖所示,其中相似圖像9se與檢測圖像9進行演算,僅單獨突顯出兩張圖像有差異區域900的差異圖像9x,以便使用者參考。或者可以進一步,如圖3E的第(d)圖所示,將差異圖像9x與檢測圖像9相互疊合以產生疊合圖像9’,並在檢測圖像上框出和相似圖像差異區域900的位置,突顯不同地方以方便使用者進行參考。Next, returning to FIG. 1A , after obtaining a similar image most similar to the detected image in
要說明的是,比對檢測圖像與資料庫中所儲存的紀錄圖像的過程中,可能有兩種情況,第一種為前述之以整張檢測圖像以及紀錄圖像的相似濃度進行比較,以挑選出與檢測圖樣相似濃度最高的單張紀錄圖像。第二種情況可能比對出一或兩張以上的紀錄圖像與檢測圖像最為相關,以下就第二種情況的實施例,進行說明。It should be noted that, in the process of comparing the detected image with the recorded image stored in the database, there may be two situations. The first is to use the similar density of the entire detected image and the recorded image as mentioned above. Compare to select the single recorded image with the highest density similar to the detection pattern. In the second case, it is possible to compare one or more than two recorded images that are most relevant to the detection image. The following describes the embodiment of the second case.
如圖4A至圖4C所示,其中圖4A為本發明之醫療影像處理方法之另一實施例流程示意圖,圖4B為演算產生複數張相似的紀錄圖像之一實施例流程示意圖,圖4C為產生相似圖像之一實施例流程示意圖。圖4A所示的醫療影像處理方法2a在步驟20a~21a的方式與前述步驟20~21的方式相同,於此不做贅述。本實施例中的步驟22a中,如圖4B所示,更進一步包括有於檢測圖像與紀錄圖像中定義比較區域,並比對檢測圖像與該些紀錄圖像,以從該些紀錄圖像中選擇至少一與檢測圖像相近的紀錄圖像。在一實施例中,步驟22a可以更進一步包括步驟220a,將檢測圖像9(如圖5A所示)與每一張紀錄圖像9a~9f(如圖5B所示)分別定義成複數個區域,在本實施例中,係由影像的長寬中心劃分四個區域以形成四個象限,其中在檢測影像9定義成四個第一比較區域90~93,第一象限為第一比較區域90,第二象限為第一比較區域91,第三象限為第一比較區域92,第四象限為第一比較區域93。而紀錄圖像9a~9f則分別定義與第一比較區域90~93相對應的複數個第二比較區域90a~93a至90f~93f,其中第一象限為第二比較區域90a~90f,第二象限為第二比較區域91a~91f,第三象限為第二比較區域92a~92f,第四象限為第二比較區域93a~93f。As shown in FIGS. 4A to 4C , wherein FIG. 4A is a schematic flowchart of another embodiment of the medical image processing method of the present invention, FIG. 4B is a schematic flowchart of an embodiment of calculating and generating a plurality of similar recorded images, and FIG. 4C is A schematic diagram of the process flow of an embodiment of generating similar images. In the medical
然後進行步驟221a,將每一第一比較區域90~93的第一區別特徵點C0與每一張紀錄圖像9a~9f中相對應的第二比較區域90a~93a至90f~93f所具有的第二區別特徵點C1~C6進行演算。在步驟221a的一實施例中,透過SIFT演算法將檢測圖像9的每一個第一比較區域90~93與每一張紀錄圖像9a~9f所具有的相對應第二比較區域90a~93a至90f~93f進行演算,演算過程中每一張紀錄圖像9a~9f在每一個第二比較區90a~93a至90f~93f所分別具有的第二區別特徵點C1~C6和相對應第一比較區90~93的第一區別特徵點C0透過演算,可以得到每一個第二比較區域90a~93a至90f~93f的相似濃度,亦即代表每一張紀錄圖像9a~9f的第二比較區域90a~93a至90f~93f與檢測圖像9中相對應的第一比較區90~93的相似程度。Then proceed to step 221a, and compare the first distinguishing feature point C0 of each first comparison area 90-93 with the corresponding
接著進行步驟222a根據每一張紀錄圖像9a~9f中的第二比較區90a~93a至90f~93f所具有的演算結果決定出與檢測圖像9最近似的至少一張紀錄圖像。步驟222a的結果有兩種態樣,第一種態樣為經過演算之後,具有最高濃度的四個象限的第二比較區域都是出現在同一張紀錄圖像;第二種態樣,為本實施例主要介紹的特徵,就是具有最高濃度的象限,是分布在不同的紀錄圖像上,以下進行詳細說明。如圖4A所示,步驟22a之後,進行步驟23a調整至少一紀錄圖像的輪廓、方位或比例,以產生相似圖像。如圖4C所示,在步驟23a的調整程序中,首先以步驟230a判斷所有相似濃度最高第二比較區域的是否都出現在同一張紀錄圖像。在一實施例中,如圖5C所示,圖中每一張紀錄圖像9a~9f都具有一相似濃度值M(M
90a ~90f, M
91a ~91f, M
92a ~92f, M
93a ~93f),其係分別由對應四個第二比較區域90a~93a至90f~93f的相似濃度值所構成,從圖5C的示意圖可以看出紀錄圖像9d的每一個第二比較區域90d~93d的相似濃度為M(9, 8, 9, 8)都是最高,因此會進行步驟231a以所有比較區域都具有最高相似濃度的紀錄圖像9d作為最相近的紀錄圖像。之後進行步驟232a的調整程序,例如可為圖像視角的調整,主要是將步驟231a的最相近於檢測圖像的紀錄圖像進行調整演算,以得到與檢測圖像相同視角方位、輪廓或比例的相似圖像。在一實施例中,經過步驟231a的紀錄圖像可能會與檢測圖像之間具有視角方位、輪廓或比例上的差異,例如圖3C所示的狀態。因此透過步驟232a的調整程序可以將相似圖像透過調整演算予以修正,得到如圖3D所示的圖像狀態。調整之演算法,屬習用之技術,在此不做贅述。
Next,
在另一實施例中,如圖5D所示,可以清楚看到相似濃度M發生在不同的紀錄圖像上。本實施例中,紀錄圖像9d的第二比較區域90d~93d所分別具有的相似濃度為M(8, 7, 6, 9),其中在第二比較區域90d與93d具有較高的相似濃度,而紀錄圖像9e的第二比較區域90e~93e所具有的相似濃度M(7, 8, 9, 6),其中在第二比較區域91e與92e則具有較高的相似濃度。在這種情況下,由於並沒有單張紀錄圖像與檢測圖像9最相似,因此步驟231a之後,會進行步驟233a,將具有較高相似濃度的圖像藉由內插演算以產生相似圖像。在本步驟中,內插演算有很多種方式,例如在一實施例中,將圖5D中的紀錄圖像9d每一個位置的像素(x, y)所具有的特徵值,例如:灰階值、亮度值或對比度值等,與紀錄圖像9e中相對應的像素(x, y)所具有的特徵值相加除以二所得的特徵值作為像素(x,y)新的灰階值。兩張紀錄圖像的相對應像素經過演算之後所得的新的圖像即為相似圖像。In another embodiment, as shown in Figure 5D, it can be clearly seen that similar concentrations M occur on different recorded images. In this embodiment, the similar concentrations of the
除了前述將兩紀錄圖像的特徵值相加除以二來決定相似圖像的方式之外,在步驟233a另一演算的實施例中,可以透過對該紀錄圖像9d與紀錄圖像9e中每一個第二比較區域90d~93d與90e~93e定義一權重值,其中具有較多第二區別特徵點匹配數量的第二比較區域具有較大的權重值。然後將紀錄圖像9d與紀錄圖像9e中每一個第二比較區域90d~93d與90e~93e內的像素所具有的像素特徵值根據其所具有的權重值進行演算,以得到相似圖像。以下說明上述的演算方式。In addition to the aforementioned method of adding and dividing the feature values of the two recorded images by two to determine similar images, in another embodiment of the calculation in
如圖6A與6B所示,假設兩張分別具有比較高相似濃度的第二比較區域的紀錄圖像為圖5D所示的紀錄圖像9d與9e。在紀錄圖像9d第二比較區域90d與第二比較區域93d,也就是在正X軸向上延著Y軸向的兩個第二比較區域90d與93d相似濃度高於紀錄圖像9e的相對應第二比較區域90e與93e,而紀錄圖像9e在第二比較區域91e與第二比較區域92e,也就是在負X軸向上延著Y軸向的兩個第二比較區域91e與92e相似濃度高於紀錄圖像9d的相對應第二比較區域91d與92d。As shown in FIGS. 6A and 6B , it is assumed that the two recorded images of the second comparison area having relatively high similar density respectively are the recorded
在上述的情況下,如圖6B所示,由於相似濃度高的分別在紀錄圖像9d的右半部與紀錄圖像9e的左半部的第二比較區域,演算時是用左半部與右半部權重分配來調整,因此權重的決定是以和Y軸之間的距離x來決定。根據前述法則,各個象限的第二比較區域所具有的權重分布如下:
要說明的是,前述所舉的例子,為分別在正X軸向或負X軸向的Y軸向上的兩第二比較區域具有高相似濃度的演算式。在另一實施例中,如圖6E與6F所示,在本實施例中,相似濃度高的第二比較區域位於紀錄圖像9d中的正Y軸與正負X軸向上的兩第二比較區域90d與91d,以及紀錄圖像9e負Y軸與正負X軸向上的兩的比較區域92e與93e具有高相似濃度。由於相似濃度高的分別在紀錄圖像9d的上半部與紀錄圖像9e的下半部的第二比較區域,演算時是用上半部與下半部權重分配來調整,因此權重的決定是以和X軸之間的距離y來決定。根據前述法則,各個象限的第二比較區域所具有的權重分布如下因此其權重關係式如下:
如果單一紀錄圖像具有三個的相似濃度比較高的情況下,如圖6H所示,在本實施例中,紀錄圖像9d的第二比較區域90d~92d具有較高的相似濃度,而紀錄圖像9e中的第二比較區域93e具有高相似濃度,因此其權重關係式如下:
再回到圖4C,透過步驟233a取得相似圖像之後,進行步驟234a的視角方位、輪廓或比例調整程序。本步驟中,主要是將步驟233a的相似圖像與檢測圖像進行調整演算得到與檢測圖像相同視角方位、輪廓或比例的相似圖像。在一實施例中,經過步驟233a所得的相似圖像,可能會與檢測圖像之間具有視角方位、輪廓或比例上的差異,例如圖3C所示的狀態。因此透過步驟234a的視角方位、輪廓或比例調整程序可以將相似圖像透過調整演算予以修正,得到如圖3D所示的圖像狀態。調整之演算法,屬習用之技術,在此不做贅述。最後,進行步驟24a比對檢測圖像與相似圖像,以判斷取得至少一差異部位(如圖3E)。本步驟的程序如前述步驟24所述,在此不做贅述。Returning to FIG. 4C , after obtaining the similar image through
請參閱圖7所示,該圖為本發明之醫療影像處理裝置之一實施例架構示意圖。本實施例中的醫療影像處理裝置3包括有圖像擷取單元30、影像處理單元31以及第一影像輸出單元32。本實施例中的圖像擷取單元30藉由類比數位轉換單元(analog-to-digital converter, ADC)37耦接影像產生裝置4,圖像擷取單元30接收影像產生裝置4輸出的檢測影像,並從檢測影像中擷取檢測圖像。本實施例中,圖像擷取單元30為FPGA元件,用以進行影像的相關演算。影像產生裝置4可以為超音波掃瞄裝置、核磁共振掃瞄(Magnetic Resonance Imaging,MRI)、正子斷層掃描(Positron Emission Tomography,PET)、電腦斷層掃描(Computed Tomography,CT)、***攝影或者是X光攝影裝置。本實施例中的影像產生裝置4包括有檢測裝置40、與檢測裝置40電性連接的運算主機41以及與運算主機 41電性連接的第二顯示裝置42。Please refer to FIG. 7 , which is a schematic structural diagram of an embodiment of the medical image processing apparatus of the present invention. The medical
影像處理單元31電性連接影像擷取單元30用以接收圖像擷取單元30輸出的檢測圖像。影像處理單元31更藉由網路介面36與網路100連接,並透過網路100與雲端伺服器5連接。雲端伺服器5內具有資料庫50,其儲存有複數張紀錄圖像。前述的紀錄圖像為病人透過影像產生裝置4進行檢測時所留下的影像紀錄。醫療影像處理裝置3從資料庫50取得複數張紀錄圖像,並傳送至影像處理單元31進行後續演算的處理。影像處理單元31可以為具有運算處理能力的系統晶片(system on silicon, SOC)。本實施例中,影像處理單元31用以執行如圖1A~圖1B、圖4A至4C的演算流程,其係如前所述,於此不作贅述。圖像擷取單元30與影像處理單元31也耦接有記憶體單元38,例如:快閃記憶體、動態隨機存取記憶體或前述的組合等。第一影像輸出單元32與影像處理單元31以及第一顯示裝置39電性連接,第一影像輸出單元32用以輸出經過演算後的圖像給第一顯示裝置39進行顯示。The
醫療影像處理裝置3更包括輸入介面單元33,電性連接影像處理單元31與輸入裝置34,例如:鍵盤、滑鼠、軌跡球或者是觸控面板等。輸入介面單元33接收輸入裝置34所輸入的輸入訊號,用以控制影像處理單元31輸出圖像的模式,例如圖7(a)~(d)所示。此外,在另一實施例中,醫療影像處理裝置3更包括第二影像輸出單元35,電性連接影像擷取單元30,用以將影像回傳給圖像產生裝置4的運算主機41。運算主機 41可以將回傳的影像經由第二顯示裝置42輸出。要說明的是,由醫療影像處理裝置3回傳給運算主機 41的圖像可以為檢測影像、記錄圖像、檢測圖像、相似圖像、或者是相似圖像與檢測圖像進行比較處理的程序之後所得到的相減圖像或疊加圖像等,使得圖像產生裝置4也可以顯示出經由醫療影像處理裝置3所處理的圖像,幫助檢測者進行即時判斷。The medical
綜合上述,本發明藉由實施例說明了將檢測裝置產生的檢測影像,透過影像比對機制將檢測影像中的圖像與過去的紀錄圖像進行比較,再由過去之紀錄圖像中選取或內插演算得到相近圖像,進而可以和檢測圖像進行比較、疊合或相減等程序,產生新的圖像資訊給使用者進行醫療判斷上的參考。藉由前述自動比較的方式,可以解決習用技術中,使用者透過視覺比較時的不便利性以及容易產生誤判的問題。此外,本發明的實施例更進一步說明了內插演算得到的相近圖像的演算機制,解決以往透過全3D建模再進行切片得到相似圖像的演算效率問題,達到運算快速的效果。To sum up the above, the present invention describes the detection image generated by the detection device through the embodiment, compares the image in the detection image with the past recorded image through the image comparison mechanism, and then selects or selects from the past recorded image. The similar images are obtained by interpolation, and then the detected images can be compared, superimposed or subtracted to generate new image information for the user to make reference for medical judgment. The aforementioned automatic comparison method can solve the problems of inconvenience and easy misjudgment of users when comparing through visual inspection in the conventional technology. In addition, the embodiments of the present invention further describe the calculation mechanism of similar images obtained by interpolation, solve the problem of calculation efficiency of obtaining similar images by slicing through full 3D modeling in the past, and achieve the effect of fast calculation.
以上所述,乃僅記載本發明為呈現解決問題所採用的技術手段之較佳實施方式或實施例而已,並非用來限定本發明專利實施之範圍。即凡與本發明專利申請範圍文義相符,或依本發明專利範圍所做的均等變化與修飾,皆為本發明專利範圍所涵蓋。The above descriptions are merely for describing the preferred embodiments or examples of the technical means adopted by the present invention to solve the problems, and are not intended to limit the scope of the patent implementation of the present invention. That is, all the equivalent changes and modifications that are consistent with the context of the scope of the patent application of the present invention, or made in accordance with the scope of the patent of the present invention, are all covered by the scope of the patent of the present invention.
2、2a:醫療影像處理方法
20~24:步驟
20a~24a:步驟
220~222:步驟
220a~222a:步驟
230a~233a:步驟
3:醫療影像處理裝置
30:圖像擷取單元
31:影像處理單元
32:第一影像輸出單元
33:輸入介面單元
34:輸入裝置
35:第二影像輸出單元
36:網路連接單元
37:類比數位轉換單元
38:記憶體單元
39:第一顯示裝置
4:影像產生裝置
40:檢測裝置
41:運算主機
42:第二顯示裝置
5:雲端伺服器
50:資料庫
9:檢測圖像
9a~9f:紀錄圖像
9s:相似圖像
9’:疊合圖像
9sc:90~93:第一比較區域
90a~93f:第二比較區域
90sc:模擬圖像
900:差異區域
100:網路
C0:第一區別特徵點
C1~C6:第二區別特徵點
Pd、Pe:像素2. 2a: Medical
圖1A為本發明之醫療影像處理方法之一實施例流程示意圖。 圖1B為本發明之比對檢測圖像與紀錄圖像之一實施例流程示意圖。 圖2為本發明之醫療影像處理裝置之一實施例示意圖。 圖3A為本發明之檢測圖像的一實施例示意圖。 圖3B為本發明之複數張紀錄圖像示意圖。 圖3C為本發明進行調整演算之前的紀錄圖像之一實施例示意圖。 圖3D為本發明進行調整演算之後產生的相似圖像之一實施例示意圖。 圖3E為對相似圖像與檢測圖像進行比較處理之一實施例示意圖。 圖4A為本發明之醫療影像處理方法之另一實施例流程示意圖。 圖4B為本發明之比對檢測圖像與紀錄圖像之另一實施例流程示意圖。 圖4C為產生相似圖像之一實施例流程示意圖。 圖5A為本發明之具有複數個比較區域的檢測圖像示意圖。 圖5B為本發明之具有複數個比較區域的紀錄圖像示意圖。 圖5C與圖5D分別為相似濃度分布示意圖。 圖6A與6B分別為在不同比較區域中具有高相似濃度之紀錄圖像示意圖。 圖6C與6D為本發明之調整演算得到相似圖像之一實施例示意圖。 圖6E至6G為本發明之調整演算得到相似圖像之另一實施例示意圖。 圖6H為本發明之調整演算得到相似圖像之又一實施例示意圖。 圖7為本發明之醫療影像處理裝置應用於醫療影像處理之一系統架構示意圖。 FIG. 1A is a schematic flowchart of an embodiment of a medical image processing method of the present invention. FIG. 1B is a schematic flow chart of an embodiment of comparing the detected image and the recorded image according to the present invention. FIG. 2 is a schematic diagram of an embodiment of the medical image processing apparatus of the present invention. FIG. 3A is a schematic diagram of an embodiment of the detection image of the present invention. FIG. 3B is a schematic diagram of a plurality of recorded images of the present invention. FIG. 3C is a schematic diagram of an embodiment of a recorded image before performing adjustment calculation in the present invention. FIG. 3D is a schematic diagram of an embodiment of a similar image generated after the adjustment calculation is performed in the present invention. FIG. 3E is a schematic diagram of an embodiment of a comparison process between a similar image and a detected image. FIG. 4A is a schematic flowchart of another embodiment of the medical image processing method of the present invention. FIG. 4B is a schematic flow chart of another embodiment of comparing the detected image and the recorded image according to the present invention. FIG. 4C is a schematic flowchart of an embodiment of generating a similar image. 5A is a schematic diagram of a detection image having a plurality of comparison regions according to the present invention. FIG. 5B is a schematic diagram of a recorded image having a plurality of comparison regions according to the present invention. 5C and 5D are schematic diagrams of similar concentration distributions, respectively. 6A and 6B are schematic diagrams of recorded images with high similar concentrations in different comparison regions, respectively. 6C and 6D are schematic diagrams of an embodiment of the similar images obtained by the adjustment calculation of the present invention. 6E to 6G are schematic diagrams of another embodiment of the similar images obtained by the adjustment calculation of the present invention. FIG. 6H is a schematic diagram of another embodiment of the similar image obtained by the adjustment calculation of the present invention. FIG. 7 is a schematic diagram of a system structure of the medical image processing apparatus of the present invention applied to medical image processing.
2:醫療影像處理方法 2: Medical Image Processing Methods
20~24:步驟 20~24: Steps
Claims (19)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109133391A TWI771761B (en) | 2020-09-25 | 2020-09-25 | Method and device for processing medical image |
CN202110951168.0A CN114267433A (en) | 2020-09-25 | 2021-08-18 | Medical image processing method and medical image processing device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109133391A TWI771761B (en) | 2020-09-25 | 2020-09-25 | Method and device for processing medical image |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202213184A TW202213184A (en) | 2022-04-01 |
TWI771761B true TWI771761B (en) | 2022-07-21 |
Family
ID=80824550
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW109133391A TWI771761B (en) | 2020-09-25 | 2020-09-25 | Method and device for processing medical image |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114267433A (en) |
TW (1) | TWI771761B (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI683286B (en) * | 2019-03-21 | 2020-01-21 | 上銀科技股份有限公司 | Medical image alignment method |
TW202008163A (en) * | 2018-07-24 | 2020-02-16 | 大陸商北京市商湯科技開發有限公司 | Method, device and electronic apparatus for medical image processing and storage mdeium thereof |
TW202034346A (en) * | 2019-03-12 | 2020-09-16 | 宏碁股份有限公司 | Medical image recognizition device and medical image recognizition method |
-
2020
- 2020-09-25 TW TW109133391A patent/TWI771761B/en active
-
2021
- 2021-08-18 CN CN202110951168.0A patent/CN114267433A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW202008163A (en) * | 2018-07-24 | 2020-02-16 | 大陸商北京市商湯科技開發有限公司 | Method, device and electronic apparatus for medical image processing and storage mdeium thereof |
TW202034346A (en) * | 2019-03-12 | 2020-09-16 | 宏碁股份有限公司 | Medical image recognizition device and medical image recognizition method |
TWI683286B (en) * | 2019-03-21 | 2020-01-21 | 上銀科技股份有限公司 | Medical image alignment method |
Also Published As
Publication number | Publication date |
---|---|
TW202213184A (en) | 2022-04-01 |
CN114267433A (en) | 2022-04-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5584006B2 (en) | Projection image generation apparatus, projection image generation program, and projection image generation method | |
US10542955B2 (en) | Method and apparatus for medical image registration | |
CN101336844B (en) | Medical image processing apparatus and medical image diagnosis apparatus | |
CN107886508B (en) | Differential subtraction method and medical image processing method and system | |
US8218849B2 (en) | Method and system for automatic landmark detection using discriminative joint context | |
JP5643304B2 (en) | Computer-aided lung nodule detection system and method and chest image segmentation system and method in chest tomosynthesis imaging | |
US8497862B2 (en) | Method and apparatus for processing three dimensional images, and recording medium having a program for processing three dimensional images recorded therein | |
US20200226752A1 (en) | Apparatus and method for processing medical image | |
KR101982149B1 (en) | Method and apparatus for creating medical image using partial medical image | |
US11013495B2 (en) | Method and apparatus for registering medical images | |
US20110262015A1 (en) | Image processing apparatus, image processing method, and storage medium | |
US20080287796A1 (en) | Method and system for spine visualization in 3D medical images | |
JP2012155723A (en) | Method and apparatus for automatically generating optimal two-dimensional medical image from three-dimensional medical image | |
US20120121152A1 (en) | Method and System for Automatic View Planning for Cardiac Magnetic Resonance Imaging acquisition | |
JP2012205899A (en) | Image generating method and system of body organ using three-dimensional model and computer readable recording medium | |
US20110187707A1 (en) | System and method for virtually augmented endoscopy | |
JP5982726B2 (en) | Volume data analysis system and method | |
JP2007537811A (en) | How to detect nodules | |
WO2020027228A1 (en) | Diagnostic support system and diagnostic support method | |
Varnavas et al. | Increasing the automation of a 2D-3D registration system | |
US7689018B2 (en) | Anomaly detection in volume data structure information | |
CN113197665A (en) | Minimally invasive surgery simulation method and system based on virtual reality | |
KR20130016942A (en) | Method and apparatus for generating 3d volume panorama | |
JP5364009B2 (en) | Image generating apparatus, image generating method, and program thereof | |
JPWO2005009242A1 (en) | Medical image processing apparatus and method |