TWI613993B - Telehealth care system and method using thermal imaging - Google Patents
Telehealth care system and method using thermal imaging Download PDFInfo
- Publication number
- TWI613993B TWI613993B TW104133594A TW104133594A TWI613993B TW I613993 B TWI613993 B TW I613993B TW 104133594 A TW104133594 A TW 104133594A TW 104133594 A TW104133594 A TW 104133594A TW I613993 B TWI613993 B TW I613993B
- Authority
- TW
- Taiwan
- Prior art keywords
- temperature
- patient
- analysis module
- change rate
- respiratory
- Prior art date
Links
Landscapes
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
本發明提供一種熱成像式遠端照護系統,係與一遠端照護站電性連接並用於監控一患者之狀態,其包含紅外線熱像儀、影像處理模組及呼吸分析模組。藉由分析紅外線熱像儀所拍攝之熱影像之溫度資料,並生成呼吸曲線,以判斷患者是否發生呼吸異常事件。 The present invention provides a thermal imaging remote care system that is electrically coupled to a remote care station and used to monitor the status of a patient, including an infrared camera, an image processing module, and a respiratory analysis module. By analyzing the temperature data of the thermal image taken by the infrared camera and generating a breathing curve to determine whether the patient has a respiratory abnormality.
Description
本發明係關於一種熱成像式遠端照護系統及方法,更精確的說,本發明係為一種藉由分析紅外線熱像儀所拍攝之影像之溫度資料,以判斷患者是否發生呼吸異常事件之遠端照護系統及方法。 The present invention relates to a thermal imaging type far-end care system and method. More specifically, the present invention is a method for analyzing whether a patient has a respiratory abnormality by analyzing temperature data of an image taken by an infrared camera. End care system and method.
目前傳統的呼吸量測器多是透過裝設於鼻端的呼吸罩,藉由量測進出呼吸道氣體的方向、速率與質量,來量測呼吸次數與頻率。然而,於許多情況下,並不適宜於臉部套用鼻端呼吸罩來量測呼吸次數。諸如當臉部有嚴重外傷、使用呼吸罩會增加感染機會等情況下,使用傳統的呼吸量測器將造成許多不便。此外,目前醫院所使用的傳統呼吸量測器都過於昂貴巨大,並不能適用於居家照護的環境。 At present, the traditional respiratory measuring device measures the frequency and frequency of breathing by measuring the direction, velocity and quality of the air in and out through the respiratory mask installed at the nose. However, in many cases, it is not appropriate to apply a nasal mask to the face to measure the number of breaths. The use of a conventional ventilator will cause a lot of inconvenience, such as when there is severe trauma to the face and the use of a respiratory mask increases the chance of infection. In addition, the traditional respiratory meters currently used in hospitals are too expensive and not suitable for home care environments.
此外於醫院中,病房管理及照護病患通常是護理人員之主要工作。因此,醫護人員通常需於一定時間內巡房查看病患有無任何異狀,然而此種方式係屬被動式之巡房管理服務,當病患產生呼吸異常等需要緊急處理之情形時,醫護人員難以立即發現,抑或是發現再處理之時間將過長或過晚,因而容易錯失處置之黃金時間。 In addition, in hospitals, ward management and care of patients is often the main job of nursing staff. Therefore, medical personnel usually need to patrol the room for a certain period of time to see that the patient has no abnormalities. However, this method is a passive patrol room management service. When the patient has a respiratory abnormality and other situations that require urgent treatment, it is difficult for medical personnel. Immediate discovery, or the discovery of reprocessing time will be too long or too late, so it is easy to miss the golden time of disposal.
再者,醫護人員難以在病患睡眠時長時間紀錄呼吸異常事件之發生時間,在醫護人員已忙於照顧病患的同時,無疑是更增加了醫護人員之負擔,因此大幅降低了對各病患的醫療照護品質,且若醫護人員未將各病患之情形歸檔,醫生更難以追蹤各病患之病情。 Moreover, it is difficult for medical staff to record the time of occurrence of a respiratory abnormality when the patient sleeps. When the medical staff is busy taking care of the patient, it undoubtedly increases the burden on the medical staff, thus greatly reducing the risk for each patient. The quality of medical care, and if the medical staff does not file the situation of each patient, it is more difficult for doctors to track the condition of each patient.
目前的遠端照護系統多需要對人體各部位進行辨識,例如人體辨識或人臉辨識,因此對系統規格需求高,且亦需要耗費時間及大量系統資源對圖像進行辨識。有鑑於上述問題,急需一種能在事件發生時能自動進行偵測、進行病歷數位化並主動進行事件通知的低系統需求之遠端照護系統。 At present, the remote care system needs to identify various parts of the human body, such as human body recognition or face recognition, so the system specifications are high, and it takes time and a large amount of system resources to identify the image. In view of the above problems, there is an urgent need for a remote care system that can automatically detect when an event occurs, digitize the medical record, and proactively notify the event.
有鑑於上述問題,本發明提供一種熱成像式遠端照護系統,係與一遠端照護站電性連接並用於監控一患者之狀態,其包含紅外線熱像儀、影像處理模組及呼吸分析模組。紅外線熱像儀設置於患者之周側,其經配置以拍攝與患者相關之一興趣區域之熱影像。影像處理模組電性連接於紅外線熱像儀並接收熱影像,並將熱影像轉換為溫度資料,溫度資料定義興趣區域中溫度對位置之關係。呼吸分析模組電性連接於影像處理模組,經配置以自溫度資料中取樣溫度在預定溫度範圍之關鍵興趣區域,並判斷關鍵興趣區域中,溫度對時間之變化率之絕對值是否低於預定溫度變化率下限,若是,則呼吸分析模組產生與患者相關聯之一第一事件警報並傳送至遠端照護站。若呼吸分析模組判斷溫度對時間之變化率之絕對值高於預定溫度變化率下限,則呼吸分析模組進一步判斷溫度對時間之變化率之絕對值是否高於預定溫度變化率上限,若是,則呼吸分析模組產生與患者相關聯之一第二事件警報並傳送至遠端照護站,若否,則呼吸分析模組針對在預定溫度變化率上限及預定溫度變化率下限之間之溫度 對時間之變化進行取樣獲得呼吸曲線,並據以判斷呼吸曲線之呼吸頻率是否正常,若判定為呼吸異常,則呼吸分析模組產生與患者相關聯之第三事件警報並傳送至遠端照護站。 In view of the above problems, the present invention provides a thermal imaging remote care system electrically connected to a remote care station and used to monitor the state of a patient, including an infrared camera, an image processing module, and a respiratory analysis module. group. An infrared camera is placed on the peripheral side of the patient and is configured to capture a thermal image of an area of interest associated with the patient. The image processing module is electrically connected to the infrared camera and receives the thermal image, and converts the thermal image into temperature data, and the temperature data defines the temperature-to-position relationship in the region of interest. The respiratory analysis module is electrically connected to the image processing module and configured to sample a temperature in the key interest region of the predetermined temperature range from the temperature data, and determine whether the absolute value of the temperature to time change rate in the key interest region is lower than The lower limit of temperature change rate is predetermined, and if so, the breath analysis module generates a first event alert associated with the patient and communicates to the remote care station. If the respiratory analysis module determines that the absolute value of the temperature-to-time change rate is higher than the predetermined temperature change rate lower limit, the respiratory analysis module further determines whether the absolute value of the temperature-to-time change rate is higher than the predetermined temperature change rate upper limit, and if so, The respiratory analysis module generates a second event alarm associated with the patient and transmits to the remote care station, and if not, the respiratory analysis module is directed to a temperature between an upper limit of the predetermined temperature change rate and a lower limit of the predetermined temperature change rate. Sampling the change in time to obtain a breathing curve, and determining whether the respiratory rate of the breathing curve is normal. If it is determined that the breathing is abnormal, the respiratory analysis module generates a third event alarm associated with the patient and transmits it to the remote care station. .
較佳者,溫度對時間之變化率係為一時間區間內之溫度變化量除以時間區間,且時間區間係小於患者之呼吸頻率。 Preferably, the rate of change of temperature versus time is the amount of temperature change over a time interval divided by the time interval, and the time interval is less than the respiratory rate of the patient.
較佳者,溫度預定範圍可至少包含患者之一日內體溫變化範圍。 Preferably, the predetermined temperature range may include at least one of the range of body temperature changes of the patient within the day.
較佳者,興趣區域可包含患者之頭部,第一事件警報係為一緊急事件警報,第二事件警報係為一潛在呼吸異常警報,且第三事件警報係為一呼吸異常確認警報。 Preferably, the region of interest may include the head of the patient, the first event alert is an emergency alert, the second event alert is a potential respiratory abnormality alert, and the third event alert is a respiratory abnormality alert.
較佳者,遠端照護站可進一步包含資料庫,用於儲存第一事件警報,第二事件警報及第三事件警報之發生時間以及對應第一事件警報,第二事件警報及第三事件警報之各溫度資料。 Preferably, the remote care station may further comprise a database for storing the first event alarm, the second event alarm and the third event alarm occurrence time, and the corresponding first event alarm, the second event alarm and the third event alarm. Each temperature data.
根據本發明的另一目的,在於提供一種熱成像式遠端照護方法,係適用於前述之熱成像式遠端照護系統,方法包含下列步驟:以紅外線熱像儀拍攝與患者相關之興趣區域之熱影像;以影像處理模組接收熱影像,並將熱影像轉換為溫度資料,溫度資料定義興趣區域中溫度對位置之關係;以呼吸分析模組自溫度資料中取樣溫度在預定溫度範圍之關鍵興趣區域;配置呼吸分析模組以判斷關鍵興趣區域中,溫度對時間之變化率之絕對值是否低於預定溫度變化率下限;若呼吸分析模組判斷關鍵興趣區域中,溫度對時間之變化率之絕對值低於預定溫度變化率下限,呼吸分析模組產生與患者相關聯之第一事件警報並傳送至遠端照護站;若呼吸分析模組判斷溫度對時間之變化率之絕對值高於預定溫度變化率下限,則呼吸分析模組進一步判斷溫度對時間之變化率之絕對值是否高於預定溫度變化率上限;若呼吸分析模組判斷溫度對時間之變化率之絕對值高於預定溫度變化率上限,則呼吸分析模組產生與患者相關聯之第二事 件警報並傳送至遠端照護站;若呼吸分析模組判斷溫度對時間之變化率之絕對值低於預定溫度變化率上限,則呼吸分析模組針對在預定溫度變化率上限及預定溫度變化率下限之間之溫度對時間之變化進行取樣獲得呼吸曲線;配置呼吸分析模組以判斷呼吸曲線之呼吸頻率是否正常,若判定為呼吸異常,則呼吸分析模組產生與患者相關聯之一第三事件警報並傳送至遠端照護站。 Another object of the present invention is to provide a thermal imaging distal care method suitable for use in the aforementioned thermal imaging remote care system, the method comprising the steps of: photographing an area of interest associated with a patient with an infrared camera Thermal image; the image processing module receives the thermal image, and converts the thermal image into temperature data, the temperature data defines the relationship between the temperature and the position in the region of interest; and the key of the sampling temperature of the respiratory analysis module from the temperature data in the predetermined temperature range Interest area; configure the breathing analysis module to determine whether the absolute value of the temperature-to-time change rate in the key interest area is lower than the predetermined temperature change rate lower limit; if the respiratory analysis module determines the critical interest area, the temperature-to-time change rate The absolute value is lower than the lower limit of the predetermined temperature change rate, and the respiratory analysis module generates a first event alarm associated with the patient and transmits it to the remote care station; if the respiratory analysis module determines that the absolute rate of change of temperature versus time is higher than When the lower limit of the temperature change rate is predetermined, the respiratory analysis module further determines the rate of change of temperature versus time. Value is higher than a predetermined temperature change rate limit; If the absolute value of the time variation rate of the breath analysis module determines the upper limit temperature is higher than a predetermined temperature change rate, the respiration analysis module generates second thing associated with the patient The alarm is transmitted to the remote care station; if the respiratory analysis module determines that the absolute value of the temperature-to-time change rate is lower than the predetermined temperature change rate upper limit, the respiratory analysis module is directed to the upper limit of the predetermined temperature change rate and the predetermined temperature change rate. The temperature between the lower limits is sampled to obtain a breathing curve; the respiratory analysis module is configured to determine whether the respiratory rate of the breathing curve is normal, and if it is determined that the breathing is abnormal, the respiratory analysis module generates a third associated with the patient. The event is alerted and transmitted to the remote care station.
較佳者,溫度對時間之變化率可為時間區間內之溫度變化量除以時間區間,且時間區間係小於患者之呼吸頻率。 Preferably, the rate of change of temperature versus time can be the amount of temperature change in the time interval divided by the time interval, and the time interval is less than the respiratory rate of the patient.
較佳者,溫度預定範圍可至少包含患者之一日內體溫變化範圍。 Preferably, the predetermined temperature range may include at least one of the range of body temperature changes of the patient within the day.
較佳者,興趣區域可包含患者之頭部,第一事件警報可為緊急事件警報,第二事件警報可為潛在呼吸異常警報,且第三事件警報可為呼吸異常確認警報。 Preferably, the region of interest may include the head of the patient, the first event alert may be an emergency alert, the second event alert may be a potential respiratory abnormality alert, and the third event alert may be a respiratory abnormality alert.
較佳者,遠端照護站可進一步包含資料庫,用於儲存第一事件警報,第二事件警報及第三事件警報之發生時間以及對應第一事件警報,第二事件警報及第三事件警報之各溫度資料。 Preferably, the remote care station may further comprise a database for storing the first event alarm, the second event alarm and the third event alarm occurrence time, and the corresponding first event alarm, the second event alarm and the third event alarm. Each temperature data.
綜上所述,藉由本發明的熱成像式遠端照護系統及方法,不需使用呼吸罩偵測患者之呼吸,且可在使用最少電腦系統資源的情形下,藉由分析熱影像之溫度資料,並生成呼吸曲線,以主動偵測出病患之呼吸異常事件,並進而迅速通知醫護人員進行處理。此外,不需要耗費時間及大量系統資源對圖像進行人臉辨識,除了省去醫護人員的勞力,亦可進行自動化病理分析,數位化病歷及自動歸檔,以幫助醫生了解治療效果及病情發展,進一步提昇醫療照護品質。 In summary, with the thermal imaging type far-end care system and method of the present invention, the respiratory mask can be used to detect the patient's breathing, and the temperature data of the thermal image can be analyzed by using at least the computer system resources. And generate a breathing curve to actively detect the patient's respiratory abnormality, and then promptly notify the medical staff to handle. In addition, it does not require time and a large amount of system resources to face recognition of images. In addition to eliminating the labor of medical staff, it can also perform automated pathological analysis, digital medical records and automatic archiving to help doctors understand the treatment effect and disease development. Further improve the quality of medical care.
1‧‧‧熱成像式遠端照護系統 1‧‧‧ Thermal imaging remote care system
10‧‧‧紅外線熱像儀 10‧‧‧Infrared Thermal Imager
11‧‧‧紅外線感測器 11‧‧‧Infrared sensor
12‧‧‧影像處理模組 12‧‧‧Image Processing Module
14‧‧‧呼吸分析模組 14‧‧‧ Breathing analysis module
16‧‧‧患者 16‧‧‧ patients
18‧‧‧遠端照護站 18‧‧‧Remote care station
20‧‧‧處理器 20‧‧‧ processor
22‧‧‧資料庫 22‧‧‧Database
24‧‧‧醫護人員 24‧‧‧ medical staff
25‧‧‧可攜式裝置 25‧‧‧Portable device
26‧‧‧無線基地台 26‧‧‧Wireless base station
R‧‧‧變化率 R‧‧‧change rate
SROIC‧‧‧關鍵興趣區域 SROIC‧‧‧Key Interest Area
SROIF‧‧‧變動區域 SROIF‧‧ Changed Area
STmin‧‧‧最低溫度點 STmin‧‧‧ minimum temperature point
STmax‧‧‧最高溫度點 STmax‧‧‧ highest temperature point
Temparea‧‧‧區域溫度 Temparea‧‧‧zone temperature
Temppixel‧‧‧像素溫度 Temppixel‧‧‧ pixel temperature
Tlower‧‧‧預定溫度變化率下限 Tlower‧‧‧Predetermined temperature change rate lower limit
Tupper‧‧‧預定溫度變化率上限 Tupper‧‧‧Predetermined temperature change rate upper limit
TROI‧‧‧偵測時間 TROI‧‧‧Detection time
LN*MN、Li*Mi‧‧‧像素區域 LN*MN, Li*Mi‧‧‧ pixel area
x0、y0‧‧‧座標 X0, y0‧‧‧ coordinates
△T‧‧‧溫度差 △T‧‧‧temperature difference
△tp‧‧‧時間區間 △tp‧‧‧ time interval
S701-S712‧‧‧步驟 S701-S712‧‧‧Steps
本發明之上述及其他特徵及優勢將藉由參照附圖詳細說明其例示性實施例而變得更顯而易知,其中:第1圖係為根據本發明之熱成像式遠端照護系統之第一實施例之方塊圖。 The above and other features and advantages of the present invention will become more apparent from the detailed description of the exemplary embodiments of the accompanying drawings in which: FIG. 1 is a thermal imaging remote care system according to the present invention. A block diagram of the first embodiment.
第2A圖係為根據本發明之熱成像式遠端照護系統針對熱影像進行取樣之示意圖。 Figure 2A is a schematic illustration of a thermal imaging of a thermal imaging remote care system in accordance with the present invention.
第2B圖係為根據本發明之熱成像式遠端照護系統針對熱影像產生之溫度資料之三維示意圖。 Figure 2B is a three-dimensional representation of the temperature data generated by the thermal imaging remote care system in accordance with the present invention for thermal imaging.
第2C圖係為根據本發明之熱成像式遠端照護系統針對熱影像之像素進行區域溫度取樣之示意圖。 2C is a schematic diagram of regional temperature sampling of pixels of a thermal image in accordance with the thermal imaging remote care system of the present invention.
第3圖係為根據本發明之熱成像式遠端照護系統針對熱影像進行取樣之示意圖。 Figure 3 is a schematic illustration of the thermal imaging of a thermal imaging remote care system in accordance with the present invention.
第4圖係為根據本發明之熱成像式遠端照護系統針對溫度資料進行分析之溫度對時間曲線圖。 Figure 4 is a graph of temperature vs. time for temperature data analysis of a thermal imaging remote care system in accordance with the present invention.
第5圖係為在正常呼吸情況下,根據本發明之熱成像式遠端照護系統針對溫度資料進行分析之溫度及溫度變化率對時間之曲線圖。 Figure 5 is a graph of temperature and temperature change rate versus time for temperature data analysis of a thermal imaging remote care system in accordance with the present invention under normal breathing conditions.
第6圖係為在異常呼吸事件發生時,根據本發明之熱成像式遠端照護系統針對溫度資料進行分析之溫度及溫度變化率對時間之曲線圖。 Figure 6 is a graph of temperature and temperature change rate vs. time for temperature data analysis of a thermal imaging remote care system in accordance with the present invention in the event of an abnormal respiratory event.
第7圖係為根據本發明之熱成像式遠端照護方法之實施例繪示之流程圖。 Figure 7 is a flow chart showing an embodiment of a thermal imaging distal care method in accordance with the present invention.
為利 貴審查員瞭解本發明之技術特徵、內容與優點及其所能達成之功效,茲將本發明配合附圖,並以實施例之表達形式詳細說明如下,而其中所使用之圖式,其主旨僅為示意及輔助說明書之用,未必為本發明實施後之真實比例與精準配置,故不應就所附之圖式的比例與配置關係解讀、侷限本發明於實際實施上的權利範圍,合先敘明。 The technical features, contents, and advantages of the present invention, as well as the advantages thereof, can be understood by the present inventors, and the present invention will be described in detail with reference to the accompanying drawings. The subject matter is only for the purpose of illustration and description. It is not intended to be a true proportion and precise configuration after the implementation of the present invention. Therefore, the scope and configuration relationship of the attached drawings should not be interpreted or limited. First described.
於此使用,詞彙“與/或”包含一或多個相關條列項目之任何或所有組合。當“至少其一”之敘述前綴於一元件清單前時,係修飾整個清單元件而非修飾清單中之個別元件。 As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items. When the phrase "at least one of" is preceded by a list of elements, the entire list of elements is modified instead of the individual elements in the list.
請參考第1圖,其為根據本發明之熱成像式遠端照護系統之第一實施例之方塊圖。如圖所示,提供一種熱成像式遠端照護系統1,係與遠端照護站18電性連接,並用於監控患者16之狀態。熱成像式遠端照護系統1包含紅外線熱像儀10、影像處理模組12及呼吸分析模組14。紅外線熱像儀10之紅外線感測器11可設置於患者之周側,其經配置以拍攝與患者相關之興趣區域SROIT內之熱影像。影像處理模組12連接於紅外線熱像儀10並接收熱影像,並將熱影像轉換為溫度資料,其定義興趣區域中溫度對位置之關係,其示例將於下文搭配第2A圖及第2B圖詳細說明。 Please refer to FIG. 1, which is a block diagram of a first embodiment of a thermal imaging distal care system in accordance with the present invention. As shown, a thermal imaging distal care system 1 is provided that is electrically coupled to the distal care station 18 and that is used to monitor the status of the patient 16. The thermal imaging remote care system 1 includes an infrared camera 10, an image processing module 12, and a respiratory analysis module 14. The infrared sensor 11 of the infrared camera 10 can be disposed on the peripheral side of the patient and configured to capture thermal images within the region of interest SROI T associated with the patient. The image processing module 12 is connected to the infrared camera 10 and receives the thermal image, and converts the thermal image into temperature data, which defines the relationship between the temperature and the position in the region of interest. An example of this will be matched with the second and second panels. Detailed description.
呼吸分析模組14電性連接於影像處理模組12,經配置以自溫度資料中取樣溫度在預定溫度範圍之關鍵興趣區域SROIC。較佳者,影像處理模組12及呼吸分析模組14可為本領域常見之中央處理器(Central Processing Unit,CPU)、微處理器(microprocessor)、網路處理器(NP:Network Processor)、微控制器、或為具有專用功能的半導體積體電路(Integrated Circuit(IC)),兩者可各別設置或也可共用相同的處理器達成兩者之功能。 The respiratory analysis module 14 is electrically coupled to the image processing module 12 and configured to sample a critical region of interest SROI C having a temperature within a predetermined temperature range from the temperature data. Preferably, the image processing module 12 and the respiratory analysis module 14 can be a central processing unit (CPU), a microprocessor, and a network processor (NP: Network Processor). The microcontroller, or a semiconductor integrated circuit (IC) having a dedicated function, may be provided separately or may share the same processor.
請參考第2A圖及第2B圖,其分別為根據本發明之熱成像式遠端照護系統針對熱影像進行取樣之示意圖以及針對熱影像產生之溫度資料之三維示意圖。 Please refer to FIG. 2A and FIG. 2B , which are respectively a schematic diagram of sampling of thermal images by the thermal imaging type far-end care system according to the present invention and a three-dimensional diagram of temperature data generated for thermal images.
一般而言,由於所有溫度在絕對零度(約-273℃)以上的物體,都會因自身的分子運動而產生紅外線輻射熱。紅外線熱像儀10能將人眼無法看到的輻射能量(例如:波長8微米到12微米的紅外光)轉換為電訊號,並以各種不同的顏色來顯示出不同溫度的分佈,使整個溫度分布狀態以熱影像顯示出來。如圖所示,影像處理模組12可將整個興趣區域SROIT分為在二維分佈中之複數個像素區域,舉例而言,可藉由X軸及Y軸,將整個熱影像分為LN*MN個像素區域,在其中又可針對特定區域,如圖中之Li*Mi個像素之區域進行分析,且圖中之(x0,y0)像素可具有該像素中之溫度資訊與對應的位置座標(x0,y0)。 In general, since all objects with temperatures above absolute zero (about -273 ° C) will generate infrared radiant heat due to their molecular motion. The infrared camera 10 can convert radiant energy (for example, infrared light having a wavelength of 8 micrometers to 12 micrometers) that cannot be seen by the human eye into electrical signals, and display different temperature distributions in various colors to make the entire temperature The distribution status is displayed as a thermal image. As shown in the figure, the image processing module 12 can divide the entire region of interest SROI T into a plurality of pixel regions in a two-dimensional distribution. For example, the entire thermal image can be divided into L by the X axis and the Y axis. N * M N pixel regions, in which the region can be analyzed for a specific region, such as Li * Mi pixels in the figure, and the (x 0 , y 0 ) pixel in the figure can have temperature information in the pixel Corresponding to the position coordinates (x 0 , y 0 ).
此外,透過所產生之熱影像,根據各像素之溫度資料,可產生如第2B圖所示之三維示意圖,影像處理模組12可以迅速的檢測整個溫度面,並辨識最高溫度點STmax及最低溫度點STmin,以進行溫度的定性與定量分析。 In addition, through the generated thermal image, according to the temperature data of each pixel, a three-dimensional schematic diagram as shown in FIG. 2B can be generated, and the image processing module 12 can quickly detect the entire temperature surface and identify the highest temperature point ST max and the minimum. Temperature point ST min for qualitative and quantitative analysis of temperature.
請參考第2C圖,為根據本發明之熱成像式遠端照護系統針對熱影像之像素進行區域溫度取樣之示意圖。具體而言,各像素在系統預設偵測時間TROI中的像素溫度Temppixel可以表示為
其中,t為時間,k為大於0之正整數,n為取樣之時間區間△tp內,溫度的偵測總次數,Tempk(t)為位於對應像素位置(xi,yi)處,在時間t時偵測到的溫度。因此,對應到上述針對特定像素區域LS×MS進行溫度偵測的區域溫度Temparea,可表示為
其中,i,j,k均為大於0之正整數,LS≦LN,MS≦MN,當LS=MS=1時,區域溫度Temparea=像素溫度Temppixel。因此,使用者可隨熱影像之解析度、紅外線熱像儀之單位時間內偵測次數以及系統處理能力,調整個別像素之大小,以進一步降低系統資源的使用及對系統的負擔,還可提昇系統處理速度。 Where i, j, k are positive integers greater than 0, L S ≦ L N , M S ≦ M N , when L S = M S =1, the region temperature Temp area = pixel temperature Temp pixel . Therefore, the user can adjust the size of the individual pixels according to the resolution of the thermal image, the number of detections per unit time of the infrared camera, and the processing power of the system, so as to further reduce the use of system resources and the burden on the system, and can also be improved. System processing speed.
請參考第3圖,其為根據本發明之熱成像式遠端照護系統針對熱影像進行取樣之示意圖。如圖所示,為了偵測呼吸異常事件,興趣區域SROIT必須至少包含患者之頭部,較佳者,包含鼻子及其周遭之區域。同時,為了降低系統的負擔,並判斷人體所在位置,呼吸分析模組14可經配置以自興趣區域SROIT中取出溫度在預定溫度範圍內之關鍵興趣區域SROIC。此處,溫度預定範圍可至少包含患者之一日內體溫變化範圍,較佳者,約為患者之日常皮膚溫度之最高溫度點STmax至最低溫度點STmax-△T,溫度差△T係略大於該患者之日常體溫變動範圍,例如約1.8℃,但不限於此。而可預測的,當呼吸異常事件發生,將於關鍵興趣區域SROIC中出現溫度變化劇烈的變動區域SROIF,且亦為必須被偵測到之區域。 Please refer to FIG. 3, which is a schematic diagram of sampling of thermal images by the thermal imaging remote care system according to the present invention. As shown, in order to detect a respiratory abnormality, the region of interest SROI T must contain at least the patient's head, preferably the nose and its surrounding area. Meanwhile, in order to reduce the burden on the system, and determine the location where the human body, breath analysis module 14 may be a key area of interest removed SROI C temperature within a predetermined temperature range is configured from the region of interest in the SROI T. Here, the predetermined temperature range may include at least one range of the body temperature change of the patient, preferably, the highest temperature point ST max to the lowest temperature point ST max -ΔT of the patient's daily skin temperature, and the temperature difference ΔT is slightly It is larger than the daily body temperature variation range of the patient, for example, about 1.8 ° C, but is not limited thereto. Predictably, when a respiratory abnormality occurs, a variable temperature region SROI F in the critical interest region SROI C appears, and is also an area that must be detected.
請參考第4圖,其為根據本發明之熱成像式遠端照護系統針對溫度資料進行分析之溫度對時間曲線圖。接續上圖,在取得關鍵興趣區域SROIC之溫度資料後,呼吸分析模組14可首先判斷關鍵興趣區域SROIC中,溫度對時間之變化率R之絕對值是否低於預定溫度變化率下限Tlower。較佳者,溫度對時間之變化率可為時間區間△tp內之溫度變化量除以時間區間△tp。為了偵測呼吸間隔,時間區間△tp需遠小於患者之呼吸間隔。較佳者,對成人而言,呼吸頻率約為每分鐘10~15次,嬰兒則為每分鐘20~50次。續言之,從圖中可見到兩種曲線,其 一為關鍵興趣區域SROIC之關鍵興趣區域溫度對時間作圖,其二為變動區域SROIF之變動區域溫度對時間作圖。因此,呼吸分析模組14可藉由判斷在一段監控時間中,關鍵興趣區域SROIC中各像素之溫度對時間之變化率R之絕對值是否低於預定溫度變化率下限Tlower,來確保患者仍處於呼吸狀態。若呼吸分析模組14判斷關鍵興趣區域SROIC中,溫度對時間之變化率R之絕對值低於預定溫度變化率下限Tlower,代表患者可能停止呼吸,此時呼吸分析模組14產生與患者相關聯之緊急事件警報並傳送至遠端照護站18。 Please refer to FIG. 4, which is a graph of temperature versus time for temperature data analysis of the thermal imaging remote care system in accordance with the present invention. Following the above figure, after obtaining the temperature data of the key interest area SROI C , the breathing analysis module 14 may first determine whether the absolute value of the temperature-to-time change rate R in the key interest area SROI C is lower than the predetermined temperature change rate lower limit T. Lower . Are preferred, the time rate of change of temperature may be a temperature change amount t p divided within the time interval t p is the time interval △ △. In order to detect the breathing interval, the time interval Δt p needs to be much smaller than the patient's breathing interval. Preferably, for adults, the respiratory rate is about 10-15 times per minute, and for babies 20 to 50 times per minute. In other words, two curves can be seen from the figure, one is the temperature of the key interest area of the key interest area SROI C versus time, and the other is the temperature of the variable area of the variable area SROI F versus time. Therefore, the respiratory analysis module 14 can ensure the patient whether the absolute value of the temperature-to-time change rate R of each pixel in the key interest region SROI C is lower than the predetermined lower temperature change rate lower limit T lower during a monitoring period. Still breathing. If the respiratory analysis module 14 determines that the critical interest region SROI C , the absolute value of the temperature-to-time change rate R is lower than the predetermined temperature change rate lower limit T lower , indicating that the patient may stop breathing, and the respiratory analysis module 14 generates the patient. The associated emergency alert is transmitted to the remote care station 18.
續言之,若呼吸分析模組14判斷溫度對時間之變化率R之絕對值高於預定溫度變化率下限Tlower,則進一步判斷溫度對時間之變化率R之絕對值是否高於預定溫度變化率上限Tupper,若呼吸分析模組14判斷溫度對時間之變化率R之絕對值高於預定溫度變化率上限Tupper,代表患者可能呼吸間隔過短,可能為潛在呼吸異常情況,則呼吸分析模組14產生與患者16相關聯之潛在呼吸異常警報並傳送至遠端照護站18。 In other words, if the respiratory analysis module 14 determines that the absolute value of the temperature-to-time change rate R is higher than the predetermined temperature change rate lower limit T lower , it is further determined whether the absolute value of the temperature-to-time change rate R is higher than a predetermined temperature change. The upper limit of the upper limit T upper , if the respiratory analysis module 14 determines that the absolute value of the rate of change of temperature versus time is higher than the upper limit of the predetermined temperature change rate T upper , which represents that the patient may have a short interval of breath, which may be a potential respiratory abnormality, then the respiratory analysis The module 14 generates a potential respiratory abnormality alarm associated with the patient 16 and transmits it to the remote care station 18.
請參考第5圖,其為在正常呼吸情況下,根據本發明之熱成像式遠端照護系統針對溫度資料進行分析之溫度及溫度變化率對時間之曲線圖。如圖所示,若呼吸分析模組14判斷溫度對時間之變化率R之絕對值低於預定溫度變化率上限Tupper,則呼吸分析模組14可進而針對在預定溫度變化率上限及預定溫度變化率下限之間之溫度對時間之變化進行取樣獲得呼吸曲線及對應呼吸曲線之溫度變化率R對時間之作圖。經取樣,在患者之正常呼吸情況下,可獲得如圖所示之正常呼吸曲線。獲得呼吸曲線後,可配置呼吸分析模組14判斷呼吸曲線之呼吸頻率是否正常,其中,判斷方法可採用峰值判斷法,藉由取得兩峰值之 間之時間間隔,判定各時間間隔之一致性是否在誤差範圍內,若是則為正常呼吸情況,若否則為呼吸異常情形。 Please refer to FIG. 5, which is a graph of temperature and temperature change rate versus time for temperature data analysis of the thermal imaging type far-end care system according to the present invention under normal breathing conditions. As shown in the figure, if the respiratory analysis module 14 determines that the absolute value of the temperature-to-time change rate R is lower than the predetermined upper temperature change rate upper limit T upper , the respiratory analysis module 14 may further target the predetermined temperature change rate upper limit and the predetermined temperature. The temperature between the lower limit of the rate of change is sampled to obtain a plot of the temperature change rate R versus time for the breathing curve and the corresponding breathing curve. After sampling, the normal breathing curve as shown in the figure can be obtained under normal breathing conditions of the patient. After obtaining the breathing curve, the breathing analysis module 14 can be configured to determine whether the breathing frequency of the breathing curve is normal. The determining method can adopt the peak determining method to determine whether the consistency of each time interval is consistent by obtaining the time interval between the two peaks. Within the error range, if it is, it is a normal breathing situation, otherwise it is a breathing abnormal situation.
請參考第6圖,其為在異常呼吸事件發生時,根據本發明之熱成像式遠端照護系統針對溫度資料進行分析之溫度及溫度變化率對時間之曲線圖。當患者處在呼吸異常情形時,可獲得異常呼吸曲線,其中之溫度變化曲線極為不規律,因此,呼吸分析模組14此時被配置以判斷呼吸曲線之呼吸頻率是否正常,若出現類似上述異常呼吸曲線,則判定為呼吸異常,則呼吸分析模組14產生與患者相關聯之呼吸異常確認警報並傳送至遠端照護站18。 Please refer to FIG. 6 , which is a graph of temperature and temperature change rate versus time for temperature data analysis of the thermal imaging type far-end care system according to the present invention when an abnormal respiratory event occurs. When the patient is in a breathing abnormal situation, an abnormal breathing curve can be obtained, wherein the temperature change curve is extremely irregular. Therefore, the breathing analysis module 14 is configured to determine whether the breathing frequency of the breathing curve is normal, and if the abnormality is similar If the breathing curve is determined to be a breathing abnormality, the breathing analysis module 14 generates a breathing abnormality confirmation alarm associated with the patient and transmits it to the distal care station 18.
藉由上述系統設計,可根據患者呼吸情況的不同,而有對應的警報產生,而上述實施例中,遠端照護站18可包含處理器20及資料庫22,並可配置有通用電腦系統PC,其目的在於當異常呼吸事件發生時,遠端照護站18可透過處理器20將事件紀錄於資料庫22中之患者病歷中,並透過通用電腦系統PC產生警示通知醫護人員24,亦可透過無線基地台26,將警報傳送至醫護人員24攜帶之可攜式裝置25如手機、平板等,以遠距通知醫護人員24,除了省去醫護人員的勞力,亦可進行數位化病歷及自動歸檔,還可長時間對患者的呼吸情形進行觀測,可進而協助醫生了解治療效果及病情發展,進一步提昇醫療照護品質。 With the above system design, a corresponding alarm can be generated according to the different breathing conditions of the patient. In the above embodiment, the remote care station 18 can include the processor 20 and the database 22, and can be configured with a general computer system PC. The purpose is that when an abnormal breathing event occurs, the remote care station 18 can record the event in the patient's medical record in the database 22 through the processor 20, and generate a warning to notify the medical staff 24 through the general computer system PC. The wireless base station 26 transmits the alarm to the portable device 25 carried by the medical staff 24, such as a mobile phone or a tablet, so as to notify the medical staff 24 remotely, in addition to eliminating the labor of the medical staff, the digital medical record and automatic filing can also be performed. It can also observe the patient's breathing situation for a long time, which can help the doctor to understand the treatment effect and the development of the disease, and further improve the quality of medical care.
以下將根據附圖說明本發明熱成像式遠端照護方法之各步驟。請參考第7圖,其為根據本發明之熱成像式遠端照護方法之實施例繪示之流程圖。 The steps of the thermal imaging distal care method of the present invention will now be described with reference to the accompanying drawings. Please refer to FIG. 7, which is a flow chart of an embodiment of a thermal imaging remote care method according to the present invention.
根據本發明之熱成像式遠端照護方法的實施例,其適用於前述各實施例中之熱感應式遠端照護系統,方法可包含下列步驟: An embodiment of the thermal imaging distal care method according to the present invention is applicable to the thermally inductive distal care system of the foregoing embodiments, and the method may comprise the following steps:
步驟S701:以紅外線熱像儀對準患者之上半身; Step S701: aligning the upper body of the patient with an infrared camera;
步驟S702:以紅外線熱像儀拍攝興趣區域之熱影像; Step S702: capturing a thermal image of the region of interest by using an infrared camera;
步驟S703:以影像處理模組將熱影像轉換為溫度資料; Step S703: converting the thermal image into temperature data by using the image processing module;
步驟S704:以呼吸分析模組自溫度資料中取樣溫度在預定溫度範圍之關鍵興趣區域; Step S704: The respiratory analysis module samples the temperature from the temperature data in a key interest area of the predetermined temperature range;
步驟S705:判斷溫度對時間之變化率之絕對值是否低於預定溫度變化率下限,若否,則進入步驟S706,配置呼吸分析模組以判斷溫度對時間之變化率之絕對值是否高於預定溫度變化率上限,若是,則進入步驟S709,產生緊急事件警報並傳送至遠端照護站,並隨後進入步驟S712,遠端照護站記錄事件的發生並派員處理; Step S705: determining whether the absolute value of the temperature-to-time change rate is lower than the predetermined temperature change rate lower limit. If not, proceeding to step S706, configuring the respiratory analysis module to determine whether the absolute value of the temperature-to-time change rate is higher than a predetermined value. The upper limit of the temperature change rate, if yes, proceeds to step S709, generates an emergency alert and transmits to the remote care station, and then proceeds to step S712, where the remote care station records the occurrence of the event and dispatches the staff to process;
步驟S706:配置呼吸分析模組以判斷溫度對時間之變化率之絕對值是否高於預定溫度變化率上限,若是,則進入步驟S710,產生潛在呼吸異常警報並傳送至遠端照護站,若否,則進入步驟S707,生成並分析患者之呼吸曲線,獲得呼吸頻率。 Step S706: configuring the respiratory analysis module to determine whether the absolute value of the temperature-to-time change rate is higher than the predetermined temperature change rate upper limit, and if yes, proceeding to step S710 to generate a potential respiratory abnormality alarm and transmitting to the remote care station, if not Then, the process proceeds to step S707, and the breathing curve of the patient is generated and analyzed to obtain the respiratory rate.
步驟S708:配置呼吸分析模組以判斷呼吸曲線之呼吸頻率是否正常,若是,則回到步驟S704,繼續以呼吸分析模組自溫度資料中取樣溫度在預定溫度範圍之關鍵興趣區域,若否,則進入步驟S711,產生呼吸異常確認警報並傳送至遠端照護站。 Step S708: configuring the respiratory analysis module to determine whether the respiratory frequency of the breathing curve is normal, and if yes, returning to step S704, continuing to sample the temperature in the critical interest region of the predetermined temperature range from the temperature data by the respiratory analysis module, if not, Then, proceeding to step S711, a respiratory abnormality confirmation alarm is generated and transmitted to the remote care station.
步驟S712:在遠端照護站接收到上述呼吸異常事件警報後,透過資料庫記錄呼吸異常事件發生時間,並派員處理後解除緊報。之後回到步驟S704,繼續以呼吸分析模組自溫度資料中取樣溫度在預定溫度範圍之關鍵興趣區域。 Step S712: After receiving the above-mentioned respiratory abnormality alarm, the remote care station records the occurrence time of the respiratory abnormality event through the database, and dispatches the staff to dismiss the emergency report. Then, returning to step S704, the respiratory analysis module continues to sample the key interest region of the temperature within the predetermined temperature range from the temperature data.
綜上所述,藉由本發明的熱成像式遠端照護系統及方法,不需使用呼吸罩,且可在使用最少電腦系統資源的情形下,藉由分析熱影像之溫度資 料,並生成呼吸曲線,以主動偵測出病患之呼吸異常事件,並進而迅速通知醫護人員進行處理。此外,不需要耗費時間及大量系統資源對圖像進行人臉辨識,除了省去醫護人員的勞力,亦可進行自動化病理分析,數位化病歷及自動歸檔,以幫助醫生了解治療效果及病情發展,進一步提昇醫療照護品質。 In summary, the thermal imaging type remote care system and method of the present invention eliminates the need for a respiratory mask and can analyze the temperature of the thermal image while using at least the resources of the computer system. The material is generated and a breathing curve is generated to actively detect the abnormal breathing event of the patient, and then promptly notify the medical staff for treatment. In addition, it does not require time and a large amount of system resources to face recognition of images. In addition to eliminating the labor of medical staff, it can also perform automated pathological analysis, digital medical records and automatic archiving to help doctors understand the treatment effect and disease development. Further improve the quality of medical care.
1‧‧‧熱成像式遠端照護系統 1‧‧‧ Thermal imaging remote care system
10‧‧‧紅外線熱像儀 10‧‧‧Infrared Thermal Imager
11‧‧‧紅外線感測器 11‧‧‧Infrared sensor
12‧‧‧影像處理模組 12‧‧‧Image Processing Module
14‧‧‧呼吸分析模組 14‧‧‧ Breathing analysis module
16‧‧‧患者 16‧‧‧ patients
18‧‧‧遠端照護站 18‧‧‧Remote care station
20‧‧‧處理器 20‧‧‧ processor
22‧‧‧資料庫 22‧‧‧Database
24‧‧‧醫護人員 24‧‧‧ medical staff
25‧‧‧可攜式裝置 25‧‧‧Portable device
26‧‧‧無線基地台 26‧‧‧Wireless base station
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW104133594A TWI613993B (en) | 2015-10-13 | 2015-10-13 | Telehealth care system and method using thermal imaging |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW104133594A TWI613993B (en) | 2015-10-13 | 2015-10-13 | Telehealth care system and method using thermal imaging |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201713270A TW201713270A (en) | 2017-04-16 |
TWI613993B true TWI613993B (en) | 2018-02-11 |
Family
ID=59256636
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW104133594A TWI613993B (en) | 2015-10-13 | 2015-10-13 | Telehealth care system and method using thermal imaging |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI613993B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111387957B (en) * | 2020-03-13 | 2023-03-24 | 智方达(天津)科技有限公司 | Non-contact type body temperature and respiration rate combined detection method |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW201223504A (en) * | 2010-12-14 | 2012-06-16 | Univ Nat Cheng Kung | Medical analysis method and apparatus |
TW201530480A (en) * | 2014-01-28 | 2015-08-01 | Challentech Internat Corp | Intelligent monitoring system |
-
2015
- 2015-10-13 TW TW104133594A patent/TWI613993B/en not_active IP Right Cessation
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW201223504A (en) * | 2010-12-14 | 2012-06-16 | Univ Nat Cheng Kung | Medical analysis method and apparatus |
TW201530480A (en) * | 2014-01-28 | 2015-08-01 | Challentech Internat Corp | Intelligent monitoring system |
Also Published As
Publication number | Publication date |
---|---|
TW201713270A (en) | 2017-04-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11617520B2 (en) | Depth sensing visualization modes for non-contact monitoring | |
Alkali et al. | Thermal image processing for real‐time non‐contact respiration rate monitoring | |
US9672426B2 (en) | Intelligent monitoring system | |
CN112584753A (en) | Video-based patient monitoring system and related methods for detecting and monitoring respiration | |
Agnihotri | Human body respiration measurement using digital temperature sensor with I2C interface | |
KR101242755B1 (en) | Infant monitoring system using for thermography image camera | |
JP2014135993A (en) | Body temperature measuring device, body temperature measuring method and body temperature management system | |
JP2009279076A (en) | Monitoring system | |
CN106886681A (en) | A kind of infrared thermal imaging self-service examination system | |
KR20160143608A (en) | Nursing home patient monitoring equipment | |
Rajasekaran et al. | Elderly patient monitoring system using a wireless sensor network | |
KR20130118512A (en) | System and method for monitoring the health of a patient using face recognition technology | |
KR101793616B1 (en) | Telemedicine Booth | |
TWI613993B (en) | Telehealth care system and method using thermal imaging | |
US10553099B2 (en) | Information providing apparatus and information providing system | |
Wang et al. | Contactless patient care using hospital iot: Cctv camera based physiological monitoring in icu | |
JPWO2019049530A1 (en) | Data processing device, care support system and data processing method | |
JP2019122476A (en) | Vital sensor and monitoring system | |
Farah et al. | Respiratory rate measurement in children using a thermal imaging camera | |
Al-Kalidi et al. | Respiratory rate measurement in children using a thermal camera | |
JP7090327B2 (en) | Information processing equipment, information processing method, program | |
JPWO2020071375A1 (en) | Condition monitoring device | |
TWI611368B (en) | Telehealth care system and method using thermal imaging | |
JP3236269U (en) | Biometric information monitoring equipment and systems | |
JP2017093647A (en) | Measurement system and measurement method for measuring biological activity resulting from breathing of subject |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |