WO2023281800A1 - Information processing system, information processing method, and program - Google Patents

Information processing system, information processing method, and program Download PDF

Info

Publication number
WO2023281800A1
WO2023281800A1 PCT/JP2022/006924 JP2022006924W WO2023281800A1 WO 2023281800 A1 WO2023281800 A1 WO 2023281800A1 JP 2022006924 W JP2022006924 W JP 2022006924W WO 2023281800 A1 WO2023281800 A1 WO 2023281800A1
Authority
WO
WIPO (PCT)
Prior art keywords
patient
information
monitoring
real
unit
Prior art date
Application number
PCT/JP2022/006924
Other languages
French (fr)
Japanese (ja)
Inventor
宇紀 深澤
弘泰 馬場
穂 高橋
Original Assignee
ソニーグループ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニーグループ株式会社 filed Critical ソニーグループ株式会社
Publication of WO2023281800A1 publication Critical patent/WO2023281800A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/113—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb occurring during breathing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Definitions

  • the present disclosure relates to an information processing system, an information processing method, and a program, and more particularly to an information processing system, an information processing method, and a program that can improve the efficiency of monitoring work.
  • ICU Intensive Care Unit
  • nurses monitor the condition of patients in the ICU (hereinafter referred to as ICU patients), and the monitored contents are recorded in electronic or paper media.
  • ICU patients Intensive Care Unit
  • a confirmation screen can be displayed that the caregiver uses to confirm that the patient's vital signs data should be charted in the patient's EMR.
  • a hospital bed with a graphical user interface is disclosed.
  • ICU patients have a higher risk of sudden changes in their condition than those in general wards, and more monitoring is required for condition management, so there is a need to improve the efficiency of the monitoring work performed by nurses of ICU patients.
  • ICU patients have a high risk of sudden changes in their condition, and it is important to monitor them at the appropriate time and record the results. Business efficiency is required.
  • This disclosure has been made in view of this situation, and is intended to make it possible to improve the efficiency of monitoring operations.
  • An information processing system provides real-time information obtained by monitoring a patient in real time with a relatively short measurement cycle, and monitoring the patient at intervals with a relatively long measurement cycle.
  • a data processing unit that acquires the interval information obtained by analyzing the signal obtained by sensing the patient; and a display that causes the display unit to display the real-time information and the interval information in a display layout in which the real-time information and the interval information are displayed in different display areas.
  • a display control unit that performs control, and when there is a specific update in the real-time information and the interval information, the display control unit is controlled to notify that the update has occurred, and the notification is confirmed. and a control unit for performing control to record the confirmation content in the recording unit in response to the confirmation.
  • An information processing method or program includes real-time information obtained by monitoring a patient in real time with a relatively short measurement cycle, and monitoring the patient at intervals with a relatively long measurement cycle. acquiring the interval information obtained by performing data processing for analyzing the signal obtained by sensing the patient; and displaying the real-time information and the interval information on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas. and, when there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and when the notification is confirmed, the confirmation content is confirmed. This includes controlling recording in the recording unit.
  • real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle.
  • real-time information and interval information acquired by data processing that analyzes a signal obtained by sensing a patient, and are displayed on the display unit in a display layout in which the real-time information and the interval information are displayed in different display areas. Then, when there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and control is performed to record the confirmation content in the recording unit in response to the confirmation of the notification. is done.
  • FIG. 10 is a diagram showing a first display example of a monitoring screen; It is a block diagram which shows the structural example of an information processing apparatus. 4 is a flowchart for explaining monitoring processing; FIG. 11 is a flowchart for explaining work confirmation processing when there is a change in posture; FIG. It is a figure which shows the example of a display of a work content confirmation screen.
  • FIG. 10 is a diagram showing a second display example of the monitoring screen; It is a figure which shows the display content of each icon. It is a figure explaining the remote evaluation using a monitoring system. It is a figure which shows an example of an evaluation index.
  • 1 is a block diagram showing a configuration example of an embodiment of a computer to which the present technology is applied; FIG.
  • FIG. 1 is a diagram showing a configuration example of an embodiment of a monitoring system to which the present technology is applied.
  • the monitoring system 11 shown in FIG. 1 includes a vital sensor 12, an imaging system 13, a millimeter wave radar 14, a display device 15, and an information processing device 16.
  • the vital sensor 12 measures the ICU patient's vital signs (for example, pulse, blood pressure, body temperature, etc.) and supplies the information processing device 16 with a vital sign measurement signal obtained as a result of the measurement.
  • vital signs for example, pulse, blood pressure, body temperature, etc.
  • the imaging system 13 is composed of multiple RGB cameras. For example, each RGB camera captures video for monitoring ICU patients, video for monitoring infusion and drainage, and so on. Then, the imaging system 13 supplies video signals obtained by imaging them to the information processing device 16 .
  • the millimeter-wave radar 14 transmits and receives electromagnetic waves in the millimeter-wave frequency band that are capable of detecting the movement of the body surface of the ICU patient, for example, through blankets and clothing, in order to measure the thoracic fluctuation pattern of the ICU patient. do. Then, the millimeter wave radar 14 supplies the information processing device 16 with a millimeter wave measurement signal obtained as a result of receiving the electromagnetic waves reflected by the body surface of the ICU patient.
  • the display device 15 displays a monitoring screen (see FIG. 2 described later) for monitoring ICU patients in the monitoring system 11 according to display control by the information processing device 16 .
  • the information processing device 16 uses the vital sign measurement signal supplied from the vital sensor 12, the video signal supplied from the imaging system 13, and the millimeter wave measurement signal supplied from the millimeter wave radar 14 to monitor the ICU patients. Executes information processing that performs various types of analysis. Then, the information processing device 16 displays the analysis result obtained by executing the information processing on the monitoring screen of the display device 15 .
  • FIG. 2 is a diagram showing a first display example of the monitoring screen displayed on the display device 15. As shown in FIG.
  • the monitoring screen 21 includes an attribute data display image 31, a vital signs monitoring image 32, a monitoring video 33, a respiration monitoring image 34, a water balance monitoring image 35, a urine/discharge monitoring image 36, and a sedation level.
  • a monitoring image 37 and a postural change monitoring image 38 are displayed.
  • the attribute data display image 31 displays data indicating the attributes of the ICU patient being monitored, such as the current date and time, patient name, age, gender, and weight.
  • the vital sign monitoring image 32 displays the ICU patient's vital signs measured by the vital sensor 12, for example, ECG (Electrocardiogram), SpO2 (Saturation of Percutaneous Oxygen), and RESP (Respiratory) are displayed.
  • ECG Electrocardiogram
  • SpO2 SpO2
  • RESP Respiratory
  • the monitoring image 33 an image for monitoring the ICU patient imaged by the RGB camera of the imaging system 13 is displayed.
  • the respiration monitoring image 34 includes the image of the ICU patient captured by the RGB camera of the imaging system 13 and the chest fluctuation pattern of the ICU patient measured by the millimeter wave radar 14, and analyzed by the information processing device 16.
  • the ICU patient's breathing rate and breathing pattern are displayed.
  • the water balance monitoring image 35 displays changes in the water balance of the ICU patient analyzed by the information processing device 16 based on the video for monitoring the infusion and drainage captured by the RGB camera of the imaging system 13. be.
  • a bar graph showing the amount of water taken in by the ICU patient due to medication and the amount of water discharged from the ICU patient due to urination etc.
  • a line graph is displayed showing the water balance determined based on the difference in the intake and output of .
  • the urine/drainage monitoring image 36 shows changes in urine color and drainage of the ICU patient analyzed by the information processing device 16 based on the images for monitoring the infusion and drainage captured by the RGB camera of the imaging system 13 . Discharge color change is displayed. For example, in the illustrated display example, a bar graph indicating the amount of urine and drain fluid is displayed in a color (hatched in the figure) corresponding to the color of the measured urine and drain fluid at each hourly measurement cycle. It is
  • the sedation monitoring image 37 displays the change in the sedation level of the ICU patient analyzed by the information processing device 16 based on the image of the ICU patient captured by the RGB camera of the imaging system 13 .
  • a line graph is displayed showing the degree of sedation obtained by setting the score to 0 when the ICU patient is at rest at an hourly measurement cycle.
  • the posture change monitoring image 38 displays the progress of the ICU patient's posture change analyzed by the information processing device 16 based on the ICU patient's image captured by the RGB camera of the imaging system 13 .
  • the progress of the ICU patient's position change is displayed at an hourly measurement cycle, along with the time and position of the previous position change, and the time of the next scheduled position change. and posture are displayed.
  • real-time information the vital signs, monitoring images, respiration rate and respiration pattern that are monitored in real time with a relatively short measurement period such as less than several seconds.
  • water balance, drainage change, sedation level, and postural change monitored at relatively long measurement intervals such as one-hour intervals are referred to as interval information.
  • a vital signs monitoring image 32, a monitoring video 33, and a respiration monitoring image 34 corresponding to real-time information are collectively displayed in a real-time information display area 41.
  • a water balance monitoring image 35, a urine/discharge monitoring image 36, a sedation monitoring image 37, and a postural change monitoring image 38 corresponding to the interval information are collectively displayed in the interval information display area 42.
  • an unread mark 43 is displayed to notify that there is unconfirmed update information.
  • the unread mark 43 is displayed when there is a specific update (an update in which a large change equal to or greater than a predetermined threshold is detected) in real-time information and interval information.
  • an unread mark 43 is displayed on the urine/effluent monitoring image 36 to notify that a change in the color or amount of urine or effluent requiring notification to the nurse has occurred. be.
  • the confirmation information indicating that the nurse has confirmed the contents of the update information (the time the nurse confirmed the update contents, the name of the nurse, the contents of the update information) is It is automatically recorded in the EMR (Electronic Medical Record) of the recording unit 53 in FIG.
  • nurses can collectively check real-time information and interval information in addition to ICU patient attribute information.
  • the unread mark 43 it is possible to clarify that there is unconfirmed update information, thereby avoiding the risk of the nurse overlooking the update information.
  • a vital signs monitoring image 32, a monitoring image 33, a respiration monitoring image 34, a water balance monitoring image 35, a urine/discharge monitoring image 36, a sedation The display of the degree monitoring image 37 and the postural change monitoring image 38 is automatically adjusted. For example, important monitoring items can be displayed in a large size, and unnecessary monitoring items can be hidden. For example, these items may be flexibly replaced depending on sensing devices (cameras, sensors, etc.) configuring the monitoring system 11 .
  • each notification includes a vital signs monitoring image 32, a monitoring image 33, a respiration monitoring image 34, a water balance monitoring image 35, a urine/discharge monitoring image 36, a sedation monitoring image 37, and a postural change monitoring image 38, respectively. is performed on This allows the nurse to easily recognize which items should be checked.
  • notifications are made through visual changes, such as the frame of each image shining or a red circle being displayed within the frame.
  • the number of unread notices numerically like the unread mark 43A in FIG. 8, which will be described later, the nurse can easily grasp the types and total number of unconfirmed items.
  • notifications may also be made, for example, by a mobile terminal (for example, a smartphone application) carried by the nurse.
  • a mobile terminal for example, a smartphone application
  • FIG. 3 is a block diagram showing a configuration example of the information processing device 16. As shown in FIG.
  • the information processing device 16 includes a signal acquisition unit 51, a memory 52, a recording unit 53, a central control unit 54, a display control unit 55, and a data processing unit 56.
  • the signal acquisition unit 51 acquires the vital sign measurement signal supplied from the vital sensor 12, the video signal supplied from the imaging system 13, and the millimeter wave measurement signal supplied from the millimeter wave radar 14, and sends them to the central control unit 54. supply. Further, for example, when an operation input unit (not shown) such as a touch panel or a button is operated by a nurse, the signal acquisition unit 51 acquires an operation signal corresponding to the operation, and the central control unit 54 supply to
  • the memory 52 is composed of ROM (Read Only Memory), RAM (Random Access Memory), etc., and stores various data that need to be temporarily stored when the central control unit 54 performs control.
  • the recording unit 53 is composed of, for example, an HDD (Hard Disk Drive) or the like, and records information that needs to be retained in the monitoring system 11 in the EMR under the control of the central control unit 54.
  • HDD Hard Disk Drive
  • the central control unit 54 is composed of a CPU (Central Processing Unit) and controls each block of the information processing device 16 .
  • the central control unit 54 causes the recording unit 53 to record the vital signs measurement signal supplied from the signal acquiring unit 51 and supplies the display control unit 55 with the vital signs monitoring image 32 to display the vital signs.
  • the central control unit 54 also supplies the video signal supplied from the signal acquisition unit 51 to the display control unit 55 to display the image of the ICU patient on the monitoring image 33 .
  • the central control unit 54 supplies the video signal and the millimeter wave measurement signal supplied from the signal acquisition unit 51 to the data processing unit 56 to perform various analyzes necessary for monitoring the ICU patient. The result is supplied to the display control section 55 .
  • the display control unit 55 controls the display on the display device 15 and displays the monitoring screen 21 according to the control by the central control unit 54 .
  • the data processing unit 56 is composed of a respiration analysis unit 61, a liquid state analysis unit 62, a sedation analysis unit 63, and a postural transformation analysis unit 64.
  • the respiration analysis unit 61 uses video signals and millimeter wave measurement signals to non-contactly analyze the respiration rate and respiration pattern of ICU patients.
  • ICU patients often receive respiratory management using artificial respirators and oxygen masks, and it is assumed that there are many cases in which the respiratory rate is already being monitored.
  • breathing patterns manifested in the ribcage and neck muscles are currently visually confirmed.
  • constant non-contact monitoring makes it easier to manage the condition of ICU patients.
  • the respiratory analysis unit 61 performs image recognition processing on the video signal, recognizes a predetermined part of the ICU patient (for example, the chest and neck), extracts the measurement target, and measures the amount of movement of the measurement target in millimeters. wave measurement signal. For example, when the body of the ICU patient moves, artifact correction of the millimeter wave measurement signal can be performed by re-extracting the measurement target based on the video signal of the respiratory analysis unit 61 . Then, the respiration analysis unit 61 can analyze the respiration rate and respiration pattern of the ICU patient based on the variation of the millimeter wave measurement signal, that is, based on the variation of the ICU patient's chest and neck associated with respiration. .
  • the imaging system 13 and the millimeter wave radar 14 are used so that the respiratory analysis unit 61 can extract the measurement target based on the video signal, thereby avoiding such erroneous detection. can do. Therefore, in the monitoring system 11, it is possible to improve the detection accuracy of the thorax variation pattern.
  • a method for non-contact analysis of respiration of an ICU patient using the imaging system 13 and the millimeter wave radar 14 has been described, but other methods may be used.
  • an RGB-D camera capable of acquiring depth information as well as color images may be used to measure neck muscle movement that appears during forced breathing, and the measurement signal may be analyzed to evaluate respiration.
  • the wavelength range of the RGB-D camera cannot penetrate the futon, the measurement is performed with the neck muscles as the measurement target.
  • the analysis results of the respiratory rate and respiratory pattern of the ICU patient analyzed by the respiratory analysis unit 61 are supplied to the display control unit 55 via the central control unit 54 and displayed on the respiratory monitoring image 34 of the monitoring screen 21. .
  • the situations in which the ICU patient's breathing is sensed without contact are assumed to be cases in which the ICU patient can breathe spontaneously, and cases in which the ICU patient is fitted with a ventilator.
  • image recognition processing is performed based on the video signal to recognize the predetermined parts related to breathing of the ICU patient (for example, the chest and neck) and ROI (Region of Interest). Then, the amount of motion in the ROI is acquired using the millimeter wave radar 14 and the RGB-D camera, and if there is body motion of the ICU patient, artifact correction is performed by image recognition processing based on the video signal, Respiratory rates and patterns of ICU patients can be analyzed.
  • the ROI for the object to be measured it is possible to reduce the amount of output data, increase the speed, and reduce power consumption.
  • the influence of disturbance can be reduced and the measurement target can be reliably measured.
  • the setting of the ventilator is acquired from the video signal or external input, and the respiratory rate of the ICU patient is calculated as in the case where the ICU patient can breathe spontaneously. and analyze breathing patterns. Then, based on this analysis result, FFT (Fast Fourier Transform), machine learning, etc. can be used to separate spontaneous respiration and artificial respiration. For example, when spontaneous respiration remains or spontaneous respiration returns, weaning from artificial respiration can be performed more safely by distinguishing between spontaneous respiration and artificial respiration.
  • FFT Fast Fourier Transform
  • the liquid state analysis unit 62 uses video signals to analyze the ICU patient's water balance, urine color, and drain discharge color.
  • the RGB camera of the imaging system 13 captures images for monitoring the infusion and drainage.
  • the first RGB camera captures an image of the periphery of an infusion pump, a syringe, and the like
  • the second RGB camera captures the periphery of a drainage chamber.
  • the liquid state analysis unit 62 analyzes the video signal for monitoring the infusion ingested by the ICU patient to obtain the infusion volume, and analyzes the video signal for monitoring the drainage (urine and drain) discharged from the ICU patient. to determine the drainage volume, and the patient's fluid balance can be obtained based on the difference between the infusion volume and the drainage volume.
  • the liquid state analysis unit 62 can perform image recognition (for example, optical character recognition) on the video signal for monitoring the infusion to recognize the name and flow rate of the medicine printed on the infusion pack.
  • image recognition for example, optical character recognition
  • the liquid state analysis unit 62 can record the name and flow rate of the recognized medicine in the EMR of the recording unit 53 .
  • the analysis results of the ICU patient's water balance, urine color, and drain discharge color analyzed by the liquid state analysis unit 62 are supplied to the display control unit 55 via the central control unit 54, and the water content of the monitoring screen 21 is displayed. It is displayed on the balance monitoring image 35 and the urine/discharge monitoring image 36 .
  • the liquid state analysis unit 62 analyzes the symptoms that the ICU patient may be developing based on the color of the drainage, and presents the analysis result to the nurse by displaying it on the monitoring screen 21. You may
  • the sedation analysis unit 63 uses video signals to analyze the sedation of ICU patients.
  • the sedation analysis unit 63 uses RASS (Richmond Agitation-Sedation Scale), which is an index of sedation evaluation, to analyze the appearance of ICU patients such as facial expressions, behaviors, and gazes. By analyzing the voice that is the content of the answer given by the user, it is possible to automatically calculate it.
  • RASS Random Agitation-Sedation Scale
  • the analysis result of the sedation level of the ICU patient analyzed by the sedation level analysis unit 63 is supplied to the display control unit 55 via the central control unit 54 and displayed on the sedation monitoring image 37 of the monitoring screen 21.
  • the postural change analysis unit 64 uses the video signal to analyze the postural change of the ICU patient. For example, the postural change analysis unit 64 analyzes the video signal using an analysis method based on machine learning (Open Pose, etc.), which is a known technology, and estimates the posture of the ICU patient or nurse, so that the postural change is performed. It is possible to determine whether
  • the analysis result of the ICU patient's postural change analyzed by the postural change analysis unit 64 is supplied to the display control unit 55 via the central control unit 54 and displayed on the postural change monitoring image 38 of the monitoring screen 21.
  • the information processing device 16 is configured as described above, and the monitoring screen 21 shown in FIG. Can be recorded in EMR. As a result, nurses can effectively monitor ICU patients, and by improving the efficiency of monitoring work, it is possible to reduce the workload of nurses.
  • the process is started, and in step S11, the signal acquisition unit 51 acquires the vital sign measurement signal supplied from the vital sensor 12, the video signal supplied from the imaging system 13, and the millimeter wave radar 14.
  • the supplied millimeter wave measurement signal is acquired and supplied to the central control unit 54 .
  • the central control unit 54 supplies the video signal and the millimeter wave measurement signal to the data processing unit 56 .
  • step S ⁇ b>12 the central control unit 54 causes the recording unit 53 to record the vital sign measurement signal supplied from the signal acquisition unit 51 in step S ⁇ b>11 , and supplies the signal to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15 and updates the display of vital signs in the vital signs monitoring image 32 displayed on the monitoring screen 21 .
  • step S13 the central control unit 54 supplies the video signal supplied from the signal acquisition unit 51 in step S11 to the display control unit 55.
  • the display control unit 55 controls the display on the display device 15 and updates the display of the ICU patient image in the monitoring image 33 displayed on the monitoring screen 21 .
  • step S14 in the data processing unit 56, the respiration analysis unit 61 uses the video signal and millimeter-wave measurement signal supplied from the central control unit 54 in step S11 to calculate the respiration rate and respiration pattern of the ICU patient as described above. is analyzed, and the analysis result is supplied to the central control unit 54 .
  • the central control unit 54 causes the recording unit 53 to record the analysis result of the respiratory rate and breathing pattern of the ICU patient, and supplies the result to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15 and updates the display of the respiratory rate and respiratory pattern in the respiratory monitoring image 34 displayed on the monitoring screen 21 .
  • step S15 in the data processing unit 56, the liquid state analysis unit 62 uses the video signal supplied from the central control unit 54 in step S11 to determine the water balance, urine color, and drain discharge of the ICU patient as described above.
  • the liquid color is analyzed and the analysis result is supplied to the central control unit 54 .
  • the central control unit 54 causes the recording unit 53 to record the analysis results of the ICU patient's water balance, urine color, and drain discharge color, and supplies them to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15, updates the display of the water balance in the water balance monitoring image 35 displayed on the monitoring screen 21, and adjusts the urine color and drain discharge in the urine/discharge monitoring image 36. Update liquid color display.
  • step S16 in the data processing unit 56, the sedation analysis unit 63 uses the video signal supplied from the central control unit 54 in step S11 to analyze the sedation of the ICU patient as described above. is supplied to the central control unit 54 .
  • the central control unit 54 causes the recording unit 53 to record the analysis result of the sedation level of the ICU patient, and supplies the result to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15 and updates the sedation level display in the sedation level monitoring image 37 displayed on the monitoring screen 21 .
  • step S17 in the data processing unit 56, the postural change analysis unit 64 uses the video signal supplied from the central control unit 54 in step S11 to analyze the postural change of the ICU patient as described above. is supplied to the central control unit 54 .
  • the central control unit 54 causes the recording unit 53 to record the analysis result of the postural change of the ICU patient, and supplies the result to the display control unit 55 .
  • the display control unit 55 controls the display on the display device 15 and updates the display of the postural change in the postural change monitoring image 38 displayed on the monitoring screen 21 .
  • step S18 the central control unit 54 needs to notify the nurse of vital signs, monitoring images, respiration rate and respiration pattern, water balance, urine color, drain color, sedation level, and postural change. It is determined whether or not there has been an information update with a change.
  • step S18 if the central control unit 54 determines that there is no information update with a change requiring notification to the nurse, the process returns to step S11, and the same process is repeated thereafter. On the other hand, if the central control unit 54 determines in step S18 that there is an information update that causes a change requiring notification to the nurse, the process proceeds to step S19.
  • step S19 the central control unit 54 determines that there is information update among vital signs, monitoring images, respiration rate and respiration pattern, water balance, urine color, drain color, sedation level, and postural change.
  • the target to be displayed is notified to the display control unit 55 .
  • the display control unit 55 displays the vital signs monitoring image 32, the monitoring video 33, the respiration monitoring image 34, the water balance monitoring image 35, the urine/discharge monitoring image 36, the sedation monitoring image 37, and the postural change monitoring image 38, an unread mark 43 notifying that there is unconfirmed update information is displayed.
  • the signal acquisition unit 51 acquires the operation signal and supplies it to the central control unit 54.
  • the central control unit 54 controls the display control unit 55 to display the contents of the update information on the monitoring screen 21 .
  • step S20 the central control unit 54 causes the recording unit 53 to record confirmation information indicating that the nurse has confirmed the content of the update information displayed on the monitoring screen 21 in step S19. After that, the process returns to step S11, and the same process is repeated thereafter. Note that the processing of steps S12 to 14 is performed at relatively short measurement intervals corresponding to the timing at which the signal acquisition unit 51 acquires signals, and the processing of steps S15 to 17 is performed at relatively long intervals such as one hour intervals. This is done at the measurement cycle.
  • the monitoring system 11 when the information processing device 16 executes the monitoring process, the monitoring system 11 notifies the nurse with the unread mark 43 when there is an information update that causes a change requiring notification to the nurse. Only by confirming the contents of the update information by the teacher, the confirmation information can be automatically recorded. Thereby, the monitoring system 11 can improve the efficiency of the monitoring work.
  • FIG. 5 is a flow chart explaining the work confirmation process when there is a position change.
  • step S31 the postural transformation analysis unit 64 analyzes the video signal using an analysis technique based on machine learning (Open Pose, etc.), which is a known technique, and estimates the posture of the ICU patient or nurse.
  • machine learning Open Pose, etc.
  • step S32 the postural change analysis unit 64 determines whether or not the ICU patient's postural change has occurred based on the posture estimated in step S31.
  • step S32 if the postural change analysis unit 64 determines that the ICU patient's postural change has not occurred, the process returns to step S31, and the same process is repeated thereafter. On the other hand, in step S32, when the postural change analysis unit 64 determines that the ICU patient's postural change has occurred, the process proceeds to step S33.
  • step S33 the postural change analysis unit 64 notifies the central control unit 54 that it has determined that the ICU patient's postural change has occurred.
  • the central control unit 54 controls the display control unit 55 so that the work content confirmation screen 22 as shown in FIG. 6 is superimposed on the monitoring screen 21 and displayed.
  • the work content confirmation screen 22 displays the time when it was determined that the ICU patient's position was changed, and a user interface (Yes/No) for confirming the presence or absence of the position change.
  • the signal acquisition unit 51 acquires the operation signal and the central control unit 54, and the central control unit 54 recognizes the contents of the operation by the nurse.
  • step S34 the central control unit 54 causes the EMR of the recording unit 53 to record the operation details of the work content confirmation screen 22 by the nurse and the work details of the postural change of the ICU patient (postural change implementation time, postural position, etc.). .
  • step S ⁇ b>35 the central control unit 54 controls the display control unit 55 to update the posture change display in the posture change monitoring image 38 displayed on the monitoring screen 21 of the display device 15 . After that, the process returns to step S31, and the same process is repeated thereafter.
  • FIG. 7 is a diagram showing a second display example of the monitoring screen displayed on the display device 15. As shown in FIG.
  • the monitoring system 11 is assumed to be used by a nurse to monitor multiple ICU patients with one display device 15, and the display device 15 displays a monitoring screen 23 as shown in FIG. be.
  • the monitoring screen 23 basically, vital sign monitoring images 32, which are highly important information, are displayed side by side along with a plurality of patient names.
  • the nurse can switch the images corresponding to the icons 71 to 76 from the vital sign monitoring image 32 and display them.
  • FIG. 7 shows a display example of the monitoring screen 23 when monitoring three ICU patients (Patient A, Patient B, and Patient C) with one display device 15 . That is, basically, on the monitoring screen 23, a vital signs monitoring image 32A of patient A, a vital signs monitoring image 32B of patient B, and a vital signs monitoring image 32C of patient C are displayed side by side.
  • an icon 71A for displaying the monitoring image 33 of the patient A an icon 72A for displaying the water balance monitoring image 35 of the patient A, urine and drainage monitoring of the patient A
  • An icon 73A for displaying the image 36 an icon 74A for displaying the respiratory monitoring image 34 of the patient A, an icon 75A for displaying the sedation monitoring image 37 of the patient A, and a postural change monitoring image of the patient A.
  • An icon 76A for displaying 38 is displayed.
  • icons 71B to 76B are displayed below the vital signs monitoring image 32B
  • icons 71C to 76C are displayed below the vital signs monitoring image 32C.
  • the display of the vital sign monitoring image 32A on the monitoring screen 23 is switched to the same image tab as the monitoring image 33 (FIG. 8).
  • the display of the vital sign monitoring image 32A on the monitoring screen 23 is switched to the moisture balance tab (FIG. 8) similar to the moisture balance monitoring image 35.
  • the display of the vital sign monitoring image 32A on the monitoring screen 23 is switched to the drainage tab (FIG. 8) similar to the urine/drainage monitoring image 36.
  • the icon 73A displays an unread mark 43A notifying that there is one unconfirmed update information, and the same unread mark 43A is displayed on the drainage tab shown in FIG. is displayed.
  • the monitoring system 11 can monitor multiple ICU patients with a single display device 15, and can clearly notify which items are unconfirmed by the unread marks 43A. As a result, the nurse can appropriately confirm the contents of the update information, and the efficiency of the monitoring work can be improved.
  • the display device 15 is configured with a patient camera 81 , line-of-sight detection sensor 82 , and microphone 83 . Then, the monitoring system 11 can connect the information processing device 16 to the remote monitoring terminal 91 via a network and allow communication to be performed.
  • the monitoring terminal 91 has the same function as the sedation analysis unit 63, and analyzes the video and audio signals when the nurse evaluates the sedation of the ICU patient via the network, automatically sedation may be calculated.
  • the score of the RASS evaluation method is used as an example of an evaluation index used to evaluate the degree of sedation.
  • the score of the RASS evaluation method is evaluated in 10 stages (+4 to -5) centering on 0, and the terms and explanations corresponding to each score are as shown. is.
  • the RASS evaluation method has the contents shown in steps 1 and 2, and the degree of sedation is evaluated based on the ICU patient's behavior and responses to calls.
  • the monitoring system 11 it is preferable to apply the monitoring system 11 to remote monitoring when human resources are scarce or when the risk of infectious diseases is high.
  • FIG. 11 is a block diagram showing a configuration example of one embodiment of a computer in which a program for executing the series of processes described above is installed.
  • the program can be recorded in advance in the hard disk 105 or ROM 103 as a recording medium built into the computer.
  • the program can be stored (recorded) in a removable recording medium 111 driven by the drive 109.
  • a removable recording medium 111 can be provided as so-called package software.
  • the removable recording medium 111 includes, for example, a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto Optical) disk, DVD (Digital Versatile Disc), magnetic disk, semiconductor memory, and the like.
  • the program can be installed in the computer from the removable recording medium 111 as described above, or can be downloaded to the computer via a communication network or broadcasting network and installed in the hard disk 105 incorporated therein. That is, for example, the program is transferred from the download site to the computer wirelessly via an artificial satellite for digital satellite broadcasting, or transferred to the computer by wire via a network such as a LAN (Local Area Network) or the Internet. be able to.
  • LAN Local Area Network
  • the computer incorporates a CPU (Central Processing Unit) 102 , and an input/output interface 110 is connected to the CPU 102 via a bus 101 .
  • a CPU Central Processing Unit
  • an input/output interface 110 is connected to the CPU 102 via a bus 101 .
  • the CPU 102 executes a program stored in a ROM (Read Only Memory) 103 according to a command input by the user through the input/output interface 110 by operating the input unit 107 or the like. Alternatively, the CPU 102 loads a program stored in the hard disk 105 into a RAM (Random Access Memory) 104 and executes it.
  • ROM Read Only Memory
  • RAM Random Access Memory
  • the CPU 102 performs the processing according to the above-described flowchart or the processing performed by the configuration of the above-described block diagram. Then, the CPU 102 outputs the processing result from the output unit 106 via the input/output interface 110, transmits it from the communication unit 108, or records it in the hard disk 105 as necessary.
  • the input unit 107 is composed of a keyboard, mouse, microphone, and the like. Also, the output unit 106 is configured by an LCD (Liquid Crystal Display), a speaker, and the like.
  • LCD Liquid Crystal Display
  • processing performed by the computer according to the program does not necessarily have to be performed in chronological order according to the order described as the flowchart.
  • processing performed by a computer according to a program includes processing that is executed in parallel or individually (for example, parallel processing or processing by objects).
  • the program may be processed by one computer (processor), or may be processed by a plurality of computers in a distributed manner. Furthermore, the program may be transferred to a remote computer and executed.
  • a system means a set of multiple components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device housing a plurality of modules in one housing, are both systems. .
  • the configuration described as one device (or processing unit) may be divided and configured as a plurality of devices (or processing units).
  • the configuration described above as a plurality of devices (or processing units) may be collectively configured as one device (or processing unit).
  • part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit) as long as the configuration and operation of the system as a whole are substantially the same. .
  • this technology can take a configuration of cloud computing in which a single function is shared and processed jointly by multiple devices via a network.
  • the above-described program can be executed on any device.
  • the device should have the necessary functions (functional blocks, etc.) and be able to obtain the necessary information.
  • each step described in the flowchart above can be executed by a single device, or can be shared and executed by a plurality of devices.
  • the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.
  • a plurality of processes included in one step can also be executed as processes of a plurality of steps.
  • the processing described as multiple steps can also be collectively executed as one step.
  • the program executed by the computer may be such that the processing of the steps described in the program is executed in chronological order according to the order described herein, or in parallel, or when the call is made. They may be executed individually at necessary timings such as occasions. That is, as long as there is no contradiction, the processing of each step may be executed in an order different from the order described above. Furthermore, the processing of the steps describing this program may be executed in parallel with the processing of other programs, or may be executed in combination with the processing of other programs.
  • Real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle are signals obtained by sensing the patient.
  • a data processing unit that acquires by data processing that analyzes the a display control unit that performs display control to display the real-time information and the interval information on a display unit in display layouts that are displayed in different display areas;
  • control is performed on the display control unit to notify that the update has occurred, and confirmation content is performed in response to the confirmation of the notification.
  • an information processing system comprising: a control unit that controls recording in a recording unit.
  • the real-time information includes the patient's vital information, the patient's monitoring video, and the patient's breathing rate and breathing pattern;
  • the information processing system according to (1) above wherein the interval information includes the patient's water balance, the patient's urine color and drainage color, the patient's sedation level, and the patient's postural change.
  • the data processing unit analyzes a video signal obtained by imaging the patient and a measurement signal obtained by measuring a predetermined part related to the patient's breathing, and the patient's breathing rate and breathing pattern as analysis results.
  • the measurement signal is a measurement signal obtained by measuring the patient's thorax fluctuation pattern with a millimeter wave radar, or a measurement signal obtained by measuring the neck muscle movement of the patient with an RGB-D camera capable of acquiring depth information together with a color image.
  • the data processing unit has a liquid state analysis unit that analyzes a video signal obtained by photographing the patient and acquires the patient's water balance, urine color and drainage color as analysis results.
  • the information processing system according to any one of (2) to (4).
  • the liquid state analysis unit analyzes a video signal for monitoring the infusion ingested by the patient to obtain an infusion volume, and analyzes a video signal for monitoring the drainage discharged from the patient to obtain a drainage volume.
  • the information processing system according to (5) above, wherein the water balance of the patient is obtained based on the difference between the infusion amount and the drainage amount.
  • the liquid state analysis unit performs image recognition on a video signal for monitoring the infusion ingested by the patient, recognizes the name and flow rate of the medicine used as the infusion, and causes the recording unit to record the above (5). Or the information processing system according to (6).
  • the liquid state analysis unit presents the symptoms of the patient estimated from the color of the patient's drainage obtained by analyzing a video signal for monitoring the drainage discharged from the patient. ) to any information processing system.
  • the data processing unit has a sedation level analysis unit that analyzes a video signal obtained by imaging the patient and obtains the sedation level of the patient as an analysis result.
  • Information processing system as described.
  • the sedation analysis unit analyzes the patient's appearance such as facial expression, behavior, and line of sight, and analyzes the voice that is the content of the response given by the nurse to the patient, thereby determining the patient's sedation level.
  • (11) The information processing system according to (9) or (10) above, wherein the sedation level of the patient is remotely evaluated using a monitoring terminal connected via a network.
  • the information processing system according to (2) wherein the data processing unit includes a postural change analyzing unit that analyzes a video signal obtained by imaging the patient and obtains the postural change of the patient as an analysis result.
  • the postural change analysis unit estimates a posture of the patient or the nurse from the video signal, and determines whether or not there is a postural change of the patient.
  • the display control unit causes the display unit to display a plurality of the patient's vital information side by side, and displays an icon for displaying the real-time information and the interval information other than the vital information. information processing system.
  • Real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle are signals obtained by sensing the patient.
  • obtained by data processing that analyzes the performing display control such that the real-time information and the interval information are displayed on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas;
  • control is performed to notify that the update has occurred, and control to record the confirmation content in a recording unit in response to the confirmation of the notification.
  • a method of processing information including performing (16) In the computer of the information processing system, Real-time information obtained by monitoring the patient in real time with a relatively short measurement period and interval information obtained by monitoring the patient with a relatively long measurement period at intervals are signals obtained by sensing the patient. obtained by data processing that analyzes the performing display control such that the real-time information and the interval information are displayed on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas; When there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and control to record the confirmation content in a recording unit in response to the confirmation of the notification.
  • a program for executing information processing including performing
  • Monitoring system 12 Vital sensor, 13 Imaging system, 14 Millimeter wave radar, 15 Display device, 16 Information processing device, 21 Monitoring screen, 22 Work content confirmation screen, 23 Monitoring screen, 31 Attribute data display image, 32 Vital sign monitoring Images, 33 Monitoring images, 34 Respiration monitoring images, 35 Water balance monitoring images, 36 Urine/drainage monitoring images, 37 Sedation monitoring images, 38 Position change monitoring images, 41 Real-time information display area, 42 Interval information display area, 43 Unread mark, 51 signal acquisition unit, 52 memory, 53 recording unit, 54 central control unit, 55 display control unit, 56 data processing unit, 61 respiration analysis unit, 62 liquid state analysis unit, 63 sedation analysis unit, 64 posture conversion Analysis unit, 71 to 76 icons, 81 patient camera, 82 line-of-sight detection sensor, 83 microphone, 91 monitoring terminal

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

The present disclosure pertains to an information processing system, an information processing method, and a program with which it is possible to improve the efficiency of monitoring work. Real-time information obtained by monitoring a patient in real time at relatively short measurement periods and interval information obtained by monitoring a patient at relatively long measurement periods such that intervals are provided are acquired by data processing of analyzing a signal obtained by sensing a patient, and displayed on a display unit in a display layout in which the real-time information and the interval information are displayed in mutually different display regions. When there is a specific update to the real-time information and the interval information, control for communicating the fact that the update has taken place is carried out, and in response to the communication being checked, specifics that were checked are recorded in a record unit. The present technology can be applied, e.g., to a monitoring system for monitoring a patient.

Description

情報処理システムおよび情報処理方法、並びにプログラムInformation processing system, information processing method, and program
　本開示は、情報処理システムおよび情報処理方法、並びにプログラムに関し、特に、モニタリング業務の効率化を図ることができるようにした情報処理システムおよび情報処理方法、並びにプログラムに関する。 The present disclosure relates to an information processing system, an information processing method, and a program, and more particularly to an information processing system, an information processing method, and a program that can improve the efficiency of monitoring work.
　従来、ICU（Intensive Care Unit）を備える病院では、ICUに入室している患者（以下、ICU患者と称する）の様子を看護師がモニタリングし、モニタリングした内容を電子または紙面を媒体とする看護記録に記録するモニタリング業務を行っている。看護師は、このようなモニタリング業務に多くの時間を費やしているため、モニタリング業務の効率化が求められている。 Conventionally, in hospitals equipped with an ICU (Intensive Care Unit), nurses monitor the condition of patients in the ICU (hereinafter referred to as ICU patients), and the monitored contents are recorded in electronic or paper media. We are doing monitoring work to record in. Since nurses spend a lot of time on such monitoring work, efficiency of monitoring work is required.
　例えば、特許文献１には、カルテボタンがタッチされた時に、患者のバイタルサインデータが患者のEMRにカルテ記入されるべきことを介護者が確認するために使用する確認スクリーンを表示することが可能なグラフィカルユーザーインターフェース付きの病院用ベッドが開示されている。 For example, in US Pat. No. 6,200,000, when a chart button is touched, a confirmation screen can be displayed that the caregiver uses to confirm that the patient's vital signs data should be charted in the patient's EMR. A hospital bed with a graphical user interface is disclosed.
特開２０１２－８６０１３号公報JP 2012-86013 A
　ところで、ICU患者は一般病棟の患者よりも容態急変のリスクが高く、容態管理のためにより多くのモニタリングが必要となるため、ICU患者の看護師が行うモニタリング業務の効率化が求められている。また、ICU患者は容態急変のリスクが高く、適切なタイミングでのモニタリングを実施して、その結果を記録することが重要となるため、ICUにおけるモニタリング項目が膨大で業務負担が大きいことからもモニタリング業務の効率化が求められている。 By the way, ICU patients have a higher risk of sudden changes in their condition than those in general wards, and more monitoring is required for condition management, so there is a need to improve the efficiency of the monitoring work performed by nurses of ICU patients. In addition, ICU patients have a high risk of sudden changes in their condition, and it is important to monitor them at the appropriate time and record the results. Business efficiency is required.
　本開示は、このような状況に鑑みてなされたものであり、モニタリング業務の効率化を図ることができるようにするものである。 This disclosure has been made in view of this situation, and is intended to make it possible to improve the efficiency of monitoring operations.
　本開示の一側面の情報処理システムは、比較的に短い測定周期でリアルタイムに患者をモニタリングして得られるリアルタイム情報、および、比較的に長い測定周期でインターバルを設けて前記患者をモニタリングして得られるインターバル情報を、前記患者をセンシングした信号を解析するデータ処理によって取得するデータ処理部と、前記リアルタイム情報および前記インターバル情報が、それぞれ異なる表示領域に表示される表示レイアウトで表示部に表示させる表示制御を行う表示制御部と、前記リアルタイム情報および前記インターバル情報に特定の更新があった場合に、その更新があったことを通知させる制御を前記表示制御部に対して行って、前記通知が確認されたのに応じて確認内容を記録部に記録させる制御を行う制御部とを備える。 An information processing system according to one aspect of the present disclosure provides real-time information obtained by monitoring a patient in real time with a relatively short measurement cycle, and monitoring the patient at intervals with a relatively long measurement cycle. a data processing unit that acquires the interval information obtained by analyzing the signal obtained by sensing the patient; and a display that causes the display unit to display the real-time information and the interval information in a display layout in which the real-time information and the interval information are displayed in different display areas. A display control unit that performs control, and when there is a specific update in the real-time information and the interval information, the display control unit is controlled to notify that the update has occurred, and the notification is confirmed. and a control unit for performing control to record the confirmation content in the recording unit in response to the confirmation.
　本開示の一側面の情報処理方法またはプログラムは、比較的に短い測定周期でリアルタイムに患者をモニタリングして得られるリアルタイム情報、および、比較的に長い測定周期でインターバルを設けて前記患者をモニタリングして得られるインターバル情報を、前記患者をセンシングした信号を解析するデータ処理によって取得することと、前記リアルタイム情報および前記インターバル情報が、それぞれ異なる表示領域に表示される表示レイアウトで表示部に表示させる表示制御を行うことと、前記リアルタイム情報および前記インターバル情報に特定の更新があった場合に、その更新があったことを通知させる制御を行って、前記通知が確認されたのに応じて確認内容を記録部に記録させる制御を行うことを含む。 An information processing method or program according to one aspect of the present disclosure includes real-time information obtained by monitoring a patient in real time with a relatively short measurement cycle, and monitoring the patient at intervals with a relatively long measurement cycle. acquiring the interval information obtained by performing data processing for analyzing the signal obtained by sensing the patient; and displaying the real-time information and the interval information on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas. and, when there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and when the notification is confirmed, the confirmation content is confirmed. This includes controlling recording in the recording unit.
　本開示の一側面においては、比較的に短い測定周期でリアルタイムに患者をモニタリングして得られるリアルタイム情報、および、比較的に長い測定周期でインターバルを設けて患者をモニタリングして得られるインターバル情報が、患者をセンシングした信号を解析するデータ処理によって取得され、リアルタイム情報およびインターバル情報が、それぞれ異なる表示領域に表示される表示レイアウトで表示部に表示させる表示制御が行われる。そして、リアルタイム情報およびインターバル情報に特定の更新があった場合に、その更新があったことを通知させる制御が行われて、通知が確認されたのに応じて確認内容を記録部に記録させる制御が行われる。 In one aspect of the present disclosure, real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle, and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle. , real-time information and interval information acquired by data processing that analyzes a signal obtained by sensing a patient, and are displayed on the display unit in a display layout in which the real-time information and the interval information are displayed in different display areas. Then, when there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and control is performed to record the confirmation content in the recording unit in response to the confirmation of the notification. is done.
本技術を適用したモニタリングシステムの一実施の形態の構成例を示すブロック図である。1 is a block diagram showing a configuration example of an embodiment of a monitoring system to which the present technology is applied; FIG. モニタリング画面の第１の表示例を示す図である。FIG. 10 is a diagram showing a first display example of a monitoring screen; 情報処理装置の構成例を示すブロック図である。It is a block diagram which shows the structural example of an information processing apparatus. モニタリング処理を説明するフローチャートである。4 is a flowchart for explaining monitoring processing; ***変換があった際の作業確認処理を説明するフローチャートである。FIG. 11 is a flowchart for explaining work confirmation processing when there is a change in posture; FIG. 作業内容確認画面の表示例を示す図である。It is a figure which shows the example of a display of a work content confirmation screen. モニタリング画面の第２の表示例を示す図である。FIG. 10 is a diagram showing a second display example of the monitoring screen; 各アイコンの表示内容を示す図である。It is a figure which shows the display content of each icon. モニタリングシステムを利用した遠隔評価について説明する図である。It is a figure explaining the remote evaluation using a monitoring system. 評価指標の一例を示す図である。It is a figure which shows an example of an evaluation index. 本技術を適用したコンピュータの一実施の形態の構成例を示すブロック図である。1 is a block diagram showing a configuration example of an embodiment of a computer to which the present technology is applied; FIG.
　以下、本技術を適用した具体的な実施の形態について、図面を参照しながら詳細に説明する。 Specific embodiments to which the present technology is applied will be described in detail below with reference to the drawings.
　＜モニタリングシステムの構成例＞
　図１は、本技術を適用したモニタリングシステムの一実施の形態の構成例を示す図である。 <Configuration example of monitoring system>
FIG. 1 is a diagram showing a configuration example of an embodiment of a monitoring system to which the present technology is applied.
　図１に示すモニタリングシステム１１は、バイタルセンサ１２、撮像システム１３、ミリ波レーダ１４、表示デバイス１５、および情報処理装置１６を備えて構成される。 The monitoring system 11 shown in FIG. 1 includes a vital sensor 12, an imaging system 13, a millimeter wave radar 14, a display device 15, and an information processing device 16.
　バイタルセンサ１２は、ICU患者のバイタルサイン（例えば、脈拍や血圧、体温など）を測定し、その測定結果として得られるバイタルサイン測定信号を情報処理装置１６に供給する。 The vital sensor 12 measures the ICU patient's vital signs (for example, pulse, blood pressure, body temperature, etc.) and supplies the information processing device 16 with a vital sign measurement signal obtained as a result of the measurement.
　撮像システム１３は、複数のRGBカメラにより構成される。例えば、それぞれのRGBカメラは、ICU患者をモニタリングするための映像や、輸液および排液をモニタリングするための映像などを撮像する。そして、撮像システム１３は、それらを撮像して得られる映像信号を情報処理装置１６に供給する。 The imaging system 13 is composed of multiple RGB cameras. For example, each RGB camera captures video for monitoring ICU patients, video for monitoring infusion and drainage, and so on. Then, the imaging system 13 supplies video signals obtained by imaging them to the information processing device 16 .
　ミリ波レーダ１４は、ICU患者の胸郭変動パターンを測定するために、例えば、布団や衣類を透過してICU患者の体表の運動を検出することが可能なミリ波の周波数帯域の電磁波を送受信する。そして、ミリ波レーダ１４は、ICU患者の体表で反射した電磁波を受信した結果として得られるミリ波測定信号を情報処理装置１６に供給する。 The millimeter-wave radar 14 transmits and receives electromagnetic waves in the millimeter-wave frequency band that are capable of detecting the movement of the body surface of the ICU patient, for example, through blankets and clothing, in order to measure the thoracic fluctuation pattern of the ICU patient. do. Then, the millimeter wave radar 14 supplies the information processing device 16 with a millimeter wave measurement signal obtained as a result of receiving the electromagnetic waves reflected by the body surface of the ICU patient.
　表示デバイス１５は、情報処理装置１６による表示制御に従って、モニタリングシステム１１においてICU患者をモニタリングするためのモニタリング画面（後述の図２参照）を表示する。 The display device 15 displays a monitoring screen (see FIG. 2 described later) for monitoring ICU patients in the monitoring system 11 according to display control by the information processing device 16 .
　情報処理装置１６は、バイタルセンサ１２から供給されるバイタルサイン測定信号、撮像システム１３から供給される映像信号、ミリ波レーダ１４から供給されるミリ波測定信号を用いて、ICU患者のモニタリングに必要な各種の解析を行う情報処理を実行する。そして、情報処理装置１６は、その情報処理を実行して得られる解析結果を、表示デバイス１５のモニタリング画面を表示させる。 The information processing device 16 uses the vital sign measurement signal supplied from the vital sensor 12, the video signal supplied from the imaging system 13, and the millimeter wave measurement signal supplied from the millimeter wave radar 14 to monitor the ICU patients. Executes information processing that performs various types of analysis. Then, the information processing device 16 displays the analysis result obtained by executing the information processing on the monitoring screen of the display device 15 .
　＜モニタリング画面の第１の表示例＞
　図２は、表示デバイス１５に表示されるモニタリング画面の第１の表示例を示す図である。 <First display example of the monitoring screen>
FIG. 2 is a diagram showing a first display example of the monitoring screen displayed on the display device 15. As shown in FIG.
　図２に示すように、モニタリング画面２１には、属性データ表示画像３１、バイタルサインモニタリング画像３２、モニタリング映像３３、呼吸モニタリング画像３４、水分バランスモニタリング画像３５、尿・排液モニタリング画像３６、鎮静度モニタリング画像３７、および***変換モニタリング画像３８が表示される。 As shown in FIG. 2, the monitoring screen 21 includes an attribute data display image 31, a vital signs monitoring image 32, a monitoring video 33, a respiration monitoring image 34, a water balance monitoring image 35, a urine/discharge monitoring image 36, and a sedation level. A monitoring image 37 and a postural change monitoring image 38 are displayed.
　属性データ表示画像３１には、モニタリングの対象となっているICU患者の属性を示すデータが表示され、例えば、現在の日時、患者名、年齢、性別、および、体重が表示される。 The attribute data display image 31 displays data indicating the attributes of the ICU patient being monitored, such as the current date and time, patient name, age, gender, and weight.
　バイタルサインモニタリング画像３２には、バイタルセンサ１２により測定されたICU患者のバイタルサインが表示され、例えば、ECG（Electrocardiogram）、SpO2（Saturation of Percutaneous Oxygen）、およびRESP（Respiratory）が表示される。 The vital sign monitoring image 32 displays the ICU patient's vital signs measured by the vital sensor 12, for example, ECG (Electrocardiogram), SpO2 (Saturation of Percutaneous Oxygen), and RESP (Respiratory) are displayed.
　モニタリング映像３３には、撮像システム１３のRGBカメラにより撮像されたICU患者をモニタリングするための映像が表示される。 In the monitoring image 33, an image for monitoring the ICU patient imaged by the RGB camera of the imaging system 13 is displayed.
　呼吸モニタリング画像３４には、撮像システム１３のRGBカメラにより撮像されたICU患者の映像と、ミリ波レーダ１４により計測されたICU患者の胸郭変動パターンとに基づいて、情報処理装置１６において解析されたICU患者の呼吸数および呼吸パターンが表示される。 The respiration monitoring image 34 includes the image of the ICU patient captured by the RGB camera of the imaging system 13 and the chest fluctuation pattern of the ICU patient measured by the millimeter wave radar 14, and analyzed by the information processing device 16. The ICU patient's breathing rate and breathing pattern are displayed.
　水分バランスモニタリング画像３５には、撮像システム１３のRGBカメラにより撮像された輸液および排液をモニタリングするための映像に基づいて、情報処理装置１６において解析されたICU患者の水分バランスの変化が表示される。例えば、図示する表示例では、１時間ごとの測定周期で、投薬などによってICU患者が摂取した水分の摂取量、および、排尿などによりICU患者から排出された水分の排出量を示す棒グラフとともに、水分の摂取量および排出量の差分に基づいて求められる水分バランスを示す折れ線グラフが表示されている。 The water balance monitoring image 35 displays changes in the water balance of the ICU patient analyzed by the information processing device 16 based on the video for monitoring the infusion and drainage captured by the RGB camera of the imaging system 13. be. For example, in the illustrated display example, a bar graph showing the amount of water taken in by the ICU patient due to medication and the amount of water discharged from the ICU patient due to urination etc. A line graph is displayed showing the water balance determined based on the difference in the intake and output of .
　尿・排液モニタリング画像３６には、撮像システム１３のRGBカメラにより撮像された輸液および排液をモニタリングするための映像に基づいて、情報処理装置１６において解析されたICU患者の尿色変化およびドレーン排液色変化が表示される。例えば、図示する表示例では、１時間ごとの測定周期で、尿およびドレーン排液の量を示す棒グラフが、それぞれ測定された尿色およびドレーン排液色に応じた色（図ではハッチング）で表示されている。 The urine/drainage monitoring image 36 shows changes in urine color and drainage of the ICU patient analyzed by the information processing device 16 based on the images for monitoring the infusion and drainage captured by the RGB camera of the imaging system 13 . Discharge color change is displayed. For example, in the illustrated display example, a bar graph indicating the amount of urine and drain fluid is displayed in a color (hatched in the figure) corresponding to the color of the measured urine and drain fluid at each hourly measurement cycle. It is
　鎮静度モニタリング画像３７には、撮像システム１３のRGBカメラにより撮像されたICU患者の映像に基づいて、情報処理装置１６において解析されたICU患者の鎮静度の変化が表示される。図示する表示例では、１時間ごとの測定周期で、ICU患者が安静であるときのスコアを０として求められた鎮静度を示す折れ線グラフが表示されている。 The sedation monitoring image 37 displays the change in the sedation level of the ICU patient analyzed by the information processing device 16 based on the image of the ICU patient captured by the RGB camera of the imaging system 13 . In the illustrated display example, a line graph is displayed showing the degree of sedation obtained by setting the score to 0 when the ICU patient is at rest at an hourly measurement cycle.
　***変換モニタリング画像３８には、撮像システム１３のRGBカメラにより撮像されたICU患者の映像に基づいて、情報処理装置１６において解析されたICU患者の***変換の経過が表示される。図示する表示例では、１時間ごとの測定周期で、ICU患者の***変換の経過が表示されるとともに、前回の***変換が行われた時刻および***、並びに、次回予定される***変換を行う時刻および***が表示されている。 The posture change monitoring image 38 displays the progress of the ICU patient's posture change analyzed by the information processing device 16 based on the ICU patient's image captured by the RGB camera of the imaging system 13 . In the illustrated display example, the progress of the ICU patient's position change is displayed at an hourly measurement cycle, along with the time and position of the previous position change, and the time of the next scheduled position change. and posture are displayed.
　ここで、以下、数秒未満などの比較的に短い測定周期でリアルタイムにモニタリングされるバイタルサイン、モニタリング映像、並びに、呼吸数および呼吸パターンを、リアルタイム情報と称する。また、１時間間隔などの比較的に長い測定周期でインターバルを設けてモニタリングされる水分バランス、排液変化、鎮静度、および***変換を、インターバル情報と称する。 Here, hereinafter, the vital signs, monitoring images, respiration rate and respiration pattern that are monitored in real time with a relatively short measurement period such as less than several seconds are referred to as real-time information. Also, water balance, drainage change, sedation level, and postural change monitored at relatively long measurement intervals such as one-hour intervals are referred to as interval information.
　図２に示すように、モニタリング画面２１では、リアルタイム情報に対応するバイタルサインモニタリング画像３２、モニタリング映像３３、および呼吸モニタリング画像３４が、リアルタイム情報表示領域４１にまとめて表示される。また、モニタリング画面２１では、インターバル情報に対応する水分バランスモニタリング画像３５、尿・排液モニタリング画像３６、鎮静度モニタリング画像３７、および***変換モニタリング画像３８が、インターバル情報表示領域４２にまとめて表示される。 As shown in FIG. 2, on the monitoring screen 21, a vital signs monitoring image 32, a monitoring video 33, and a respiration monitoring image 34 corresponding to real-time information are collectively displayed in a real-time information display area 41. In addition, on the monitoring screen 21, a water balance monitoring image 35, a urine/discharge monitoring image 36, a sedation monitoring image 37, and a postural change monitoring image 38 corresponding to the interval information are collectively displayed in the interval information display area 42. be.
　また、モニタリング画面２１には、看護師が未確認となっている更新情報がある場合には、未読マーク４３が表示されて、未確認の更新情報があることが通知される。例えば、リアルタイム情報およびインターバル情報に特定の更新（所定の閾値以上の大きな変化が検出されたような更新）があった場合に、未読マーク４３が表示される。図示する表示例では、尿・排液モニタリング画像３６に未読マーク４３が表示されており、看護師に対する通知が必要となるような変化が尿または排液の色や量に生じたことが通知される。例えば、看護師が更新情報を確認すると、更新情報の内容を看護師が確認したことを示す確認情報（看護師が更新内容を確認した時刻や、看護師の名前、更新情報の内容）が、自動的に、図３の記録部５３のEMR（Electronic Medical Record）に記録される。 Also, on the monitoring screen 21, if there is update information that has not been confirmed by the nurse, an unread mark 43 is displayed to notify that there is unconfirmed update information. For example, the unread mark 43 is displayed when there is a specific update (an update in which a large change equal to or greater than a predetermined threshold is detected) in real-time information and interval information. In the illustrated display example, an unread mark 43 is displayed on the urine/effluent monitoring image 36 to notify that a change in the color or amount of urine or effluent requiring notification to the nurse has occurred. be. For example, when a nurse confirms the update information, the confirmation information indicating that the nurse has confirmed the contents of the update information (the time the nurse confirmed the update contents, the name of the nurse, the contents of the update information) is It is automatically recorded in the EMR (Electronic Medical Record) of the recording unit 53 in FIG.
　このようなモニタリング画面２１によって、看護師は、ICU患者の属性情報に加えて、リアルタイム情報およびインターバル情報を一括で確認することができる。また、未読マーク４３を表示することによって、未確認の更新情報があることが明確にすることができ、看護師が更新情報を見落とすリスクを回避することができる。 With such a monitoring screen 21, nurses can collectively check real-time information and interval information in addition to ICU patient attribute information. In addition, by displaying the unread mark 43, it is possible to clarify that there is unconfirmed update information, thereby avoiding the risk of the nurse overlooking the update information.
　なお、モニタリング画面２１では、ICU患者に必要となるモニタリングの項目に応じて、バイタルサインモニタリング画像３２、モニタリング映像３３、呼吸モニタリング画像３４、水分バランスモニタリング画像３５、尿・排液モニタリング画像３６、鎮静度モニタリング画像３７、および***変換モニタリング画像３８の表示が自動調整される。例えば、重要となるモニタリングの項目を大きく表示したり、不要なモニタリングの項目を非表示にしたりすることができる。例えば、モニタリングシステム１１を構成するセンシング機器（カメラやセンサなど）によって、これらの項目を柔軟に入れ替えてもよい。 In addition, on the monitoring screen 21, depending on the items of monitoring required for the ICU patient, a vital signs monitoring image 32, a monitoring image 33, a respiration monitoring image 34, a water balance monitoring image 35, a urine/discharge monitoring image 36, a sedation The display of the degree monitoring image 37 and the postural change monitoring image 38 is automatically adjusted. For example, important monitoring items can be displayed in a large size, and unnecessary monitoring items can be hidden. For example, these items may be flexibly replaced depending on sensing devices (cameras, sensors, etc.) configuring the monitoring system 11 .
　また、バイタルサイン、モニタリング映像、並びに、呼吸数および呼吸パターンのリアルタイム情報は、看護師が指定した閾値や時間間隔に応じて、バイタルサインモニタリング画像３２、モニタリング映像３３、呼吸モニタリング画像３４に通知が表示されるようにしてもよい。また、リアルタイム情報およびインターバル情報ともに、通知には複数の段階があり、急変の際には強い通知、定時確認の際には弱い通知が行われる。このとき、それぞれの通知は、バイタルサインモニタリング画像３２、モニタリング映像３３、呼吸モニタリング画像３４、水分バランスモニタリング画像３５、尿・排液モニタリング画像３６、鎮静度モニタリング画像３７、および***変換モニタリング画像３８それぞれに行われる。これにより、看護師は、どの項目を確認すべきかを容易に認識することができる。 In addition, real-time information on vital signs, monitoring images, and respiration rate and respiration pattern is notified to the vital signs monitoring image 32, monitoring image 33, and respiration monitoring image 34 according to thresholds and time intervals specified by the nurse. may be displayed. In addition, both real-time information and interval information have a plurality of stages of notification, and strong notification is performed in the event of a sudden change, and weak notification is performed in the case of scheduled confirmation. At this time, each notification includes a vital signs monitoring image 32, a monitoring image 33, a respiration monitoring image 34, a water balance monitoring image 35, a urine/discharge monitoring image 36, a sedation monitoring image 37, and a postural change monitoring image 38, respectively. is performed on This allows the nurse to easily recognize which items should be checked.
　例えば、それぞれの画像の枠が光ったり、枠の中に赤い丸が表示されたりするように、視覚的な変化によって通知が行われる。また、後述する図８の未読マーク４３Ａのように、未読通知件数が数字で表されるようにすることで、看護師が、未確認事項の種類および総数を容易に把握することができる。 For example, notifications are made through visual changes, such as the frame of each image shining or a red circle being displayed within the frame. In addition, by displaying the number of unread notices numerically like the unread mark 43A in FIG. 8, which will be described later, the nurse can easily grasp the types and total number of unconfirmed items.
　また、これらの通知は、表示デバイス１５のモニタリング画面２１に表示する他、例えば、看護師が持ち運んでいる携帯端末（例えば、スマートフォンのアプリ）によって行われるようにしてもよい。 In addition to being displayed on the monitoring screen 21 of the display device 15, these notifications may also be made, for example, by a mobile terminal (for example, a smartphone application) carried by the nurse.
　＜情報処理装置の構成例＞
　図３は、情報処理装置１６の構成例を示すブロック図である。 <Configuration example of information processing device>
FIG. 3 is a block diagram showing a configuration example of the information processing device 16. As shown in FIG.
　図３に示すように、情報処理装置１６は、信号取得部５１、メモリ５２、記録部５３、中央制御部５４、表示制御部５５、およびデータ処理部５６を備えて構成される。 As shown in FIG. 3, the information processing device 16 includes a signal acquisition unit 51, a memory 52, a recording unit 53, a central control unit 54, a display control unit 55, and a data processing unit 56.
　信号取得部５１は、バイタルセンサ１２から供給されるバイタルサイン測定信号、撮像システム１３から供給される映像信号、ミリ波レーダ１４から供給されるミリ波測定信号を取得して、中央制御部５４に供給する。また、信号取得部５１は、例えば、タッチパネルやボタンなどの操作入力部（図示せず）に対して看護師による操作が行われると、その操作に応じた操作信号を取得して中央制御部５４に供給する。 The signal acquisition unit 51 acquires the vital sign measurement signal supplied from the vital sensor 12, the video signal supplied from the imaging system 13, and the millimeter wave measurement signal supplied from the millimeter wave radar 14, and sends them to the central control unit 54. supply. Further, for example, when an operation input unit (not shown) such as a touch panel or a button is operated by a nurse, the signal acquisition unit 51 acquires an operation signal corresponding to the operation, and the central control unit 54 supply to
　メモリ５２は、ROM（Read Only Memory）やRAM（Random Access Memory）などにより構成され、中央制御部５４が制御を行うときに一時的に記憶することが必要となる各種のデータを記憶する。 The memory 52 is composed of ROM (Read Only Memory), RAM (Random Access Memory), etc., and stores various data that need to be temporarily stored when the central control unit 54 performs control.
　記録部５３は、例えば、HDD（Hard Disk Drive）などにより構成され、中央制御部５４による制御に従って、モニタリングシステム１１において残しておく必要がある情報をEMRに記録する。 The recording unit 53 is composed of, for example, an HDD (Hard Disk Drive) or the like, and records information that needs to be retained in the monitoring system 11 in the EMR under the control of the central control unit 54.
　中央制御部５４は、CPU（Central Processing Unit）により構成され、情報処理装置１６の各ブロックを制御する。例えば、中央制御部５４は、信号取得部５１から供給されるバイタルサイン測定信号を記録部５３に記録させるとともに、表示制御部５５に供給してバイタルサインモニタリング画像３２にバイタルサインを表示させる。また、中央制御部５４は、信号取得部５１から供給される映像信号を、表示制御部５５に供給してモニタリング映像３３にICU患者の映像を表示させる。また、中央制御部５４は、信号取得部５１から供給される映像信号およびミリ波測定信号をデータ処理部５６に供給して、ICU患者のモニタリングに必要な各種の解析を行わせ、それらの解析結果を表示制御部５５に供給する。 The central control unit 54 is composed of a CPU (Central Processing Unit) and controls each block of the information processing device 16 . For example, the central control unit 54 causes the recording unit 53 to record the vital signs measurement signal supplied from the signal acquiring unit 51 and supplies the display control unit 55 with the vital signs monitoring image 32 to display the vital signs. The central control unit 54 also supplies the video signal supplied from the signal acquisition unit 51 to the display control unit 55 to display the image of the ICU patient on the monitoring image 33 . In addition, the central control unit 54 supplies the video signal and the millimeter wave measurement signal supplied from the signal acquisition unit 51 to the data processing unit 56 to perform various analyzes necessary for monitoring the ICU patient. The result is supplied to the display control section 55 .
　表示制御部５５は、中央制御部５４による制御に従って、表示デバイス１５に対する表示を制御し、モニタリング画面２１を表示させる。 The display control unit 55 controls the display on the display device 15 and displays the monitoring screen 21 according to the control by the central control unit 54 .
　データ処理部５６は、呼吸解析部６１、液体状態解析部６２、鎮静度解析部６３、および***変換解析部６４によって構成される。 The data processing unit 56 is composed of a respiration analysis unit 61, a liquid state analysis unit 62, a sedation analysis unit 63, and a postural transformation analysis unit 64.
　呼吸解析部６１は、映像信号およびミリ波測定信号を用いて、ICU患者の呼吸数および呼吸パターンを非接触で解析する。一般的に、ICU患者は、人工呼吸器や酸素マスクなどを利用した呼吸管理を受けていることが多く、呼吸数などは既にモニタリングされているケースが多いと想定される。しかしながら、胸郭や頸部筋肉に顕在化されるような呼吸パターンは現状目視確認となっている。これに対し、非接触で常時モニタリングすることでICU患者の容態を容易に管理することができるようになる。 The respiration analysis unit 61 uses video signals and millimeter wave measurement signals to non-contactly analyze the respiration rate and respiration pattern of ICU patients. In general, ICU patients often receive respiratory management using artificial respirators and oxygen masks, and it is assumed that there are many cases in which the respiratory rate is already being monitored. However, breathing patterns manifested in the ribcage and neck muscles are currently visually confirmed. On the other hand, constant non-contact monitoring makes it easier to manage the condition of ICU patients.
　そこで、呼吸解析部６１は、映像信号に対する画像認識処理を行って、ICU患者の所定部位（例えば、胸部や頸部など）を認識して測定対象を抽出し、その測定対象の動き量をミリ波測定信号から検出する。例えば、ICU患者の体が動いた場合、呼吸解析部６１映像信号に基づいて測定対象を抽出し直すことで、ミリ波測定信号のアーチファクト補正を行うことができる。そして、呼吸解析部６１は、ミリ波測定信号の変動に基づいて、即ち、呼吸に伴うICU患者の胸部や頸部など変動に基づいて、ICU患者の呼吸数および呼吸パターンを解析することができる。 Therefore, the respiratory analysis unit 61 performs image recognition processing on the video signal, recognizes a predetermined part of the ICU patient (for example, the chest and neck), extracts the measurement target, and measures the amount of movement of the measurement target in millimeters. wave measurement signal. For example, when the body of the ICU patient moves, artifact correction of the millimeter wave measurement signal can be performed by re-extracting the measurement target based on the video signal of the respiratory analysis unit 61 . Then, the respiration analysis unit 61 can analyze the respiration rate and respiration pattern of the ICU patient based on the variation of the millimeter wave measurement signal, that is, based on the variation of the ICU patient's chest and neck associated with respiration. .
　例えば、ミリ波レーダ１４のみを利用した場合には、周囲環境を認識することが難しくICU患者の体動や看護師の介入によるアーチファクトや、測定対象以外の運動を誤検出することなどが懸念される。これに対し、モニタリングシステム１１は、撮像システム１３およびミリ波レーダ１４を利用することで、呼吸解析部６１が、映像信号に基づいて測定対象を抽出するこができ、このような誤検出を回避することができる。従って、モニタリングシステム１１では、胸郭変動パターンの検出精度の向上を図ることができる。 For example, if only the millimeter-wave radar 14 is used, it is difficult to recognize the surrounding environment, and artifacts due to body movements of ICU patients and interventions by nurses, and erroneous detection of movements other than those to be measured may occur. be. On the other hand, in the monitoring system 11, the imaging system 13 and the millimeter wave radar 14 are used so that the respiratory analysis unit 61 can extract the measurement target based on the video signal, thereby avoiding such erroneous detection. can do. Therefore, in the monitoring system 11, it is possible to improve the detection accuracy of the thorax variation pattern.
　なお、本実施の形態では、撮像システム１３およびミリ波レーダ１４を用いてICU患者の呼吸を非接触で解析する手法について説明したが、それ以外の手法を用いてもよい。例えば、カラー画像とともに奥行き情報を取得可能なRGB-Dカメラを用いて、努力呼吸時に顕出する頸部筋肉の運動を測定し、その測定信号を解析して呼吸を評価してもよい。なお、RGB-Dカメラの波長レンジでは布団を透過することができないため、頸部筋肉を測定対象として測定が行われる。 In addition, in the present embodiment, a method for non-contact analysis of respiration of an ICU patient using the imaging system 13 and the millimeter wave radar 14 has been described, but other methods may be used. For example, an RGB-D camera capable of acquiring depth information as well as color images may be used to measure neck muscle movement that appears during forced breathing, and the measurement signal may be analyzed to evaluate respiration. In addition, since the wavelength range of the RGB-D camera cannot penetrate the futon, the measurement is performed with the neck muscles as the measurement target.
　そして、呼吸解析部６１により解析されたICU患者の呼吸数および呼吸パターンの解析結果は、中央制御部５４を介して表示制御部５５に供給され、モニタリング画面２１の呼吸モニタリング画像３４に表示される。 The analysis results of the respiratory rate and respiratory pattern of the ICU patient analyzed by the respiratory analysis unit 61 are supplied to the display control unit 55 via the central control unit 54 and displayed on the respiratory monitoring image 34 of the monitoring screen 21. .
　ここで、ICU患者の呼吸を非接触でセンシングする状況は、ICU患者が自発呼吸することができるケース、および、ICU患者に人工呼吸器が装着されているケースが想定される。 Here, the situations in which the ICU patient's breathing is sensed without contact are assumed to be cases in which the ICU patient can breathe spontaneously, and cases in which the ICU patient is fitted with a ventilator.
　例えば、ICU患者が自発呼吸することができるケースでは、映像信号に基づいた画像認識処理を行って、ICU患者の呼吸に関する所定部位（例えば、胸部や頸部など）を認識して、ROI（Region of Interest）を設定する。そして、ROI内の動き量をミリ波レーダ１４やRGB-Dカメラを利用して取得し、ICU患者の体動がある場合位は、映像信号に基づいた画像認識処理によってアーチファクト補正を行って、ICU患者の呼吸数および呼吸パターンを解析することができる。このように、測定対象に対してROIを設定することで、出力データの削減、高速化、および低消費電力化を図ることができる。さらに、様々なラインがICU患者に付けられている場合でも、測定対象に対してROIを設定することで、外乱影響を軽減して測定対象を確実に測定することができる。 For example, in the case where an ICU patient can breathe spontaneously, image recognition processing is performed based on the video signal to recognize the predetermined parts related to breathing of the ICU patient (for example, the chest and neck) and ROI (Region of Interest). Then, the amount of motion in the ROI is acquired using the millimeter wave radar 14 and the RGB-D camera, and if there is body motion of the ICU patient, artifact correction is performed by image recognition processing based on the video signal, Respiratory rates and patterns of ICU patients can be analyzed. By setting the ROI for the object to be measured in this way, it is possible to reduce the amount of output data, increase the speed, and reduce power consumption. Furthermore, even if various lines are attached to the ICU patient, by setting the ROI for the measurement target, the influence of disturbance can be reduced and the measurement target can be reliably measured.
　また、ICU患者に人工呼吸器が装着されているケースでは、人工呼吸器の設定を映像信号や外部入力から取得し、ICU患者が自発呼吸することができるケースと同様に、ICU患者の呼吸数および呼吸パターンを解析する。そして、この解析結果に基づいて、FFT（Fast Fourier Transform）や機械学習などを利用して、自発呼吸と人工呼吸とを分離することができる。例えば、自発呼吸が残っている場合や自発呼吸が戻ってくる場合には、自発呼吸と人工呼吸とを区別することで、人工呼吸の離脱をより安全に行うことができる。 In addition, in the case where the ICU patient is fitted with a ventilator, the setting of the ventilator is acquired from the video signal or external input, and the respiratory rate of the ICU patient is calculated as in the case where the ICU patient can breathe spontaneously. and analyze breathing patterns. Then, based on this analysis result, FFT (Fast Fourier Transform), machine learning, etc. can be used to separate spontaneous respiration and artificial respiration. For example, when spontaneous respiration remains or spontaneous respiration returns, weaning from artificial respiration can be performed more safely by distinguishing between spontaneous respiration and artificial respiration.
　液体状態解析部６２は、映像信号を用いて、ICU患者の水分バランス、尿色、およびドレーン排液色を解析する。上述したように、撮像システム１３のRGBカメラでは輸液および排液をモニタリングするための映像が撮像されている。例えば、１台目のRGBカメラで、輸液ポンプやシリンジなどの周辺が撮像され、２台目のRGBカメラで、排液チャンバーの周辺が撮像される。そして、液体状態解析部６２は、ICU患者に摂取される輸液をモニタリングする映像信号を解析して輸液量を求め、ICU患者から排出される排液（尿およびドレーン）をモニタリングする映像信号を解析して排液量を求めて、輸液量および排液量の差分に基づいて患者の水分バランスを取得することができる。 The liquid state analysis unit 62 uses video signals to analyze the ICU patient's water balance, urine color, and drain discharge color. As described above, the RGB camera of the imaging system 13 captures images for monitoring the infusion and drainage. For example, the first RGB camera captures an image of the periphery of an infusion pump, a syringe, and the like, and the second RGB camera captures the periphery of a drainage chamber. Then, the liquid state analysis unit 62 analyzes the video signal for monitoring the infusion ingested by the ICU patient to obtain the infusion volume, and analyzes the video signal for monitoring the drainage (urine and drain) discharged from the ICU patient. to determine the drainage volume, and the patient's fluid balance can be obtained based on the difference between the infusion volume and the drainage volume.
　また、液体状態解析部６２は、輸液をモニタリングする映像信号に対する画像認識（例えば、光学文字認識）を行って、輸液パックに印字されている薬の名称および流量を認識することができる。そして、液体状態解析部６２は、認識した薬の名称および流量を、記録部５３のEMRに記録させることができる。 In addition, the liquid state analysis unit 62 can perform image recognition (for example, optical character recognition) on the video signal for monitoring the infusion to recognize the name and flow rate of the medicine printed on the infusion pack. The liquid state analysis unit 62 can record the name and flow rate of the recognized medicine in the EMR of the recording unit 53 .
　例えば、ICU患者の容態安定において水分バランスの管理は非常に重要である。そのため、摂取量と排液量を手動で計算して記録する作業と比較して、この作業が自動化されることによって業務効率が向上される。 For example, managing fluid balance is extremely important in stabilizing the condition of ICU patients. Therefore, compared to manually calculating and recording intake and drainage volumes, automation of this task will improve operational efficiency.
　そして、液体状態解析部６２により解析されたICU患者の水分バランス、尿色、およびドレーン排液色の解析結果は、中央制御部５４を介して表示制御部５５に供給され、モニタリング画面２１の水分バランスモニタリング画像３５および尿・排液モニタリング画像３６に表示される。なお、液体状態解析部６２は、例えば、排液の色に基づいてICU患者が発症している可能性のある症状を分析し、その分析結果をモニタリング画面２１に表示することで看護師に提示してもよい。 The analysis results of the ICU patient's water balance, urine color, and drain discharge color analyzed by the liquid state analysis unit 62 are supplied to the display control unit 55 via the central control unit 54, and the water content of the monitoring screen 21 is displayed. It is displayed on the balance monitoring image 35 and the urine/discharge monitoring image 36 . In addition, the liquid state analysis unit 62, for example, analyzes the symptoms that the ICU patient may be developing based on the color of the drainage, and presents the analysis result to the nurse by displaying it on the monitoring screen 21. You may
　鎮静度解析部６３は、映像信号を用いて、ICU患者の鎮静度を解析する。例えば、鎮静度解析部６３は、鎮静度評価の指標であるRASS（Richmond Agitation-Sedation Scale）を、ICU患者の表情や、行動、視線などの外観を解析したり、看護師がICU患者に対して行う受け答えの内容となる音声を解析したりすることで、自動的に演算により求めることができる。 The sedation analysis unit 63 uses video signals to analyze the sedation of ICU patients. For example, the sedation analysis unit 63 uses RASS (Richmond Agitation-Sedation Scale), which is an index of sedation evaluation, to analyze the appearance of ICU patients such as facial expressions, behaviors, and gazes. By analyzing the voice that is the content of the answer given by the user, it is possible to automatically calculate it.
　そして、鎮静度解析部６３により解析されたICU患者の鎮静度の解析結果は、中央制御部５４を介して表示制御部５５に供給され、モニタリング画面２１の鎮静度モニタリング画像３７に表示される。 The analysis result of the sedation level of the ICU patient analyzed by the sedation level analysis unit 63 is supplied to the display control unit 55 via the central control unit 54 and displayed on the sedation monitoring image 37 of the monitoring screen 21.
　***変換解析部６４は、映像信号を用いて、ICU患者の***変換を解析する。例えば、***変換解析部６４は、公知技術である機械学習（Open Poseなど）による解析手法を用いて映像信号を解析し、ICU患者または看護師の姿勢を推定することで、***変換が実施されたかどうかを判別することができる。 The postural change analysis unit 64 uses the video signal to analyze the postural change of the ICU patient. For example, the postural change analysis unit 64 analyzes the video signal using an analysis method based on machine learning (Open Pose, etc.), which is a known technology, and estimates the posture of the ICU patient or nurse, so that the postural change is performed. It is possible to determine whether
　そして、***変換解析部６４により解析されたICU患者の***変換の解析結果は、中央制御部５４を介して表示制御部５５に供給され、モニタリング画面２１の***変換モニタリング画像３８に表示される。 The analysis result of the ICU patient's postural change analyzed by the postural change analysis unit 64 is supplied to the display control unit 55 via the central control unit 54 and displayed on the postural change monitoring image 38 of the monitoring screen 21.
　以上のように情報処理装置１６は構成されており、図２に示したモニタリング画面２１を表示デバイス１５に表示して看護師に確認させ、自動的に、看護師による確認内容を記録部５３のEMRに記録することができる。これにより、看護師は、ICU患者を効果的にモニタリングすることができ、モニタリング業務の効率化によって、看護師の業務負担の軽減を図ることができる。 The information processing device 16 is configured as described above, and the monitoring screen 21 shown in FIG. Can be recorded in EMR. As a result, nurses can effectively monitor ICU patients, and by improving the efficiency of monitoring work, it is possible to reduce the workload of nurses.
　＜モニタリング処理の処理例＞
　図４に示すフローチャートを参照して、情報処理装置１６において実行されるモニタリング処理について説明する。 <Processing example of monitoring processing>
The monitoring process executed in the information processing device 16 will be described with reference to the flowchart shown in FIG.
　例えば、モニタリングシステム１１が起動すると処理が開始され、ステップＳ１１において、信号取得部５１は、バイタルセンサ１２から供給されるバイタルサイン測定信号、撮像システム１３から供給される映像信号、ミリ波レーダ１４から供給されるミリ波測定信号を取得して、中央制御部５４に供給する。中央制御部５４は、映像信号およびミリ波測定信号をデータ処理部５６に供給する。 For example, when the monitoring system 11 is activated, the process is started, and in step S11, the signal acquisition unit 51 acquires the vital sign measurement signal supplied from the vital sensor 12, the video signal supplied from the imaging system 13, and the millimeter wave radar 14. The supplied millimeter wave measurement signal is acquired and supplied to the central control unit 54 . The central control unit 54 supplies the video signal and the millimeter wave measurement signal to the data processing unit 56 .
　ステップＳ１２において、中央制御部５４は、ステップＳ１１で信号取得部５１から供給されるバイタルサイン測定信号を記録部５３に記録させるとともに、表示制御部５５に供給する。表示制御部５５は、表示デバイス１５に対する表示を制御し、モニタリング画面２１に表示されているバイタルサインモニタリング画像３２におけるバイタルサインの表示を更新する。 In step S<b>12 , the central control unit 54 causes the recording unit 53 to record the vital sign measurement signal supplied from the signal acquisition unit 51 in step S<b>11 , and supplies the signal to the display control unit 55 . The display control unit 55 controls the display on the display device 15 and updates the display of vital signs in the vital signs monitoring image 32 displayed on the monitoring screen 21 .
　ステップＳ１３において、中央制御部５４は、ステップＳ１１で信号取得部５１から供給される映像信号を、表示制御部５５に供給する。表示制御部５５は、表示デバイス１５に対する表示を制御し、モニタリング画面２１に表示されているモニタリング映像３３におけるICU患者の映像の表示を更新する。 In step S13, the central control unit 54 supplies the video signal supplied from the signal acquisition unit 51 in step S11 to the display control unit 55. The display control unit 55 controls the display on the display device 15 and updates the display of the ICU patient image in the monitoring image 33 displayed on the monitoring screen 21 .
　ステップＳ１４において、データ処理部５６では、呼吸解析部６１が、ステップＳ１１で中央制御部５４から供給された映像信号およびミリ波測定信号を用いて、上述したようにICU患者の呼吸数および呼吸パターンを解析し、その解析結果を中央制御部５４に供給する。中央制御部５４は、ICU患者の呼吸数および呼吸パターンの解析結果を記録部５３に記録させるとともに、表示制御部５５に供給する。表示制御部５５は、表示デバイス１５に対する表示を制御し、モニタリング画面２１に表示されている呼吸モニタリング画像３４における呼吸数および呼吸パターンの表示を更新する。 In step S14, in the data processing unit 56, the respiration analysis unit 61 uses the video signal and millimeter-wave measurement signal supplied from the central control unit 54 in step S11 to calculate the respiration rate and respiration pattern of the ICU patient as described above. is analyzed, and the analysis result is supplied to the central control unit 54 . The central control unit 54 causes the recording unit 53 to record the analysis result of the respiratory rate and breathing pattern of the ICU patient, and supplies the result to the display control unit 55 . The display control unit 55 controls the display on the display device 15 and updates the display of the respiratory rate and respiratory pattern in the respiratory monitoring image 34 displayed on the monitoring screen 21 .
　ステップＳ１５において、データ処理部５６では、液体状態解析部６２が、ステップＳ１１で中央制御部５４から供給された映像信号を用いて、上述したようにICU患者の水分バランス、尿色、およびドレーン排液色を解析し、その解析結果を中央制御部５４に供給する。中央制御部５４は、ICU患者の水分バランス、尿色、およびドレーン排液色の解析結果を記録部５３に記録させるとともに、表示制御部５５に供給する。表示制御部５５は、表示デバイス１５に対する表示を制御し、モニタリング画面２１に表示されている水分バランスモニタリング画像３５における水分バランスの表示を更新し、尿・排液モニタリング画像３６における尿色およびドレーン排液色の表示を更新する。 In step S15, in the data processing unit 56, the liquid state analysis unit 62 uses the video signal supplied from the central control unit 54 in step S11 to determine the water balance, urine color, and drain discharge of the ICU patient as described above. The liquid color is analyzed and the analysis result is supplied to the central control unit 54 . The central control unit 54 causes the recording unit 53 to record the analysis results of the ICU patient's water balance, urine color, and drain discharge color, and supplies them to the display control unit 55 . The display control unit 55 controls the display on the display device 15, updates the display of the water balance in the water balance monitoring image 35 displayed on the monitoring screen 21, and adjusts the urine color and drain discharge in the urine/discharge monitoring image 36. Update liquid color display.
　ステップＳ１６において、データ処理部５６では、鎮静度解析部６３が、ステップＳ１１で中央制御部５４から供給された映像信号を用いて、上述したようにICU患者の鎮静度を解析し、その解析結果を中央制御部５４に供給する。中央制御部５４は、ICU患者の鎮静度の解析結果を記録部５３に記録させるとともに、表示制御部５５に供給する。表示制御部５５は、表示デバイス１５に対する表示を制御し、モニタリング画面２１に表示されている鎮静度モニタリング画像３７における鎮静度の表示を更新する。 In step S16, in the data processing unit 56, the sedation analysis unit 63 uses the video signal supplied from the central control unit 54 in step S11 to analyze the sedation of the ICU patient as described above. is supplied to the central control unit 54 . The central control unit 54 causes the recording unit 53 to record the analysis result of the sedation level of the ICU patient, and supplies the result to the display control unit 55 . The display control unit 55 controls the display on the display device 15 and updates the sedation level display in the sedation level monitoring image 37 displayed on the monitoring screen 21 .
　ステップＳ１７において、データ処理部５６では、***変換解析部６４が、ステップＳ１１で中央制御部５４から供給された映像信号を用いて、上述したようにICU患者の***変換を解析し、その解析結果を中央制御部５４に供給する。中央制御部５４は、ICU患者の***変換の解析結果を記録部５３に記録させるとともに、表示制御部５５に供給する。表示制御部５５は、表示デバイス１５に対する表示を制御し、モニタリング画面２１に表示されている***変換モニタリング画像３８における***変換の表示を更新する。 In step S17, in the data processing unit 56, the postural change analysis unit 64 uses the video signal supplied from the central control unit 54 in step S11 to analyze the postural change of the ICU patient as described above. is supplied to the central control unit 54 . The central control unit 54 causes the recording unit 53 to record the analysis result of the postural change of the ICU patient, and supplies the result to the display control unit 55 . The display control unit 55 controls the display on the display device 15 and updates the display of the postural change in the postural change monitoring image 38 displayed on the monitoring screen 21 .
　ステップＳ１８において、中央制御部５４は、バイタルサイン、モニタリング映像、呼吸数および呼吸パターン、水分バランス、尿色、ドレーン排液色、鎮静度、並びに、***変換について、看護師に対する通知が必要となる変化が生じた情報更新があったか否かを判定する。 In step S18, the central control unit 54 needs to notify the nurse of vital signs, monitoring images, respiration rate and respiration pattern, water balance, urine color, drain color, sedation level, and postural change. It is determined whether or not there has been an information update with a change.
　ステップＳ１８において、中央制御部５４が、看護師に対する通知が必要となる変化が生じた情報更新がないと判定した場合、処理はステップＳ１１に戻り、以下、同様の処理が繰り返して行われる。一方、ステップＳ１８において、中央制御部５４が、看護師に対する通知が必要となる変化が生じた情報更新があると判定した場合、処理はステップＳ１９に進む。 In step S18, if the central control unit 54 determines that there is no information update with a change requiring notification to the nurse, the process returns to step S11, and the same process is repeated thereafter. On the other hand, if the central control unit 54 determines in step S18 that there is an information update that causes a change requiring notification to the nurse, the process proceeds to step S19.
　ステップＳ１９において、中央制御部５４は、バイタルサイン、モニタリング映像、呼吸数および呼吸パターン、水分バランス、尿色、ドレーン排液色、鎮静度、並びに、***変換のうち、情報更新があると判断された対象を表示制御部５５に通知する。表示制御部５５は、その通知された対象に応じて、バイタルサインモニタリング画像３２、モニタリング映像３３、呼吸モニタリング画像３４、水分バランスモニタリング画像３５、尿・排液モニタリング画像３６、鎮静度モニタリング画像３７、および***変換モニタリング画像３８のいずれかに、未確認の更新情報があることを通知する未読マーク４３を表示させる。 In step S19, the central control unit 54 determines that there is information update among vital signs, monitoring images, respiration rate and respiration pattern, water balance, urine color, drain color, sedation level, and postural change. The target to be displayed is notified to the display control unit 55 . The display control unit 55 displays the vital signs monitoring image 32, the monitoring video 33, the respiration monitoring image 34, the water balance monitoring image 35, the urine/discharge monitoring image 36, the sedation monitoring image 37, and the postural change monitoring image 38, an unread mark 43 notifying that there is unconfirmed update information is displayed.
　そして、看護師が未読マーク４３に対する操作（例えば、表示デバイス１５のタッチパネルに対するタッチ）を行うと、その操作信号を信号取得部５１が取得して中央制御部５４に供給する。これに応じて、中央制御部５４は、表示制御部５５に対する制御を行って、更新情報の内容をモニタリング画面２１に表示させる。 Then, when the nurse performs an operation on the unread mark 43 (for example, touches the touch panel of the display device 15), the signal acquisition unit 51 acquires the operation signal and supplies it to the central control unit 54. In response, the central control unit 54 controls the display control unit 55 to display the contents of the update information on the monitoring screen 21 .
　ステップＳ２０において、中央制御部５４は、ステップＳ１９でモニタリング画面２１に表示させた更新情報の内容を看護師に確認させたことを示す確認情報を記録部５３に記録させる。その後、処理はステップＳ１１に戻り、以下、同様の処理が繰り返して行われる。なお、ステップＳ１２乃至１４の処理は、信号取得部５１が信号を取得するタイミングに応じた比較的に短い測定周期で行われ、ステップＳ１５乃至１７の処理は、１時間間隔などの比較的に長い測定周期で行われる。 In step S20, the central control unit 54 causes the recording unit 53 to record confirmation information indicating that the nurse has confirmed the content of the update information displayed on the monitoring screen 21 in step S19. After that, the process returns to step S11, and the same process is repeated thereafter. Note that the processing of steps S12 to 14 is performed at relatively short measurement intervals corresponding to the timing at which the signal acquisition unit 51 acquires signals, and the processing of steps S15 to 17 is performed at relatively long intervals such as one hour intervals. This is done at the measurement cycle.
　以上のように、情報処理装置１６がモニタリング処理を実行することよって、モニタリングシステム１１は、看護師に対する通知が必要となる変化が生じた情報更新があった場合に未読マーク４３によって通知し、看護師が更新情報の内容を確認するだけで、確認情報を自動的に記録することができる。これにより、モニタリングシステム１１は、モニタリング業務の効率化を図ることができる。 As described above, when the information processing device 16 executes the monitoring process, the monitoring system 11 notifies the nurse with the unread mark 43 when there is an information update that causes a change requiring notification to the nurse. Only by confirming the contents of the update information by the teacher, the confirmation information can be automatically recorded. Thereby, the monitoring system 11 can improve the efficiency of the monitoring work.
　図５は、***変換があった際の作業確認処理について説明するフローチャートである。 FIG. 5 is a flow chart explaining the work confirmation process when there is a position change.
　ステップＳ３１において、***変換解析部６４は、公知技術である機械学習（Open Poseなど）による解析手法を用いて映像信号を解析し、ICU患者または看護師の姿勢を推定する。 In step S31, the postural transformation analysis unit 64 analyzes the video signal using an analysis technique based on machine learning (Open Pose, etc.), which is a known technique, and estimates the posture of the ICU patient or nurse.
　ステップＳ３２において、***変換解析部６４は、ステップＳ３１で推定した姿勢に基づいて、ICU患者の***変換があったか否かを判定する。 In step S32, the postural change analysis unit 64 determines whether or not the ICU patient's postural change has occurred based on the posture estimated in step S31.
　ステップＳ３２において、***変換解析部６４が、ICU患者の***変換がなかったと判定した場合、処理はステップＳ３１に戻り、以下、同様の処理が繰り返される。一方、ステップＳ３２において、***変換解析部６４が、ICU患者の***変換があったと判定した場合、処理はステップＳ３３に進む。 In step S32, if the postural change analysis unit 64 determines that the ICU patient's postural change has not occurred, the process returns to step S31, and the same process is repeated thereafter. On the other hand, in step S32, when the postural change analysis unit 64 determines that the ICU patient's postural change has occurred, the process proceeds to step S33.
　ステップＳ３３において、***変換解析部６４は、ICU患者の***変換があったと判定したことを中央制御部５４に通知する。中央制御部５４は、図６に示すような作業内容確認画面２２をモニタリング画面２１に重畳して表示するように、表示制御部５５に対する制御を行う。図６に示すように、作業内容確認画面２２には、ICU患者の***変換があったと判定された時刻と、***変換の有無を確認するためのユーザインタフェース（Yes/No）が表示される。 In step S33, the postural change analysis unit 64 notifies the central control unit 54 that it has determined that the ICU patient's postural change has occurred. The central control unit 54 controls the display control unit 55 so that the work content confirmation screen 22 as shown in FIG. 6 is superimposed on the monitoring screen 21 and displayed. As shown in FIG. 6, the work content confirmation screen 22 displays the time when it was determined that the ICU patient's position was changed, and a user interface (Yes/No) for confirming the presence or absence of the position change.
　そして、看護師が作業内容確認画面２２のユーザインタフェース（Yes/No）に対する操作（例えば、表示デバイス１５のタッチパネルに対するタッチ）を行うと、その操作信号を信号取得部５１が取得して中央制御部５４に供給し、中央制御部５４は看護師による操作内容を認識する。 Then, when the nurse operates the user interface (Yes/No) of the work content confirmation screen 22 (for example, touches the touch panel of the display device 15), the signal acquisition unit 51 acquires the operation signal and the central control unit 54, and the central control unit 54 recognizes the contents of the operation by the nurse.
　ステップＳ３４において、中央制御部５４は、看護師による作業内容確認画面２２に対する操作内容とともに、ICU患者の***変換の作業内容（***変換の実施時刻や***など）を記録部５３のEMRに記録させる。 In step S34, the central control unit 54 causes the EMR of the recording unit 53 to record the operation details of the work content confirmation screen 22 by the nurse and the work details of the postural change of the ICU patient (postural change implementation time, postural position, etc.). .
　ステップＳ３５において、中央制御部５４は、表示制御部５５に対する制御を行い、表示デバイス１５のモニタリング画面２１に表示されている***変換モニタリング画像３８における***変換の表示を更新する。その後、処理はステップＳ３１に戻り、以下、同様の処理が繰り返して行われる。 In step S<b>35 , the central control unit 54 controls the display control unit 55 to update the posture change display in the posture change monitoring image 38 displayed on the monitoring screen 21 of the display device 15 . After that, the process returns to step S31, and the same process is repeated thereafter.
　以上のような作業確認処理を行うことによって、モニタリング業務の効率化を図ることができる。特に、ICU患者は寝たきりである場合が多く、褥瘡防止の目的で頻繁に***変換する必要があり、作業確認処理によってICU患者の***変換の作業内容をEMRに自動的に記録することで、看護師の負担を大幅に軽減することができる。 By performing the above work confirmation process, it is possible to improve the efficiency of monitoring work. In particular, ICU patients are often bedridden and need to change positions frequently for the purpose of preventing pressure ulcers. The burden on teachers can be greatly reduced.
　＜モニタリング画面の第２の表示例＞
　図７は、表示デバイス１５に表示されるモニタリング画面の第２の表示例を示す図である。 <Second display example of monitoring screen>
FIG. 7 is a diagram showing a second display example of the monitoring screen displayed on the display device 15. As shown in FIG.
　例えば、モニタリングシステム１１では、看護師が、複数のICU患者を１台の表示デバイス１５でモニタリングするような利用が想定され、表示デバイス１５には、図７に示すようなモニタリング画面２３が表示される。モニタリング画面２３では、基本的に、複数の患者名とともに重要度の高い情報であるバイタルサインモニタリング画像３２がそれぞれ並んで表示される。そして、看護師は、モニタリング画面２３に表示されているアイコン７１乃至７６に対する操作を行うことで、アイコン７１乃至７６それぞれに対応する画像を、バイタルサインモニタリング画像３２から切り替えて表示させることができる。 For example, the monitoring system 11 is assumed to be used by a nurse to monitor multiple ICU patients with one display device 15, and the display device 15 displays a monitoring screen 23 as shown in FIG. be. On the monitoring screen 23, basically, vital sign monitoring images 32, which are highly important information, are displayed side by side along with a plurality of patient names. By operating the icons 71 to 76 displayed on the monitoring screen 23 , the nurse can switch the images corresponding to the icons 71 to 76 from the vital sign monitoring image 32 and display them.
　図７には、３人のICU患者（患者Ａ、患者Ｂ、患者Ｃ）を１台の表示デバイス１５でモニタリングする際のモニタリング画面２３の表示例が示されている。即ち、モニタリング画面２３には、基本的に、患者Ａのバイタルサインモニタリング画像３２Ａ、患者Ｂのバイタルサインモニタリング画像３２Ｂ、および患者Ｃのバイタルサインモニタリング画像３２Ｃが並んで表示される。 FIG. 7 shows a display example of the monitoring screen 23 when monitoring three ICU patients (Patient A, Patient B, and Patient C) with one display device 15 . That is, basically, on the monitoring screen 23, a vital signs monitoring image 32A of patient A, a vital signs monitoring image 32B of patient B, and a vital signs monitoring image 32C of patient C are displayed side by side.
　また、バイタルサインモニタリング画像３２Ａの下方には、患者Ａのモニタリング映像３３を表示させるためのアイコン７１Ａ、患者Ａの水分バランスモニタリング画像３５を表示させるためのアイコン７２Ａ、患者Ａの尿・排液モニタリング画像３６を表示させるためのアイコン７３Ａ、患者Ａの呼吸モニタリング画像３４を表示させるためのアイコン７４Ａ、患者Ａの鎮静度モニタリング画像３７を表示させるためのアイコン７５Ａ、および、患者Ａの***変換モニタリング画像３８を表示させるためのアイコン７６Ａが表示される。同様に、バイタルサインモニタリング画像３２Ｂの下方には、アイコン７１Ｂ乃至７６Ｂが表示され、バイタルサインモニタリング画像３２Ｃの下方には、アイコン７１Ｃ乃至７６Ｃが表示される。 Further, below the vital sign monitoring image 32A, an icon 71A for displaying the monitoring image 33 of the patient A, an icon 72A for displaying the water balance monitoring image 35 of the patient A, urine and drainage monitoring of the patient A An icon 73A for displaying the image 36, an icon 74A for displaying the respiratory monitoring image 34 of the patient A, an icon 75A for displaying the sedation monitoring image 37 of the patient A, and a postural change monitoring image of the patient A. An icon 76A for displaying 38 is displayed. Similarly, icons 71B to 76B are displayed below the vital signs monitoring image 32B, and icons 71C to 76C are displayed below the vital signs monitoring image 32C.
　例えば、アイコン７１Ａに対するタッチ操作が行われると、モニタリング画面２３のバイタルサインモニタリング画像３２Ａの表示が、モニタリング映像３３と同様の映像タブ（図８）に切り替えられる。同様に、アイコン７２Ａに対するタッチ操作が行われると、モニタリング画面２３のバイタルサインモニタリング画像３２Ａの表示が、水分バランスモニタリング画像３５と同様の水分バランスタブ（図８）に切り替えられる。 For example, when a touch operation is performed on the icon 71A, the display of the vital sign monitoring image 32A on the monitoring screen 23 is switched to the same image tab as the monitoring image 33 (FIG. 8). Similarly, when a touch operation is performed on the icon 72A, the display of the vital sign monitoring image 32A on the monitoring screen 23 is switched to the moisture balance tab (FIG. 8) similar to the moisture balance monitoring image 35.
　また、アイコン７３Ａに対するタッチ操作が行われると、モニタリング画面２３のバイタルサインモニタリング画像３２Ａの表示が、尿・排液モニタリング画像３６と同様の排液タブ（図８）に切り替えられる。ここで、図７に示すように、アイコン７３Ａには、未確認の更新情報が１件あることを通知する未読マーク４３Ａが表示されており、図８に示す排液タブにも同様の未読マーク４３Ａが表示される。 Further, when a touch operation is performed on the icon 73A, the display of the vital sign monitoring image 32A on the monitoring screen 23 is switched to the drainage tab (FIG. 8) similar to the urine/drainage monitoring image 36. Here, as shown in FIG. 7, the icon 73A displays an unread mark 43A notifying that there is one unconfirmed update information, and the same unread mark 43A is displayed on the drainage tab shown in FIG. is displayed.
　以下、同様に、アイコン７４Ａ乃至７６Ａに対するタッチ操作が行われると、呼吸モニタリング画像３４と同様の呼吸数・呼吸パターンタブ（図８）、鎮静度モニタリング画像３７と同様の鎮静度タブ（図８）、または***変換モニタリング画像３８と同様の***変換タブ（図８）に、それぞれ表示の切り替えが行われる。なお、アイコン７１Ｂ乃至７６Ｂおよびアイコン７１Ｃ乃至７６Ｃに対するタッチ操作についても、同様に表示の切り替えが行われる。 Thereafter, similarly, when the icons 74A to 76A are touched, the respiration rate/breathing pattern tab (FIG. 8) similar to the respiration monitoring image 34 and the sedation level tab (FIG. 8) similar to the sedation monitoring image 37 are displayed. , or a posture change tab (FIG. 8) similar to the posture change monitoring image 38, respectively. It should be noted that touch operations on the icons 71B to 76B and the icons 71C to 76C also switch the display in the same manner.
　以上のように、モニタリングシステム１１は、複数のICU患者を１台の表示デバイス１５でモニタリングすることができ、未読マーク４３Ａによって、どの項目が未確認かを明確に通知することができる。これにより、看護師は、更新情報の内容を適宜確認することができ、モニタリング業務の効率化を図ることができる。 As described above, the monitoring system 11 can monitor multiple ICU patients with a single display device 15, and can clearly notify which items are unconfirmed by the unread marks 43A. As a result, the nurse can appropriately confirm the contents of the update information, and the efficiency of the monitoring work can be improved.
　＜遠隔モニタリングの適用例＞
　図９を参照して、モニタリングシステム１１を遠隔モニタリングに適用する適用例について説明する。 <Application example of remote monitoring>
An application example in which the monitoring system 11 is applied to remote monitoring will be described with reference to FIG.
　図９に示すように、モニタリングシステム１１を遠隔モニタリングに適用する場合、表示デバイス１５は、患者用カメラ８１、視線検出センサ８２、およびマイク８３を備えられた構成となる。そして、モニタリングシステム１１は、ネットワークを介して、遠隔地にあるモニタリング端末９１に情報処理装置１６を接続して通信を行わせることができる。 As shown in FIG. 9 , when the monitoring system 11 is applied to remote monitoring, the display device 15 is configured with a patient camera 81 , line-of-sight detection sensor 82 , and microphone 83 . Then, the monitoring system 11 can connect the information processing device 16 to the remote monitoring terminal 91 via a network and allow communication to be performed.
　例えば、ICU患者の鎮静度を評価する場合、通常、看護師がICU患者に対面して、ICU患者の外観や呼びかけ応答などを目視にて確認することで評価している。これに対し、モニタリングシステム１１を遠隔モニタリングに適用することで、患者用カメラ８１、視線検出センサ８２、およびマイク８３を利用してモニタリング端末９１を介して看護師がICU患者を確認し、ICU患者の鎮静度を評価することができる。このとき、モニタリング端末９１が、鎮静度解析部６３と同様の機能を備えていて、ネットワークを介して看護師がICU患者の鎮静度を評価する際の映像信号および音声信号を解析して、自動的に鎮静度を算出してもよい。 For example, when evaluating the sedation level of an ICU patient, a nurse usually faces the ICU patient and visually confirms the patient's appearance and response to calls. On the other hand, by applying the monitoring system 11 to remote monitoring, the nurse confirms the ICU patient via the monitoring terminal 91 using the patient camera 81, the line-of-sight detection sensor 82, and the microphone 83, and the ICU patient sedation can be assessed. At this time, the monitoring terminal 91 has the same function as the sedation analysis unit 63, and analyzes the video and audio signals when the nurse evaluates the sedation of the ICU patient via the network, automatically sedation may be calculated.
　このような鎮静度の評価に用いる評価指標の一例として、RASS評価方法のスコアが用いられている。例えば、図１０のＡに示すように、RASS評価方法のスコアは、０を中心として１０段階（＋４～－５）で鎮静度が評価され、それぞれのスコアに対応する用語および説明は図示する通りである。また、図１０のＢに示すように、RASS評価方法は、ステップ１およびステップ２に示す内容で、ICU患者の行動や呼びかけの応答などから鎮静度の評価が行われる。 The score of the RASS evaluation method is used as an example of an evaluation index used to evaluate the degree of sedation. For example, as shown in A of FIG. 10, the score of the RASS evaluation method is evaluated in 10 stages (+4 to -5) centering on 0, and the terms and explanations corresponding to each score are as shown. is. In addition, as shown in FIG. 10B, the RASS evaluation method has the contents shown in steps 1 and 2, and the degree of sedation is evaluated based on the ICU patient's behavior and responses to calls.
　例えば、人的リソースが乏しい場合や感染症リスクが高い場合などにおいて、モニタリングシステム１１を遠隔モニタリングに適用することが好適である。 For example, it is preferable to apply the monitoring system 11 to remote monitoring when human resources are scarce or when the risk of infectious diseases is high.
　＜コンピュータの構成例＞
　次に、上述した一連の処理（情報処理方法）は、ハードウェアにより行うこともできるし、ソフトウェアにより行うこともできる。一連の処理をソフトウェアによって行う場合には、そのソフトウェアを構成するプログラムが、汎用のコンピュータ等にインストールされる。 <Computer configuration example>
Next, the series of processes (information processing method) described above can be performed by hardware or by software. When a series of processes is performed by software, a program that constitutes the software is installed in a general-purpose computer or the like.
　図１１は、上述した一連の処理を実行するプログラムがインストールされるコンピュータの一実施の形態の構成例を示すブロック図である。 FIG. 11 is a block diagram showing a configuration example of one embodiment of a computer in which a program for executing the series of processes described above is installed.
　プログラムは、コンピュータに内蔵されている記録媒体としてのハードディスク１０５やROM１０３に予め記録しておくことができる。 The program can be recorded in advance in the hard disk 105 or ROM 103 as a recording medium built into the computer.
　あるいはまた、プログラムは、ドライブ１０９によって駆動されるリムーバブル記録媒体１１１に格納（記録）しておくことができる。このようなリムーバブル記録媒体１１１は、いわゆるパッケージソフトウェアとして提供することができる。ここで、リムーバブル記録媒体１１１としては、例えば、フレキシブルディスク、CD-ROM(Compact Disc Read Only Memory)，MO(Magneto Optical)ディスク，DVD(Digital Versatile Disc)、磁気ディスク、半導体メモリ等がある。 Alternatively, the program can be stored (recorded) in a removable recording medium 111 driven by the drive 109. Such a removable recording medium 111 can be provided as so-called package software. Here, the removable recording medium 111 includes, for example, a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magneto Optical) disk, DVD (Digital Versatile Disc), magnetic disk, semiconductor memory, and the like.
　なお、プログラムは、上述したようなリムーバブル記録媒体１１１からコンピュータにインストールする他、通信網や放送網を介して、コンピュータにダウンロードし、内蔵するハードディスク１０５にインストールすることができる。すなわち、プログラムは、例えば、ダウンロードサイトから、ディジタル衛星放送用の人工衛星を介して、コンピュータに無線で転送したり、LAN(Local Area Network)、インターネットといったネットワークを介して、コンピュータに有線で転送することができる。 It should be noted that the program can be installed in the computer from the removable recording medium 111 as described above, or can be downloaded to the computer via a communication network or broadcasting network and installed in the hard disk 105 incorporated therein. That is, for example, the program is transferred from the download site to the computer wirelessly via an artificial satellite for digital satellite broadcasting, or transferred to the computer by wire via a network such as a LAN (Local Area Network) or the Internet. be able to.
　コンピュータは、CPU(Central Processing Unit)１０２を内蔵しており、CPU１０２には、バス１０１を介して、入出力インタフェース１１０が接続されている。 The computer incorporates a CPU (Central Processing Unit) 102 , and an input/output interface 110 is connected to the CPU 102 via a bus 101 .
　CPU１０２は、入出力インタフェース１１０を介して、ユーザによって、入力部１０７が操作等されることにより指令が入力されると、それに従って、ROM(Read Only Memory)１０３に格納されているプログラムを実行する。あるいは、CPU１０２は、ハードディスク１０５に格納されたプログラムを、RAM(Random Access Memory)１０４にロードして実行する。 The CPU 102 executes a program stored in a ROM (Read Only Memory) 103 according to a command input by the user through the input/output interface 110 by operating the input unit 107 or the like. . Alternatively, the CPU 102 loads a program stored in the hard disk 105 into a RAM (Random Access Memory) 104 and executes it.
　これにより、CPU１０２は、上述したフローチャートにしたがった処理、あるいは上述したブロック図の構成により行われる処理を行う。そして、CPU１０２は、その処理結果を、必要に応じて、例えば、入出力インタフェース１１０を介して、出力部１０６から出力、あるいは、通信部１０８から送信、さらには、ハードディスク１０５に記録等させる。 As a result, the CPU 102 performs the processing according to the above-described flowchart or the processing performed by the configuration of the above-described block diagram. Then, the CPU 102 outputs the processing result from the output unit 106 via the input/output interface 110, transmits it from the communication unit 108, or records it in the hard disk 105 as necessary.
　なお、入力部１０７は、キーボードや、マウス、マイク等で構成される。また、出力部１０６は、LCD(Liquid Crystal Display)やスピーカ等で構成される。 The input unit 107 is composed of a keyboard, mouse, microphone, and the like. Also, the output unit 106 is configured by an LCD (Liquid Crystal Display), a speaker, and the like.
　ここで、本明細書において、コンピュータがプログラムに従って行う処理は、必ずしもフローチャートとして記載された順序に沿って時系列に行われる必要はない。すなわち、コンピュータがプログラムに従って行う処理は、並列的あるいは個別に実行される処理（例えば、並列処理あるいはオブジェクトによる処理）も含む。 Here, in this specification, the processing performed by the computer according to the program does not necessarily have to be performed in chronological order according to the order described as the flowchart. In other words, processing performed by a computer according to a program includes processing that is executed in parallel or individually (for example, parallel processing or processing by objects).
　また、プログラムは、１のコンピュータ（プロセッサ）により処理されるものであっても良いし、複数のコンピュータによって分散処理されるものであっても良い。さらに、プログラムは、遠方のコンピュータに転送されて実行されるものであっても良い。 Also, the program may be processed by one computer (processor), or may be processed by a plurality of computers in a distributed manner. Furthermore, the program may be transferred to a remote computer and executed.
　さらに、本明細書において、システムとは、複数の構成要素（装置、モジュール（部品）等）の集合を意味し、すべての構成要素が同一筐体中にあるか否かは問わない。したがって、別個の筐体に収納され、ネットワークを介して接続されている複数の装置、及び、１つの筐体の中に複数のモジュールが収納されている１つの装置は、いずれも、システムである。 Furthermore, in this specification, a system means a set of multiple components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device housing a plurality of modules in one housing, are both systems. .
　また、例えば、１つの装置（または処理部）として説明した構成を分割し、複数の装置（または処理部）として構成するようにしてもよい。逆に、以上において複数の装置（または処理部）として説明した構成をまとめて１つの装置（または処理部）として構成されるようにしてもよい。また、各装置（または各処理部）の構成に上述した以外の構成を付加するようにしてももちろんよい。さらに、システム全体としての構成や動作が実質的に同じであれば、ある装置（または処理部）の構成の一部を他の装置（または他の処理部）の構成に含めるようにしてもよい。 Also, for example, the configuration described as one device (or processing unit) may be divided and configured as a plurality of devices (or processing units). Conversely, the configuration described above as a plurality of devices (or processing units) may be collectively configured as one device (or processing unit). Further, it is of course possible to add a configuration other than the above to the configuration of each device (or each processing unit). Furthermore, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit) as long as the configuration and operation of the system as a whole are substantially the same. .
　また、例えば、本技術は、１つの機能を、ネットワークを介して複数の装置で分担、共同して処理するクラウドコンピューティングの構成をとることができる。 In addition, for example, this technology can take a configuration of cloud computing in which a single function is shared and processed jointly by multiple devices via a network.
　また、例えば、上述したプログラムは、任意の装置において実行することができる。その場合、その装置が、必要な機能（機能ブロック等）を有し、必要な情報を得ることができるようにすればよい。 Also, for example, the above-described program can be executed on any device. In that case, the device should have the necessary functions (functional blocks, etc.) and be able to obtain the necessary information.
　また、例えば、上述のフローチャートで説明した各ステップは、１つの装置で実行する他、複数の装置で分担して実行することができる。さらに、１つのステップに複数の処理が含まれる場合には、その１つのステップに含まれる複数の処理は、１つの装置で実行する他、複数の装置で分担して実行することができる。換言するに、１つのステップに含まれる複数の処理を、複数のステップの処理として実行することもできる。逆に、複数のステップとして説明した処理を１つのステップとしてまとめて実行することもできる。 Also, for example, each step described in the flowchart above can be executed by a single device, or can be shared and executed by a plurality of devices. Furthermore, when one step includes a plurality of processes, the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices. In other words, a plurality of processes included in one step can also be executed as processes of a plurality of steps. Conversely, the processing described as multiple steps can also be collectively executed as one step.
　なお、コンピュータが実行するプログラムは、プログラムを記述するステップの処理が、本明細書で説明する順序に沿って時系列に実行されるようにしても良いし、並列に、あるいは呼び出しが行われたとき等の必要なタイミングで個別に実行されるようにしても良い。つまり、矛盾が生じない限り、各ステップの処理が上述した順序と異なる順序で実行されるようにしてもよい。さらに、このプログラムを記述するステップの処理が、他のプログラムの処理と並列に実行されるようにしても良いし、他のプログラムの処理と組み合わせて実行されるようにしても良い。 It should be noted that the program executed by the computer may be such that the processing of the steps described in the program is executed in chronological order according to the order described herein, or in parallel, or when the call is made. They may be executed individually at necessary timings such as occasions. That is, as long as there is no contradiction, the processing of each step may be executed in an order different from the order described above. Furthermore, the processing of the steps describing this program may be executed in parallel with the processing of other programs, or may be executed in combination with the processing of other programs.
　なお、本明細書において複数説明した本技術は、矛盾が生じない限り、それぞれ独立に単体で実施することができる。もちろん、任意の複数の本技術を併用して実施することもできる。例えば、いずれかの実施の形態において説明した本技術の一部または全部を、他の実施の形態において説明した本技術の一部または全部と組み合わせて実施することもできる。また、上述した任意の本技術の一部または全部を、上述していない他の技術と併用して実施することもできる。 It should be noted that the multiple techniques described in this specification can be implemented independently as long as there is no contradiction. Of course, it is also possible to use any number of the present techniques in combination. For example, part or all of the present technology described in any embodiment can be combined with part or all of the present technology described in other embodiments. Also, part or all of any of the techniques described above may be implemented in conjunction with other techniques not described above.
　＜構成の組み合わせ例＞
　なお、本技術は以下のような構成も取ることができる。
（１）
　比較的に短い測定周期でリアルタイムに患者をモニタリングして得られるリアルタイム情報、および、比較的に長い測定周期でインターバルを設けて前記患者をモニタリングして得られるインターバル情報を、前記患者をセンシングした信号を解析するデータ処理によって取得するデータ処理部と、
　前記リアルタイム情報および前記インターバル情報が、それぞれ異なる表示領域に表示される表示レイアウトで表示部に表示させる表示制御を行う表示制御部と、
　前記リアルタイム情報および前記インターバル情報に特定の更新があった場合に、その更新があったことを通知させる制御を前記表示制御部に対して行って、前記通知が確認されたのに応じて確認内容を記録部に記録させる制御を行う制御部と
　を備える情報処理システム。
（２）
　前記リアルタイム情報には、前記患者のバイタル情報、前記患者のモニタリング映像、並びに、前記患者の呼吸数および呼吸パターンが含まれ、
　前記インターバル情報には、前記患者の水分バランス、前記患者の尿色および排液色、前記患者の鎮静度、並びに、前記患者の***変換が含まれる
　上記（１）に記載の情報処理システム。
（３）
　前記データ処理部は、前記患者を撮影して得られる映像信号、および、前記患者の呼吸に関する所定部位を測定して得られる測定信号を解析し、前記患者の呼吸数および呼吸パターンを解析結果として取得する呼吸解析部を有する
　上記（２）に記載の情報処理システム。
（４）
　前記測定信号は、ミリ波レーダによって前記患者の胸郭変動パターンを測定した測定信号、または、カラー画像とともに奥行き情報を取得可能なRGB-Dカメラにより前記患者の頸部筋肉の運動を測定した測定信号である
　上記（３）に記載の情報処理システム。
（５）
　前記データ処理部は、前記患者を撮影して得られる映像信号を解析し、前記患者の水分バランス、並びに、前記患者の尿色および排液色を解析結果として取得する液体状態解析部を有する
　上記（２）から（４）までのいずれかに記載の情報処理システム。
（６）
　前記液体状態解析部は、前記患者に摂取される輸液をモニタリングする映像信号を解析して輸液量を求め、前記患者から排出される排液をモニタリングする映像信号を解析して排液量を求めて、前記輸液量および前記排液量の差分に基づいて前記患者の水分バランスを取得する
　上記（５）に記載の情報処理システム。
（７）
　前記液体状態解析部は、前記患者に摂取される輸液をモニタリングする映像信号に対する画像認識を行って、前記輸液として用いられる薬の名称および流量を認識し、前記記録部に記録させる
　上記（５）または（６）に記載の情報処理システム。
（８）
　前記液体状態解析部は、前記患者から排出される排液をモニタリングする映像信号を解析して得られる前記患者の排液色から推定される前記患者の症状を提示する
　上記（５）から（７）までのいずれかに記載の情報処理システム。
（９）
　前記データ処理部は、前記患者を撮影して得られる映像信号を解析し、前記患者の鎮静度を解析結果として取得する鎮静度解析部を有する
　上記（２）から（８）までのいずれかに記載の情報処理システム。
（１０）
　前記鎮静度解析部は、前記患者の表情、行動、および視線といった外観の解析、および、前記患者に対して看護師が行う受け答えの内容となる音声の解析を行うことで、前記患者の鎮静度を取得する
　上記（９）に記載の情報処理システム。
（１１）
　ネットワークを介して接続されるモニタリング端末を利用して、前記患者の鎮静度が遠隔で評価される
　上記（９）または（１０）に記載の情報処理システム。
（１２）
　前記データ処理部は、前記患者を撮影して得られる映像信号を解析し、前記患者の***変換を解析結果として取得する***変換解析部を有する
　上記（２）に記載の情報処理システム。
（１３）
　前記***変換解析部は、前記映像信号から前記患者または看護師の姿勢を推定し、前記患者の***変換があったか否かを判定する
　上記（１２）に記載の情報処理システム。
（１４）
　前記表示制御部は、複数の前記患者のバイタル情報を前記表示部に並べて表示させるとともに、前記バイタル情報以外の前記リアルタイム情報および前記インターバル情報を表示させるためのアイコンを表示させる
　上記（２）に記載の情報処理システム。
（１５）
　情報処理システムが、
　比較的に短い測定周期でリアルタイムに患者をモニタリングして得られるリアルタイム情報、および、比較的に長い測定周期でインターバルを設けて前記患者をモニタリングして得られるインターバル情報を、前記患者をセンシングした信号を解析するデータ処理によって取得することと、
　前記リアルタイム情報および前記インターバル情報が、それぞれ異なる表示領域に表示される表示レイアウトで表示部に表示させる表示制御を行うことと、
　前記リアルタイム情報および前記インターバル情報に特定の更新があった場合に、その更新があったことを通知させる制御を行って、前記通知が確認されたのに応じて確認内容を記録部に記録させる制御を行うこと
　を含む情報処理方法。
（１６）
　情報処理システムのコンピュータに、
　比較的に短い測定周期でリアルタイムに患者をモニタリングして得られるリアルタイム情報、および、比較的に長い測定周期でインターバルを設けて前記患者をモニタリングして得られるインターバル情報を、前記患者をセンシングした信号を解析するデータ処理によって取得することと、
　前記リアルタイム情報および前記インターバル情報が、それぞれ異なる表示領域に表示される表示レイアウトで表示部に表示させる表示制御を行うことと、
　前記リアルタイム情報および前記インターバル情報に特定の更新があった場合に、その更新があったことを通知させる制御を行って、前記通知が確認されたのに応じて確認内容を記録部に記録させる制御を行うこと
　を含む情報処理を実行させるためのプログラム。 <Configuration example combination>
Note that the present technology can also take the following configuration.
(1)
Real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle are signals obtained by sensing the patient. a data processing unit that acquires by data processing that analyzes the
a display control unit that performs display control to display the real-time information and the interval information on a display unit in display layouts that are displayed in different display areas;
When there is a specific update in the real-time information and the interval information, control is performed on the display control unit to notify that the update has occurred, and confirmation content is performed in response to the confirmation of the notification. an information processing system comprising: a control unit that controls recording in a recording unit.
(2)
the real-time information includes the patient's vital information, the patient's monitoring video, and the patient's breathing rate and breathing pattern;
The information processing system according to (1) above, wherein the interval information includes the patient's water balance, the patient's urine color and drainage color, the patient's sedation level, and the patient's postural change.
(3)
The data processing unit analyzes a video signal obtained by imaging the patient and a measurement signal obtained by measuring a predetermined part related to the patient's breathing, and the patient's breathing rate and breathing pattern as analysis results. The information processing system according to (2) above, including a respiratory analysis unit that acquires data.
(4)
The measurement signal is a measurement signal obtained by measuring the patient's thorax fluctuation pattern with a millimeter wave radar, or a measurement signal obtained by measuring the neck muscle movement of the patient with an RGB-D camera capable of acquiring depth information together with a color image. The information processing system according to (3) above.
(5)
The data processing unit has a liquid state analysis unit that analyzes a video signal obtained by photographing the patient and acquires the patient's water balance, urine color and drainage color as analysis results. The information processing system according to any one of (2) to (4).
(6)
The liquid state analysis unit analyzes a video signal for monitoring the infusion ingested by the patient to obtain an infusion volume, and analyzes a video signal for monitoring the drainage discharged from the patient to obtain a drainage volume. The information processing system according to (5) above, wherein the water balance of the patient is obtained based on the difference between the infusion amount and the drainage amount.
(7)
The liquid state analysis unit performs image recognition on a video signal for monitoring the infusion ingested by the patient, recognizes the name and flow rate of the medicine used as the infusion, and causes the recording unit to record the above (5). Or the information processing system according to (6).
(8)
The liquid state analysis unit presents the symptoms of the patient estimated from the color of the patient's drainage obtained by analyzing a video signal for monitoring the drainage discharged from the patient. ) to any information processing system.
(9)
Any one of the above (2) to (8), wherein the data processing unit has a sedation level analysis unit that analyzes a video signal obtained by imaging the patient and obtains the sedation level of the patient as an analysis result. Information processing system as described.
(10)
The sedation analysis unit analyzes the patient's appearance such as facial expression, behavior, and line of sight, and analyzes the voice that is the content of the response given by the nurse to the patient, thereby determining the patient's sedation level. The information processing system according to (9) above.
(11)
The information processing system according to (9) or (10) above, wherein the sedation level of the patient is remotely evaluated using a monitoring terminal connected via a network.
(12)
The information processing system according to (2), wherein the data processing unit includes a postural change analyzing unit that analyzes a video signal obtained by imaging the patient and obtains the postural change of the patient as an analysis result.
(13)
The information processing system according to (12) above, wherein the postural change analysis unit estimates a posture of the patient or the nurse from the video signal, and determines whether or not there is a postural change of the patient.
(14)
The display control unit causes the display unit to display a plurality of the patient's vital information side by side, and displays an icon for displaying the real-time information and the interval information other than the vital information. information processing system.
(15)
Information processing system
Real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle are signals obtained by sensing the patient. obtained by data processing that analyzes the
performing display control such that the real-time information and the interval information are displayed on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas;
When there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and control to record the confirmation content in a recording unit in response to the confirmation of the notification. A method of processing information, including performing
(16)
In the computer of the information processing system,
Real-time information obtained by monitoring the patient in real time with a relatively short measurement period and interval information obtained by monitoring the patient with a relatively long measurement period at intervals are signals obtained by sensing the patient. obtained by data processing that analyzes the
performing display control such that the real-time information and the interval information are displayed on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas;
When there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and control to record the confirmation content in a recording unit in response to the confirmation of the notification. A program for executing information processing including performing
　なお、本実施の形態は、上述した実施の形態に限定されるものではなく、本開示の要旨を逸脱しない範囲において種々の変更が可能である。また、本明細書に記載された効果はあくまで例示であって限定されるものではなく、他の効果があってもよい。 It should be noted that the present embodiment is not limited to the embodiment described above, and various modifications are possible without departing from the gist of the present disclosure. Moreover, the effects described in this specification are merely examples and are not limited, and other effects may be provided.
　１１　モニタリングシステム，　１２　バイタルセンサ，　１３　撮像システム，　１４　ミリ波レーダ，　１５　表示デバイス，　１６　情報処理装置，　２１　モニタリング画面，　２２　作業内容確認画面，　２３　モニタリング画面，　３１　属性データ表示画像，　３２　バイタルサインモニタリング画像，　３３　モニタリング映像，　３４　呼吸モニタリング画像，　３５　水分バランスモニタリング画像，　３６　尿・排液モニタリング画像，　３７　鎮静度モニタリング画像，　３８　***変換モニタリング画像，　４１　リアルタイム情報表示領域，　４２　インターバル情報表示領域，　４３　未読マーク，　５１　信号取得部，　５２　メモリ，　５３　記録部，　５４　中央制御部，　５５　表示制御部，　５６　データ処理部，　６１　呼吸解析部，　６２　液体状態解析部，　６３　鎮静度解析部，　６４　***変換解析部，　７１乃至７６　アイコン，　８１　患者用カメラ，　８２　視線検出センサ，　８３　マイク，　９１　モニタリング端末 11 Monitoring system, 12 Vital sensor, 13 Imaging system, 14 Millimeter wave radar, 15 Display device, 16 Information processing device, 21 Monitoring screen, 22 Work content confirmation screen, 23 Monitoring screen, 31 Attribute data display image, 32 Vital sign monitoring Images, 33 Monitoring images, 34 Respiration monitoring images, 35 Water balance monitoring images, 36 Urine/drainage monitoring images, 37 Sedation monitoring images, 38 Position change monitoring images, 41 Real-time information display area, 42 Interval information display area, 43 Unread mark, 51 signal acquisition unit, 52 memory, 53 recording unit, 54 central control unit, 55 display control unit, 56 data processing unit, 61 respiration analysis unit, 62 liquid state analysis unit, 63 sedation analysis unit, 64 posture conversion Analysis unit, 71 to 76 icons, 81 patient camera, 82 line-of-sight detection sensor, 83 microphone, 91 monitoring terminal

Claims (16)

  1. 　比較的に短い測定周期でリアルタイムに患者をモニタリングして得られるリアルタイム情報、および、比較的に長い測定周期でインターバルを設けて前記患者をモニタリングして得られるインターバル情報を、前記患者をセンシングした信号を解析するデータ処理によって取得するデータ処理部と、
    　前記リアルタイム情報および前記インターバル情報が、それぞれ異なる表示領域に表示される表示レイアウトで表示部に表示させる表示制御を行う表示制御部と、
    　前記リアルタイム情報および前記インターバル情報に特定の更新があった場合に、その更新があったことを通知させる制御を前記表示制御部に対して行って、前記通知が確認されたのに応じて確認内容を記録部に記録させる制御を行う制御部と
    　を備える情報処理システム。     Real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle are signals obtained by sensing the patient. a data processing unit that acquires by data processing that analyzes the
    a display control unit that performs display control to display the real-time information and the interval information on a display unit in display layouts that are displayed in different display areas;
    When there is a specific update in the real-time information and the interval information, control is performed on the display control unit to notify that the update has occurred, and confirmation content is performed in response to the confirmation of the notification. an information processing system comprising: a control unit that controls recording in a recording unit.
  2. 　前記リアルタイム情報には、前記患者のバイタル情報、前記患者のモニタリング映像、並びに、前記患者の呼吸数および呼吸パターンが含まれ、
    　前記インターバル情報には、前記患者の水分バランス、前記患者の尿色および排液色、前記患者の鎮静度、並びに、前記患者の***変換が含まれる
    　請求項１に記載の情報処理システム。     the real-time information includes the patient's vital information, the patient's monitoring video, and the patient's breathing rate and breathing pattern;
    The information processing system according to claim 1, wherein the interval information includes the patient's water balance, the patient's urine color and drainage color, the patient's sedation level, and the patient's postural change.
  3. 　前記データ処理部は、前記患者を撮影して得られる映像信号、および、前記患者の呼吸に関する所定部位を測定して得られる測定信号を解析し、前記患者の呼吸数および呼吸パターンを解析結果として取得する呼吸解析部を有する
    　請求項２に記載の情報処理システム。     The data processing unit analyzes a video signal obtained by imaging the patient and a measurement signal obtained by measuring a predetermined part related to the patient's breathing, and the patient's breathing rate and breathing pattern as analysis results. 3. The information processing system according to claim 2, comprising a respiration analysis unit that acquires.
  4. 　前記測定信号は、ミリ波レーダによって前記患者の胸郭変動パターンを測定した測定信号、または、カラー画像とともに奥行き情報を取得可能なRGB-Dカメラにより前記患者の頸部筋肉の運動を測定した測定信号である
    　請求項３に記載の情報処理システム。     The measurement signal is a measurement signal obtained by measuring the patient's thorax fluctuation pattern with a millimeter wave radar, or a measurement signal obtained by measuring the neck muscle movement of the patient with an RGB-D camera capable of acquiring depth information together with a color image. The information processing system according to claim 3.
  5. 　前記データ処理部は、前記患者を撮影して得られる映像信号を解析し、前記患者の水分バランス、並びに、前記患者の尿色および排液色を解析結果として取得する液体状態解析部を有する
    　請求項２に記載の情報処理システム。     The data processing unit has a liquid state analysis unit that analyzes a video signal obtained by photographing the patient and obtains the patient's water balance and the urine color and drainage color of the patient as analysis results. Item 3. The information processing system according to item 2.
  6. 　前記液体状態解析部は、前記患者に摂取される輸液をモニタリングする映像信号を解析して輸液量を求め、前記患者から排出される排液をモニタリングする映像信号を解析して排液量を求めて、前記輸液量および前記排液量の差分に基づいて前記患者の水分バランスを取得する
    　請求項５に記載の情報処理システム。     The liquid state analysis unit analyzes a video signal for monitoring the infusion ingested by the patient to obtain an infusion volume, and analyzes a video signal for monitoring the drainage discharged from the patient to obtain a drainage volume. 6. The information processing system according to claim 5, wherein the patient's water balance is obtained based on the difference between the infusion amount and the drainage amount.
  7. 　前記液体状態解析部は、前記患者に摂取される輸液をモニタリングする映像信号に対する画像認識を行って、前記輸液として用いられる薬の名称および流量を認識し、前記記録部に記録させる
    　請求項５に記載の情報処理システム。     6. According to claim 5, the liquid state analysis unit performs image recognition on video signals for monitoring the infusion ingested by the patient, recognizes the name and flow rate of the medicine used as the infusion, and records them in the recording unit. Information processing system as described.
  8. 　前記液体状態解析部は、前記患者から排出される排液をモニタリングする映像信号を解析して得られる前記患者の排液色から推定される前記患者の症状を提示する
    　請求項５に記載の情報処理システム。     6. The information according to claim 5, wherein the liquid state analysis unit presents the symptoms of the patient estimated from the color of the patient's drainage obtained by analyzing a video signal for monitoring the drainage discharged from the patient. processing system.
  9. 　前記データ処理部は、前記患者を撮影して得られる映像信号を解析し、前記患者の鎮静度を解析結果として取得する鎮静度解析部を有する
    　請求項２に記載の情報処理システム。     The information processing system according to claim 2, wherein the data processing unit has a sedation level analysis unit that analyzes a video signal obtained by imaging the patient and acquires the sedation level of the patient as an analysis result.
  10. 　前記鎮静度解析部は、前記患者の表情、行動、および視線といった外観の解析、および、前記患者に対して看護師が行う受け答えの内容となる音声の解析を行うことで、前記患者の鎮静度を取得する
    　請求項９に記載の情報処理システム。     The sedation analysis unit analyzes the patient's appearance such as facial expression, behavior, and line of sight, and analyzes the voice that is the content of the response given by the nurse to the patient, thereby determining the patient's sedation level. The information processing system according to Claim 9.
  11. 　ネットワークを介して接続されるモニタリング端末を利用して、前記患者の鎮静度が遠隔で評価される
    　請求項９に記載の情報処理システム。     10. The information processing system according to claim 9, wherein the patient's sedation level is remotely evaluated using a monitoring terminal connected via a network.
  12. 　前記データ処理部は、前記患者を撮影して得られる映像信号を解析し、前記患者の***変換を解析結果として取得する***変換解析部を有する
    　請求項２に記載の情報処理システム。     3. The information processing system according to claim 2, wherein the data processing unit has a postural change analysis unit that analyzes a video signal obtained by photographing the patient and acquires the postural change of the patient as an analysis result.
  13. 　前記***変換解析部は、前記映像信号から前記患者または看護師の姿勢を推定し、前記患者の***変換があったか否かを判定する
    　請求項１２に記載の情報処理システム。     13. The information processing system according to claim 12, wherein the postural change analysis unit estimates the posture of the patient or the nurse from the video signal and determines whether or not the patient's postural change has occurred.
  14. 　前記表示制御部は、複数の前記患者のバイタル情報を前記表示部に並べて表示させるとともに、前記バイタル情報以外の前記リアルタイム情報および前記インターバル情報を表示させるためのアイコンを表示させる
    　請求項２に記載の情報処理システム。     3. The display control unit according to claim 2, wherein the display unit displays a plurality of the patient's vital information side by side, and displays an icon for displaying the real-time information and the interval information other than the vital information. Information processing system.
  15. 　情報処理システムが、
    　比較的に短い測定周期でリアルタイムに患者をモニタリングして得られるリアルタイム情報、および、比較的に長い測定周期でインターバルを設けて前記患者をモニタリングして得られるインターバル情報を、前記患者をセンシングした信号を解析するデータ処理によって取得することと、
    　前記リアルタイム情報および前記インターバル情報が、それぞれ異なる表示領域に表示される表示レイアウトで表示部に表示させる表示制御を行うことと、
    　前記リアルタイム情報および前記インターバル情報に特定の更新があった場合に、その更新があったことを通知させる制御を行って、前記通知が確認されたのに応じて確認内容を記録部に記録させる制御を行うこと
    　を含む情報処理方法。     Information processing system
    Real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle are signals obtained by sensing the patient. obtained by data processing that analyzes the
    performing display control such that the real-time information and the interval information are displayed on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas;
    When there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and control to record the confirmation content in a recording unit in response to the confirmation of the notification. A method of processing information, including performing
  16. 　情報処理システムのコンピュータに、
    　比較的に短い測定周期でリアルタイムに患者をモニタリングして得られるリアルタイム情報、および、比較的に長い測定周期でインターバルを設けて前記患者をモニタリングして得られるインターバル情報を、前記患者をセンシングした信号を解析するデータ処理によって取得することと、
    　前記リアルタイム情報および前記インターバル情報が、それぞれ異なる表示領域に表示される表示レイアウトで表示部に表示させる表示制御を行うことと、
    　前記リアルタイム情報および前記インターバル情報に特定の更新があった場合に、その更新があったことを通知させる制御を行って、前記通知が確認されたのに応じて確認内容を記録部に記録させる制御を行うこと
    　を含む情報処理を実行させるためのプログラム。     In the computer of the information processing system,
    Real-time information obtained by monitoring the patient in real time with a relatively short measurement cycle and interval information obtained by monitoring the patient at intervals with a relatively long measurement cycle are signals obtained by sensing the patient. obtained by data processing that analyzes the
    performing display control such that the real-time information and the interval information are displayed on a display unit in a display layout in which the real-time information and the interval information are displayed in different display areas;
    When there is a specific update in the real-time information and the interval information, control is performed to notify that the update has occurred, and control to record the confirmation content in a recording unit in response to the confirmation of the notification. A program for executing information processing including performing
PCT/JP2022/006924 2021-07-09 2022-02-21 Information processing system, information processing method, and program WO2023281800A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021114039 2021-07-09
JP2021-114039 2021-07-09

Publications (1)

Publication Number Publication Date
WO2023281800A1 true WO2023281800A1 (en) 2023-01-12

Family

ID=84801649

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/006924 WO2023281800A1 (en) 2021-07-09 2022-02-21 Information processing system, information processing method, and program

Country Status (1)

Country Link
WO (1) WO2023281800A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016507256A (en) * 2012-12-14 2016-03-10 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． Patient monitoring of subacute patients based on activity status and posture
JP2019150545A (en) * 2018-03-06 2019-09-12 株式会社 Ｍｔｇ Movement booth installation structure and method
US20190313966A1 (en) * 2018-04-11 2019-10-17 Somniferum Labs LLC Pain level determination method, apparatus, and system
JP2020515948A (en) * 2017-07-11 2020-05-28 ドレーゲルヴェルク アクチェンゲゼルシャフト ウント コンパニー コマンディートゲゼルシャフト アウフ アクチェンＤｒａｅｇｅｒｗｅｒｋ ＡＧ ＆ Ｃｏ．ＫＧａＡ Method, apparatus and computer program for detecting optical image data around a patient and identifying a check for the patient
US20200367762A1 (en) * 2018-02-07 2020-11-26 Arthur Wallace Methods and Systems for Patient Monitoring
US20210093243A1 (en) * 2018-04-02 2021-04-01 Potrero Medical, Inc. Systems, devices and methods for draining and analyzing bodily fluids and assessing health

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016507256A (en) * 2012-12-14 2016-03-10 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． Patient monitoring of subacute patients based on activity status and posture
JP2020515948A (en) * 2017-07-11 2020-05-28 ドレーゲルヴェルク アクチェンゲゼルシャフト ウント コンパニー コマンディートゲゼルシャフト アウフ アクチェンＤｒａｅｇｅｒｗｅｒｋ ＡＧ ＆ Ｃｏ．ＫＧａＡ Method, apparatus and computer program for detecting optical image data around a patient and identifying a check for the patient
US20200367762A1 (en) * 2018-02-07 2020-11-26 Arthur Wallace Methods and Systems for Patient Monitoring
JP2019150545A (en) * 2018-03-06 2019-09-12 株式会社 Ｍｔｇ Movement booth installation structure and method
US20210093243A1 (en) * 2018-04-02 2021-04-01 Potrero Medical, Inc. Systems, devices and methods for draining and analyzing bodily fluids and assessing health
US20190313966A1 (en) * 2018-04-11 2019-10-17 Somniferum Labs LLC Pain level determination method, apparatus, and system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
20 March 1998 (1998-03-20), OMATSU, MASAHIRO ET AL: "Using computer networks to manage biometric information. ", XP009542489 *

Similar Documents

Publication Publication Date Title
CN106102571B (en) Patient monitor and intervention/event timeline
JP2022185032A (en) Systems and methods for patient fall detection
US20170245793A1 (en) Systems and Methods for Collecting and Displaying User Orientation Information on a User-Worn Sensor Device
JP7355826B2 (en) Platform-independent real-time medical data display system
JP7108267B2 (en) Biological information processing system, biological information processing method, and computer program
KR20180039703A (en) Medical monitoring analysis and replay including signs of reacting to light weakened by body tissues
EP3295871A1 (en) Pressure ulcer detection methods, devices and techniques
JP2014176696A (en) Methods, systems, and devices for monitoring and displaying medical parameters for patient
WO2019162054A1 (en) System and method for client-side physiological condition estimations based on a video of an individual
US11179095B2 (en) Method, system, and apparatus for remote patient monitoring or tracking of sepsis-related indicators
Keim-Malpass et al. Nursing and precision predictive analytics monitoring in the acute and intensive care setting: An emerging role for responding to COVID-19 and beyond
CN109044656B (en) Medical nursing equipment
US20230079951A1 (en) System for configuring patient monitoring
WO2023281800A1 (en) Information processing system, information processing method, and program
US8181862B1 (en) System for providing identification and information, method of use thereof
WO2018219809A1 (en) System and method for providing a layer-based presentation of a model-generated patient-related prediction
CN105520723B (en) Vital sign measurement device, vital sign display method, and program
US20230114135A1 (en) Systems and methods for monitoring caregiver burnout risk
JP7325576B2 (en) Terminal device, output method and computer program
US20190244711A1 (en) System and method for timing delivery of queries to telehealth patients
JP7327397B2 (en) Computer-implemented programs, information processing systems, and computer-implemented methods
JP7342863B2 (en) Computer-executed programs, information processing systems, and computer-executed methods
CN108471957B (en) Patient monitor
WO2020133429A1 (en) Monitoring method, monitor and computer storage medium
Nagarnaidu Rajaperumal et al. Cloud-based intelligent internet of medical things applications for healthcare systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22837222

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE