WO2011108913A1 - A tracking and movement monitoring system and a method thereof - Google Patents

A tracking and movement monitoring system and a method thereof Download PDF

Info

Publication number
WO2011108913A1
WO2011108913A1 PCT/MY2010/000184 MY2010000184W WO2011108913A1 WO 2011108913 A1 WO2011108913 A1 WO 2011108913A1 MY 2010000184 W MY2010000184 W MY 2010000184W WO 2011108913 A1 WO2011108913 A1 WO 2011108913A1
Authority
WO
WIPO (PCT)
Prior art keywords
child
image
adult
restricted region
subject
Prior art date
Application number
PCT/MY2010/000184
Other languages
French (fr)
Inventor
Ee Lee Ng
Weng Kin Lai
Tomas Henrique Bode Maul
Norshuhada Samudin
Original Assignee
Mimos Berhad
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mimos Berhad filed Critical Mimos Berhad
Publication of WO2011108913A1 publication Critical patent/WO2011108913A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18—Status alarms
    • G08B21/22—Status alarms responsive to presence or absence of persons

Definitions

  • the present invention relates to a tracking and analyzing system of at least one subject in an environment and a method thereof.
  • US 6720880 describes a method and apparatus for monitoring locations using vision based technologies for automatically triggering safety measures when a child is detected under field of view.
  • criteria used to determine whether a child is in danger is not sufficient as field of view is not a reliable measure for triggering safety measures.
  • a tracking and analyzing system of at least one subject in an environment includes an image sensor, an image viewing means, wherein a plurality of live images captured by the image sensor is viewable successively on the image viewing means, a motion detection module which receives the plurality of live images captured by the image sensor and an alarm which is triggerable by the motion detection module, wherein a restricted region of the environment is definable by a user.
  • a method of tracking and analyzing movement of at least one subject in an environment includes the steps of obtaining at least one image, determining a restricted region in the environment, classifying motion detection of at least one subject in the at least one image into motion of at least one adult or at least one child, determining location of the at least one child, analyzing speed and direction of movement of the at least one child and triggering an alarm.
  • Figure 1 illustrates a flowchart of a method in a preferred embodiment of the invention
  • Figure 2 illustrates flowchart of a method of determining triggering level of alarms when a child is in close proximity to the restricted region in a preferred embodiment of the invention
  • Figure 4 illustrates factors that affect gait analysis in a method of the preferred embodiment of the invention.
  • Figure 5 illustrates an example of a restricted region defined in the preferred embodiment of the invention.
  • the present invention relates to a tracking and analyzing system of at least one subject in an environment and a method thereof.
  • this specification will describe the present invention according to the preferred embodiment of the present invention.
  • limiting the description to the preferred embodiment of the invention is merely to facilitate discussion of the present invention and it is envisioned that those skilled in the art may devise various modifications and equivalents without departing from the scope of the appended claims.
  • a preferred embodiment of the present invention provides for a tracking and analyzing system of at least one subject in an environment.
  • the system includes an image sensor, an image viewing means, wherein a plurality of live images captured by the image sensor is viewable successively on the image viewing means, a motion detection module which receives the plurality of live images captured by the image sensor, and an alarm which his triggerable by the motion detection module, wherein a restricted region of the environment is definable by a user.
  • the image sensor includes a camera means for capturing a sequence of images which may be selected from but not restricted to, a video camera, an Internet Protocol (IP) video camera and a still camera.
  • IP Internet Protocol
  • the image viewing means used in this embodiment of the invention is a monitor.
  • the at least one subject in this example is at least one adult or at least one child to be monitored in a restricted region.
  • the restricted region is shown as seen in Figure 5 to be a user selected region.
  • the restricted region is considered to be a high risk area that is dangerous to children.
  • Analysis is conducted based on a combination of human detection and tracking as well as classification based on gait analysis and physical attributes. Analysis of different conditions is based on speed and direction to provide varying levels of alarm triggers.
  • At least one surveillance image is obtained from an image sensor such as a camera, at a surveillance scene.
  • a surveillance scene can be any areas potentially dangerous to children such as swimming pools or staircases.
  • a restricted region is selected by a user that is defined as a dangerous area to children, wherein children are not allowed to access without presence of an adult within a predetermined distance as seen in Figure 5.
  • the restricted region may then be framed using a plurality of shape selection tools to enclose the restricted region, regardless of geometrical shape of the restricted region.
  • Motion of subjects within the restricted region is then detected in the surveillance scene. Subsequently, cause of the motion will be analyzed to be either adult or children. Gait analysis is employed at this point to classify the subject as adult or a child.
  • Various factors are taken into consideration for the gait analysis such as stride length of a child being shorter than that of an adult as well as head to body ratio as seen in Figure 4.
  • Figures 2 and 3 illustrate the method based on speed, location and direction of the child.
  • Figure 2 shows an embodiment of the method wherein the child is at a close proximity to the restricted region.
  • Figure 3 shows an embodiment of the method wherein the child is at a further proximity to the restricted region. Close proximity of the child is defined as to how close the child is to the restricted region based on speed and direction of the child's movement as well the child's location.
  • Figure 3 shows the steps of the method when the child is at a further proximity from an adult to determine a level of alarm to be triggered.
  • An alarm level 3 is triggered when the child is found to be moving towards the restricted region at a fast pace. If the child is found to be moving towards the restricted region but at a slower pace, alarm level 4 is triggered. Further, the alarm will not be triggered or be deactivated if the child is found to not be moving towards the restricted region. It is to be understood that varying levels of alarms may be triggered indicating severity of danger in any situation based on surveillance images. The severity of danger and corresponding alarm levels may be determined by users of the system in advance.
  • a child is in or in close proximity to the restricted region and no adults are within a predetermined distance with the child.
  • a child is in or in close proximity to the restricted region and at least one adult is present within a predetermined distance with the child. The child is found to be moving away from the at least one adult.
  • a child is at a further proximity to the restricted region and moving at a fast pace towards the restricted region.
  • a child is at a further proximity to the restricted region and moving slowly to the restricted region. 5. A child is at a further proximity to the restricted region and moving slowly away from the restricted region.
  • a child is at a further proximity to the restricted region and moving at a fast pace from the restricted region.
  • a child is in the restricted region with an adult and is not moving.
  • Scenarios 1 , 2 and 3 will trigger Alarm Level 1 , Level 2, Level 3 and Level 4 respectively.
  • the alarm may be deactivated when the scenarios 4, 5, 6 or 7 happen.
  • Alarm Level 1 indicates that a situation is very dangerous and critically needs immediate action from an adult.
  • a third party is part of the method to ensure that the incident does not go unattended to.
  • Alarm Level 2 ihdicates that a situation is relatively dangerous and the alarm level 2 alerts an adult who is present within the predetermined distance of the child.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Emergency Alarm Devices (AREA)
  • Image Analysis (AREA)

Abstract

A tracking and analyzing system of at least one subject in an environment is provided, the system includes an image sensor, an image viewing means, wherein a plurality of live images captured by the image sensor is viewable successively on the image viewing means, a motion detection module which receives the plurality of live images captured by the image sensor and an alarm which his triggerable by the motion detection module, wherein a restricted region of the environment is definable by a user.

Description

A TRACKING AND MOVEMENT MONITORING SYSTEM AND A METHOD
THEREOF
FIELD OF INVENTION
The present invention relates to a tracking and analyzing system of at least one subject in an environment and a method thereof.
BACKGROUND OF INVENTION
Children are constantly exposed to danger in everywhere. Every year, thousands of toddlers lose their lives or are injured in various household accidents. Potential hazards such as swimming pools, staircases and balconies pose a greater threat to a child's safety when the child is present in its vicinity without the supervision of an adult. Child accidents, for example, falling and drowning, can be avoided by restricting children from assessing high risk area even without the supervision of an adult.
US 6720880 describes a method and apparatus for monitoring locations using vision based technologies for automatically triggering safety measures when a child is detected under field of view. However, criteria used to determine whether a child is in danger is not sufficient as field of view is not a reliable measure for triggering safety measures.
Therefore, there is a need for reliable solution to monitor and track children to ensure their safety is not compromised in environments that may not necessarily include adults. SUMMARY OF INVENTION
Accordingly there is provided a tracking and analyzing system of at least one subject in an environment, the system includes an image sensor, an image viewing means, wherein a plurality of live images captured by the image sensor is viewable successively on the image viewing means, a motion detection module which receives the plurality of live images captured by the image sensor and an alarm which is triggerable by the motion detection module, wherein a restricted region of the environment is definable by a user.
There is also provided a method of tracking and analyzing movement of at least one subject in an environment, the method includes the steps of obtaining at least one image, determining a restricted region in the environment, classifying motion detection of at least one subject in the at least one image into motion of at least one adult or at least one child, determining location of the at least one child, analyzing speed and direction of movement of the at least one child and triggering an alarm.
The present invention consists of several novel features and a combination of parts hereinafter fully described and illustrated in the accompanying description and drawings, it being understood that various changes in the details may be made without departing from the scope of the invention or sacrificing any of the advantages of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will be fully understood from the detailed description given herein below and the accompanying drawings which are given by way of illustration only, and thus are not limitative of the present invention, wherein:
Figure 1 illustrates a flowchart of a method in a preferred embodiment of the invention;
Figure 2 illustrates flowchart of a method of determining triggering level of alarms when a child is in close proximity to the restricted region in a preferred embodiment of the invention;
Figure 3 illustrates flowchart of a method of determining triggering level of alarms when a child is in further proximity to the restricted region in a preferred embodiment of the invention;
Figure 4 illustrates factors that affect gait analysis in a method of the preferred embodiment of the invention; and
Figure 5 illustrates an example of a restricted region defined in the preferred embodiment of the invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
The present invention relates to a tracking and analyzing system of at least one subject in an environment and a method thereof. Hereinafter, this specification will describe the present invention according to the preferred embodiment of the present invention. However, it is to be understood that limiting the description to the preferred embodiment of the invention is merely to facilitate discussion of the present invention and it is envisioned that those skilled in the art may devise various modifications and equivalents without departing from the scope of the appended claims.
The following detailed description of the preferred embodiment will now be described in accordance with the attached drawings, either individually or in combination.
A preferred embodiment of the present invention provides for a tracking and analyzing system of at least one subject in an environment. The system includes an image sensor, an image viewing means, wherein a plurality of live images captured by the image sensor is viewable successively on the image viewing means, a motion detection module which receives the plurality of live images captured by the image sensor, and an alarm which his triggerable by the motion detection module, wherein a restricted region of the environment is definable by a user. The image sensor includes a camera means for capturing a sequence of images which may be selected from but not restricted to, a video camera, an Internet Protocol (IP) video camera and a still camera. The image viewing means used in this embodiment of the invention is a monitor. The at least one subject in this example is at least one adult or at least one child to be monitored in a restricted region. The restricted region is shown as seen in Figure 5 to be a user selected region. In this embodiment, the restricted region is considered to be a high risk area that is dangerous to children.
Analysis is conducted based on a combination of human detection and tracking as well as classification based on gait analysis and physical attributes. Analysis of different conditions is based on speed and direction to provide varying levels of alarm triggers.
A method of tracking and analyzing movement of at least one subject in an environment is described as seen in Figure 1. The method includes the steps of obtaining at least one image, determining a restricted region in the environment, classifying motion detection of at least one subject in the at least one image into motion of at least one adult or at least one child, determining location of the at least one child, analyzing speed and direction of movement of the at least one child and triggering an alarm. An image of at least one adult is determined whether present within a high risk area simultaneously with an image of at least one child and a predetermined alarm level is triggered wherein the image of the at least one child is not accompanied by an image of at least one adult.
At least one surveillance image is obtained from an image sensor such as a camera, at a surveillance scene. A surveillance scene can be any areas potentially dangerous to children such as swimming pools or staircases. A restricted region is selected by a user that is defined as a dangerous area to children, wherein children are not allowed to access without presence of an adult within a predetermined distance as seen in Figure 5. The restricted region may then be framed using a plurality of shape selection tools to enclose the restricted region, regardless of geometrical shape of the restricted region. Motion of subjects within the restricted region is then detected in the surveillance scene. Subsequently, cause of the motion will be analyzed to be either adult or children. Gait analysis is employed at this point to classify the subject as adult or a child. Various factors are taken into consideration for the gait analysis such as stride length of a child being shorter than that of an adult as well as head to body ratio as seen in Figure 4.
A corresponding level of alarm is triggered based on speed, location and direction of the child to alert any personnel or authorized party to attend to impending danger to the child.
A series of XY-coordinates corresponding to movement of subjects within the surveillance scene is then provided. Figures 2 and 3 illustrate the method based on speed, location and direction of the child. Figure 2 shows an embodiment of the method wherein the child is at a close proximity to the restricted region. Figure 3 shows an embodiment of the method wherein the child is at a further proximity to the restricted region. Close proximity of the child is defined as to how close the child is to the restricted region based on speed and direction of the child's movement as well the child's location.
As seen in Figure 2, presence of at least one adult next to the child is verified as being close to or in the restricted region. If at least one adult is confirmed to be present, speed of movement of the child is measured, as this indicates whether the child is running away from the at least one adult. A level 2 Alarm is triggered if the child is indeed found to be running away from the at least one adult. If the speed of movement is lower than a threshold value, the alarm is deactivated as it is to be understood that the child is safe under adult supervision even if the child is in the restricted region. A maximum level of alarm, such as level 1 , is triggered if children are found alone in close proximity to the restricted region or in the restricted region without an adult within the restricted region. If no response is detected after a predetermined period of time to attend to the child, a third part is summoned to the restricted region.
Figure 3 shows the steps of the method when the child is at a further proximity from an adult to determine a level of alarm to be triggered. An alarm level 3 is triggered when the child is found to be moving towards the restricted region at a fast pace. If the child is found to be moving towards the restricted region but at a slower pace, alarm level 4 is triggered. Further, the alarm will not be triggered or be deactivated if the child is found to not be moving towards the restricted region. It is to be understood that varying levels of alarms may be triggered indicating severity of danger in any situation based on surveillance images. The severity of danger and corresponding alarm levels may be determined by users of the system in advance.
In this example, there are at least seven different scenarios as a result of different speed and direction to determine various levels of alarms to be triggered as seen below:
1. A child is in or in close proximity to the restricted region and no adults are within a predetermined distance with the child.
2. A child is in or in close proximity to the restricted region and at least one adult is present within a predetermined distance with the child. The child is found to be moving away from the at least one adult.
3. A child is at a further proximity to the restricted region and moving at a fast pace towards the restricted region.
4. A child is at a further proximity to the restricted region and moving slowly to the restricted region. 5. A child is at a further proximity to the restricted region and moving slowly away from the restricted region.
6. A child is at a further proximity to the restricted region and moving at a fast pace from the restricted region.
7. A child is in the restricted region with an adult and is not moving.
Scenarios 1 , 2 and 3 will trigger Alarm Level 1 , Level 2, Level 3 and Level 4 respectively. The alarm may be deactivated when the scenarios 4, 5, 6 or 7 happen.
Alarm Level 1 indicates that a situation is very dangerous and critically needs immediate action from an adult. A third party is part of the method to ensure that the incident does not go unattended to.
Alarm Level 2 ihdicates that a situation is relatively dangerous and the alarm level 2 alerts an adult who is present within the predetermined distance of the child.
Alarm Level 3 and 4 caution an adult that the child is running or walking respectively toward restricted region. The alarm may be deactivated when no possible danger is imminent and the child is safe.
It is to be appreciated that various combinations of the above mentioned scenarios may be matched to corresponding alarm levels based on application and requirement of a user in the system. The invention is significantly more efficient than prior art as child safety features take more factors into consideration such as location of the child, speed of movement of said child and direction of movement of said child. Varying levels of alarms are also a dependable indicator to danger levels of children in supervised or unsupervised environments.
It is to be understood that the embodiments of the invention described are exchangeable for other variations of the same in order to be used in various applications. The present embodiment of the invention is intended for, but not safety monitoring of children in locations that may be hazardous.

Claims

1. A tracking and analyzing system of at least one subject in an environment, the system includes:
i. an image sensor;
ii. an image viewing means, wherein a plurality of live images captured by the image sensor is viewable successively on the image viewing means;
iii. a motion detection module which receives the plurality of live images captured by the image sensor; and
iv. an alarm which is triggerable by the motion detection module,
wherein a restricted region of the environment is definable by a user.
2. The system as claimed in claim 1 , wherein the image sensor includes a camera means for capturing a sequence of images.
3. The system as claimed in claim 1 , wherein the camera means includes a video camera, an Internet Protocol (IP) video camera and a still camera.
4. The system as claimed in claim 1 , wherein image viewing means includes a
monitor.
5. The system as claimed in claim 1 , wherein the subject is at least one adult.
6. The system as claimed in claim 1 , wherein the subject is at least one child.
7. A method of tracking and analyzing movement of at least one subject in an environment, the method includes the steps of:
i. obtaining at least one image;
ii. determining a restricted region in the environment;
iii. classifying motion detection of at least one subject in the at least one image into motion of at least one adult or at least one child;
iv. determining location of the at least one child;
v. analyzing speed and direction of movement of the at least one child; and vi. triggering an alarm.
8. The method as claimed in claim 7, wherein determining location of the at least one child further includes the steps of:
i. determining whether an image of at least one adult is present within a high risk area simultaneously with an image of at least one child; ii. triggering a predetermined alarm level,
wherein the image of the at least one child is not accompanied by an image of at least one adult.
PCT/MY2010/000184 2010-03-01 2010-09-30 A tracking and movement monitoring system and a method thereof WO2011108913A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
MYPI2010700009A MY159281A (en) 2010-03-01 2010-03-01 A method tracking and analyzing movement
MYPI2010700009 2010-03-01

Publications (1)

Publication Number Publication Date
WO2011108913A1 true WO2011108913A1 (en) 2011-09-09

Family

ID=44542414

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/MY2010/000184 WO2011108913A1 (en) 2010-03-01 2010-09-30 A tracking and movement monitoring system and a method thereof

Country Status (2)

Country Link
MY (1) MY159281A (en)
WO (1) WO2011108913A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110166734A (en) * 2018-02-12 2019-08-23 北京快乐智慧科技有限责任公司 A kind of Intelligence In Baogang Kindergarten monitoring method and system
CN110443984A (en) * 2019-06-27 2019-11-12 维沃移动通信有限公司 A kind of monitoring method and mobile terminal
CN111797776A (en) * 2020-07-07 2020-10-20 云知声智能科技股份有限公司 Infant monitoring method and device based on posture
CN113971868A (en) * 2020-07-23 2022-01-25 易程融创信息科技有限公司 Alarm method and system based on infant behavior statistics
JP2022032355A (en) * 2020-08-11 2022-02-25 トヨタ自動車株式会社 Information processing device, information processing method, and program

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010038264A (en) * 1999-10-23 2001-05-15 윤종용 CCD camera and method for transmission an alarm signal in case of emergency
KR100376417B1 (en) * 2000-08-30 2003-03-17 다모쯔 미야모또 Surveillance system
JP2004096457A (en) * 2002-08-30 2004-03-25 Sumitomo Osaka Cement Co Ltd Area monitoring apparatus
KR200430806Y1 (en) * 2006-08-25 2006-11-13 주식회사 센플러스 Monitoring system for a living environment around a baby
KR20090091539A (en) * 2008-02-25 2009-08-28 동서대학교산학협력단 System for monitoring occurrence of dangerous motion

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010038264A (en) * 1999-10-23 2001-05-15 윤종용 CCD camera and method for transmission an alarm signal in case of emergency
KR100376417B1 (en) * 2000-08-30 2003-03-17 다모쯔 미야모또 Surveillance system
JP2004096457A (en) * 2002-08-30 2004-03-25 Sumitomo Osaka Cement Co Ltd Area monitoring apparatus
KR200430806Y1 (en) * 2006-08-25 2006-11-13 주식회사 센플러스 Monitoring system for a living environment around a baby
KR20090091539A (en) * 2008-02-25 2009-08-28 동서대학교산학협력단 System for monitoring occurrence of dangerous motion

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110166734A (en) * 2018-02-12 2019-08-23 北京快乐智慧科技有限责任公司 A kind of Intelligence In Baogang Kindergarten monitoring method and system
CN110443984A (en) * 2019-06-27 2019-11-12 维沃移动通信有限公司 A kind of monitoring method and mobile terminal
CN111797776A (en) * 2020-07-07 2020-10-20 云知声智能科技股份有限公司 Infant monitoring method and device based on posture
CN113971868A (en) * 2020-07-23 2022-01-25 易程融创信息科技有限公司 Alarm method and system based on infant behavior statistics
JP2022032355A (en) * 2020-08-11 2022-02-25 トヨタ自動車株式会社 Information processing device, information processing method, and program
JP7439694B2 (en) 2020-08-11 2024-02-28 トヨタ自動車株式会社 Information processing device, information processing method, and program

Also Published As

Publication number Publication date
MY159281A (en) 2016-12-30

Similar Documents

Publication Publication Date Title
KR101766305B1 (en) Apparatus for detecting intrusion
CN105141885B (en) Carry out the method and device of video monitoring
Tzeng et al. Design of fall detection system with floor pressure and infrared image
JP5473801B2 (en) Monitoring device
KR101980551B1 (en) System For Detecting An Action Through Real-Time Intelligent CCTV Image Analysis Using Machine Learning Object Detection And Method For Detecting An Action Through Real-Time Intelligent CCTV Image Analysis Using Machine Learning Object Detection
TWI469096B (en) System and method for detecting a falling object
US20180089980A1 (en) Systems, methods and computer program products for detecting a presence of an object in a body of water
Kepski et al. Fuzzy inference-based reliable fall detection using Kinect and accelerometer
WO2011108913A1 (en) A tracking and movement monitoring system and a method thereof
Khawandi et al. Implementation of a monitoring system for fall detection in elderly healthcare
KR20130094489A (en) System and method for monitoring emergency motion based image
US9613510B2 (en) Apparatus and method for rapid human detection with pet immunity
CN112757300A (en) Robot protection system and method
Doulamis Iterative motion estimation constrained by time and shape for detecting persons' falls
KR101075550B1 (en) Image sensing agent and security system of USN complex type
EP2587462A1 (en) Image monitoring system and method with false alarm rate reduction
JP2007264706A (en) Image processing device, surveillance camera and video surveillance system
TW201324446A (en) Family safety surveillance system and method
CN110222216B (en) Multifunctional intelligent defense system
KR101138212B1 (en) Fire detecting system and method using image recognition and motion sensor
KR101212383B1 (en) Apparatus and Method for Home Healthcare Monitoring
JP2008541650A (en) Monitoring method and apparatus
WO2012002904A1 (en) Device and method for detection of abnormal spatial states of a human body
Miaou et al. A smart vision-based human fall detection system for telehealth applications
Jamil et al. Design and implementation of an eye blinking detector system for automobile accident prevention

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10847106

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10847106

Country of ref document: EP

Kind code of ref document: A1