CN108922599A - A kind of accurate mask method of medical image lesion point based on MIL - Google Patents

A kind of accurate mask method of medical image lesion point based on MIL Download PDF

Info

Publication number
CN108922599A
CN108922599A CN201810677693.6A CN201810677693A CN108922599A CN 108922599 A CN108922599 A CN 108922599A CN 201810677693 A CN201810677693 A CN 201810677693A CN 108922599 A CN108922599 A CN 108922599A
Authority
CN
China
Prior art keywords
sample
lesion point
model
medical image
data set
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810677693.6A
Other languages
Chinese (zh)
Inventor
唐鹏
万加龙
金炜东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southwest Jiaotong University
Original Assignee
Southwest Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southwest Jiaotong University filed Critical Southwest Jiaotong University
Priority to CN201810677693.6A priority Critical patent/CN108922599A/en
Publication of CN108922599A publication Critical patent/CN108922599A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/20ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Epidemiology (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a kind of accurate mask method of medical image lesion point based on MIL, includes the following steps:Step 1:Medical images data sets are acquired, positive sample collection and negative sample collection are divided into;Step 2:Carry out the initialization of disaggregated model;Step 3:S example is acquired for each sample standard deviation that positive sample is concentrated, each example is input in sorter model;Record has the maximum example of lesion point probability value, and then the example is added in data set D;Step 4:S example is acquired for each sample standard deviation that negative sample is concentrated, each example is input in sorter model;Record most unlikely has the example of lesion point, and then also the example is added in data set D;Step 5:It is iterated training in neural network classifier model, obtains training pattern;Step 6:Detection and the mark of new samples are carried out according to disaggregated model;The present invention in large quantity can accurately mark lesion point sample, and speed it is fast, it is at low cost, with high efficiency.

Description

A kind of accurate mask method of medical image lesion point based on MIL
Technical field
The present invention relates to a kind of medical image processing methods, and in particular to one kind is based on MIL(Multiple Instance Learning)The accurate mask method of medical image lesion point.
Background technique
The image labeling of medical domain is:By lesions such as tumour, tubercle, calcification points in the image datas such as DR piece, CT film Region marked out in the image datas such as dicom by way of human-computer interaction by doctor come;As deep learning is in medicine figure As the expansion in process field, training just needs the data set of large-scale standard to support;Therefore, the accurate mark of mass data collection Problem is just particularly important;Different with the mark of normal image, the mark of medical image needs professional knowledge and technical ability People does;Therefore, it is difficult to obtain a large amount of accurate labeled data collection to learn for deep neural network;Currently, by traditional depth Habit is widely used in the field of medical imaging, and there are still following problems:First, the image of medical domain, which accurately marks, needs high level Doctor complete, non-medical field personnel are nonsensical to the mark of medical image;But objectively, the work of China doctor is strong Degree is big, it is difficult to have energy to carry out the accurate mark of medical image;And there is a large amount of different types of lesion figures in reality Picture, but the picture much stored does not all have enough time marking and use, and resource utilization is lower;Second, that is, enable a physician to essence The medical image really marked, but need to eliminate personal subjectivity since data mark, it needs more people repeatedly to mark, takes comprehensive flat Result;This results in capable of reaching effective labeled data of application level in fact negligible amounts;Third, the image sample of disease Originally it is limited to the disease incidence of the disease, certain diseases are difficult to construct enough magnitudes there are sample rareness due to being non-common disease The problem of data set.
The reform of digitlization case history is carried out in current existing medical institutions extensively, having built many PACS systems etc. includes The medical records database such as medical imaging data, physicochemical data;Diagnosis is contained in these case histories, but not to focal zone Domain precise marking;Current medical imaging data are mostly non-precision labeled data(It is sick and disease-free that has only been marked), but not Accurately provide lesions position coordinate;Therefore current deep learning algorithm is caused to be difficult to directly adapt to.
Summary of the invention
The present invention provides that a kind of speed is fast, at low cost, the accurate side of mark of the high-efficient medical image lesion point based on MIL Method.
The technical solution adopted by the present invention is that:A kind of accurate mask method of medical image lesion point based on MIL, including with Lower step:
Step 1:Medical images data sets are acquired, positive sample collection and negative sample collection are divided into;
Step 2:Carry out the initialization of disaggregated model;
Step 3:S example is acquired for each sample standard deviation that positive sample is concentrated, each example is input in sorter model; Record has the maximum example of lesion point probability value, and then the example is added in data set D;
Step 4:S example is acquired for each sample standard deviation that negative sample is concentrated, each example is input in sorter model; Record most unlikely has the example of lesion point, is then added to the example in the data set D that step 3 obtains;
Step 5:The data set D that step 4 obtains is iterated training in neural network classifier model, obtains training mould Type;
Step 6:Detection and the mark of new samples are carried out according to the model that step 5 obtains.
Further, the disaggregated model uses the neural network model based on LeNet, including input layer, the first convolution Layer, the first pond layer, the second convolutional layer, the second pond layer, the first full articulamentum, activation primitive layer, the second full articulamentum and use In realize classification and it is softmax layers normalized.
Further, detection and new samples each in annotation process sample S example in the step 6, to each example Classified with sorter model;If having one and above example having lesion point, determine that the sample is to have lesion point diagram piece;It is no Then determine the sample for no lesion point diagram piece;Until having detected all new samples.
Further, during the repetitive exercise in the step 5, step 3 is repeated before training each time and step 4 obtains Take updated data set D.
Further, initialization procedure is to choose the sample with label to carry out supervised learning in the step 2.
The beneficial effects of the invention are as follows:
(1)The present invention is not influenced by variety classes lesion, and mixing to a variety of lesions also can be carried out accurate mark, robust Property is strong;
(2)The present invention also can be carried out essence to some irregular, uncommon shapes not only to the mark of lesion point Common Shape Really mark, universality are high;
(3)The present invention is conducive to detection and mark of the hospital to various lesion images, can greatly reduce professional technician to doctor The workload of image labeling is learned, while being also convenient for the lesion point that doctor quickly checked and diagnosed patient;
(4)The present invention large batch of can accurately mark lesion point, speed is fast, it is at low cost, with high efficiency.
Detailed description of the invention
Fig. 1 is flow diagram of the present invention.
Fig. 2 is the disaggregated model structural schematic diagram that the present invention uses.
Specific embodiment
The present invention will be further described in the following with reference to the drawings and specific embodiments.
A kind of accurate mask method of medical image lesion point based on MIL, includes the following steps:
Step 1:Medical images data sets are acquired, positive sample collection and negative sample collection are divided into;
By Medical Devices camera acquire different types of lesion point image several, therefrom number of images at regular intervals Select picture clearly image as raw data set;A certain number of pictures are chosen, are made after corresponding image tag is convenient for It is continuous to be trained.
Step 2:Carry out the initialization of disaggregated model;
It chooses the sample with label and carries out supervised learning, carry out the initialization of disaggregated model;Disaggregated model selection is based on The model of the medical image lesion point precise classification of LeNet, disaggregated model are not limited to LeNet, it is also an option that other points Class model can all make the adjustment of relevant parameter, for improving nicety of grading according to training result when training terminates every time; It can also be using disaggregated models such as following AlexNet, GoogleNet, VGG.
Based on LeNet disaggregated model as shown in Fig. 2, including input layer, the first convolutional layer, the first pond layer, the second convolution Layer, the second pond layer, the first full articulamentum, activation primitive layer, the second full articulamentum and for realizing classification and it is normalized Softmax layers.
Input layer:Input layer inputs one 28 × 28 picture;
First convolutional layer:Convolution is carried out to input layer picture respectively using 20 5 × 5 convolution kernels, includes 20 × 5 × 5=500 A parameter weighting parameter;Picture side length is after convolution(28-5+1)/ 1=24,20 24 × 24 map are generated, comprising 20 × 24 × 24=11520 neurons;
First pond layer:It is down-sampled to upper one layer each 2 × 2 region progress, each maximum regional value is chosen, this layer is not joined Number;The down-sampled length of each map and width later become original half;
Second convolutional layer:The layer carries out convolution, institute to upper one layer each map respectively using 20 × 50 5 × 5 convolution kernels To include 20 × 50 × 5 × 5=25000 parameter weighting parameters;Picture side length is after convolution(12-5+1)/ 1=8, so generating 50 8 × 8 map include 50 × 8 × 8=3200 neurons;
Second pond layer:It is similar with first pond layer function, by the down-sampled map for being 4 × 4 of 8 × 8 map;The layer is without ginseng Number;
First full articulamentum:Upper one layer of all neurons are attached, which contains 500 neurons, so one is shared 50 × 4 × 4 × 500=400000 weighting parameters;
Activation primitive layer, that is, relu layers:It realizes x=max [0, x], this layer of neuron number and upper one layer of identical, no weighting parameter;
Second full articulamentum:Function is similar with the first full articulamentum, which shares 10 neurons, includes 500 × 10=5000 Parameter;
Softmax layers:It realizes classification and normalization, the probability of each example generic is recorded using softmax function, thus Carry out classification judgement.
Step 3:S example is acquired for each sample standard deviation that positive sample is concentrated, each example is input to classifier mould In type;Record has the maximum example of lesion point probability value, and then the example is added in data set D.
Step 4:S example is acquired for each sample standard deviation that negative sample is concentrated, each example is input to classifier mould In type;Record most unlikely has the example of lesion point, is then added to the example in the data set D that step 3 obtains.
Step 5:The data set D that step 4 obtains is iterated training in neural network classifier model, is trained Model;
Data set is sent in disaggregated model by Program transformation at .npy format using mainstream deep learning frame and platform, Classification based training is carried out, training pattern is obtained and is saved in local;Carry out multiplicating training, each training will resampling simultaneously More new data set;It carries out saving last training pattern after repeatedly training.
Step 6:Detection and the mark of sample are carried out according to the model that step 5 obtains;The sample to be marked is sent to Differentiation is trained in disaggregated model;Each new samples sample S example, are classified to each example with sorter model; If having one and above example having lesion point, determine that the sample is to have lesion point diagram piece;Otherwise determine the sample for no lesion Point picture;Until all new samples have been detected, so that the mass for completing new samples accurately marks.
Wherein MIL(Multiple Instance Learning)It indicates multi-instance learning, includes packet(bags)And example (instance)Two key concepts;Packet is by multiple composition examples, for example in Medical Images Classification, a picture is exactly One packet, the patches that picture segmentation goes out mean that example.
In training part:It takes sub-fraction training sample to be labeled, is then carried out by the method for certain supervised learning Training obtains the disaggregated model of an initialization;And then S instance is sampled to each positive sample bag, each Instance is input in sorter model, has the lesion point maximum instance of probability value using SoftMax function record, most The instance is added in data set D afterwards;S instance is equally sampled to each negative sample bag, each Instance is input in sorter model, most unlikely there is the instance of lesion point using SoftMax function record, also will The instance is added in data set D;It is finally input in sorter model and is trained with obtained data set D again, often Secondary training will resampling and more new data set D, and save finally trained model.Differentiating part:New sample Bags equally samples S instance, then classifies for each instance sorter model, and the rule of judgement is:Only There is an instance to have lesion point, then determines that sample bag is the picture for having lesion point;If all instance are There is no lesion point, then determines sample bag for the picture of no lesion point;The samples pictures of each Zhang Xin are carried out determining step above Suddenly, so training, until having detected all new samples.
Multi-instance learning method belongs to the scope of Weakly supervised study, is not have for training the instance of sorter model Category label, but bags is to have category label, this point and previous all frames are not very identical;In training department Point, each time when train classification models, the data set loaded all can resampling and more new data set D, with frequency of training Increase, the nicety of grading of disaggregated model can also greatly improve;After the completion of training, model will be stored in local, convenient for it is subsequent The accurate mark of sample lesion point is used in the field of medical imaging;Method and step and disaggregated model used are transplanted to medical treatment to set In standby, different types of lesion point samples pictures are taken by medicine video camera, picture is zoomed to required by MIL algorithm Picture size, and by program, all pixels value in image is read in the form of multi-dimensional matrix in the algorithm;It loads trained The disaggregated model of completion, so that mass, rapid, precision detects and marks lesion point picture.
Using the video camera of Medical Devices as collector, different types of lesion point image is acquired, is therefrom selected several High-visible image carries out disaggregated model by choosing sub-fraction semantic label image as model training data acquisition system Initialization operation.Then, model training and save using the deep learning frame and platform of mainstream, finally using training Model new image is detected and is marked, obtain the largely data sets that precisely mark;The present invention is not by variety classes disease The influence of stove, mixing to a variety of lesions also can be carried out accurate mark, strong robustness;It is not only common for lesion point The mark of shape, for some irregular, uncommon shape also can be carried out accurate mark, and universality is high;It is imaged by medicine Head carries out image sampling, and utilizes trained model, automatic to detect lesion point image, to precisely be differentiated to new samples And mark;Be conducive to detection and mark of the hospital for various lesion images, can greatly reduce professional technician for medicine The workload of image labeling, while being also convenient for the lesion point that doctor quickly checked and diagnosed patient;It only needs to provide high resolution Lesion picture, the accurate mark of lesion point in large quantity can be carried out, and speed is fast, it is at low cost, therefore have high effect It is forthright.

Claims (5)

1. a kind of accurate mask method of medical image lesion point based on MIL, which is characterized in that include the following steps:
Step 1:Medical images data sets are acquired, positive sample collection and negative sample collection are divided into;
Step 2:Carry out the initialization of disaggregated model;
Step 3:S example is acquired for each sample standard deviation that positive sample is concentrated, each example is input in sorter model; Record has the maximum example of lesion point probability value, and then the example is added in data set D;
Step 4:S example is acquired for each sample standard deviation that negative sample is concentrated, each example is input in sorter model; Record most unlikely has the example of lesion point, is then added to the example in the data set D that step 3 obtains;
Step 5:The data set D that step 4 obtains is iterated training in neural network classifier model, obtains training mould Type;
Step 6:Detection and the mark of new samples are carried out according to the model that step 5 obtains.
2. a kind of accurate mask method of medical image lesion point based on MIL according to claim 1, which is characterized in that The disaggregated model uses the neural network model based on LeNet, including input layer, the first convolutional layer, the first pond layer, second Convolutional layer, the second pond layer, the first full articulamentum, activation primitive layer, the second full articulamentum and for realizing classifying and normalize Softmax layer.
3. a kind of accurate mask method of medical image lesion point based on MIL according to claim 1, which is characterized in that Detection and new samples each in annotation process sample S example in the step 6, are divided with sorter model each example Class;If having one and above example having lesion point, determine that the sample is to have lesion point diagram piece;Otherwise determine that the sample is disease-free Stove point picture;Until having detected all new samples.
4. a kind of accurate mask method of medical image lesion point based on MIL according to claim 1, which is characterized in that During repetitive exercise in the step 5, step 3 is repeated before training each time and step 4 obtains updated data set D。
5. a kind of accurate mask method of medical image lesion point based on MIL according to claim 1, which is characterized in that Initialization procedure is to choose the sample with label to carry out supervised learning in the step 2.
CN201810677693.6A 2018-06-27 2018-06-27 A kind of accurate mask method of medical image lesion point based on MIL Pending CN108922599A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810677693.6A CN108922599A (en) 2018-06-27 2018-06-27 A kind of accurate mask method of medical image lesion point based on MIL

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810677693.6A CN108922599A (en) 2018-06-27 2018-06-27 A kind of accurate mask method of medical image lesion point based on MIL

Publications (1)

Publication Number Publication Date
CN108922599A true CN108922599A (en) 2018-11-30

Family

ID=64423841

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810677693.6A Pending CN108922599A (en) 2018-06-27 2018-06-27 A kind of accurate mask method of medical image lesion point based on MIL

Country Status (1)

Country Link
CN (1) CN108922599A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111340A (en) * 2019-04-28 2019-08-09 南开大学 The Weakly supervised example dividing method cut based on multichannel
CN110148192A (en) * 2019-04-18 2019-08-20 上海联影智能医疗科技有限公司 Medical image imaging method, device, computer equipment and storage medium
CN110969626A (en) * 2019-11-27 2020-04-07 西南交通大学 Method for extracting hippocampus of human brain nuclear magnetic resonance image based on 3D neural network
CN112634255A (en) * 2020-12-30 2021-04-09 清华大学 Method and device for establishing brain focus detection model and computer equipment
WO2021114630A1 (en) * 2020-05-28 2021-06-17 平安科技(深圳)有限公司 Medical image sample screening method, apparatus, computer device, and storage medium
CN114926396A (en) * 2022-04-13 2022-08-19 四川大学华西医院 Mental disorder magnetic resonance image preliminary screening model construction method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106909784A (en) * 2017-02-24 2017-06-30 天津大学 Epileptic electroencephalogram (eeg) recognition methods based on two-dimentional time-frequency image depth convolutional neural networks
CN107563123A (en) * 2017-09-27 2018-01-09 百度在线网络技术(北京)有限公司 Method and apparatus for marking medical image
CN107680088A (en) * 2017-09-30 2018-02-09 百度在线网络技术(北京)有限公司 Method and apparatus for analyzing medical image
CN107784319A (en) * 2017-09-26 2018-03-09 天津大学 A kind of pathological image sorting technique based on enhancing convolutional neural networks

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106909784A (en) * 2017-02-24 2017-06-30 天津大学 Epileptic electroencephalogram (eeg) recognition methods based on two-dimentional time-frequency image depth convolutional neural networks
CN107784319A (en) * 2017-09-26 2018-03-09 天津大学 A kind of pathological image sorting technique based on enhancing convolutional neural networks
CN107563123A (en) * 2017-09-27 2018-01-09 百度在线网络技术(北京)有限公司 Method and apparatus for marking medical image
CN107680088A (en) * 2017-09-30 2018-02-09 百度在线网络技术(北京)有限公司 Method and apparatus for analyzing medical image

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110148192A (en) * 2019-04-18 2019-08-20 上海联影智能医疗科技有限公司 Medical image imaging method, device, computer equipment and storage medium
CN110111340A (en) * 2019-04-28 2019-08-09 南开大学 The Weakly supervised example dividing method cut based on multichannel
CN110111340B (en) * 2019-04-28 2021-05-14 南开大学 Weak supervision example segmentation method based on multi-path segmentation
CN110969626A (en) * 2019-11-27 2020-04-07 西南交通大学 Method for extracting hippocampus of human brain nuclear magnetic resonance image based on 3D neural network
CN110969626B (en) * 2019-11-27 2022-06-07 西南交通大学 Method for extracting hippocampus of human brain nuclear magnetic resonance image based on 3D neural network
WO2021114630A1 (en) * 2020-05-28 2021-06-17 平安科技(深圳)有限公司 Medical image sample screening method, apparatus, computer device, and storage medium
CN112634255A (en) * 2020-12-30 2021-04-09 清华大学 Method and device for establishing brain focus detection model and computer equipment
CN112634255B (en) * 2020-12-30 2022-12-02 清华大学 Method and device for establishing brain focus detection model and computer equipment
CN114926396A (en) * 2022-04-13 2022-08-19 四川大学华西医院 Mental disorder magnetic resonance image preliminary screening model construction method

Similar Documents

Publication Publication Date Title
CN108922599A (en) A kind of accurate mask method of medical image lesion point based on MIL
Xue et al. An application of transfer learning and ensemble learning techniques for cervical histopathology image classification
CN106056595B (en) Based on the pernicious assistant diagnosis system of depth convolutional neural networks automatic identification Benign Thyroid Nodules
CN108257135A (en) The assistant diagnosis system of medical image features is understood based on deep learning method
Pan et al. Mitosis detection techniques in H&E stained breast cancer pathological images: A comprehensive review
CN109325942A (en) Eye fundus image Structural Techniques based on full convolutional neural networks
Huang et al. Lesion-based contrastive learning for diabetic retinopathy grading from fundus images
CN110910377B (en) Cerebral infarction MRI image identification method based on neural network
CN108549912A (en) A kind of medical image pulmonary nodule detection method based on machine learning
CN111369501B (en) Deep learning method for identifying oral squamous cell carcinoma based on visual features
CN116188479B (en) Hip joint image segmentation method and system based on deep learning
Wang et al. Cataract detection based on ocular B-ultrasound images by collaborative monitoring deep learning
CN110867242A (en) Capsule endoscope image intelligent screening system
Tang et al. Lesion segmentation and RECIST diameter prediction via click-driven attention and dual-path connection
CN111028230A (en) Fundus image optic disc and macula lutea positioning detection algorithm based on YOLO-V3
Hasan et al. Dental impression tray selection from maxillary arch images using multi-feature fusion and ensemble classifier
CN114399634A (en) Three-dimensional image classification method, system, device and medium based on weak supervised learning
CN113011340B (en) Cardiovascular operation index risk classification method and system based on retina image
CN114140437A (en) Fundus hard exudate segmentation method based on deep learning
CN110070125A (en) A kind of liver and gall surgical department's therapeutic scheme screening technique and system based on big data analysis
CN113963199A (en) Medical waste identification method based on multiple sensor feature fusion and machine learning
Guo et al. LLTO: towards efficient lesion localization based on template occlusion strategy in intelligent diagnosis
Wang et al. Optic disc detection based on fully convolutional neural network and structured matrix decomposition
CN101609452A (en) The fuzzy SVM feedback that is used for the medical image target identification is estimated method
CN116012639A (en) Quantitative index and staging method for retinal fundus image of premature infant based on meta-learning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181130

RJ01 Rejection of invention patent application after publication