CN109816019A - A kind of image data automation auxiliary mask method - Google Patents

A kind of image data automation auxiliary mask method Download PDF

Info

Publication number
CN109816019A
CN109816019A CN201910075655.8A CN201910075655A CN109816019A CN 109816019 A CN109816019 A CN 109816019A CN 201910075655 A CN201910075655 A CN 201910075655A CN 109816019 A CN109816019 A CN 109816019A
Authority
CN
China
Prior art keywords
data
mark
image data
labeled
mask method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201910075655.8A
Other languages
Chinese (zh)
Inventor
龚飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Xiaomeng Technology Co Ltd
Original Assignee
Shanghai Xiaomeng Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Xiaomeng Technology Co Ltd filed Critical Shanghai Xiaomeng Technology Co Ltd
Priority to CN201910075655.8A priority Critical patent/CN109816019A/en
Publication of CN109816019A publication Critical patent/CN109816019A/en
Withdrawn legal-status Critical Current

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a kind of image datas to automate auxiliary mask method comprising the steps of: A, acquisition image data;B, large-scale dataset and small lot data set are splitted data into;C, small-scale data set is manually marked and 3D renders labeled data;The small lot data set that obtains that treated;D, to treated, small lot data set is labeled model treatment, summarizes after processing with large-scale dataset;E, batch is carried out to the data set that step D summarizes to mark from dynamic auxiliary;F, the initial automatic marking data that step D is obtained manually are finely tuned, obtain extensive complete labeled data collection, the automatic replication theme of data described using this patent, on the one hand time reduction manual operation can be saved, mark rule is optimized, promotes data mark accuracy, on the other hand it can guarantee the accuracy of algorithm, enhance the stability of intelligence retail cabinet.

Description

A kind of image data automation auxiliary mask method
Technical field
The present invention relates to technical field of image processing, specifically a kind of image data automation auxiliary mask method.
Background technique
It is always the very stubborn problem of artificial intelligence field one that image data, which marks work, has model steady Fixed performance, it is necessary to carry out training pattern using a large amount of labeled data, usually in artificial intelligence landing project, at least need tens of thousands of The labeled data of even higher number of levels can just train feasible model.Conventional images data mark work It is completed completely using artificial mark, scientific research institutions both domestic and external, business unit etc. all take in this work sizable Manpower and time, to increase project development cost.
Mass data mark problem is a big difficulty in artificial intelligence landing project, for promoted image data mark when Between efficiency, save mark cost of labor, optimization mark rule, the design proposes a kind of image data automation auxiliary mark side Case.
Summary of the invention
The purpose of the present invention is to provide a kind of image datas to automate auxiliary mask method, to solve above-mentioned background technique The problem of middle proposition.
To achieve the above object, the invention provides the following technical scheme:
A kind of image data automation auxiliary mask method comprising the steps of:
A, image data is acquired;
B, large-scale dataset and small lot data set are splitted data into;
C, small-scale data set is manually marked and 3D rendering marks;The small lot data set that obtains that treated;
D, to treated, small lot data set is labeled model treatment, summarizes after processing with large-scale dataset;
E, batch is carried out to the data set that step D summarizes to mark from dynamic auxiliary;
F, the initial automatic marking data that step E is obtained manually are finely tuned, obtains extensive complete labeled data collection.
As further technical solution of the present invention: the step A is realized by camera.
As further technical solution of the present invention: being more than the number using 3D rendering mark using the data manually marked According to.
As further technical solution of the present invention: the step D is specifically: by the artificial labeled data and 3D of small lot Rendering labeled data constitutes a small training set together, is then carried out come training pattern to high-volume data using the training set Automatic marking.
As further technical solution of the present invention: the marking model is the neural network model of low complex degree.
As further technical solution of the present invention: the marking model is the network model in actual items.
As further technical solution of the present invention: 3D renders labeled data and needs to carry out 3D modeling to commodity in advance, Automatic marking is carried out to 3D rendering labeled data using program clearly after mark rule.
Compared with prior art, the beneficial effects of the present invention are: using this patent describe the automatic replication theme of data, one Aspect can save time reduction manual operation, optimize mark rule, promote data mark accuracy, on the other hand can guarantee The accuracy of algorithm enhances the stability of intelligence retail cabinet.
Detailed description of the invention
Fig. 1 is the schematic diagram of image data automation auxiliary mask method.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
Embodiment 1: referring to Fig. 1, a kind of image data automation auxiliary mask method comprising the steps of:
A, image data is acquired;
B, large-scale dataset and small lot data set are splitted data into;
C, small-scale data set is manually marked and 3D rendering marks;The small lot data set that obtains that treated;It builds first Then 3D rendering mark number of the part with markup information is added in the artificial labeled data collection of a vertical small lot in the data set According to.Artificial labeled data and 3D rendering labeled data are as shown in Figure 1.Artificial labeled data by data that camera is acquired into Pedestrian's work mark obtains, and 3D renders labeled data and needs to carry out 3D modeling to commodity in advance, utilizes after clearly mark rule Program carries out automatic marking to 3D rendering labeled data.The data in two kinds of sources are made into Small Sample Database library, it can be in terms of two Promote the efficiency of auxiliary mark.Firstly, artificial small lot labeled data specifies mark rule, secondly, 3D renders labeled data The integrality of data can be promoted up from a variety of variations such as multi-angle, multi-pose.The two is used to train marking model simultaneously, is had Help be promoted the accuracy of mark.
In the actual operation process, the selection mode of labeled data is rendered as the artificial labeled data and 3D of small lot, It can be depending on specific requirements.For image data, it is assumed that the total amount of data for finally needing to mark is T, and is needed small quantities of Measure that artificial labeled data is, the data volume of 3D rendering labeled data is, then the data count for training marking model is N ,, here, their quantity meets following relationship:;Usually take,,, Known to here artificial small lot labeled data only account for 7.0 % (0.7 × 0.1 × 100%) of total data, in actual mechanical process Use ratio to various data it is not strictly necessary that, but to guarantee for training the artificial labeled data of marking model to use up More than 3D rendering labeled data, secondly in the actual operation process amount guarantees, it is proposed thatValue cannot be too small, otherwise trains Automatic marking model accuracy is lower, can not ensure the accuracy of automatic marking, will increase labor workload instead.
D, to treated, small lot data set is labeled model treatment, summarizes after processing with large-scale dataset;For It realizes to the quick marks of high-volume data, the present invention devises a kind of automatic marking scheme to assist to complete mark task.It is real In the operating process of border, artificial labeled data and 3D the rendering labeled data of small lot are constituted a small training by the present invention together Then collection carries out automatic marking to high-volume data come training pattern using the training set.
E, batch is carried out to the data set that step D summarizes to mark from dynamic auxiliary;
F, it is manually finely tuned to what step E was obtained from dynamic auxiliary labeled data, obtains extensive complete labeled data collection.It is logical Often, if handling the markup information of hundreds of thousands of or millions of ranks using manually, the plenty of time can be consumed, this mark side Method can cause huge obstruction to the implementation progress of actual items.
Therefore, the present invention first trains mini Mod using small lot data, then mini Mod is recycled to mark from dynamic auxiliary The scheme of high-volume image data solves the above problems.
In the actual operation process, trained auxiliary marking model is usually constructed with preferably mark performance, marks accuracy rate 95.00% or more can be reached, generally manually the error label of the size to callout box, position or only a few is only needed to adjust It is whole.In some cases, the mark rule manually determined is less reasonable, causes automatic marking to will appear more apparent mark and misses Difference at this time can adjust mark rule, and then optimize mark rule.
It is mutually coordinated from both dynamic auxiliary mark and artificial fine tuning, it is common to promote annotating efficiency and mark quality, finally both Time cost and cost of labor are saved, mark rule is optimized, improves data mark accuracy, and protect to a certain extent Arithmetic accuracy is demonstrate,proved.
Embodiment 2, on the basis of embodiment 1, in training marking model, how to design marking model can be according to reality Depending on situation, usually there are two types of optinal plans here:
Scheme one: the neural network model for designing low complex degree is trained.This scheme flexibility is higher, can be according to trained As a result model structure is adjusted at any time, reduces the training time.But the data that mark out of the model of this scheme training be possible to The demand of actual items has certain difference.
Scheme two: it is trained using the network model in actual items.Because data volume is smaller, this scheme can be one Determine to reduce the training time in degree, the data marked out using the model that this scheme trains more meet the need of actual items It asks, and can also assist in the performance of analysis actual items network model.
The present invention relates to automation auxiliary labelling schemes in, it is preferred to use scheme two is carried out training pattern and is marked automatically Note.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power Benefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claims Variation is included within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.
In addition, it should be understood that although this specification is described in terms of embodiments, but not each embodiment is only wrapped Containing an independent technical solution, this description of the specification is merely for the sake of clarity, and those skilled in the art should It considers the specification as a whole, the technical solutions in the various embodiments may also be suitably combined, forms those skilled in the art The other embodiments being understood that.

Claims (7)

1. a kind of image data automation auxiliary mask method, which is characterized in that comprise the steps of:
A, image data is acquired;
B, large-scale dataset and small lot data set are splitted data into;
C, small-scale data set is manually marked and 3D rendering marks;The small lot data set that obtains that treated;
D, to treated, small lot data set is labeled model treatment, summarizes after processing with large-scale dataset;
E, batch is carried out to the data set that step D summarizes to mark from dynamic auxiliary;
The initial automatic marking data that step E is obtained manually are finely tuned, extensive complete labeled data collection is obtained.
2. a kind of image data automation auxiliary mask method according to claim 1, which is characterized in that the step A It is realized by camera.
3. a kind of image data automation auxiliary mask method according to claim 1, which is characterized in that using artificial mark The data of note are more than the data using 3D rendering mark.
4. a kind of image data automation auxiliary mask method according to claim 1, which is characterized in that the step E Specifically: artificial labeled data and 3D the rendering labeled data of small lot being constituted into a small training set together, then used The training set carrys out training pattern and carries out automatic marking to high-volume data.
5. a kind of image data automation auxiliary mask method according to claim 1, which is characterized in that the mark mould Type is the neural network model of low complex degree.
6. a kind of image data automation auxiliary mask method according to claim 1, which is characterized in that the mark mould Type is the network model in actual items.
7. a kind of image data automation auxiliary mask method according to claim 1 to 4, which is characterized in that 3D wash with watercolours Contaminate labeled data need in advance to commodity carry out 3D modeling, clearly mark rule after using program to 3D render labeled data into Row automatic marking.
CN201910075655.8A 2019-01-25 2019-01-25 A kind of image data automation auxiliary mask method Withdrawn CN109816019A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910075655.8A CN109816019A (en) 2019-01-25 2019-01-25 A kind of image data automation auxiliary mask method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910075655.8A CN109816019A (en) 2019-01-25 2019-01-25 A kind of image data automation auxiliary mask method

Publications (1)

Publication Number Publication Date
CN109816019A true CN109816019A (en) 2019-05-28

Family

ID=66605290

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910075655.8A Withdrawn CN109816019A (en) 2019-01-25 2019-01-25 A kind of image data automation auxiliary mask method

Country Status (1)

Country Link
CN (1) CN109816019A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110880021A (en) * 2019-11-06 2020-03-13 创新奇智(北京)科技有限公司 Model-assisted data annotation system and annotation method
CN111310667A (en) * 2020-02-18 2020-06-19 北京小马慧行科技有限公司 Method, device, storage medium and processor for determining whether annotation is accurate
CN111311571A (en) * 2020-02-13 2020-06-19 上海小萌科技有限公司 Target information acquisition method, system, device and readable storage medium
CN111832619A (en) * 2020-06-09 2020-10-27 哈尔滨市科佳通用机电股份有限公司 Target detection data set VOC data format labeling method based on deep learning
CN112968941A (en) * 2021-02-01 2021-06-15 中科视拓(南京)科技有限公司 Data acquisition and man-machine collaborative annotation method based on edge calculation
WO2022242199A1 (en) * 2021-05-19 2022-11-24 上海仙途智能科技有限公司 Data annotation

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170011077A1 (en) * 2015-07-07 2017-01-12 Socrata, Inc. Scalable annotation architecture
CN108960409A (en) * 2018-06-13 2018-12-07 南昌黑鲨科技有限公司 Labeled data generation method, equipment and computer readable storage medium
CN108985293A (en) * 2018-06-22 2018-12-11 深源恒际科技有限公司 A kind of image automation mask method and system based on deep learning

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170011077A1 (en) * 2015-07-07 2017-01-12 Socrata, Inc. Scalable annotation architecture
CN108960409A (en) * 2018-06-13 2018-12-07 南昌黑鲨科技有限公司 Labeled data generation method, equipment and computer readable storage medium
CN108985293A (en) * 2018-06-22 2018-12-11 深源恒际科技有限公司 A kind of image automation mask method and system based on deep learning

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110880021A (en) * 2019-11-06 2020-03-13 创新奇智(北京)科技有限公司 Model-assisted data annotation system and annotation method
CN110880021B (en) * 2019-11-06 2021-03-16 创新奇智(北京)科技有限公司 Model-assisted data annotation system and annotation method
CN111311571A (en) * 2020-02-13 2020-06-19 上海小萌科技有限公司 Target information acquisition method, system, device and readable storage medium
CN111310667A (en) * 2020-02-18 2020-06-19 北京小马慧行科技有限公司 Method, device, storage medium and processor for determining whether annotation is accurate
CN111310667B (en) * 2020-02-18 2023-09-01 北京小马慧行科技有限公司 Method, device, storage medium and processor for determining whether annotation is accurate
CN111832619A (en) * 2020-06-09 2020-10-27 哈尔滨市科佳通用机电股份有限公司 Target detection data set VOC data format labeling method based on deep learning
CN112968941A (en) * 2021-02-01 2021-06-15 中科视拓(南京)科技有限公司 Data acquisition and man-machine collaborative annotation method based on edge calculation
CN112968941B (en) * 2021-02-01 2022-07-08 中科视拓(南京)科技有限公司 Data acquisition and man-machine collaborative annotation method based on edge calculation
WO2022242199A1 (en) * 2021-05-19 2022-11-24 上海仙途智能科技有限公司 Data annotation

Similar Documents

Publication Publication Date Title
CN109816019A (en) A kind of image data automation auxiliary mask method
US10083517B2 (en) Segmentation of an image based on color and color differences
CN110163640A (en) A kind of method and computer equipment of product placement in video
CN101689215B (en) For the method based on steiner tree of polygon fracturing
CN102812463A (en) Method And System Enabling 3D Printing Of Three-dimensional Object Models
DE112022003220T5 (en) Methods, systems, articles of manufacture and apparatus for decoding purchase data using an image
CN110276442A (en) A kind of searching method and device of neural network framework
CN111898424B (en) Character recognition model training method and device, electronic equipment and storage medium
CN103942571B (en) Graphic image sorting method based on genetic programming algorithm
CN106886917B (en) Method and device for generating advertisement
CN103116827A (en) Rural power grid engineering control system
WO2019223145A1 (en) Electronic device, promotion list recommendation method and system, and computer-readable storage medium
CN109978619A (en) Method, system, equipment and the medium of air ticket pricing Policy Filtering
CN109543693A (en) Weak labeling data noise reduction method based on regularization label propagation
CN110737805A (en) Method and device for processing graph model data and terminal equipment
CN106952024A (en) It is a kind of to strengthen the workflow engine method and system of net O&M scenarios suitable for ground
CN111178845A (en) Data annotation system and method based on network service platform
CN108446262A (en) A kind of list generates, analysis method and device
CN108268615A (en) A kind of data processing method, device and system
CN114997263A (en) Training rate analysis method, device, equipment and storage medium based on machine learning
CN103065009A (en) Intelligent design system and method of traffic sign lines
CN108052726A (en) A kind of building materials business and construction Information uploading system based on BIM models
CN115858843A (en) City space map information platform in block form and construction method thereof
CN112988403B (en) Integrated circuit simulation multithread management parallel method and device with security function
CN109101544A (en) Heating power drawing generating method, calculates equipment and readable storage medium storing program for executing at device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20190528

WW01 Invention patent application withdrawn after publication