CN114936207A - Method for evaluating sensing data quality of sensing equipment of Internet of things - Google Patents
Method for evaluating sensing data quality of sensing equipment of Internet of things Download PDFInfo
- Publication number
- CN114936207A CN114936207A CN202210875069.3A CN202210875069A CN114936207A CN 114936207 A CN114936207 A CN 114936207A CN 202210875069 A CN202210875069 A CN 202210875069A CN 114936207 A CN114936207 A CN 114936207A
- Authority
- CN
- China
- Prior art keywords
- sensing
- things
- internet
- data
- sensing equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y20/00—Information sensed or collected by the things
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Pure & Applied Mathematics (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Signal Processing (AREA)
- Evolutionary Biology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Probability & Statistics with Applications (AREA)
- General Health & Medical Sciences (AREA)
- Algebra (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention provides a method for evaluating the quality of sensing data of sensing equipment of the Internet of things, and belongs to the technical field of evaluation of the quality of sensing data of sensing equipment of the Internet of things. The method comprises the steps that real-time sensing data of the sensing equipment of the Internet of things are acquired by the acquisition and docking equipment and are stored in a database; the method comprises the steps of obtaining sensing data of the sensing equipment of the Internet of things from a database, wherein the sensing data of the sensing equipment of the Internet of things comprises sensing data of sensing equipment of the discrete Internet of things and sensing data of sensing equipment of the continuous Internet of things, respectively carrying out data quality evaluation on the sensing data of the sensing equipment of the discrete Internet of things and the sensing data of the sensing equipment of the continuous Internet of things to obtain a process sigma value, determining data quality according to the process sigma value, and creating a linear regression model to predict the sensing data quality of the sensing equipment of the Internet of things. The method and the system effectively filter the defective equipment data and mark the problematic equipment in time, thereby improving the correctness of service decision. The technical problem of low data quality accuracy rate in the prior art is solved.
Description
Technical Field
The application relates to a quality evaluation method, in particular to a quality evaluation method for sensing data of sensing equipment of the Internet of things, and belongs to the technical field of quality evaluation of sensing data of sensing equipment of the Internet of things.
Background
The internet of things is also called as a sensing network. The internet of things is a network which connects any article with the internet according to an agreed protocol through information sensing equipment such as Radio Frequency Identification (RFID), an infrared sensor, a global positioning system, a laser scanner and the like to exchange and communicate information so as to realize intelligent identification, positioning, tracking, monitoring and management.
The concept of the internet of things and related technical products have widely penetrated into various fields of social and economic lives and play a key role in more and more industrial innovation. The internet of things plays an important role in promoting transformation and upgrading, improving social services, improving service lives, promoting efficiency and energy conservation and the like by virtue of deep integration and comprehensive application of a new generation of information technology, and brings real 'intelligent' application in partial fields.
With the further development and breakthrough of the technology in the related field and the gradual improvement of the cognition degree of the client, the internet of things can be more widely applied to various fields such as industry, agriculture, electric power, building, traffic, logistics, environmental protection, medical treatment, security, home furnishing and the like. The market of the internet of things has great potential and can be developed at high speed in the coming years, and the good development prospect of the market also brings opportunities and challenges for numerous manufacturers.
The Internet of things equipment serves as a sensing terminal and feeds back accurate and effective sensing information in time based on different needs of services. The condition of the quality of the sensing data can seriously affect the analysis and calculation of the final result, the quality of the sensing data is ensured, and the invalid equipment and the sensing data are necessary to be checked and removed in time. The current data quality inspection algorithm usually counts the qualified rate by the integral qualified rate, but judges the qualified rate by the deviation condition of single data, which causes the qualified rate of partial equipment within the specified deviation to be high, but the data quality accuracy rate caused by the deviation is low.
Disclosure of Invention
The following presents a simplified summary of the invention in order to provide a basic understanding of some aspects of the invention. It should be understood that this summary is not an exhaustive overview of the invention. It is not intended to determine the key or important part of the present invention, nor is it intended to limit the scope of the present invention. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is discussed later.
In view of this, in order to solve the technical problem of low data quality accuracy rate in the prior art, the invention provides a method for evaluating the sensing data quality of sensing equipment of the internet of things.
The first scheme is as follows: the method for evaluating the quality of the sensing data of the sensing equipment of the Internet of things is characterized by comprising the steps of acquiring real-time sensing data of the sensing equipment of the Internet of things obtained by butt joint equipment and storing the sensing data into a database; the method comprises the steps of obtaining sensing data of the sensing equipment of the Internet of things from a database, wherein the sensing data of the sensing equipment of the Internet of things comprises sensing data of sensing equipment of the discrete Internet of things and sensing data of sensing equipment of the continuous Internet of things, respectively carrying out data quality evaluation on the sensing data of the sensing equipment of the discrete Internet of things and the sensing data of the sensing equipment of the continuous Internet of things to obtain a process sigma value, determining data quality according to the process sigma value, and creating a linear regression model to predict the sensing data quality of the sensing equipment of the Internet of things.
Preferably, the quality evaluation method of the sensing data of the discrete internet of things sensing device comprises the following steps:
s1, selecting N pieces of sensing data of the discrete Internet of things sensing equipment in a certain time period from the database, and recording the data of each piece of Internet of things sensing equipment as i 1 ,i 2 ,i 3 .....i n (ii) a Respectively receiving six data of each Internet of things sensing deviceChecking the dimensions to obtain W pieces of defect data;
s2, calculating the probability of the computer fault DPO;
s3, calculating the DPMO (number of million opportunity defects);
s4, inquiring a corresponding relation table of DMPO and sigma to obtain a process sigma value Z of sensing data of the sensing equipment of the current Internet of things;
and S5, evaluating the quality of the sensing data of the discrete Internet of things sensing equipment according to the flow sigma value Z.
Preferably, the six dimensions include completeness, normalization, consistency, accuracy, uniqueness and relevance; the sensing data of the sensing equipment of the Internet of things which does not conform to one of six dimensions is the sensing equipment data of the defective Internet of things, and each sensing data of the sensing equipment of the Internet of things has six defect opportunities.
Preferably, the calculation method of the opportunistic defect rate DPO is as follows:
DPO = number of defects/(number of products × number of opportunities for defects);
the calculation method of the DPMO with the million chance defect number is as follows:
DPMO=DPO*10^6
the number of the products is the number of sensing data of the sensing equipment of the Internet of things, the number of the defects is the number of the defects of the sensing data of the sensing equipment of the Internet of things, and the number of the opportunities of the defects is the proportion of the number of the defects of the sensing data of each sensing equipment of the Internet of things to the number of the defects of the sensing data of all sensing equipment of the Internet of things.
Preferably, the method for evaluating the quality of the sensing data of the discrete internet of things sensing device according to the process sigma value Z is that the larger the process sigma value Z is, the better the quality of the sensing data of the internet of things sensing device is.
Preferably, the quality evaluation method for sensing data of the continuous internet of things sensing equipment comprises the following steps:
step one, selecting N pieces of sensing data of continuous Internet of things sensing equipment in a certain time period from a database, and respectively recording the sensing data result of each piece of Internet of things sensing equipment as i 1 ,i 2 ,i 3 .....i n Obtaining sensing number of continuous Internet of things sensing equipmentThe average value according to;
step two, variance calculation is carried out on sensing data and the average value of the continuous Internet of things sensing equipment;
thirdly, calculating probability density according to the average value and the variance to obtain the perception data qualification rate P of the continuous Internet of things sensing equipment good Thereby obtaining the sensing data opportunity defect rate 1-P of the continuous Internet of things sensing equipment good ;
Step four, calculating the DPMO with the million chance defect number, wherein the DPMO = DPO 10^6, and the DPO value is 1-P good Inquiring a corresponding relation table of DMPO and sigma to obtain a process sigma value Z of sensing data of the current sensing equipment of the Internet of things;
and fifthly, evaluating the quality of the sensing data of the continuous Internet of things sensing equipment according to the flow sigma value Z.
Preferably, the specific method for calculating the probability density according to the mean and the variance to obtain the yield is as follows:
When in use=0,When =1, the normal distribution is a standard normal distribution, and the probability density function is simplified as follows:=expthe cumulative probability area function is: p (X) = ∅ (X) ===1
According to the formula, the fraction defective under the tolerance lower bound LSL is calculated as follows:
the result of calculating the reject ratio above the tolerance upper bound USL is as follows:
the cumulative probability area of the region between the lower tolerance bound and the upper tolerance bound is:
Preferably, the method for predicting the sensing data quality of the sensing equipment of the internet of things by establishing the linear regression model comprises the following steps: the linear regression model is: y =(x)= 0 + 1 x, wherein(x) Representing a functional mapping from x to y, 0 and 1 the method comprises the steps that regression parameters are adopted, x is an independent variable, corresponding time T and y are target output variables, the target output variables are inquired through a corresponding relation table of DMPO and sigma to obtain a process sigma value Z of sensing data of current sensing equipment, and the larger the process sigma value Z is, the better the sensing data quality of the sensing equipment of the Internet of things is.
The second scheme is that the electronic device comprises a memory and a processor, the memory stores a computer program, and the processor implements the steps of the first scheme when executing the computer program.
Solution three, a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of solution one.
The invention has the following beneficial effects: the method and the device can effectively filter out defective equipment data, mark out problem equipment in time and improve the correctness of service decision. The method and the device can analyze the data quality of the equipment in a segmented manner, dynamically evaluate the perceived data quality condition of the equipment, and give an alarm in time when the perceived data quality condition is lower than a set quality standard condition.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a schematic flow diagram of the process of the present invention;
FIG. 2 is a schematic diagram of a normal distribution curve according to the present invention.
Detailed Description
In order to make the technical solutions and advantages of the embodiments of the present application more apparent, the following further detailed description of the exemplary embodiments of the present application with reference to the accompanying drawings makes it clear that the described embodiments are only a part of the embodiments of the present application, and are not exhaustive of all embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Embodiment 1, this embodiment is described with reference to fig. 1 to 2, and a method for evaluating sensing data quality of internet of things sensing equipment includes acquiring real-time sensing data of the internet of things sensing equipment acquired by docking equipment and storing the data in a database; the method comprises the steps of obtaining sensing data of the sensing equipment of the Internet of things from a database, wherein the sensing data of the sensing equipment of the Internet of things comprises sensing data of sensing equipment of the discrete Internet of things and sensing data of sensing equipment of the continuous Internet of things, respectively carrying out data quality evaluation on the sensing data of the sensing equipment of the discrete Internet of things and the sensing data of the sensing equipment of the continuous Internet of things to obtain a process sigma value, determining data quality according to the process sigma value, and creating a linear regression model to predict the sensing data quality of the sensing equipment of the Internet of things.
Specifically, acquiring real-time device sensing data acquired by the docking device includes the following contents: firstly, introducing a sensing result parameter standard deviation value (tolerance upper bound (USL)/tolerance lower bound (LSL)) of the obtained equipment through national standards and an Internet of things sensing equipment product; and secondly, connecting the sensing equipment of the Internet of things to a power grid, verifying whether the equipment is normal, checking and confirming whether the voltage and the network bandwidth of the sensing equipment of the Internet of things are normal, checking whether the voltage and the network bandwidth of the sensing equipment of the Internet of things meet the requirements of the normal working environment of the equipment, continuing to perform the next step if the voltage and the network bandwidth meet the requirements, otherwise, giving an alarm and notifying, and stopping detection. And finally, after the normal work of the equipment is confirmed, acquiring the perception information of the equipment for modeling analysis, and evaluating the quality condition of the perception data of the equipment.
Specifically, the quality evaluation method for sensing data of the discrete internet of things sensing equipment comprises the following steps:
s1, selecting N discrete Internet of things sensing equipment sensing data in a certain time period from the database, and recording the sensing data of each discrete Internet of things sensing equipment as i 1 ,i 2 ,i 3 .....i n (ii) a And verifying the sensing data of each discrete Internet of things sensing device from six dimensions of integrity, normalization, consistency, accuracy, uniqueness and relevance to obtain W pieces of defect data, wherein the six dimensions are six defect opportunities, and the sensing data of each Internet of things sensing device has six defect opportunities as long as the sensing data of the Internet of things sensing device does not conform to one of the six dimensions, namely the defect data.
S2, calculating the chance defect rate DPO by using the chance defect rate DPO calculation formula, i.e. the ratio of the defect occurrence rate in each chance represents the proportion of the defect number in each sample amount to the total chance number, and therefore, calculating the chance defect rate DPO as follows:
DPO = number of defects/(number of products × number of opportunities for defects); i.e. DPO = W/(6 × N).
S3, calculating the DPMO (number of million opportunity defects); the calculation method is as follows:
DPMO = DPO 10^ 6; namely DMPO = (10^6 × W)/(6 × N).
The product number is the number of sensing data of the sensing equipment of the Internet of things, the defect number is the defect number of the sensing data of the sensing equipment of the Internet of things, and the defect opportunity number is the proportion of the defect number of the sensing data of each sensing equipment of the Internet of things to the defect number of all sensing data of the sensing equipment of the Internet of things.
S4, obtaining a flow sigma value Z of the sensing data of the current discrete type Internet of things sensing equipment through query of a corresponding relation table (DMPO and sigma) of DMPO and sigma;
table-DMPO and sigma correspondence table
And S5, evaluating the quality of the sensing data of the discrete Internet of things sensing equipment according to the flow sigma value Z, wherein the larger the flow sigma value Z is, the better the quality of the sensing data of the Internet of things sensing equipment is.
Specifically, the quality evaluation method for sensing data of the continuous internet of things sensing equipment comprises the following steps:
step one, selecting N pieces of sensing data of continuous Internet of things sensing equipment in a certain time period from a database, and respectively recording the sensing data result of each piece of Internet of things sensing equipment as i 1 ,i 2 ,i 3 .....i n And acquiring the average value of the sensing data of the continuous Internet of things sensing equipment.
The method for obtaining the average value is realized by the following formula: μ = gAnd μ represents the average value of the sensing data of the N pieces of sensing equipment of the Internet of things.
Step two, variance calculation is carried out on the sensing data and the average value of the continuous Internet of things sensing equipment, and the specific calculation method is as follows:
σ 2 =(1/N) wherein i n Values, σ, representing each successive datum 2 The variance obtained for N data is shown.
Thirdly, calculating probability density according to the average value and the variance to obtain the perception data qualification rate P of the continuous Internet of things sensing equipment good So as to obtain the sensing data opportunity defect rate 1-P of the continuous Internet of things sensing equipment good ;
Step four, calculating the DPMO with the million chance defect number, wherein the DPMO = DPO 10^6, and the DPO value is 1-P good Inquiring a flow sigma value Z of the data of the current sensing equipment through a corresponding relation table of DMPO and sigma;
and step five, evaluating the quality of the continuous sensing data according to the flow sigma value Z.
Specifically, the normal distribution data N to (. mu.,. sigma.) will be described with reference to FIG. 2 2 ) The symmetry axis of the normal distribution curve is the average of the normal samples, the average of the samples increases, the curve translates to the right, the average of the samples decreases, and the curve translates to the left. The larger the standard deviation of a normal sample, the flatter the normal distribution curve and the smaller the peak, with a total probability Area under the distribution curve of 1 (Rejected Area being a bad Area).
Specifically, the method for calculating the probability density according to the mean and the variance to obtain the yield is that,
When in use=0,When =1, the normal distribution is a standard normal distribution, and the probability density function is simplified as follows:=exp(-) The cumulative probability area function is: p (X) = ∅ (X) ===1
According to the formula, we calculate the reject ratio below the lower tolerance bound LSL as:
the result of calculating the fraction defective above the tolerance upper bound USL is as follows:
the cumulative probability area of the region between the lower tolerance bound and the upper tolerance bound is:
Therefore, DPMO = (1-P) in million chance defect number good )*And inquiring a flow sigma value Z of the data of the current sensing equipment through a corresponding relation table I of DMPO and sigma, and determining whether the sensing data quality of the current sensing equipment of the Internet of things is good or bad according to the Z value, wherein the larger the Z value is, the better the data quality is.
Specifically, the method for establishing the linear regression model to predict the sensing data quality of the sensing equipment of the internet of things comprises the following steps: the linear regression model is: y =(x)= 0 + 1 x, wherein(x) Representing a functional mapping from x to y, 0 and 1 the regression parameter is x is independent variable, corresponding time T and y are target output variables, and the target output variables are inquired through a corresponding relation table of DMPO and sigma to obtain the number of the current sensing equipmentAccording to the flow sigma value Z.
Specifically, the detailed process of the method for establishing the model to predict the quality of the sensing data of the sensing equipment of the internet of things is as follows:
a. the corresponding sigma level Z values are calculated for the data of different time periods T, i.e. assuming the data set S = { (T) 1 ,Z 1 ),(T 2 ,Z 2 ),...(T 3 ,Z 3 )};
b. Assuming a linear regression model as: y =(x)= 0 + 1 x, wherein(x) Representing a functional mapping from x to y, 0 and 1 is a regression parameter, x is an independent variable, corresponding to time T, y is a target output variable, corresponding to sigma level Z;
c. quantifying a loss function such that the regression parameters 0 And 1 the optimal regression parameters required to be calculated in the step a can be continuously optimized in the solving process 0 And 1 can be converted into min ((x)-y);
Assuming the loss function is: j (J))=Where m represents the number of instances in the training set,、represents the ith observation instance;
find out a group 0 And 1 minimizing the value of the loss function, the solution J (b) can be) The partial derivative is 0, and the calculation is derived as follows:
to obtain 0 And 1 values of two parameters, so the linear regression model y =(x)= 0 + 1 x can be used for predicting a sigma horizontal Z value corresponding to the time period T, the quality of the sensing data quality of the sensing equipment of the Internet of things can be predicted according to the Z value, and the larger the Z value of the sigma value of the process is, the better the sensing data quality of the sensing equipment of the Internet of things is.
Specifically, in different time periods, the prediction model can predict sigma level values corresponding to different time periods.
In embodiment 2, the computer device of the present invention may be a device including a processor, a memory, and the like, for example, a single chip microcomputer including a central processing unit, and the like. And the processor is used for implementing the steps of the recommendation method capable of modifying the relationship-driven recommendation data based on the CREO software when executing the computer program stored in the memory.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
Embodiment 3 computer-readable storage Medium embodiment
The computer readable storage medium of the present invention may be any form of storage medium that can be read by a processor of a computer device, including but not limited to non-volatile memory, ferroelectric memory, etc., and the computer readable storage medium has stored thereon a computer program that, when the computer program stored in the memory is read and executed by the processor of the computer device, can implement the above-mentioned steps of the CREO-based software that can modify the modeling method of the relationship-driven modeling data.
The computer program comprises computer program code which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.
Claims (10)
1. The method for evaluating the quality of the sensing data of the sensing equipment of the Internet of things is characterized by comprising the steps of acquiring real-time sensing data of the sensing equipment of the Internet of things obtained by butt joint equipment and storing the sensing data into a database; the method comprises the steps of obtaining sensing data of the sensing equipment of the Internet of things from a database, wherein the sensing data of the sensing equipment of the Internet of things comprises sensing data of sensing equipment of the discrete Internet of things and sensing data of sensing equipment of the continuous Internet of things, respectively carrying out data quality evaluation on the sensing data of the sensing equipment of the discrete Internet of things and the sensing data of the sensing equipment of the continuous Internet of things to obtain a process sigma value, determining data quality according to the process sigma value, and creating a linear regression model to predict the sensing data quality of the sensing equipment of the Internet of things.
2. The method for evaluating the quality of the sensing data of the sensing equipment of the internet of things according to claim 1, wherein the method for evaluating the quality of the sensing data of the sensing equipment of the discrete type internet of things comprises the following steps:
s1, selecting N pieces of sensing data of the discrete Internet of things sensing equipment in a certain time period from the database, and recording the data of each piece of Internet of things sensing equipment as i 1 ,i 2 ,i 3 .....i n (ii) a Verifying each piece of data of the sensing equipment of the Internet of things from six dimensions respectively to obtain W pieces of defect data;
s2, calculating the probability of defect DPO;
s3, calculating the DPMO of million opportunity defects;
s4, inquiring a corresponding relation table of DMPO and sigma to obtain a process sigma value Z of sensing data of the sensing equipment of the current Internet of things;
and S5, evaluating the quality of the sensing data of the discrete Internet of things sensing equipment according to the flow sigma value Z.
3. The method for evaluating the quality of the perception data of the sensing equipment of the internet of things according to claim 2, wherein the six dimensions comprise integrity, normalization, consistency, accuracy, uniqueness and relevance; the sensing data of the IOT sensing equipment which does not conform to one of the six dimensions is defect IOT sensing equipment data, and each sensing data of the IOT sensing equipment has six defect opportunities.
4. The method for evaluating the perception data quality of the sensing equipment of the Internet of things according to claim 3,
the calculation method of the opportunistic defect rate DPO is as follows:
DPO = number of defects/(number of products × number of opportunities for defects);
the calculation method of the DPMO with the million chance defect number is as follows:
DPMO=DPO*10^6
the number of the products is the number of sensing data of the sensing equipment of the Internet of things, the number of the defects is the number of the defects of the sensing data of the sensing equipment of the Internet of things, and the number of the opportunities of the defects is the proportion of the number of the defects of the sensing data of each sensing equipment of the Internet of things to the number of the defects of the sensing data of all sensing equipment of the Internet of things.
5. The method for evaluating the quality of the sensing data of the IOT sensing equipment according to claim 4, wherein the method for evaluating the quality of the sensing data of the discrete type IOT sensing equipment according to the process sigma value Z is that the greater the process sigma value Z is, the better the quality of the sensing data of the IOT sensing equipment is.
6. The method for evaluating the quality of the sensing data of the sensing equipment of the internet of things according to claim 5, wherein the method for evaluating the quality of the sensing data of the sensing equipment of the continuous internet of things comprises the following steps:
step one, selecting N pieces of sensing data of continuous Internet of things sensing equipment in a certain time period from a database, and respectively recording the sensing data result of each piece of Internet of things sensing equipment as i 1 ,i 2 ,i 3 .....i n Acquiring an average value of sensing data of continuous Internet of things sensing equipment;
secondly, calculating the variance of the sensing data and the average value of the continuous Internet of things sensing equipment;
thirdly, calculating probability density according to the average value and the variance to obtain the perception data qualification rate P of the continuous Internet of things sensing equipment good Thereby obtaining the sensing data opportunity defect rate 1-P of the continuous Internet of things sensing equipment good ;
Step four, calculating the DPMO of million chance defects, wherein the DPMO = DPO 10^6, and the DPO value is 1-P good Inquiring a corresponding relation table of DMPO and sigma to obtain a process sigma value Z of sensing data of the current sensing equipment of the Internet of things;
and fifthly, evaluating the quality of the sensing data of the continuous Internet of things sensing equipment according to the flow sigma value Z.
7. The method for evaluating the quality of the sensing data of the sensing equipment of the internet of things according to claim 6, wherein the specific method for calculating the probability density according to the mean value and the variance to obtain the qualification rate is as follows:
When in use=0,When =1, the normal distribution is a standard normal distribution, and the probability density function is simplified as follows:=exp(-) The cumulative probability area function is: p (X) = ∅ (X) ===1
According to the formula, the fraction defective under the tolerance lower bound LSL is calculated as follows:
the result of calculating the fraction defective above the tolerance upper bound USL is as follows:
the cumulative probability area of the region between the lower tolerance bound and the upper tolerance bound is:
8. The method for evaluating the quality of the sensing data of the sensing equipment of the internet of things according to claim 7, wherein a linear regression model is created for predicting the quality of the sensing data of the sensing equipment of the internet of things: the linear regression model is: y =(x)= 0 + 1 x, wherein(x) Representing a functional mapping from x to y, 0 and 1 and inquiring the target output variable through a corresponding relation table of DMPO and sigma to obtain a process sigma value Z of the sensing data of the current sensing equipment, wherein the larger the process sigma value Z is, the better the sensing data quality of the sensing equipment of the internet of things is.
9. An electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method for evaluating the perceptual data quality of the internet of things sensing device according to any one of claims 1 to 8 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the method for assessing the perceptual data quality of the internet of things sensing device according to any one of claims 1 to 8.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210875069.3A CN114936207B (en) | 2022-07-25 | 2022-07-25 | Method for evaluating quality of sensing data of sensing equipment of Internet of things |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210875069.3A CN114936207B (en) | 2022-07-25 | 2022-07-25 | Method for evaluating quality of sensing data of sensing equipment of Internet of things |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114936207A true CN114936207A (en) | 2022-08-23 |
CN114936207B CN114936207B (en) | 2022-11-25 |
Family
ID=82868892
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210875069.3A Active CN114936207B (en) | 2022-07-25 | 2022-07-25 | Method for evaluating quality of sensing data of sensing equipment of Internet of things |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114936207B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117708615A (en) * | 2024-02-04 | 2024-03-15 | 芯联集成电路制造股份有限公司 | Product detection method and processing equipment monitoring method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101477653A (en) * | 2008-12-29 | 2009-07-08 | 大唐软件技术股份有限公司 | Processing method and system for data quality |
CN110727665A (en) * | 2019-09-23 | 2020-01-24 | 江河瑞通(北京)技术有限公司 | Internet of things equipment reported data quality analysis method and system |
CN113592314A (en) * | 2021-08-02 | 2021-11-02 | 红云红河烟草(集团)有限责任公司 | Silk making process quality evaluation method based on sigma level |
CN114140035A (en) * | 2022-01-30 | 2022-03-04 | 希望知舟技术(深圳)有限公司 | Parameter quality management method and related device |
-
2022
- 2022-07-25 CN CN202210875069.3A patent/CN114936207B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101477653A (en) * | 2008-12-29 | 2009-07-08 | 大唐软件技术股份有限公司 | Processing method and system for data quality |
CN110727665A (en) * | 2019-09-23 | 2020-01-24 | 江河瑞通(北京)技术有限公司 | Internet of things equipment reported data quality analysis method and system |
CN113592314A (en) * | 2021-08-02 | 2021-11-02 | 红云红河烟草(集团)有限责任公司 | Silk making process quality evaluation method based on sigma level |
CN114140035A (en) * | 2022-01-30 | 2022-03-04 | 希望知舟技术(深圳)有限公司 | Parameter quality management method and related device |
Non-Patent Citations (2)
Title |
---|
杨玺等: "数据质量管理在电力安全生产信息***中的应用", 《电子世界》 * |
桂云苗等: "一种非正态分布数据过程能力的计算方法", 《商业研究》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117708615A (en) * | 2024-02-04 | 2024-03-15 | 芯联集成电路制造股份有限公司 | Product detection method and processing equipment monitoring method |
CN117708615B (en) * | 2024-02-04 | 2024-05-17 | 芯联集成电路制造股份有限公司 | Product detection method and processing equipment monitoring method |
Also Published As
Publication number | Publication date |
---|---|
CN114936207B (en) | 2022-11-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113407517B (en) | Data quality health degree analysis method and system based on multidimensional analysis technology | |
CN112543470B (en) | Terminal positioning method and system based on machine learning | |
CN114936207B (en) | Method for evaluating quality of sensing data of sensing equipment of Internet of things | |
CN113408947B (en) | Intelligent manufacturing industrial production data acquisition and analysis method, equipment and computer storage medium | |
CN115393727A (en) | Pavement linear crack identification method, electronic equipment and storage medium | |
CN116523262B (en) | Intelligent planning method, system and medium for production plan based on big data | |
CN116821750A (en) | Data security risk monitoring traceability system based on artificial intelligence | |
CN110458601B (en) | Method and device for processing resource data, computer equipment and storage medium | |
CN113449703B (en) | Quality control method and device for environment online monitoring data, storage medium and equipment | |
CN105721406A (en) | Method and device for obtaining IP black list | |
CN109189407A (en) | Statistical method, system, device and the storage medium of a kind of pair of multi-chip burning | |
CN114764774A (en) | Defect detection method, device, electronic equipment and computer readable storage medium | |
CN112565422A (en) | Method, system and storage medium for identifying fault data of power internet of things | |
CN114090556B (en) | Electric power marketing data acquisition method and system | |
CN103913150B (en) | Intelligent electric energy meter electronic devices and components consistency detecting method | |
CN116879831A (en) | Intelligent ammeter monitoring method and system based on Internet of things | |
CN117575624A (en) | Conductive adhesive traceability management system | |
CN115599653A (en) | Method, system and medium for constructing welding quality diagnosis model | |
CN113110961B (en) | Equipment abnormality detection method and device, computer equipment and readable storage medium | |
CN114202179A (en) | Target enterprise identification method and device | |
CN114189506B (en) | Equipment inspection method, device and system | |
CN110910061A (en) | Material management method, material management system, storage medium and electronic equipment | |
KR20200065820A (en) | Energy and security efficiency analysis system based on digital twin modeling for smart factory introduction | |
CN110110151B (en) | Method, system, computer equipment and storage medium for analyzing and warehousing resource packages | |
CN113342872B (en) | PUE energy consumption monitoring-based method and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |