CN105335486A - Data filter method and device - Google Patents
Data filter method and device Download PDFInfo
- Publication number
- CN105335486A CN105335486A CN201510669876.XA CN201510669876A CN105335486A CN 105335486 A CN105335486 A CN 105335486A CN 201510669876 A CN201510669876 A CN 201510669876A CN 105335486 A CN105335486 A CN 105335486A
- Authority
- CN
- China
- Prior art keywords
- data
- data filtering
- communication data
- file type
- terminal device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention discloses a data filter method and device; the method comprises the following steps: obtaining communication data generated in an exchange process between a user and a terminal device; extracting data features of the communication data; determining whether the data features satisfy with data filter conditions or not; if yes, filtering the generated communication data. The method and device can filter the exchange data between the user and the terminal device, so the data can more accurately reflect real behavior of the user.
Description
Technical field
The present invention relates to technical field of data processing, be specifically related to a kind of data filtering method and data filtering device.
Background technology
User is can produce mass communication data via the internet behavior occurred during terminal device (such as desk-top computer or mobile terminal device) view Internet (hyperlink such as, keyed in page address or click in the page in browser address bar).
When needing these communication datas produced user to analyze, because the data volume produced is larger, and it is more to there are a large amount of " dirty data " (that is, data that real internet behavior (such as, the manual behavior of user) is irrelevant with user).Can cause the processing speed of data comparatively slow like this, and affect the accuracy of data analysis, to such an extent as to have impact on the quality of data of many levels, and the storage space needed is larger.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of data filtering method and data filtering device, filters the interaction data of user and terminal device.
The technical scheme that the present invention solves the problems of the technologies described above is as follows:
Based on one aspect of the present invention, provide a kind of data filtering method, described method comprises:
The communication data produced in S1, acquisition user and terminal device reciprocal process;
S2, extract the data characteristics of described communication data;
S3, judge whether described data characteristics meets data filtering condition;
If the described data characteristics of S4 meets data filtering condition, then the described communication data produced is filtered.
Based on another aspect of the present invention, provide a kind of data filtering device, described device comprises:
Data acquisition module, for obtaining the communication data produced in user and terminal device reciprocal process;
Characteristic extracting module, for extracting the data characteristics of described communication data;
Judge module, for judging whether described data characteristics meets data filtering condition;
Data filtering module, if meet data filtering condition for described data characteristics, then filters the described communication data produced.
A kind of data filtering method provided by the invention and data filtering device, obtain communication data the data characteristics extracted in this communication data that user and terminal device produce alternately, judge whether this data characteristics meets data filtering condition, if meet, then communication data is filtered, can filter the interaction data of user and terminal device, make the real behavior according to user can be reflected more accurately.
Accompanying drawing explanation
Fig. 1 is a kind of data filtering method process flow diagram of the embodiment of the present invention 1;
Fig. 2 is a kind of data filtering device schematic diagram of the embodiment of the present invention 2.
Embodiment
Be described principle of the present invention and feature below in conjunction with accompanying drawing, example, only for explaining the present invention, is not intended to limit scope of the present invention.
Embodiment 1, a kind of data filtering method.Below in conjunction with Fig. 1, the method that the present embodiment provides is described in detail.
See Fig. 1, S1, obtain the communication data produced in user and terminal device reciprocal process.
S2, extract the data characteristics of described communication data;
S3, judge whether described data characteristics meets data filtering condition;
If the described data characteristics of S4 meets data filtering condition, then the described communication data produced is filtered.
Wherein, the data characteristics of the communication data produced in the user in step S2 and terminal device reciprocal process specifically comprises the file type information of communication data, and file type information specifically comprises again content type identification and/or file type mark.Described content type identification is by the http header parser of described communication data, and described file type mark is resolved by the http inclusion of described communication data.
Step S3, according to the file type information of described communication data, judges whether this file type information meets data filtering condition.Be specially: according to content type identification and/or the file type mark of communication data, judge whether content belonging to communication data and/or file meet data filtering condition, if meet data filtering condition, then filter communication data according to data filtering condition.
In the process of data filtering, be terminal equipment configuration data filtering function in advance, if the communication data that user and terminal device produce alternately meets data filtering condition, then step S4 calls the data filtering function corresponding with this terminal device, filters communication data.
Embodiment 2, a kind of data filtering device.Below in conjunction with Fig. 2, the device that the present embodiment provides is described in detail.
See Fig. 2, the data filtering device that the present embodiment provides comprises data acquisition module 201, characteristic extracting module 202, judge module 203, function configuration module 204 and data filtering module 205.
Wherein, data acquisition module 201, for obtaining the communication data produced in user and terminal device reciprocal process.
Characteristic extracting module 202, for extracting the data characteristics of described communication data.
Judge module 203, for judging whether described data characteristics meets data filtering condition.
Data filtering module 205, if meet data filtering condition for described data characteristics, then filters the described communication data produced.
Wherein, the data characteristics of the communication data produced in user and terminal device reciprocal process that characteristic extracting module 202 is extracted specifically comprises the file type information of communication data, and file type information specifically comprises again content type identification and/or file type identifies.Described content type identification is by the http header parser of described communication data, and described file type mark is resolved by the http inclusion of described communication data.
Judge module 203, according to the file type information of described communication data, judges whether this file type information meets data filtering condition.Be specially: according to content type identification and/or the file type mark of communication data, judge whether content belonging to communication data and/or file meet data filtering condition, if meet data filtering condition, then filter communication data according to data filtering condition.
In the process of data filtering, function configuration module 204 is terminal equipment configuration data filtering function in advance, if the communication data that user and terminal device produce alternately meets data filtering condition, then data filtering module 205 calls the data filtering function corresponding with this terminal device, filters communication data.
A kind of data filtering method provided by the invention and data filtering device, obtain communication data the data characteristics extracted in this communication data that user and terminal device produce alternately, judge whether this data characteristics meets data filtering condition, if meet, then communication data is filtered, can filter the interaction data of user and terminal device, make the real behavior according to user can be reflected more accurately.
In the description of this instructions, concrete grammar, device or feature that the description of reference term " embodiment one ", " example ", " concrete example " or " some examples " etc. means to describe in conjunction with this embodiment or example are contained at least one embodiment of the present invention or example.In this manual, to the schematic representation of above-mentioned term not must for be identical embodiment or example.And the specific features of description, method, device or feature can combine in one or more embodiment in office or example in an appropriate manner.In addition, when not conflicting, the feature of the different embodiment described in this instructions or example and different embodiment or example can carry out combining and combining by those skilled in the art.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a data filtering method, is characterized in that, described method comprises:
The communication data produced in S1, acquisition user and terminal device reciprocal process;
S2, extract the data characteristics of described communication data;
S3, judge whether described data characteristics meets data filtering condition;
If the described data characteristics of S4 meets data filtering condition, then the described communication data produced is filtered.
2. data filtering method as claimed in claim 1, it is characterized in that, the data characteristics in described step S2 comprises the file type information in communication data.
3. data filtering method as claimed in claim 2, is characterized in that, described file type information comprises content type identification and/or file type mark.
4. data filtering method as claimed in claim 3, it is characterized in that, described content type identification is by the http header parser of described communication data, and described file type mark is resolved by the http inclusion of described communication data.
5. data filtering method as claimed in claim 2, it is characterized in that, described step S3 specifically comprises:
According to the file type information of described communication data, judge whether this file type information meets data filtering condition.
6. data filtering method as claimed in claim 1, it is characterized in that, described step S4 specifically comprises:
For terminal equipment configuration data filtering function, if the communication data that user and terminal device produce alternately meets data filtering condition, then call the data filtering function corresponding with this terminal device, communication data is filtered.
7. a data filtering device, is characterized in that, described device comprises:
Data acquisition module, for obtaining the communication data produced in user and terminal device reciprocal process;
Characteristic extracting module, for extracting the data characteristics of described communication data;
Judge module, for judging whether described data characteristics meets data filtering condition;
Data filtering module, if meet data filtering condition for described data characteristics, then filters the described communication data produced.
8. data filtering device as claimed in claim 7, it is characterized in that, the data characteristics of described communication data comprises file type information.
9. data filtering device as claimed in claim 8, is characterized in that, described judge module specifically for:
According to the file type information of described communication data, judge whether this file type information meets data filtering condition.
10. data filtering device as claimed in claim 7, it is characterized in that, described device also comprises:
Function configuration module, for being terminal equipment configuration data filtering function;
If the communication data that described data filtering module produces alternately specifically for user and terminal device meets data filtering condition, then call the data filtering function corresponding with this terminal device, communication data is filtered.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510669876.XA CN105335486A (en) | 2015-10-15 | 2015-10-15 | Data filter method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510669876.XA CN105335486A (en) | 2015-10-15 | 2015-10-15 | Data filter method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105335486A true CN105335486A (en) | 2016-02-17 |
Family
ID=55286013
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510669876.XA Pending CN105335486A (en) | 2015-10-15 | 2015-10-15 | Data filter method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105335486A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110362724A (en) * | 2019-07-23 | 2019-10-22 | 国家卫星海洋应用中心 | A kind of data filtering method, device, electronic equipment and readable storage medium storing program for executing |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857493A (en) * | 2012-06-30 | 2013-01-02 | 华为技术有限公司 | Content filtering method and device |
| CN104022924A (en) * | 2014-07-02 | 2014-09-03 | 浪潮电子信息产业股份有限公司 | Method for detecting HTTP (hyper text transfer protocol) communication content |
| CN104601527A (en) * | 2013-10-31 | 2015-05-06 | 腾讯科技（北京）有限公司 | Method and device for filtering data |
-
2015
- 2015-10-15 CN CN201510669876.XA patent/CN105335486A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857493A (en) * | 2012-06-30 | 2013-01-02 | 华为技术有限公司 | Content filtering method and device |
| CN104601527A (en) * | 2013-10-31 | 2015-05-06 | 腾讯科技（北京）有限公司 | Method and device for filtering data |
| CN104022924A (en) * | 2014-07-02 | 2014-09-03 | 浪潮电子信息产业股份有限公司 | Method for detecting HTTP (hyper text transfer protocol) communication content |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110362724A (en) * | 2019-07-23 | 2019-10-22 | 国家卫星海洋应用中心 | A kind of data filtering method, device, electronic equipment and readable storage medium storing program for executing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107943954B (en) | Method and device for detecting webpage sensitive information and electronic equipment | |
| CN108847977B (en) | Service data monitoring method, storage medium and server | |
| CN111143415B (en) | Data processing method, device and computer readable storage medium | |
| CN109597974B (en) | Report generation method and device | |
| RU2014135221A (en) | METHOD, SYSTEM AND DEVICE FOR FILTRATION OF ADVERTISEMENTS OF WEB PAGES ON THE MOBILE TERMINAL | |
| CN103336766A (en) | Short text garbage identification and modeling method and device | |
| CN103116638B (en) | Webpage screening method and device thereof | |
| CN103679030B (en) | Malicious code analysis and detection method based on dynamic semantic features | |
| CN104348871B (en) | A kind of similar account extended method and device | |
| CN103279516A (en) | Web spider identification method | |
| CN104933138A (en) | Webpage crawler system and webpage crawling method | |
| CN106446113A (en) | Mobile big data analysis method and device | |
| CN102929762A (en) | Method and device for monitoring health state of terminal equipment | |
| CN110609908A (en) | Case serial-parallel method and device | |
| CN103218410A (en) | Internet event analysis method and device | |
| KR101712592B1 (en) | Program | |
| CN103500158A (en) | Method and device for annotating electronic document | |
| CN108737193A (en) | A kind of failure prediction method and device | |
| CN108683649A (en) | A kind of malice domain name detection method based on text feature | |
| CN103455572B (en) | Obtain the method and device of video display main body in webpage | |
| CN105335486A (en) | Data filter method and device | |
| CN103327178B (en) | Automatically method and the device of extension telephone in the page is dialed | |
| CN103902906A (en) | Mobile terminal malicious code detecting method and system based on application icon | |
| CN111125704B (en) | Webpage Trojan horse recognition method and system | |
| CN107135199B (en) | Method and device for detecting webpage backdoor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160217 |
|
| RJ01 | Rejection of invention patent application after publication |