CN109189760A - A kind of building of traffic element portrait and analysis method based on big data technology - Google Patents
A kind of building of traffic element portrait and analysis method based on big data technology Download PDFInfo
- Publication number
- CN109189760A CN109189760A CN201810933748.5A CN201810933748A CN109189760A CN 109189760 A CN109189760 A CN 109189760A CN 201810933748 A CN201810933748 A CN 201810933748A CN 109189760 A CN109189760 A CN 109189760A
- Authority
- CN
- China
- Prior art keywords
- data
- library
- cells
- portrait
- traffic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of building of traffic element portrait and analysis method based on big data technology, including external data cells, original library unit, library cells, using library unit, ES and H base module intelligently searches plain module, module for managing files.The beneficial effects of the present invention are: external data cells integrate traffic control industry multi-source, multidimensional data, that realizes magnanimity multi-dimensional data stablizes access storage, the standardization of holding data and fresh and alive degree, ensure the timeliness of data analysis result, the complexity and delay of library cells reduction subsequent data analysis, the convenient searching to data is searched for, dynamic labels model is based on using library unit, portrait analysis is carried out to traffic element, traffic element dynamic labels are provided for user, prompt the service feature of user element, incidence relation between time and space idea and element, excavate element operation hidden danger point and abnormal state point, user is provided, intuitive and valuable information is provided, promote the data insight of traffic element.
Description
Technical field
The present invention relates to a kind of buildings of traffic element portrait and analysis, specially a kind of traffic based on big data technology to want
The building of element portrait and analysis method, belong to Modern Traffic intellectualized technology field.
Background technique
It is a kind of based on big data technology traffic element portrait building with analysis method method, system with people, vehicle, enterprise,
The five big traffic element such as road, event is the theme, and carries out various dimensions association to traffic element related data, realizes that traffic element is complete
Comprehensive display, association analysis and the early warning for ceasing archive information collect vehicle data, drive personal data, business data, road
The subject datas such as circuit-switched data, traffic event data, using data model association unlawful data, casualty data, the car data that passed through,
The traffic related datas such as business handling data form traffic element archive information network so that traffic factor data links work at selected spots with that in entire areas,
Depict motor vehicle, driver, enterprise, road, event multi-dimensional data portrait, meanwhile, in the form of dynamic labels identify hand over
The behavioural characteristic of logical element is seen clearly the abnormal behaviour and hidden danger phenomenon of traffic element by data depth analysis, forms traffic control industry
Business early warning, by the system, user can understand and vehicle, driver, enterprise, road, event correlation from an entrance
Information and abnormity early warning prompt, be the search of traffic element archive information, traffic accident investigation, key object manage etc. business work
Make to provide comprehensive data support system function mainly include archives search, one grade of a vehicle, one grade of a people, one look forward to one grade, all the way
One grade, one grade of a thing.
There are many existing traffic element portrait building and analysis, however all there are some flaws, first, to massive information
Processing reaction is slower, influences working efficiency, second, data improvement system is incomplete, third, label model is excessively single, no
Traffic element can be analyzed comprehensively.
Summary of the invention
The object of the invention is that providing a kind of traffic element based on big data technology to solve the above-mentioned problems
Portrait building and analysis method.
The present invention is through the following technical solutions to achieve the above objectives: a kind of traffic element portrait based on big data technology
Building and analysis method, including
External data cells are collected and classify to external some information, are one of most basic links；
Original library unit accesses external data cells, constructs big data platform, realizes the access of mass data, provides strong
Big data-handling capacity meets the interaction demand of data；
Library cells are accessed mass data based on the low latency of stsndard SQL, and access original library unit；
Using library unit, library cells and original library unit are accessed, using distributed big data computing engines spark-
Core and spark-sql has excellent calculated performance；
ES and H base module is present in original library, wherein including theme library, thematic library data provide indexing information；
Intelligence searches plain module, carries out intellectual search to the information of acquisition, and be present in using library unit；
Module for managing files is analyzed and is managed concentratedly to the information acquired in a period of time；
Wherein, the external data cells include one data of the six directions, and bayonet crosses car data, and emphasis vehicle GPS data are motor-driven
Vehicle business handling data, driver's license business handling data, road information data etc., the output end of the library cells and outside
The input terminal of data cell is attached, and the output end of the library cells and the input terminal of original library unit are attached,
And the library cells include two large divisions, the input terminal using library unit is attached with library cells, and institute
It states and is mainly used for traffic element portrait using library unit, summarize to earlier data.
Preferably, in order to realize magnanimity multi-dimensional data stablize access storage, keep data standardization and fresh and alive degree,
Ensure that the timeliness of data analysis result, the external data cells integrate traffic control industry multi-source, multidimensional data, user oriented mentions
For unified body data analysis and associated data analysis, complete to analyze the holographic data of element main body.
Preferably, in order to reduce the complexity and delay of subsequent data analysis, the convenient searching to data is searched for, the mark
Quasi- library unit provides element information full-text search function, data needed for precisely obtaining, and user can input one or more keywords
Relevant all data contents can be searched, uncertain content can also be searched for generally, replaced not with asterisk wildcard
Determining keyword content can be carried out customized for full-text search data area by user, freely add new retrieval data
Source, data needed for precisely obtaining.
Preferably, intuitive and valuable information is provided in order to provide user, promotes the data insight of traffic element, institute
It states and is based on dynamic labels model using library unit, portrait analysis is carried out to traffic element, provide traffic element dynamic for user and mark
Label, prompt the service feature of user element, and the incidence relation between time and space idea and element excavates element operation hidden danger point and state
Abnormal point.
A kind of building of traffic element portrait and analysis method based on big data technology, application method is by following step
It is rapid to constitute:
Step A, provides various ways, realizes the flexible access of external data, it is ensured that external data timing access storage, more
Newly arrive original library unit；
Step B, original library unit data progress specially treated is standardized and accuracy, is then stored importing mark
In quasi- library unit；
The standard information of step C, library cells storage are passed to using in library unit, and by intelligent classification and archives pipe
Reason.
Step D, final system possess two big engines with excellent calculated performance, pass through the association analysis to multidimensional data
It is excavated with depth, provides computing capability for operation system modeling analysis, dynamic labels label portrait.
The beneficial effects of the present invention are: should be closed based on the building of the traffic element of big data technology portrait and analysis method
Reason, external data cells integrate traffic control industry multi-source, multidimensional data, and user oriented provides unified body data and analyzes and be associated with
Data analysis is completed to analyze the holographic data of element main body, and that realizes magnanimity multi-dimensional data stablizes access storage, keeps number
According to standardization and fresh and alive degree, ensure the timeliness of data analysis result, library cells provide element information full-text search function
Can, data needed for precisely obtaining, user, which can input one or more keywords, can search relevant all data contents, right
It can also be searched for generally in uncertain content, uncertain keyword content be replaced with asterisk wildcard, for full-text search number
It according to range, can be carried out by user customized, freely add new retrieval data source, data needed for precisely obtaining reduce subsequent number
According to the complexity and delay of analysis, the convenient searching to data is searched for, and is based on dynamic labels model using library unit, is wanted to traffic
Element carries out portrait analysis, provides traffic element dynamic labels for user, prompts the service feature of user element, time and space idea and wants
Incidence relation between element excavates element operation hidden danger point and abnormal state point, provides user and provides intuitive and valuable information,
Promote the data insight of traffic element.
Detailed description of the invention
Fig. 1 is the technical framework diagram of the building of traffic element portrait and analysis method；
Fig. 2 is traffic element representation data processing schematic.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Please refer to Fig. 1~2, a kind of building of traffic element portrait and analysis method based on big data technology, including
External data cells are collected and classify to external some information, are one of most basic links；
Original library unit accesses external data cells, constructs big data platform, realizes the access of mass data, provides strong
Big data-handling capacity meets the interaction demand of data；
Library cells are accessed mass data based on the low latency of stsndard SQL, and access original library unit；
Using library unit, library cells and original library unit are accessed, using distributed big data computing engines spark-
Core and spark-sql has excellent calculated performance；
ES and Hbase module is present in original library, wherein including theme library, thematic library data provide indexing information；
Intelligence searches plain module, carries out intellectual search to the information of acquisition, and be present in using library unit；
Module for managing files is analyzed and is managed concentratedly to the information acquired in a period of time.
Wherein, the external data cells include one data of the six directions, and bayonet crosses car data, and emphasis vehicle GPS data are motor-driven
Vehicle business handling data, driver's license business handling data, road information data etc., the output end of the library cells and outside
The input terminal of data cell is attached, and the output end of the library cells and the input terminal of original library unit are attached,
And the library cells include two large divisions, the input terminal using library unit is attached with library cells, and institute
It states and is mainly used for traffic element portrait using library unit, summarize to earlier data.
The external data cells integrate traffic control industry multi-source, multidimensional data, and user oriented provides unified body data
Analysis and associated data analysis are completed to analyze the holographic data of element main body, and that realizes magnanimity multi-dimensional data stablizes access
Storage, keep data standardization and fresh and alive degree, ensure the timeliness of data analysis result, the library cells provide element
Information full-text search function, precisely obtain needed for data, user can input one or more keywords can search it is relevant
All data contents, can also search for uncertain content generally, replace uncertain keyword content with asterisk wildcard,
It for full-text search data area, can be carried out by user customized, freely add new retrieval data source, number needed for precisely obtaining
According to reducing the complexity and delay of subsequent data analysis, the convenient searching to data is searched for, and the application library unit is based on dynamically
Label model carries out portrait analysis to traffic element, provides traffic element dynamic labels for user, prompts the business of user element
Feature, the incidence relation between time and space idea and element excavate element operation hidden danger point and abnormal state point, provide user and provide directly
It sees and valuable information, promotes the data insight of traffic element.
A kind of building of traffic element portrait and analysis method based on big data technology, application method is by following step
It is rapid to constitute:
Step A, provides various ways, realizes the flexible access of external data, it is ensured that external data timing access storage, more
Newly arrive original library unit；
Step B, original library unit data progress specially treated is standardized and accuracy, is then stored importing mark
In quasi- library unit；
The standard information of step C, library cells storage are passed to using in library unit, and by intelligent classification and archives pipe
Reason.
Step D, final system possess two big engines with excellent calculated performance, pass through the association analysis to multidimensional data
It is excavated with depth, provides computing capability for operation system modeling analysis, dynamic labels label portrait.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie
In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power
Benefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claims
Variation is included within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.
In addition, it should be understood that although this specification is described in terms of embodiments, but not each embodiment is only wrapped
Containing an independent technical solution, this description of the specification is merely for the sake of clarity, and those skilled in the art should
It considers the specification as a whole, the technical solutions in the various embodiments may also be suitably combined, forms those skilled in the art
The other embodiments being understood that.
Claims (4)
1. a kind of building of traffic element portrait and analysis method based on big data technology, it is characterised in that: including
External data cells are collected and classify to external some information, are one of most basic links；
Original library unit accesses external data cells, constructs big data platform, realizes the access of mass data, provide powerful
Data-handling capacity meets the interaction demand of data；
Library cells are accessed mass data based on the low latency of stsndard SQL, and access original library unit；
Using library unit, library cells and original library unit are accessed, using distributed big data computing engines spark-core
And spark-sql, there is excellent calculated performance；
ES and H base module is present in original library, wherein including theme library, thematic library data provide indexing information；
Intelligence searches plain module, carries out intellectual search to the information of acquisition, and be present in using library unit；
Module for managing files is analyzed and is managed concentratedly to the information acquired in a period of time；
Wherein, the external data cells include one data of the six directions, and bayonet crosses car data, emphasis vehicle GPS data, motor vehicle industry
Data, driver's license business handling data, road information data etc., the output end and external data of the library cells are handled in business
The input terminal of unit is attached, and the output end of the library cells and the input terminal of original library unit are attached, and institute
Stating library cells includes two large divisions, and the input terminal using library unit is attached with library cells, and described is answered
It is mainly used for traffic element portrait with library unit, summarizes to earlier data；
Its application method is made of following steps:
Step A, provides various ways, realizes the flexible access of external data, it is ensured that external data timing access storage, update are arrived
Original library unit；
Step B, original library unit data progress specially treated is standardized and accuracy, is then stored and imports java standard library
In unit；
The standard information of step C, library cells storage are passed to using in library unit, and by intelligent classification and file administration.
Step D, final system possess two big engines with excellent calculated performance, pass through the association analysis and depth to multidimensional data
Degree excavates, and provides computing capability for operation system modeling analysis, dynamic labels portrait.
2. a kind of building of traffic element portrait and analysis method based on big data technology according to claim 1, special
Sign is: the external data cells integrate traffic control industry multi-source, multidimensional data, and user oriented provides unified body data point
Analysis and associated data analysis are completed to analyze the holographic data of element main body.
3. a kind of building of traffic element portrait and analysis method based on big data technology according to claim 1, special
Sign is: the library cells provide element information full-text search function, data needed for precisely obtaining, and user can input one
Or multiple keywords can search relevant all data contents, and uncertain content can also be searched for generally, with
Asterisk wildcard replaces uncertain keyword content, for full-text search data area, can be carried out by user customized, freely added
New retrieval data source, data needed for precisely obtaining.
4. a kind of building of traffic element portrait and analysis method based on big data technology according to claim 1, special
Sign is: the application library unit is based on dynamic labels model, carries out portrait analysis to traffic element, provides traffic for user and want
Plain dynamic labels, prompt the service feature of user element, and the incidence relation between time and space idea and element excavates element and runs hidden danger
Point and abnormal state point.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810933748.5A CN109189760A (en) | 2018-08-16 | 2018-08-16 | A kind of building of traffic element portrait and analysis method based on big data technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810933748.5A CN109189760A (en) | 2018-08-16 | 2018-08-16 | A kind of building of traffic element portrait and analysis method based on big data technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109189760A true CN109189760A (en) | 2019-01-11 |
Family
ID=64918148
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810933748.5A Pending CN109189760A (en) | 2018-08-16 | 2018-08-16 | A kind of building of traffic element portrait and analysis method based on big data technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109189760A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110363985A (en) * | 2019-06-27 | 2019-10-22 | 北京易华录信息技术股份有限公司 | A kind of traffic data analyzing method, apparatus, storage medium and equipment |
| CN111477028A (en) * | 2020-04-28 | 2020-07-31 | 北京百度网讯科技有限公司 | Method and apparatus for generating information |
| CN112053558A (en) * | 2020-08-25 | 2020-12-08 | 青岛海信网络科技股份有限公司 | Traffic jam state identification method, device and equipment |
| CN113177780A (en) * | 2021-05-12 | 2021-07-27 | 中移智行网络科技有限公司 | Data processing method and device, network equipment and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106484808A (en) * | 2016-09-23 | 2017-03-08 | 上海电科智能***股份有限公司 | A kind of traffic object holography electronic record Data Modeling Method |
| CN106777110A (en) * | 2016-12-15 | 2017-05-31 | 武汉邮电科学研究院 | A kind of smart city big data integration system and method |
| CN107315796A (en) * | 2017-06-19 | 2017-11-03 | 北京易华录信息技术股份有限公司 | A kind of traffic alert based on big data studies and judges analysis system and method |
| US20180121519A1 (en) * | 2016-10-27 | 2018-05-03 | American Express Travel Related Services Company, Inc. | Systems and methods for a self-services data file configuration with various data sources |
-
2018
- 2018-08-16 CN CN201810933748.5A patent/CN109189760A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106484808A (en) * | 2016-09-23 | 2017-03-08 | 上海电科智能***股份有限公司 | A kind of traffic object holography electronic record Data Modeling Method |
| US20180121519A1 (en) * | 2016-10-27 | 2018-05-03 | American Express Travel Related Services Company, Inc. | Systems and methods for a self-services data file configuration with various data sources |
| CN106777110A (en) * | 2016-12-15 | 2017-05-31 | 武汉邮电科学研究院 | A kind of smart city big data integration system and method |
| CN107315796A (en) * | 2017-06-19 | 2017-11-03 | 北京易华录信息技术股份有限公司 | A kind of traffic alert based on big data studies and judges analysis system and method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110363985A (en) * | 2019-06-27 | 2019-10-22 | 北京易华录信息技术股份有限公司 | A kind of traffic data analyzing method, apparatus, storage medium and equipment |
| CN111477028A (en) * | 2020-04-28 | 2020-07-31 | 北京百度网讯科技有限公司 | Method and apparatus for generating information |
| CN112053558A (en) * | 2020-08-25 | 2020-12-08 | 青岛海信网络科技股份有限公司 | Traffic jam state identification method, device and equipment |
| CN113177780A (en) * | 2021-05-12 | 2021-07-27 | 中移智行网络科技有限公司 | Data processing method and device, network equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7930288B2 (en) | Knowledge extraction for automatic ontology maintenance | |
| US8311999B2 (en) | System and method for knowledge research | |
| CN109189760A (en) | A kind of building of traffic element portrait and analysis method based on big data technology | |
| Beebe et al. | Digital forensic text string searching: Improving information retrieval effectiveness by thematically clustering search results | |
| JP4455120B2 (en) | Computer search including association | |
| US7668813B2 (en) | Techniques for searching future events | |
| Pradhan | Science mapping and visualization tools used in bibliometric & scientometric studies: An overview | |
| US20150120777A1 (en) | System and Method for Mining Data Using Haptic Feedback | |
| US20090217179A1 (en) | System and method for knowledge navigation and discovery utilizing a graphical user interface | |
| US20060116994A1 (en) | System and method for interactive multi-dimensional visual representation of information content and properties | |
| US20100115393A1 (en) | Creation and retrieval of global annotations | |
| US20130298050A1 (en) | Generating visualizations of facet values for facets defined over a collection of objects | |
| US7058643B2 (en) | System, tools and methods to facilitate identification and organization of new information based on context of user's existing information | |
| WO2009009192A2 (en) | Adaptive archive data management | |
| CN113407785B (en) | Data processing method and system based on distributed storage system | |
| CN102609512A (en) | System and method for heterogeneous information mining and visual analysis | |
| CN105354325A (en) | Document retrieval and analysis system | |
| Talaş et al. | Elastic stack in action for smart cities: Making sense of big data | |
| KR101441219B1 (en) | Automatic association of informational entities | |
| Yimam et al. | new/s/leak–information extraction and visualization for investigative data journalists | |
| Simoff et al. | MDM/KDD2002: multimedia data mining between promises and problems | |
| Tan et al. | Semantic presentation and fusion framework of unstructured data in smart cites | |
| KR100775852B1 (en) | System and method for searching resource of application program | |
| Tchuissang et al. | Predicting dataspace retrieval using probabilistic hidden information | |
| Li et al. | Information mining: Integrating data mining and text mining for business intelligence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190111 |