CN110321375A - A kind of data communication system and method that multi-data source is integrated - Google Patents
A kind of data communication system and method that multi-data source is integrated Download PDFInfo
- Publication number
- CN110321375A CN110321375A CN201910180902.0A CN201910180902A CN110321375A CN 110321375 A CN110321375 A CN 110321375A CN 201910180902 A CN201910180902 A CN 201910180902A CN 110321375 A CN110321375 A CN 110321375A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- data source
- access request
- source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 62
- 238000000034 method Methods 0.000 title claims abstract description 16
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
Abstract
It include: application end, communication module, multiple data source kernel services modules, multiple drive modules and multiple data sources the present invention relates to field of data communication more particularly to a kind of multi-data source integrated data communication system and method, the system；Application end is used to be connected according to data access request instruction with corresponding data source kernel services module for sending data access request instruction, communication module；Data source kernel services module, which is used to be instructed according to data access request, establishes connection with corresponding drive module, sends corresponding drive module for data access request instruction and sends communication module for the data that drive module returns；Drive module, which is used to be instructed according to data access request, establishes connection with corresponding data source；Data source is used for the storage of data.By using the present invention, realizes application end and data access is carried out to different data sources.
Description
Technical field
The present invention relates to data communication systems and method that field of data communication more particularly to a kind of multi-data source are integrated.
Background technique
With the constantly development of 4.0 construction of IP6, big data and industry, as the storage of core and service is calculated using data
System is becoming the core of IT application in enterprise.Currently, these data are typically stored in industrial flow field
In the data sources such as ISYS, PI, PHD and IP21.Since there are larger differences in usage mode for different data sources, cause in phase
With application scenarios in, application developer needs to be customized exploitation to the driver of every kind of data source, is just able to achieve pair
Each data source carries out the access of data, brings big inconvenience to upper layer application, at the same there is also at high cost, Maintenance Difficulty and
The problems such as scalability is poor.
Summary of the invention
To solve the above problems, the present invention proposes that a kind of data communication system and method, realization that multi-data source is integrated is answered
Data access is carried out to different data sources with end.
A kind of data communication system that multi-data source is integrated, comprising: application end, communication module, multiple data source kernels clothes
Business module, multiple drive modules and multiple data sources；Wherein,
The application end, for sending data access request instruction,
The communication module, for being connected according to data access request instruction with corresponding data source kernel services module,
By data access request instruction be sent to corresponding data source kernel services module and by data source kernel services module return
Data are sent to application end；
The data source kernel services module connects for being established according to data access request instruction with corresponding drive module
It connects, send corresponding drive module for data access request instruction and sends communication mould for the data that drive module returns
Block；
The drive module establishes connection with corresponding data source for instructing according to data access request, data is visited
It asks that request instruction is sent to corresponding data source, and sends data source kernel services module for the data that data source returns；
The data source is used for the storage of data, and is instructed according to data access request to drive module and send corresponding number
According to.
Preferably, further includes: management module；
The management module, for adding, modifying, deleting data source kernel services module.
It preferably, further include data cache module, the data that the data cache module is used to send data source carry out
Caching, when the data that application end requests access to are in data cache module, communication module is directly obtained from data cache module
The Data Concurrent is taken to be sent to application end.
Preferably, the communication module records the data access request instruction that application end is sent, when the phase of transmission
When the number of same data access request instruction is greater than given threshold, then corresponding data are instructed to store the data access request
In data cache module.
A kind of data communication method that multi-data source is integrated, comprising the following steps:
S1: different data access requests is established according to different data sources and is instructed；
S2: application end sends data access request instruction；
S3: communication module is instructed according to data access request, is connected with corresponding data source kernel services module communication；
S4: data source kernel services module instructs according to data access request and establishes connection with corresponding drive module；
S5: drive module instructs according to data access request and establishes connection with corresponding data source, is asked according to data access
It asks instruction to search corresponding data in corresponding data source, and data is passed sequentially through into drive module, data source kernel
Service module communication module is sent to application end.
Preferably, described different data access request instructions are established according to different data sources to include:
The configuration information for obtaining each data source generates the corresponding data source kernel services module of each data source and communication module
Between link information, and according to link information generate data access request instruction.
Preferably, further include step S6: data cache module caches the data that data source is sent, when application end is asked
Ask the data of access in data cache module when, communication module directly obtains the Data Concurrent from data cache module and is sent to
Application end.
By using the present invention, following effect may be implemented:
1. different data sources is integrated in the same system, and different data access is generated for different data sources
Request instruction, when application end send relevant data access request instruction when, then can according to the data access request instruct with
Corresponding data source communicates, and obtains corresponding data, carries out data visit to different data sources to realize application end
It asks；
2. storing data in data cache module, when obtaining data again, directly obtained from data cache module
Corresponding data are taken, the efficiency of data access is improved.
Detailed description of the invention
The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.
Fig. 1 is the overall structure diagram of the embodiment of the present invention；
Fig. 2 is the structural schematic diagram of management module in the embodiment of the present invention；
Fig. 3 is the structural schematic diagram of data cache module in the embodiment of the present invention；
Fig. 4 is the flow diagram of the embodiment of the present invention；
Fig. 5 is the flow diagram of step S5 in the embodiment of the present invention.
Specific embodiment
Below in conjunction with attached drawing, technical scheme of the present invention will be further described, but the present invention is not limited to these realities
Apply example.
The basic idea of the invention is that different data sources is integrated in the same system and raw for different data sources
It is instructed at different data access requests, it, then can be according to the number when application end sends the instruction of relevant data access request
It instructs according to access request and communicates with corresponding data source, and obtain corresponding data, to realize application end to different
Data source carries out data access.
As shown in Figure 1, the present embodiment provides the data communication systems that a kind of multi-data source integrates, comprising: application end, communication
Module, multiple data source kernel services modules, multiple drive modules and multiple data sources.
Wherein, application end is for sending data access request instruction.In the present embodiment, acquisition of the application end as data
End, can use different equipment.In the construction of industrial flow field especially intelligent plant, application end can be movement
End, the end Web or monitoring alarm etc..Application of these application ends after obtaining data may be different, but the acquisition as data
End, the mode obtained is identical.
Communication module is used to be connected according to data access request instruction with corresponding data source kernel services module, by data
Access request instruction is sent to corresponding data source kernel services module and the data for returning to data source kernel services module are sent out
It is sent to application end.It should be noted that the communication module in the present embodiment is used not only for the interaction of data, while being also used to pair
Data access request instruction is identified.Specifically, the corresponding different data source kernel clothes of different data access request instructions
It is engaged in module, communication module identifies different data access request instructions, and then realizes in the data source corresponding to it
Core service module is communicated.
Data source kernel services module uses unified data-interface, and connects one to one with drive module.Data source
Kernel services module, which is used to be instructed according to data access request, establishes connection with corresponding drive module, and data access request is referred to
It enables and is sent to corresponding drive module and sends communication module for the data that drive module returns.For the ease of to data source
Management, data core service module are designed as an independent kernel process, externally expose unified data-interface, and application end is logical
Communication module is crossed to data core service module data access request, data core service module asks the data access of application end
It asks instruction to be transmitted to internal drive module, the data for calling correspondence database is gone by drive module.
Drive module, which is used to be instructed according to data access request, establishes connection with corresponding data source, by data access request
Instruction is sent to corresponding data source, and sends data source kernel services module for the data that data source returns.
Data source is used for the storage of data, and is instructed according to data access request to drive module and send corresponding data.
In the present embodiment, data source includes: the ISYS of Zhejiang SUPCON Software Co., Ltd., the PI of OSISoft company, the U.S., the U.S.
InfoPlus21, Process History Database (PHD) of HoneyWell company, the U.S. of AspenTech company etc.
Data source.
Under the application scenarios for there are multiple data sources, the configuration information of each data source is obtained, it is corresponding to generate each data source
Link information between data source kernel services module and communication module, and data access request is generated according to link information and is referred to
It enables.Therefore, communication module is only needed to be instructed according to data access request and can be connected with corresponding data source kernel services module,
It is being connected by corresponding drive module with corresponding data source, to obtain corresponding data.Without being directed to every kind of number
It is customized exploitation according to the driver in source, is just able to achieve the access for carrying out data to each data source.
To realize the management to data source kernel services module, management module is also added in the present embodiment.Such as Fig. 2 institute
Show, management module, for adding, modifying, deleting data source kernel services module.
When needing to add data source kernel services module, data source management module obtains the data source kernel services module
The configuration information of corresponding data source, and the link information between the data source and communication module is generated, and according to link information
Data access request instruction is generated, that is, realizes the addition to data source kernel services module.Each data source has uniquely
Configuration information, configuration information can be regarded as the identity ID of each data source.Communication module can find correspondence according to link information
Data source, and communicate therewith.Data access request instruction is generated according to link information, includes connecting in data access request instruction
The data information for connecing information and needing to request access to, first communication module parse data access request instruction, identify
Link information therein out is attached with corresponding data source data source kernel services module, and corresponding data source is to data
The data information that needs in access request instruction request access to is parsed, and searches corresponding number according to data information
According to, and the data are sent in sequence to application end.
When needing to modify data source kernel services module, which is modified by data source management module
The corresponding data source configuration information of module, will by saving options for data source management module after determining that modification information is errorless
Modified configuration information is saved in configuration file；Finally by startupoptions, data source and communication module will be regenerated
Between link information, and according to the link information generate data access request instruction, that is, realize to data source kernel services mould
The modification of block configuration information operates.
When needing to delete data source kernel services module, by data source management module, data source to be deleted is chosen
Kernel services module；If current data source state is operating status, needs to stop operation the data source, determine data source
State is to be deleted the data source kernel services module chosen by the delete operation in data source management module after stopping,
It realizes and specified data source kernel services module is deleted from data source configuration file.
In order to realize the quick access of data, as shown in figure 3, in the present embodiment by the data buffer storage obtained in number
According in cache module, identified mistake is instructed before when communication module recognizes the data access request, then no longer from corresponding
Corresponding data are obtained in data source, but scan for obtaining corresponding data in data cache module.Compared to from number
Data are obtained according to source, it is direct with communication module in data source that data are omitted in the mode of acquisition data from data cache module
Transmission process improves the efficiency of data access.
It is identical when transmission specifically, the data access request instruction that communication module sends application end records
When the number of data access request instruction is greater than given threshold, then corresponding data are instructed to be stored in number the data access request
According in cache module.For reduce data cache module storage pressure, data cache module only to the data repeatedly accessed into
Row storage.
The present embodiment also provides a kind of data communication method that multi-data source is integrated, as shown in Figure 4, comprising the following steps:
S1: different data access requests is established according to different data sources and is instructed；
S2: application end sends data access request instruction；
S3: communication module is instructed according to data access request, is connected with corresponding data source kernel services module communication；
S4: data source kernel services module instructs according to data access request and establishes connection with corresponding drive module；
S5: drive module instructs according to data access request and establishes connection with corresponding data source, is asked according to data access
It asks instruction to search corresponding data in corresponding data source, and data is passed sequentially through into drive module, data source kernel
Service module communication module is sent to application end.
Specifically, establishing different data access request instructions according to different data sources and including:
The configuration information for obtaining each data source generates the corresponding data source kernel services module of each data source and communication module
Between link information, and according to link information generate data access request instruction.
As the preferred of the present embodiment, as shown in figure 5, further including step S6: data cache module sends data source
Data are cached, and when the data that application end requests access to are in data cache module, communication module is directly from data buffer storage
The Data Concurrent is obtained in module is sent to application end.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with other
The difference of embodiment, the same or similar parts in each embodiment may refer to each other.For method disclosed in embodiment
For, since it is corresponding with system disclosed in embodiment, so being described relatively simple, related place is said referring to method part
It is bright.
Those skilled in the art can make various modifications to described specific embodiment
Or supplement or be substituted in a similar manner, however, it does not deviate from the spirit of the invention or surmounts the appended claims determines
The range of justice.
Claims (7)
1. a kind of integrated data communication system of multi-data source characterized by comprising application end, communication module, multiple data
Source kernel services module, multiple drive modules and multiple data sources；Wherein,
The application end, for sending data access request instruction,
The communication module will be counted for being connected according to data access request instruction with corresponding data source kernel services module
The data for being sent to corresponding data source kernel services module according to access request instruction and returning to data source kernel services module
It is sent to application end；
The data source kernel services module establishes connection with corresponding drive module for instructing according to data access request,
Corresponding drive module is sent by data access request instruction and sends communication module for the data that drive module returns；
The drive module establishes connection with corresponding data source for instructing according to data access request, data access is asked
It asks instruction to be sent to corresponding data source, and sends data source kernel services module for the data that data source returns；
The data source is used for the storage of data, and is instructed according to data access request to drive module and send corresponding data.
2. the integrated data communication system of multi-data source according to claim 1, which is characterized in that further include: management mould
Block；
The management module, for adding, modifying, deleting data source kernel services module.
3. the integrated data communication system of described in any item multi-data sources according to claim 1~2, which is characterized in that also wrap
Data cache module is included, the data cache module is for caching the data that data source is sent, when application end requests to visit
When the data asked are in data cache module, communication module directly obtains the Data Concurrent from data cache module and is sent to application
End.
4. the integrated data communication system of multi-data source according to claim 3, which is characterized in that the communication module pair
The data access request instruction that application end is sent is recorded, when the number that the identical data access request of transmission instructs is greater than
When given threshold, then corresponding data are instructed to be stored in data cache module the data access request.
5. a kind of integrated data communication method of multi-data source, which is characterized in that the method is appointed applied to Claims 1 to 4
The integrated data communication system of multi-data source described in meaning one, comprising the following steps:
S1: different data access requests is established according to different data sources and is instructed；
S2: application end sends data access request instruction；
S3: communication module is instructed according to data access request, is connected with corresponding data source kernel services module communication；
S4: data source kernel services module instructs according to data access request and establishes connection with corresponding drive module；
S5: drive module instructs according to data access request and establishes connection with corresponding data source, is referred to according to data access request
Order searches corresponding data in corresponding data source, and data are passed sequentially through drive module, data source kernel services
Module communication module is sent to application end.
6. the integrated data communication method of multi-data source according to claim 5, which is characterized in that described according to different
Data source establishes different data access request instructions
The configuration information for obtaining each data source generates between the corresponding data source kernel services module of each data source and communication module
Link information, and according to link information generate data access request instruction.
7. the integrated data communication method of multi-data source according to claim 5, which is characterized in that further include step S6:
Data cache module caches the data that data source is sent, when the data that application end requests access to are in data cache module
When, communication module directly obtains the Data Concurrent from data cache module and is sent to application end.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910180902.0A CN110321375A (en) | 2019-03-11 | 2019-03-11 | A kind of data communication system and method that multi-data source is integrated |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910180902.0A CN110321375A (en) | 2019-03-11 | 2019-03-11 | A kind of data communication system and method that multi-data source is integrated |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110321375A true CN110321375A (en) | 2019-10-11 |
Family
ID=68112744
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910180902.0A Pending CN110321375A (en) | 2019-03-11 | 2019-03-11 | A kind of data communication system and method that multi-data source is integrated |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110321375A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105743676A (en) * | 2014-12-10 | 2016-07-06 | 北京神州泰岳软件股份有限公司 | Integrated acquisition device and method for multiple data sources |
| CN107391422A (en) * | 2017-07-19 | 2017-11-24 | 上海航天测控通信研究所 | multi-path asynchronous serial communication data access system and method |
| CN107818127A (en) * | 2017-09-09 | 2018-03-20 | 国网浙江省电力公司 | A kind of querying method and system for multi-source data |
| CN109189841A (en) * | 2018-07-24 | 2019-01-11 | 中国电力科学研究院有限公司 | A kind of multi-data source access method and system |
-
2019
- 2019-03-11 CN CN201910180902.0A patent/CN110321375A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105743676A (en) * | 2014-12-10 | 2016-07-06 | 北京神州泰岳软件股份有限公司 | Integrated acquisition device and method for multiple data sources |
| CN107391422A (en) * | 2017-07-19 | 2017-11-24 | 上海航天测控通信研究所 | multi-path asynchronous serial communication data access system and method |
| CN107818127A (en) * | 2017-09-09 | 2018-03-20 | 国网浙江省电力公司 | A kind of querying method and system for multi-source data |
| CN109189841A (en) * | 2018-07-24 | 2019-01-11 | 中国电力科学研究院有限公司 | A kind of multi-data source access method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107317830B (en) | Service discovery processing method and device | |
| CN102164160B (en) | Method, device and system for supporting large quantity of concurrent downloading | |
| CN101090401A (en) | Data buffer store method and system at duster environment | |
| CN104333512A (en) | Distributed memory database access system and method | |
| CN101958838A (en) | Data access method and device | |
| CN111352806B (en) | Log data monitoring method and device | |
| CN101436998A (en) | Method for obtaining message forwarding route and apparatus for forwarding message | |
| CN102333130A (en) | Method and system for accessing cache server and intelligent cache scheduler | |
| CN100589079C (en) | Data sharing method, system and device | |
| CN103607424A (en) | Server connection method and server system | |
| CN101673217B (en) | Method for realizing remote program call and system thereof | |
| JP2013203236A (en) | Data output device for vehicle | |
| CN111464612A (en) | Method for providing stable computing service in severe environment | |
| CN116189330A (en) | Processing method, storage medium and processor for working condition data of engineering vehicle | |
| CN115292010A (en) | Method and system for automatically generating service through process configuration | |
| CN108509230B (en) | High-precision intelligent gray scale release system | |
| CN110321375A (en) | A kind of data communication system and method that multi-data source is integrated | |
| CN112100210A (en) | Data processing method and automobile big data management cloud platform | |
| US20070101017A1 (en) | System and method for routing information | |
| CN112905676A (en) | Data file importing method and device | |
| CN113364892B (en) | Domain name resolution method, related method, device and system for cross-multi-cluster service | |
| CN111625427B (en) | Real-time monitoring system and method for configuring connection health status of central client | |
| CN115032973A (en) | Data transmission system, method, device, equipment and medium | |
| CN108156201A (en) | It is managed collectively the method and apparatus of application system configuration data | |
| CN112596974A (en) | Full link monitoring method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191011 |