CN103761265A - NoSQL (not only SOL) based medical information system database implementation method - Google Patents
NoSQL (not only SOL) based medical information system database implementation method Download PDFInfo
- Publication number
- CN103761265A CN103761265A CN201410000527.4A CN201410000527A CN103761265A CN 103761265 A CN103761265 A CN 103761265A CN 201410000527 A CN201410000527 A CN 201410000527A CN 103761265 A CN103761265 A CN 103761265A
- Authority
- CN
- China
- Prior art keywords
- ast
- nosql
- implementation method
- database
- jdbc
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a NoSQL (not only SQL) based medical information system database implementation method. The implementation method includes the steps that A, an application program is driven to be connected to a JDBC (java database connectivity) interface through JDBC; B, the JDBC interface is called and connected to a Server module through Pyro; C, the Server module performs AST (glutamic oxalacetic transaminase) analysis upon SQL (structured query language) to obtain an AST structure tree; D, the AST structure tree is analyzed, if an association list is obtained, an Overlay operation is performed, and if an independent list is obtained, a Cache operation is performed; E, the AST structure tree is converted to form an executing script; F, the executing script is mapped to an NoSQL database through an API (application program interface). By the application of the implementation method, shortcomings in the prior art can be overcome, and rapid access with high performance, high expandability and a high-redundancy database can be realized.
Description
Technical field
The present invention relates to database technical field, especially a kind of medical information system database implementation method based on NoSQL.
Background technology
Traditional database, To enterprises level application conventionally.The scale of this class application, compares with internet, applications, and scale has the difference of the order of magnitude conventionally.Internet, applications is easy to run into the data volume with hundred million/day increase in size, the extensibility of therefore data being stored, and high-performance, redundant ability has stronger demand.On the other hand, internet, applications is not emphasized the consistance of data conventionally, allows the data of certain short time inconsistent, postpones the appearance of the situations such as insertion.Therefore the advantage of traditional database is also not obvious under Internet service model, but the inferior position of traditional database is showed nothing left.
Owing to progressively moving to the browser architectures of B/S in present medical information system from client framework in the past, and more and more focus on open to the publicly, thereby medical information system just changes internet, applications into from typical enterprise-level application in the past.Along with going deep into of this transition process, originally bore the traditional database of system storage core, expose all the more problem, urgently to be resolved hurrily.Yet although the emerging database such as NoSQL has high-performance, enhanced scalability, highly redundant Performance Characteristics, it adopts the diverse api interface with SQL, it is very big that traditional application system moves on NoSQL database cost.
Similarly problem also has some other settling mode now, and such as hive, shark etc., provide the mapping of SQL interface to map-reduce model.Yet these solutions are only applicable to the hadoop model scheme based on map-reduce, more for for once needing to move several hours and even the data analysis business of a couple of days.For common business SQL query, postpone too hugely, cannot use.
Summary of the invention
The technical problem to be solved in the present invention is to provide a kind of medical information system database implementation method based on NoSQL, can solve the deficiencies in the prior art, realizes the fast access to high-performance, enhanced scalability, highly redundant database.
For solving the problems of the technologies described above, the technical solution used in the present invention is as follows.
A medical information system database implementation method based on NoSQL, is characterized in that comprising the following steps:
A, application program are driven and are connected to JDBC interface by JDBC;
B, JDBC interface are called and are connected to Server module by Pyro;
C, Server module are carried out AST parsing to SQL, get AST structure tree;
D, AST structure tree is analyzed, if obtain contingency table, carried out, if obtain singly showing, carry out;
E, AST structure tree is changed and form to carry out script;
F, by api interface, be mapped to NoSQL database.
The beneficial effect that adopts technique scheme to bring is: it is basis that the present invention adopts the fastest key-value class database of response speed in NoSQL, make up them and lacked the defect of abundant data manipulation ability, realized a set of high-level semantic from this extreme complexity of SQL statement, the mapping model and the method that to this extremely simple database of key-value type database, realize.Thereby for tradition application provides transparent SQL interface, based on high performance NoSQL, realize again simultaneously, obtain the required characteristic possessing under the cloud computing backgrounds such as high-performance, enhanced scalability, highly redundant, mass data.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of an embodiment of the present invention.
Fig. 2 is the schematic diagram of server module in embodiment of the present invention.
The process flow diagram of AST transfer process in embodiment of Fig. 3 the present invention.
Fig. 4 is the schematic diagram of Cache Overlay structure in an embodiment of invention.
Fig. 5 is that the number of responses per second of using the present invention to carry out test sample distributes.
Fig. 6 is used the present invention to carry out the operating lag of test sample.
Fig. 7 is that the operating lag that uses the present invention to carry out test sample distributes.
Fig. 8 is the number of transactions of using the present invention to carry out the processing per second of test sample.
Fig. 9 is that the number of responses per second of using the present invention to carry out test sample distributes.
Figure 10 is used the present invention to carry out the operating lag of test sample.
Figure 11 is that the operating lag that uses the present invention to carry out test sample distributes.
Figure 12 is the number of transactions of using the present invention to carry out the processing per second of test sample.
Embodiment
With reference to accompanying drawing, a kind of medical information system database implementation method based on NoSQL, comprises the following steps:
A, application program are driven and are connected to JDBC interface by JDBC;
B, JDBC interface are called and are connected to Server module by Pyro;
C, Server module are carried out AST parsing to SQL, get AST structure tree;
D, AST structure tree is analyzed, if obtain contingency table, carried out, if obtain singly showing, carry out;
E, AST structure tree is changed and form to carry out script;
F, by api interface, be mapped to NoSQL database.
Server carries out AST parsing to SQL, and the resolving that gets AST structure tree is as follows:
Server inside modules, keeper can pass through the behavior of CLI interface control Server, such as configuration, which database of which sql server is carried out to transparent mapped etc.AST analyzes and mapping block by SQL after resolving, and analyzes contingency table relation, for contingency table, carries out Overlay, for single list structure, carries out Cache.Data management by synchronization module, according to the AST information of accumulation, is analyzed the access frequency to SQL table, and is synchronously processed on backstage, in the Cache that the content synchronization of traditional SQL database is formed to NoSQL.
Described AST structure:
In the transfer process of AST, the mapper based on code consists of one section of code description, thereby has the highest dirigibility, but because need to will carry out once the AST of each generation, thereby efficiency is lower; Mapper based on regular expression is described and is formed by one section of regular expression, has certain dirigibility, and execution efficiency efficiency is also high; Adaptation based on AST is described and is mated according to AST structure, all passes through this filter matching in most of situation, after comprehensive execution efficiency and description dirigibility, is best selection.
Mapper based on code:
Mapper based on regular expression (content is that one section of canonical is described):
r″select\s+\*from\s+where\s+([a-z\.]+)\(([a-z0-9\.]\+)″
Adaptation example based on AST structure (content is one section of AST tree):
After AST coupling, also need, through an AST conversion, AST structure to be carried out to equivalent variations, to promote execution efficiency, finally by AST, compile and be converted to final execution script, and submit to script engine to carry out.For mapper and the mapper based on code of regular expression, owing to lacking AST information, thereby the script that maps directly to user's appointment is directly carried out.
Here provide the example of a concrete AST conversion, as an AST structure tree:
AST matching template is provided:
And mapping template:
Thereby function name is changed to trans_test from ereport.Similarly matching template and mapping template, to providing a lot of groups to form principle of optimality storehouse, realize the transformation to various application.
Cache Overlay provides based on NoSQL, and Main Function is one deck mirror image to content in traditional SQL database.Because traditional SQL is often used multilist join, and the efficiency for multilist join of NoSQL, especially key-value type is extremely low, therefore for multilist join, need to create one deck Cache again.
Use the present invention to carry out test sample,
Sample number: 60000;
Best-case Response Time: 8ms;
Maximum response time: 2735ms;
Average response time: 133ms;
90% response time: 196ms;
Average inquiry per second: 2141.6/s.
Use existing Oracle to carry out contrast test,
Sample number: 60000;
Best-case Response Time: 1ms;
Maximum response time: 53033ms;
Average response time: 328ms;
90% response time: 181ms;
Average inquiry per second: 890.9/s.
More than show and described ultimate principle of the present invention and principal character and advantage of the present invention.The technician of the industry should understand; the present invention is not restricted to the described embodiments; that in above-described embodiment and instructions, describes just illustrates principle of the present invention; without departing from the spirit and scope of the present invention; the present invention also has various changes and modifications, and these changes and improvements all fall in the claimed scope of the invention.The claimed scope of the present invention is defined by appending claims and equivalent thereof.
Claims (1)
1. the medical information system data village, often used in village names implementation method based on NoSQL, is characterized in that comprising the following steps:
A, application program are driven and are connected to JDBC interface by JDBC;
B, JDBC interface are called and are connected to Server module by Pyro;
C, Server module are carried out AST parsing to SQL, get AST structure tree;
D, AST structure tree is analyzed, if obtain contingency table, carried out Overlay operation, if obtain singly showing, carry out Cache operation;
E, AST structure tree is changed and form to carry out script;
F, by api interface, be mapped to NoSQL database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410000527.4A CN103761265A (en) | 2014-01-02 | 2014-01-02 | NoSQL (not only SOL) based medical information system database implementation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410000527.4A CN103761265A (en) | 2014-01-02 | 2014-01-02 | NoSQL (not only SOL) based medical information system database implementation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103761265A true CN103761265A (en) | 2014-04-30 |
Family
ID=50528502
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410000527.4A Pending CN103761265A (en) | 2014-01-02 | 2014-01-02 | NoSQL (not only SOL) based medical information system database implementation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103761265A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105721507A (en) * | 2016-04-21 | 2016-06-29 | 中国科学院软件研究所 | Basic support system and method for data sharing service platform based on JDBC (Java Data Base Connectivity)-long message |
| CN106407427A (en) * | 2016-09-27 | 2017-02-15 | 上海携程商务有限公司 | key-value engine interface method and system |
| CN106933869A (en) * | 2015-12-30 | 2017-07-07 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus of operating database |
| CN110990425A (en) * | 2019-11-28 | 2020-04-10 | 中科驭数（北京）科技有限公司 | JDBC driving method and device of hardware database |
| CN112346730A (en) * | 2020-11-04 | 2021-02-09 | 星环信息科技(上海)股份有限公司 | Intermediate representation generation method, computer equipment and storage medium |
| CN115687317A (en) * | 2022-10-21 | 2023-02-03 | 南京上游软件有限公司 | Method for realizing Java-end-based multi-branch tree object adding, deleting, modifying and checking service |
-
2014
- 2014-01-02 CN CN201410000527.4A patent/CN103761265A/en active Pending
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106933869A (en) * | 2015-12-30 | 2017-07-07 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus of operating database |
| CN106933869B (en) * | 2015-12-30 | 2020-09-01 | 北京京东尚科信息技术有限公司 | Method and device for operating database |
| CN105721507A (en) * | 2016-04-21 | 2016-06-29 | 中国科学院软件研究所 | Basic support system and method for data sharing service platform based on JDBC (Java Data Base Connectivity)-long message |
| CN105721507B (en) * | 2016-04-21 | 2019-03-19 | 中国科学院软件研究所 | It is a kind of based on JDBC service-long message data sharing service platform base support system and method |
| CN106407427A (en) * | 2016-09-27 | 2017-02-15 | 上海携程商务有限公司 | key-value engine interface method and system |
| CN110990425A (en) * | 2019-11-28 | 2020-04-10 | 中科驭数（北京）科技有限公司 | JDBC driving method and device of hardware database |
| CN110990425B (en) * | 2019-11-28 | 2020-12-25 | 中科驭数（北京）科技有限公司 | JDBC driving method and device of hardware database |
| CN112346730A (en) * | 2020-11-04 | 2021-02-09 | 星环信息科技(上海)股份有限公司 | Intermediate representation generation method, computer equipment and storage medium |
| CN115687317A (en) * | 2022-10-21 | 2023-02-03 | 南京上游软件有限公司 | Method for realizing Java-end-based multi-branch tree object adding, deleting, modifying and checking service |
| CN115687317B (en) * | 2022-10-21 | 2023-10-03 | 南京上游软件有限公司 | Method for realizing Java-end-based multi-way tree object adding, deleting and checking service |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103761265A (en) | NoSQL (not only SOL) based medical information system database implementation method | |
| Zhao et al. | Schema conversion model of SQL database to NoSQL | |
| JP6416194B2 (en) | Scalable analytic platform for semi-structured data | |
| CN105279286A (en) | Interactive large data analysis query processing method | |
| CN110019267A (en) | A kind of metadata updates method, apparatus, system, electronic equipment and storage medium | |
| CN103631870A (en) | System and method used for large-scale distributed data processing | |
| CN104111996A (en) | Health insurance outpatient clinic big data extraction system and method based on hadoop platform | |
| Jo et al. | High-performance geospatial big data processing system based on MapReduce | |
| CN107066546B (en) | MPP engine-based cross-data center quick query method and system | |
| CN105787119A (en) | Hybrid engine based big data processing method and system | |
| CN107491476B (en) | Data model conversion and query analysis method suitable for various big data management systems | |
| Wu et al. | A NOSQL–SQL hybrid organization and management approach for real-time geospatial data: A case study of public security video surveillance | |
| US20210157850A1 (en) | Augmenting relational database engines with graph query capability | |
| EP3872703A2 (en) | Method and device for classifying face image, electronic device and storage medium | |
| CN104077386A (en) | Creating and inquiring methods for genealogy data relation table | |
| CN106919697A (en) | A kind of method that data are imported multiple Hadoop components simultaneously | |
| CN103605733A (en) | Page layout storage method based on JSON arrays | |
| Qin et al. | THBase: A coprocessor-based scheme for big trajectory data management | |
| CN113779349A (en) | Data retrieval system, apparatus, electronic device, and readable storage medium | |
| CN105468756A (en) | Design and implementation method of mass data processing system | |
| Mahmood | Automated algorithm for data migration from relational to NoSQL databases | |
| CN112214453A (en) | Large-scale industrial data compression storage method, system and medium | |
| Papadakis et al. | Blocking for large-scale entity resolution: Challenges, algorithms, and practical examples | |
| CN108319604B (en) | Optimization method for association of large and small tables in hive | |
| Haque et al. | Distributed RDF triple store using hbase and hive |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140430 |