CN108287889A - A kind of multi-source heterogeneous date storage method and system based on elastic table model - Google Patents
A kind of multi-source heterogeneous date storage method and system based on elastic table model Download PDFInfo
- Publication number
- CN108287889A CN108287889A CN201810046272.3A CN201810046272A CN108287889A CN 108287889 A CN108287889 A CN 108287889A CN 201810046272 A CN201810046272 A CN 201810046272A CN 108287889 A CN108287889 A CN 108287889A
- Authority
- CN
- China
- Prior art keywords
- data
- facet
- information
- table model
- grouping
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of multi-source heterogeneous date storage method and system based on elastic table model, the method includes：Obtain the attribute information of the object information and data of data；Elastic table model is established based on the object information and the attribute information, the elasticity table model is used to carry out object grouping to the data according to the object information, it is stored with the identical data of object information in each object grouping, and the identical data of attribute information are divided into same class data in being grouped each object, the data in being grouped respectively to each object carry out classification storage；The data are stored based on the elastic table model.Data are grouped by the object information of data and attribute information respectively, classification storage, by the isomeric data organization of unity of multiple dimensions of an object, the number of attributes that can be continuously increased in isomeric data type and a kind of data in multiple dimensions, has elasticity in each dimension.
Description
Technical field
The present invention relates to computer data management technical fields, more particularly, to a kind of based on the more of elastic table model
Source isomeric data storage method and system.
Background technology
With popularizing for big data application, people need the type and quantity for managing data constantly increasing, these data
Include not only traditional structural data, further include the unstructured datas such as text, image, video, and is based on these data
Extraction and the secondary operation data etc. excavated.In addition, the source of data also becomes more various, such as work for an equipment
The object information of situation both include equipment on the collected time series data of sensor, further include user's input system inspection,
The data such as maintenance.
The use of multi-source heterogeneous data proposes huge challenge to existing data management system, wherein main problem is just
It is, the existing data management system based on relational model can not cope with two big characteristics of these multi-source heterogeneous data：(1)
Same target has a variety of isomeric datas, and is constantly developing；A kind of attribute value of data of (2) objects is constantly being drilled
Change.
Traditional relational have to utilization cost it is high external key association multi-source heterogeneous data are associated, and
The evolution of data class, data attribute is realized using the variation sentence of pattern, this makes the multi-source under relational data model different
Not only inconvenient and efficiency is poor for structure unified management.Traditional object model data library then mainly between considering class after
Hold relationship, object reference etc., it is also difficult to handle the demand that isomeric data constantly develops.In addition, existing Hadoop, MongoDB,
The dedicated system such as DynamoDB only support the single data model such as document, key assignments, and versatility is weak, thus storing diversiform data need to
Multiple systems are integrated, platform construction is high with O＆M cost, seeks to realize diversiform data integration by unified data model
Storage has become the inevitable development trend of unstructured data technology.
Invention content
The present invention provides a kind of one kind for overcoming the above problem or solving the above problems at least partly and is based on elastic table
The multi-source heterogeneous date storage method and system of model, solve in the prior art that storage system only supports document, versatility weak,
And the problem that platform construction, O＆M cost are high.
According to an aspect of the present invention, a kind of multi-source heterogeneous date storage method is provided, including：
Obtain the attribute information of the object information and data of data；
Elastic table model is established based on the object information and the attribute information, the elasticity table model is used for according to institute
It states object information and object grouping is carried out to the data, the identical data of object information are stored in each object grouping, and will
The identical data of attribute information are divided into same class data in each object grouping, and the data in being grouped respectively to each object are divided
Class stores；
The data are stored based on the elastic table model.
It is specifically included preferably, establishing elastic table model based on the object information and the attribute information：
List object is established, and establishes multiple object groupings in the list object, each object grouping is for storing
The identical data of object information；
Facet list is established in object grouping, multiple facets are established in the facet list, each facet is used
In the identical data of attribute information storage.
Preferably, further including after establishing facet list：
Define the sortord of data in each facet by attribute information, if being not defined sortord, to data into
Row is randomly ordered.
It is specifically included preferably, carrying out storage to the data based on the elastic table model：
Judge in the elastic table model with the presence or absence of the object grouping belonging to new data；
If in the presence of judging in the object grouping with the presence or absence of the facet belonging to the new data, if there are matched
The new data is then added in the facet by facet, if being not present, is created facet, is stored to the new data；
If new Object grouping and facet there is no if, the new data is stored.
Preferably, the attribute information includes timing information, metadata information, primary data information (pdi), incidence relation
Information.
A kind of multi-source heterogeneous data-storage system, including：
Data acquisition module is used for when obtaining data, while obtaining the object information and attribute information of data；
Memory module, for establishing elastic table model, the elasticity table model is used for according to the object information to described
Data carry out object grouping, and carry out classification storage to the data in the grouping of each object according to the attribute information；Based on described
Elastic table model stores the data.
Preferably, the memory module includes：
Elastic table model for establishing list object, and establishes multiple object groupings in the list object, each right
As grouping is used for the identical data of storage object information；Facet list is established in object grouping, in the facet list
In establish multiple facets, each facet is used for the identical data of attribute information storage；
Data storage cell adds in facet or removes attribute for being added in elastic table model or removing facet；
Query unit, for inquiring the attribute list in elastic table model, facet list.
A kind of multi-source heterogeneous data elastic storing equipment, including：
At least one processor；And
At least one processor being connect with the processor communication, wherein：
The memory is stored with the program instruction that can be executed by the processor, and the processor calls described program to refer to
Order is able to carry out such as above-mentioned multi-source heterogeneous date storage method.
A kind of multi-source heterogeneous data storage device, including：
At least one processor, at least one processor, communication interface and bus；Wherein,
The processor, memory, communication interface complete mutual communication by the bus；
The communication interface is for the information transmission between the test equipment and the communication equipment of display device；
The memory is stored with the program instruction that can be executed by the processor, and the processor calls described program to refer to
Order is able to carry out such as above-mentioned multi-source heterogeneous date storage method.
A kind of computer program product, the computer program product include being stored in non-transient computer readable storage medium
Computer program in matter, the computer program include program instruction, when described program instruction is computer-executed, make institute
It states computer and executes such as above-mentioned multi-source heterogeneous date storage method.
The present invention proposes a kind of multi-source heterogeneous date storage method and system based on elastic table model, passes through data respectively
Object information and attribute information data are grouped, classification storage, the isomeric datas of multiple dimensions of an object is united
One tissue, allows data model to be continuously increased the number of attributes in isomeric data type and a kind of data with the evolution of application,
The application demand so that it more gears to actual circumstances has elasticity so that model can prop up in multiple dimensions and in each dimension
It holds using the continuous variation for collecting data type, elastic table model allows attribute dynamic increase and decrease in facet so that model can be with
Support large-scale data application.
Description of the drawings
Fig. 1 is the multi-source heterogeneous date storage method flow diagram according to the embodiment of the present invention；
Fig. 2 is the structural schematic diagram according to the elastic table model of the embodiment of the present invention.
Specific implementation mode
With reference to the accompanying drawings and examples, the specific implementation mode of the present invention is described in further detail.Implement below
Example is not limited to the scope of the present invention for illustrating the present invention.
As shown in Figure 1, a kind of multi-source heterogeneous date storage method based on elastic table model is shown in figure, including：
Obtain the object information and attribute information of data；
Elastic table model is established based on the object information and the attribute information, the elasticity table model is used for according to institute
It states object information and object grouping is carried out to the data, the identical data of object information are stored in each object grouping, and will
The identical data of attribute information are divided into same class data in each object grouping, and the data in being grouped respectively to each object are divided
Class stores；
The data are stored based on the elastic table model.
In the present embodiment, the object information is the object indicated described in data, and the attribute information includes sequential letter
Breath, metadata information, primary data information (pdi), incidence relation information etc..
In the present embodiment, obtain data object information and attribute information after further include：
Elastic table model is established, list object is established, and establishes multiple object groupings in the list object, it is each right
As grouping is used for the identical data of storage object information；Facet list is established in object grouping, in the facet list
In establish multiple facets, each facet is used for the identical data of attribute information storage.
Specifically, all data are grouped by elastic table model according to its described object, i.e., for data acquisition system number
According to set D={ d0,d1,…,dn, D={ O can be grouped into0,O1,…,Om, wherein Qi={ di0,di1,…,dik}；
Data in each object are grouped by attribute, and every group is referred to as a facet, includes several correlations in each facet
Attribute, the tissue sortord of attribute is different in different facets.I.e. given object Qi={ di0,di1,…,dik, there are Oi={ Fi0,
Fi1,…,Fik, wherein facet Fij=Sortij=({ dij0,dij1,…,dijt), wherein SortijIt is a ranking functions；
The type and quantity of facet between above-mentioned each object instance can be different, the quantity of the attribute of each facet
It can be different；In the present embodiment, the quantity of facet can dynamically increase and decrease, and the number of attributes in facet can dynamically increase
Subtract.
In the present embodiment, further include after establishing facet list：
Define the sortord of attribute in each facet, i.e., the setting of ranking functions among the above.
On the basis of above-mentioned elastic table model, it can support to operate as follows：
1, extension facet operation addFacet (Oi,Fj)：By facet FjIt is added to object OiOn；
2, facet operation rmFacet (O are shunki,Fj)：By facet FjFrom object OiUpper removal；
3, extended attribute operation addProp (Oi,Fj,Pk)：By attribute PkIt is added to facet FjIn；
4, property of shrinkage operation rmProp (Oi,Fj,Pk)：By attribute PkFrom facet FjMiddle removal；
5, inquiry facet list listFacets (Oi)：Obtain object OiWhole facets；
6, querying attributes list listProps (Oi,Fj)：Obtain object OiFacet FjAll properties；
7, inquiry single attribute getProps (Oi,Fj,Pk)：Obtain object OiFacet FjAttribute PkDetails.
In the present embodiment, the new model with common data models such as relational model, object models is proposed：Elastic table model,
Realize the unified management of multi-source heterogeneous data；Elastic table model allows dynamic to increase and decrease between facet so that model can be supported to answer
With the continuous variation for collecting data type；Elastic table model allows User Defined to sort in facet so that model can fit
Answer various data types and a variety of application loads；Elastic table model allows attribute dynamic to increase and decrease in facet so that model can be with
Support large-scale data application.
In the present embodiment, storage is carried out to the data based on the elastic table model to specifically include：
Judge in the elastic table model with the presence or absence of the object grouping belonging to new data；
If in the presence of judging in the object grouping with the presence or absence of the facet belonging to the new data, if there are matched
The new data is then added in the facet by facet, if being not present, is created facet, is stored to the new data；
If new Object grouping and facet there is no if, the new data is stored.
Specifically, according to application demand, the sortord of attribute in facet type and the facet per class object is defined；
1) when new data d is reached, judge the facet F belonging to d and the object grouping O belonging to it and object type：
2) if object type is not present and object grouping O is not present, new Object is grouped O, and goes to step 4)；
If object type exists, but object grouping O is not present, then new Object is grouped O, then goes to step 3)；Otherwise straight
Switch through step 3)；
3) if the definition of facet F exists, go to step 5)；
If 4) definition of facet F is not present, family of converting should specify the ranking functions of F, if not specifying, acquiescence according to two into
Then the ascending sort of data processed creates facet, and F is added on object grouping O；
5) d is added in facet F.
As shown in Fig. 2, using industrial equipment as object, multi-source heterogeneous data include to start in the collected equipment of sensor
The rotary speed data of machine, the equipment image data of camera shooting, the registration information datas such as owner's information of equipment, equipment match number of packages
According to.The rotary speed data of wherein sensor acquisition belongs to time series data, and equipment image data is typical unstructured data, registration
Information data is the metadata of structuring, and the accessory of equipment then forms incidence relation between equipment.
Elasticity table model construction method according to the invention, can be such as undertissue's data：
(1) industrial equipment object, including timing information, metadata, initial data, four quarters of incidence relation data are defined
Face, wherein initial data, that is, image data.Wherein timing information data sort according to timestamps ordering；
(2) when first timing information data of equipment 1 reach, 1 object of equipment is created, increases the data to timing information
Facet；
(3) when second timing information data of equipment 1 reach, increase the data to timing information facet；
(4) when first image data of equipment 1 reaches, increase the image data to initial data facet；
(5) assume that service application wishes to establish index to picture to carry out similarity retrieval, then need to extract each figure
The characteristic value of piece, these features can be divided into high-level semantics features and low-level image feature.
(6) since high-level semantics features and low-level image feature facet being not present in the original definition of industrial equipment, it is therefore desirable to
It creates the two facets to be simultaneously added in equipment 1, and the characteristic value of extraction is increased to the two can be on face；
(7) when the image data of equipment 2 reaches, it is assumed that similarity retrieval need not be carried out to the picture of equipment 2, then be not required to
Feature is extracted to the picture of equipment 2, equipment 2 does not include high-level semantics features and low-level image feature the two facets at this time.
In above-mentioned steps, step (2) and (3) embody the elasticity in facet；Step (6) and (7) then embody facet
Between elasticity；And as can be seen that the facet of different objects can be entirely different in step (7), this and traditional neat pass
It is that table model or object model form distinct gap.
A kind of multi-source heterogeneous data-storage system based on elastic table model, including：
Data acquisition module is used for when obtaining data, while obtaining the object information and attribute information of data；
Memory module, for establishing elastic table model, the elasticity table model is used for according to the object information to described
Data carry out object grouping, are stored with the identical data of object information in each object grouping, and belong to during each object is grouped
Property the identical data of information be divided into same class data, respectively to each object be grouped in data carry out classification storage.
In the present embodiment, the memory module includes：
Elastic table model for establishing list object, and establishes multiple object groupings in the list object, each right
As grouping is used for the identical data of storage object information；Facet list is established in object grouping, in the facet list
In establish multiple facets, each facet is used for the identical data of attribute information storage；
Data storage cell adds in facet or removes attribute for being added in elastic table model or removing facet；
Query unit, for inquiring the attribute list in elastic table model, facet list.
The specific querying method of query unit includes：
1, extension facet operation addFacet (Oi,Fj)：By facet FjIt is added to object OiOn；
2, facet operation rmFacet (O are shunki,Fj)：By facet FjFrom object OiUpper removal；
3, extended attribute operation addProp (Oi,Fj,Pk)：By attribute PkIt is added to facet FjIn；
4, property of shrinkage operation rmProp (Oi,Fj,Pk)：By attribute PkFrom facet FjMiddle removal；
5, inquiry facet list listFacets (Oi)：Obtain object OiWhole facets；
6, querying attributes list listProps (Oi,Fj)：Obtain object OiFacet FjAll properties；
7, inquiry single attribute getProps (Oi,Fj,Pk)：Obtain object OiFacet FjAttribute PkDetails.
In the present embodiment, the new model with common data models such as relational model, object models is proposed：Elastic table model,
Realize the unified management of multi-source heterogeneous data；Elastic table model allows dynamic to increase and decrease between facet so that model can be supported to answer
With the continuous variation for collecting data type；Elastic table model allows User Defined to sort in facet so that model can fit
Answer various data types and a variety of application loads；Elastic table model allows attribute dynamic to increase and decrease in facet so that model can be with
Support large-scale data application.
A kind of multi-source heterogeneous data elastic storing equipment is also shown in the present embodiment, including：
At least one processor；And
At least one processor being connect with the processor communication, wherein：
The memory is stored with the program instruction that can be executed by the processor, and the processor calls described program to refer to
Order is able to carry out such as the above-mentioned multi-source heterogeneous date storage method based on elastic table model.
Multi-source heterogeneous data elastic storing equipment is also shown in the present embodiment, including：Processor (processor) is deposited
Reservoir (memory), communication interface (Communications Interface) and bus；
Wherein,
The processor, memory, communication interface complete mutual communication by the bus；
The communication interface is for the information transmission between the test equipment and the communication equipment of display device；
The processor is used to call the program instruction in the memory, is provided with executing above-mentioned each method embodiment
The multi-source heterogeneous date storage method based on elastic table model, such as including：
Obtain the object information and attribute information of data；
Elastic table model is established based on the object information and the attribute information, the elasticity table model is used for according to institute
It states object information and object grouping is carried out to the data, the identical data of object information are stored in each object grouping, and will
The identical data of attribute information are divided into same class data in each object grouping, and the data in being grouped respectively to each object are divided
Class stores；
The data are stored based on the elastic table model.
The present embodiment discloses a kind of computer program product, and the computer program product includes being stored in non-transient calculating
Computer program on machine readable storage medium storing program for executing, the computer program include program instruction, when described program instruction is calculated
When machine executes, computer is able to carry out the multi-source heterogeneous data elastic storage method that above-mentioned each method embodiment is provided, such as
Including：
Obtain the object information and attribute information of data；
Elastic table model is established based on the object information and the attribute information, the elasticity table model is used for according to institute
It states object information and object grouping is carried out to the data, the identical data of object information are stored in each object grouping, and will
The identical data of attribute information are divided into same class data in each object grouping, and the data in being grouped respectively to each object are divided
Class stores；
The data are stored based on the elastic table model.
The present embodiment provides a kind of non-transient computer readable storage medium, the non-transient computer readable storage medium
Store computer instruction, the computer instruction make that the computer executes that above-mentioned each method embodiment provided based on elasticity
The multi-source heterogeneous date storage method of table model, such as including：
Obtain the object information and attribute information of data；
Elastic table model is established based on the object information and the attribute information, the elasticity table model is used for according to institute
It states object information and object grouping is carried out to the data, the identical data of object information are stored in each object grouping, and will
The identical data of attribute information are divided into same class data in each object grouping, and the data in being grouped respectively to each object are divided
Class stores；
The data are stored based on the elastic table model.
One of ordinary skill in the art will appreciate that：Realize that all or part of step of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer read/write memory medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed；And storage medium above-mentioned includes：ROM, RAM, magnetic disc or light
The various media that can store program code such as disk.
In conclusion the present invention proposes a kind of multi-source heterogeneous date storage method and system based on elastic table model, point
Data are not grouped by the object information of data and attribute information, classification storage, by multiple dimensions of an object
Isomeric data organization of unity allows data model to be continuously increased with the evolution of application in isomeric data type and a kind of data
Number of attributes so that its application demand that more gears to actual circumstances has elasticity in multiple dimensions and in each dimension so that
Model can support that using the continuous variation for collecting data type, elastic table model allows attribute dynamic to increase and decrease in facet, makes
Large-scale data application can be supported by obtaining model.
The embodiments such as the test equipment of display device described above are only schematical, wherein described as separation
The unit of part description may or may not be physically separated, the component shown as unit can be or
It can not be physical unit, you can be located at a place, or may be distributed over multiple network units.It can be according to reality
Border needs to select some or all of module therein to achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art
In the case where not paying performing creative labour, you can to understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It is realized by the mode of software plus required general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, on
Stating technical solution, substantially the part that contributes to existing technology can be expressed in the form of software products in other words, should
Computer software product can store in a computer-readable storage medium, such as ROM/RAM, magnetic disc, CD, including several fingers
It enables and using so that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation
Method described in certain parts of example or embodiment.
Finally, method of the invention is only preferable embodiment, is not intended to limit the scope of the present invention.It is all
Within the spirit and principles in the present invention, any modification, equivalent replacement, improvement and so on should be included in the protection of the present invention
Within the scope of.
Claims (10)
1. a kind of multi-source heterogeneous date storage method, which is characterized in that including：
Obtain the attribute information of the object information and data of data；
Elastic table model is established based on the object information and the attribute information, the elasticity table model is used for according to described right
Image information carries out object grouping to the data, is stored with the identical data of object information in each object grouping, and will be each
The identical data of attribute information are divided into same class data in object grouping, and the data in being grouped respectively to each object carry out classification and deposit
Storage；
The data are stored based on the elastic table model.
2. multi-source heterogeneous date storage method according to claim 1, which is characterized in that be based on the object information and institute
It states attribute information and establishes elastic table model, specifically include：
List object is established, and establishes multiple object groupings in the list object, each object grouping is used for storage object
The identical data of information；
Facet list is established in object grouping, multiple facets are established in the facet list, each facet is for depositing
Store up the identical data of attribute information.
3. multi-source heterogeneous date storage method according to claim 2, which is characterized in that also wrapped after establishing facet list
It includes：
The sortord by attribute information for obtaining data carries out data randomly ordered if not there is sortord.
4. multi-source heterogeneous date storage method according to claim 2, which is characterized in that based on the elastic table model pair
The data carry out storage and specifically include：
Judge in the elastic table model with the presence or absence of the object grouping belonging to new data；
If in the presence of, judge in the object grouping with the presence or absence of the facet belonging to the new data, if there are matched facet,
Then the new data is added in the facet, if being not present, facet is created, the new data is stored；
If new Object grouping and facet there is no if, the new data is stored.
5. multi-source heterogeneous date storage method according to claim 1, which is characterized in that the attribute information includes sequential
Information, metadata information, primary data information (pdi), incidence relation information.
6. a kind of multi-source heterogeneous data-storage system, which is characterized in that including：
Data acquisition module is used for when obtaining data, while obtaining the object information and attribute information of data；
Memory module, for establishing elastic table model, the elasticity table model is used for according to the object information to the data
Object grouping is carried out, the identical data of object information are stored in each object grouping, and attribute in the grouping of each object is believed
It ceases identical data and is divided into same class data, the data in being grouped respectively to each object carry out classification storage.
7. multi-source heterogeneous data-storage system according to claim 6, which is characterized in that the memory module includes：
Elastic table model for establishing list object, and establishes multiple object groupings, each object point in the list object
Group is used for the identical data of storage object information；Facet list is established in object grouping, is built in the facet list
Multiple facets are stood, each facet is used for the identical data of attribute information storage；
Data storage cell adds in facet or removes attribute for being added in elastic table model or removing facet；
Query unit, for inquiring the attribute list in elastic table model, facet list.
8. a kind of multi-source heterogeneous data storage device, which is characterized in that including：
At least one processor；And
At least one processor being connect with the processor communication, wherein：
The memory is stored with the program instruction that can be executed by the processor, and the processor calls described program to instruct energy
Enough methods executed as described in claim 1 to 5 is any.
9. a kind of multi-source heterogeneous data storage device, which is characterized in that including：
At least one processor, at least one processor, communication interface and bus；Wherein,
The processor, memory, communication interface complete mutual communication by the bus；
The communication interface is for the information transmission between the test equipment and the communication equipment of display device；
The memory is stored with the program instruction that can be executed by the processor, and the processor calls described program to instruct energy
Enough methods executed as described in claim 1 to 5 is any.
10. a kind of computer program product, which is characterized in that the computer program product includes being stored in non-transient computer
Computer program on readable storage medium storing program for executing, the computer program include program instruction, when described program is instructed by computer
When execution, the computer is made to execute the method as described in claim 1 to 5 is any.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810046272.3A CN108287889B (en) | 2018-01-17 | 2018-01-17 | A kind of multi-source heterogeneous date storage method and system based on elastic table model |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810046272.3A CN108287889B (en) | 2018-01-17 | 2018-01-17 | A kind of multi-source heterogeneous date storage method and system based on elastic table model |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108287889A true CN108287889A (en) | 2018-07-17 |
| CN108287889B CN108287889B (en) | 2019-06-18 |
Family
ID=62835277
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810046272.3A Active CN108287889B (en) | 2018-01-17 | 2018-01-17 | A kind of multi-source heterogeneous date storage method and system based on elastic table model |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108287889B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109213758A (en) * | 2018-07-24 | 2019-01-15 | 中国联合网络通信集团有限公司 | Data access method, device, equipment and computer readable storage medium |
| CN109446204A (en) * | 2018-11-27 | 2019-03-08 | 北京微播视界科技有限公司 | A kind of date storage method of instant messaging, device, electronic equipment and medium |
| CN111538871A (en) * | 2020-07-08 | 2020-08-14 | 北京东方通科技股份有限公司 | Integrated retrieval method supporting different data types |
| CN111723245A (en) * | 2019-03-18 | 2020-09-29 | 阿里巴巴集团控股有限公司 | Method for establishing incidence relation of different types of storage objects in data storage system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101083656A (en) * | 2007-07-05 | 2007-12-05 | 上海交通大学 | Data stream technique based multi-source heterogeneous data integrated system |
| US20090248698A1 (en) * | 2008-03-31 | 2009-10-01 | Stephan Rehmann | Managing Consistent Interfaces for Internal Service Request Business Objects Across Heterogeneous Systems |
| CN105760449A (en) * | 2016-02-03 | 2016-07-13 | 浙江工业大学 | Multi-source heterogeneous data cloud pushing method |
| CN106897462A (en) * | 2017-03-13 | 2017-06-27 | 榆林学院 | Data statistic analysis plateform system |
-
2018
- 2018-01-17 CN CN201810046272.3A patent/CN108287889B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101083656A (en) * | 2007-07-05 | 2007-12-05 | 上海交通大学 | Data stream technique based multi-source heterogeneous data integrated system |
| US20090248698A1 (en) * | 2008-03-31 | 2009-10-01 | Stephan Rehmann | Managing Consistent Interfaces for Internal Service Request Business Objects Across Heterogeneous Systems |
| CN105760449A (en) * | 2016-02-03 | 2016-07-13 | 浙江工业大学 | Multi-source heterogeneous data cloud pushing method |
| CN106897462A (en) * | 2017-03-13 | 2017-06-27 | 榆林学院 | Data statistic analysis plateform system |
Non-Patent Citations (1)
| Title |
|---|
| 黄弘: "国土资源一张图云存储关键技术研究", 《中国博士学位论文全文数据库 信息科技辑》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109213758A (en) * | 2018-07-24 | 2019-01-15 | 中国联合网络通信集团有限公司 | Data access method, device, equipment and computer readable storage medium |
| CN109213758B (en) * | 2018-07-24 | 2021-03-30 | 中国联合网络通信集团有限公司 | Data access method, device, equipment and computer readable storage medium |
| CN109446204A (en) * | 2018-11-27 | 2019-03-08 | 北京微播视界科技有限公司 | A kind of date storage method of instant messaging, device, electronic equipment and medium |
| CN111723245A (en) * | 2019-03-18 | 2020-09-29 | 阿里巴巴集团控股有限公司 | Method for establishing incidence relation of different types of storage objects in data storage system |
| CN111723245B (en) * | 2019-03-18 | 2024-04-26 | 阿里巴巴集团控股有限公司 | Method for establishing association relation of different types of storage objects in data storage system |
| CN111538871A (en) * | 2020-07-08 | 2020-08-14 | 北京东方通科技股份有限公司 | Integrated retrieval method supporting different data types |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108287889B (en) | 2019-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108287889B (en) | A kind of multi-source heterogeneous date storage method and system based on elastic table model | |
| US10719560B2 (en) | System for identifying, associating, searching and presenting documents based on relation combination | |
| US9256665B2 (en) | Creation of inverted index system, and data processing method and apparatus | |
| US20170132219A1 (en) | System for identifying, associating, searching and presenting documents based on time sequentialization | |
| CN109522357A (en) | A kind of data processing method, device, server and storage medium | |
| CN106126601A (en) | A kind of social security distributed preprocess method of big data and system | |
| CN104951512A (en) | Public sentiment data collection method and system based on Internet | |
| US20190205342A1 (en) | Identifying and structuring related data | |
| CN108446391A (en) | Processing method, device, electronic equipment and the computer-readable medium of data | |
| CN106503274A (en) | A kind of Data Integration and searching method and server | |
| CN103631922A (en) | Hadoop cluster-based large-scale Web information extraction method and system | |
| CN107391502A (en) | The data query method, apparatus and index structuring method of time interval, device | |
| CN111611266A (en) | Knowledge-driven joint big data query and analysis platform | |
| CN102508919A (en) | Data processing method and system | |
| CN105677763A (en) | Image quality evaluating system based on Hadoop | |
| CN103425257A (en) | Method and device for prompting information of uncommon characters | |
| Bayraktar et al. | A hybrid image dataset toward bridging the gap between real and simulation environments for robotics: Annotated desktop objects real and synthetic images dataset: ADORESet | |
| CN111611448A (en) | Knowledge-driven joint big data query and analysis platform | |
| CN103914488A (en) | Document collection, identification, association, search and display system | |
| CN112765150A (en) | Big data heterogeneous fusion extraction method and device | |
| CN103914486A (en) | Document search and display system | |
| CN109271479A (en) | A kind of resume structuring processing method | |
| CN102945270A (en) | Parallel distribution type network public opinion data management method and system | |
| CN117236624A (en) | Issue repairer recommendation method and apparatus based on dynamic graph | |
| KR20180077830A (en) | Processing method for a relational query in distributed stream processing engine based on shared-nothing architecture, recording medium and device for performing the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |