CN109213758A - Data access method, device, equipment and computer readable storage medium - Google Patents
Data access method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109213758A CN109213758A CN201810821435.0A CN201810821435A CN109213758A CN 109213758 A CN109213758 A CN 109213758A CN 201810821435 A CN201810821435 A CN 201810821435A CN 109213758 A CN109213758 A CN 109213758A
- Authority
- CN
- China
- Prior art keywords
- subdata
- data
- subindex
- memory module
- stored
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of data access method, device, equipment and computer readable storage medium.Method includes: to split according to the split rule to data to be stored, obtains subdata information；Wherein, subdata packet enclosed tool data and its attribute information；Subdata information is sent to multiple memory modules, so that subdata is stored memory module respectively, and the corresponding subindex of subdata is generated according to the attribute information of subdata；The corresponding general index of data to be stored is determined according to subindex.Method, apparatus, equipment and computer readable storage medium of the invention stores respectively after capable of being split data, to reduce the storage pressure of single memory module, additionally it is possible to improve storage speed.Also, identical subdata is stored by multiple memory modules, after some memory modules are attacked, corresponding subdata can also be obtained from other memory modules, to guarantee that the data obtained are accurate.
Description
Technical field
The present invention relates to data processing technique more particularly to a kind of data access method, device, equipment and computer-readable
Storage medium.
Background technique
With the development of network technology, more and more economic society activities need to rely on network progress, to generate a large amount of
Network data.
It is in the prior art to be stored directly in server, or deposited by way of encryption to the storage mode of network data
Storage in the server, can be directly acquired when using these data from server.For example, being carried out greatly according to network data
When data processing development, data required for being obtained directly from server.
But server is happened occasionally by the phenomenon that causing network data to be tampered is attacked, this results in network data to deposit
In the problem of inaccuracy, this product for resulting in dependence network data to make also will appear quality problems, in turn result in economic wealth
Produce loss.
Summary of the invention
The present invention provides a kind of data access method, device, equipment and computer readable storage medium, to solve existing skill
The technical issues of network data present in art is easily tampered
The first aspect of the invention is to provide a kind of date storage method, comprising:
Data to be stored is split according to the split rule, obtains subdata information；Wherein, the subdata packet
Enclosed tool data and its attribute information；
The subdata information is sent to multiple memory modules so that the memory module respectively to the subdata into
Row storage, and the corresponding subindex of the subdata is generated according to the attribute information of the subdata；
The corresponding general index of the data to be stored is determined according to the subindex.
The second aspect of the invention is to provide a kind of data capture method, comprising:
The request message for obtaining data is received, general index corresponding with the data is determined according to the request message；
Multiple subindexs are determined according to the general index, obtain son from multiple memory modules according to multiple subindexs
Data, and determine according to the subindex attribute information of the subdata；
The subdata is grouped according to the attribute information, and determines target subdata in every group of subdata；
According to the target subdata and its attribute information, target data corresponding with the request message is determined.
The third aspect of the invention is to provide a kind of data storage device, comprising:
It splits module and obtains subdata information for splitting according to the split rule to data to be stored；Wherein, institute
State subdata packet enclosed tool data and its attribute information；
The subdata information is sent to multiple memory modules by the fractionation module, so that the memory module is right respectively
The subdata is stored, and generates the corresponding subindex of the subdata according to the attribute information of the subdata；
First determining module, for determining the corresponding general index of the data to be stored according to the subindex.
The fourth aspect of the invention is to provide a kind of data acquisition facility, comprising:
Receiving module, for receiving the request message for obtaining data, according to request message determination and the data pair
The general index answered；
Subindex determining module, for determining multiple subindexs according to the general index；
Module is obtained, for obtaining subdata from multiple memory modules according to multiple subindexs, and according to described
Subindex determines the attribute information of the subdata；
Target subdata determining module, for being grouped according to the attribute information to the subdata, and at every group
Target subdata is determined in subdata；
Target data determining module, for according to the target subdata and its attribute information, determination to disappear with the request
Cease corresponding target data.
The fifth aspect of the invention is to provide a kind of data storage device, comprising:
Memory；
Processor；And
Computer program；
Wherein, the computer program stores in the memory, and is configured to be executed by the processor to realize
Date storage method as described in above-mentioned first aspect.
The sixth aspect of the invention is to provide a kind of computer readable storage medium, is stored thereon with computer program,
The computer program is executed by processor to realize the date storage method as described in above-mentioned first aspect.
The seventh aspect of the invention is to provide a kind of data acquisition facility, comprising:
Memory；
Processor；And
Computer program；
Wherein, the computer program stores in the memory, and is configured to be executed by the processor to realize
Data capture method as described in above-mentioned second aspect.
The eighth aspect of the invention is to provide a kind of computer readable storage medium, is stored thereon with computer program,
The computer program is executed by processor to realize the data capture method as described in above-mentioned second aspect.
Data access method provided by the invention, device, equipment and computer readable storage medium have the technical effect that
Data access method, device, equipment and computer readable storage medium provided by the invention, comprising: according to fractionation
Rule splits data to be stored, obtains subdata information；Wherein, subdata packet enclosed tool data and its attribute letter
Breath；Subdata information is sent to multiple memory modules, so that subdata is stored memory module respectively, and according to subnumber
According to attribute information generate the corresponding subindex of subdata；The corresponding general index of data to be stored is determined according to subindex.This reality
It applies after method, apparatus, equipment and the computer readable storage medium that example provides can be split data and stores respectively, thus
Reduce the storage pressure of single memory module, additionally it is possible to improve storage speed.Also, by multiple memory modules to identical subnumber
According to being stored, after some memory modules are attacked, corresponding subdata can also be obtained from other memory modules, to protect
The data that card obtains are accurate.
Detailed description of the invention
Fig. 1 is the flow chart of the date storage method shown in an exemplary embodiment of the invention；
Fig. 2 is the flow chart of the date storage method shown in another exemplary embodiment of the present invention；
Fig. 3 is the flow chart of the data capture method shown in an exemplary embodiment of the invention；
Fig. 4 is the flow chart of the data capture method shown in another exemplary embodiment of the present invention；
Fig. 5 is the structure chart of the data storage device shown in an exemplary embodiment of the invention；
Fig. 6 is the structure chart of the data storage device shown in another exemplary embodiment of the present invention；
Fig. 7 is the structure chart of the data acquisition facility shown in an exemplary embodiment of the invention；
Fig. 8 is the structure chart of the data acquisition facility shown in another exemplary embodiment of the present invention；
Fig. 9 is the structure chart of the data storage device shown in an exemplary embodiment of the invention；
Figure 10 is the structure chart of the data acquisition facility shown in an exemplary embodiment of the invention.
Specific embodiment
Fig. 1 is the flow chart of the date storage method shown in an exemplary embodiment of the invention.
As shown in Figure 1, date storage method provided in this embodiment includes:
Step 101, data to be stored is split according to the split rule, obtains subdata information.
Wherein, subdata packet enclosed tool data and its attribute information.
Specifically, method provided in this embodiment can be executed by storage system, it can preset and be closed with storage system
The target object of connection is stored the data of these target objects generation by storage system.Target object can send out the data of generation
It is sent in storage system, so that storage system stores it.For example, storage system can be used to store target object generation
Behavioral data, behavior can be the operation behavior generated when user interacts with client, for example, the row of user's registration account
For the behavior etc. of user's login account.
Specifically, fractionation rule can also be preset, for splitting data to be stored.It may include more for splitting rule
Kind, it such as split according to data length, split according to behavior type.Being split according to data length can be complicated text
Paragraph data dismantling is tactic subdata.It can be according to the operation behavior logarithm of particular user according to behavior type fractionation
It, can be according to the types such as being transferred to, produce, pay to data to be stored according to being split, such as in the scene of account trading
It is split.It can specifically be determined according to the attribute of target object, data to be stored and split rule.
Further, data to be stored is carried out splitting available multiple subdatas, it can also according to the split rule really
The attribute information of each subdata calmly, the attribute information can be determination according to the split rule, position, behavior such as subdata
Type etc..Such as data to be stored is split according to data length, then subdata mark can be first segment, second segment etc.
Information, if splitting according to behavior type to data to be stored, subdata mark, which can be, to be transferred to data, produces data.
It may include subdata itself and its attribute information in subdata information when practical application.In addition, subdata information
It can also include the mark of data to be stored, such as a strip data information may include: the number of deals of 2018.7.10 user A
It is to be transferred to according to, data type, specific transfer information.
Step 102, subdata information is sent to multiple memory modules, so that memory module respectively deposited by subdata
Storage, and the corresponding subindex of subdata is generated according to the attribute information of subdata.
Wherein, multiple memory modules can also be set in storage system, for storing each subdata.The memory module can
It to exist in a variety of forms, such as can be computer, can also be table for storing data, can also be that setting is being counted
Database etc. in calculation machine.
Specifically, when subdata information is sent to memory module, it can be set a variety of sending strategys, such as can will be complete
The subdata information in portion is sent respectively to each memory module, a part of subdata information can also be sent to a portion
Memory module, another part subdata information are sent to another part memory module.For example, when being split to data to be stored
10 strip data informations are obtained, then 5 strip data information therein can be sent to a part of memory module, by other 5
Subdata information is sent to another part memory module.Data to be stored is split as a plurality of subdata, then carrying out storage can
Improve storage speed, additionally it is possible to avoid data to be stored being stored by single memory, cause to reach memory soon
Storage cap the problem of.
Further, preferably same subdata information is sent at least two different memory modules, i.e., by multiple
Memory module stores same subdata information.
When practical application, memory module can obtain specific subdata from subdata information, and according to subnumber it is believed that
The attribute information for including in breath generates the corresponding subindex of subdata, for example, can generate son according to the location information of subdata
Index.
Wherein, it in subindex can also include the mark of memory module, for example, stored by the table of entitled Excel1
Subdata further includes then Excel1 in the corresponding subindex of the subdata.It can also include subdata in subindex in storage mould
Specific location in block, such as subdata are stored in the 131st row of table Excel1, then can also include position in subindex
The information of 131 rows.
Specifically, according to subindex it is available to subdata can be from the 131st row of Excel1 in the example above
Middle acquisition subdata.
Step 103, the corresponding general index of data to be stored is determined according to subindex.
Further, determining subindex can be fed back to storage system by each memory module, so that storage system root
General index is determined according to subindex.
When practical application, directly it can be combined each subindex to obtain general index, it can also be according to subdata
Mark, is combined subindex.For example, general index may is that
First segment: Excel1, the 131st row；
Excel3, the 141st row；
Second segment: Excel4, the 78th row；
Excel6, the 65th row.
Wherein it is possible to obtain the subindex with identical subdata attribute information, and carry out to it in multiple subindexs
Combination, obtains general index.
Specifically, due in general index include subindex information, subindex can be determined according to general index,
Further get subdata.
Further, general index can also only include the mark of subindex, such as general index includes: subindex 1, subindex
2, subindex 3, subindex 4.Each subindex is corresponding with specific subdata and its information.
When practical application, data to be stored is split as multiple subdatas, then store these subnumbers by multiple memory modules
According to when obtaining the data to be stored in the later period, subdata being obtained from each memory module, then subdata is combined
Final data are obtained, even if some memory modules are attacked, there is the hidden danger being tampered from data, but other memory modules
The probability attacked simultaneously is lower, therefore, corresponding subdata can be obtained from other memory modules, to guarantee final obtain
Data be accurate.
Method provided in this embodiment for storing data, equipment of this method by being equipped with method provided in this embodiment
It executes, which realizes usually in a manner of hardware and/or software.
Date storage method provided in this embodiment, comprising: data to be stored is split according to the split rule, is obtained
Subdata information；Wherein, subdata packet enclosed tool data and its attribute information；Subdata information is sent to multiple storage moulds
Block so that subdata is stored memory module respectively, and generates the corresponding son of subdata according to the attribute information of subdata
Index；The corresponding general index of data to be stored is determined according to subindex.Method provided in this embodiment can tear data open
It is stored respectively after point, to reduce the storage pressure of single memory module, additionally it is possible to improve storage speed.Also, it is deposited by multiple
Storage module stores identical subdata, after some memory modules are attacked, can also obtain from other memory modules
Corresponding subdata, to guarantee that the data obtained are accurate.
Fig. 2 is the flow chart of the date storage method shown in another exemplary embodiment of the present invention.
As shown in Fig. 2, date storage method provided in this embodiment includes:
Step 201, storage model is determined according to data to be stored, and is determined according to storage model and splits rule and/or deposit
Store up module.
Wherein it is possible to preset storage model, each storage model can correspond to the attribute letter of one group of data to be stored
Breath, such as data type (such as operation class, financial class, info class), data length, target object information.Such as storage model 1
Corresponding data to be stored attribute may is that -1000 bytes of operation class-client 1, then when data to be stored is by client 1
It generates, totally 1000 byte can determine storage model corresponding with the data to be stored when belonging to operation class data to data
For storage model 1.
Storage model may include splitting rule and memory module information, when data mould has been determined according to data to be stored
After type, fractionation rule corresponding with the data model and memory module can be determined accordingly.
It wherein, can also be to storage model after the corresponding fractionation rule of storage model and/or memory module change
It is updated.Such as wherein a memory module in system suspends store function, then can deposit the storage model is corresponding
Module is stored up to delete.
Specifically, a storage model can correspond to multiple memory modules, to be stored according to multiple memory modules wait deposit
Store up the subdata of data.
Further, different storage models can correspond to the data to be stored of same alike result, at this point, these storage models
There can also be priority, after determining multiple storage models according to data to be stored, can choose the storage of highest priority
Model, and the storage model according to the highest priority stores data to be stored.
Step 202, data to be stored is split according to the split rule, obtains subdata information.
Wherein, subdata packet enclosed tool data and its attribute information.
Step 202 is similar with the concrete principle of step 101 and implementation, and details are not described herein again.
Step 203, subdata information is sent to memory module, so that memory module is determined according to the classification of sub- subdata
Submodule, and sub- subdata is stored by submodule；Memory module generates the corresponding son of subdata according to the attribute information of subdata
Index.
Wherein, subdata includes the sub- subdata of multiple classifications；Memory module includes submodule.
Specifically, memory module can also be further according to the number in subdata if the composition of subdata is more complex
According to corresponding classification determine sub- subdata such as subdata be telephone expenses list data, then can also wherein specifically include communicating data,
Flow note data, other data.
Correspondingly, including submodule in memory module, each submodule is for storing a kind of sub- subdata.For example, list 5
It again include multiple sublists in list 5 for storing telephone expenses list data, if table B, C are for storing communicating data, table D, E are used for
Storing data flow and note data, table F, G are for storing other data.It is similar, using multiple sublists storage same class
Subdata, when can be avoided one of sublist and being attacked, there is mistake in the sub- subdata of acquisition.
Memory module can also generate the corresponding subindex of subdata according to the attribute information of subdata, specifically can wrap
It includes:
Sub- subindex is generated according to sub- subdata, subindex is determined according to sub- subindex.
Can specifically generate sub- subindex according to the storage location and attribute information of sub- subdata, then by sub- subindex into
Row combination, obtains subindex.
Step 204, the corresponding general index of data to be stored is determined according to subindex.
Step 204 is similar with the concrete principle of step 103 and implementation, and details are not described herein again.
Fig. 3 is the flow chart of the data capture method shown in an exemplary embodiment of the invention.
As shown in figure 3, data capture method provided in this embodiment, comprising:
Step 301, the request message for obtaining data is received, general index corresponding with data is determined according to request message.
Wherein it is possible to execute method provided in this embodiment by storage system, storage system for storing data, for example,
Storage system can be used to store the behavioral data of target object generation, and behavior, which can be, to be generated when user interacts with client
Operation behavior, for example, the behavior of user's registration account, the behavior etc. of user's login account.
Specifically, user can operate client, and sent to operating system for obtaining asking for data by client
Seek message.For example, client can be with storage system by network connection, client also be can be set within the storage system.With
Family can be by Client browse data entry, and downloads data therein, at this point, client can send to storage system and should
Data obtain data request information accordingly.
Further, it may include the information such as Data Identification in the request message, can also determine number according to Data Identification
According to corresponding general index.It within the storage system, can be with the corresponding relationship of storing data and general index, when storage system receives
After the request message for obtaining data, general index can be found according to the corresponding Data Identification of the request message.
Step 302, multiple subindexs are determined according to general index, obtains son from multiple memory modules according to multiple subindexs
Data, and determine according to subindex the attribute information of subdata.
Include the attribute information of multiple subindexs when practical application, in general index, again includes corresponding in subindex
The attribute information of subdata.
It in one embodiment, may include the mark of each subindex in general index, such as: general index includes: sub- rope
Draw 1, subindex 2, subindex 3, subindex 4.
In another embodiment, general index be composed of multiple subindexs, such as:
General index may is that
First segment: Excel1, the 131st row；
Excel3, the 141st row；
Second segment: Excel4, the 78th row；
Excel6, the 65th row.
It wherein, may include: memory module mark, subdata storage location, subdata attribute in subindex.Such as one
Subindex can be Excel1, the 131st row, first segment.Therefore, corresponding subdata storage position can be found according to subindex
It sets, and obtains the subdata.
Multiple memory modules can also be set in storage system, for storing each subdata.The memory module can be with
Diversified forms exist, such as can be computer, can also be table for storing data, can also be and are arranged in computer
Interior database etc..
It include that multiple memory modules identify in these subindexs specifically, including a plurality of subindex in a general index, because
This, can find corresponding subdata from multiple memory modules.
Further, due in subindex including the attribute information of subdata, and hence it is also possible to be obtained according to subindex determination
The attribute information of the subdata taken.
Step 303, it is grouped according to attribute information subdata, and determines target subdata in every group of subdata.
Further, in method provided in this embodiment, same subdata is stored in multiple memory modules, thus
So that same subdata has multiple subindexs.
It can be grouped according to subdata of the attribute information to acquisition, the subdata of same alike result information is one group, and
Target subdata is determined in every group of subdata.Can be by every group of subdata, the most subdata of identical subdata accounting is true
It is set to target subdata.It include altogether 3 datas, two of them are mutually all 00011, and Article 3 is such as in one group of subdata
00010, it is determined that 00011 is target subdata.
When practical application, if the memory module of storage subdata is attacked, subdata is caused to be tampered, then can be based on
Other memory modules for being stored with the subdata obtain accurate data, and then solve single storage mode in the prior art and be easy
The problem of causing data to be tampered.
Step 304, according to target subdata and the corresponding subindex of target subdata, determination is corresponding with request message
Target data.
The attribute of the target subdata can be determined according to the corresponding subindex of target subdata, if the data are " first
The information such as section ", are combined it further according to the attribute information of each target subdata, obtain target data.
If the attribute information of target subdata is the location informations such as first segment, second segment, can be straight according to location information
The each target subdata of combination is connect, target data corresponding with request message is obtained.
If the attribute information of target subdata is classification information, can according to default rule or template, according to point
Category information is combined target subdata, obtains target data corresponding with request message.
After determining target data, which can also be fed back to transmission and obtain number by method provided in this embodiment
According to request message terminal, such as user terminal.
Method provided in this embodiment is for obtaining data, equipment of this method by being equipped with method provided in this embodiment
It executes, which realizes usually in a manner of hardware and/or software.
Data capture method provided in this embodiment, comprising: the request message for obtaining data is received, it is true according to request message
Fixed general index corresponding with data；Multiple subindexs are determined according to general index, according to multiple subindexs from multiple memory modules
Subdata is obtained, and determines the attribute information of subdata according to subindex；It is grouped according to attribute information subdata, and
Target subdata is determined in every group of subdata；According to target subdata and the corresponding subindex of target subdata, determines and ask
Seek the corresponding target data of message.Data can be respectively stored in by method provided in this embodiment in the form of each subdata
In multiple memory modules, the storage pressure of single memory module can reduce.Also, by multiple memory modules to same genus
Property information subdata stored, after some memory modules are attacked, can also be obtained from other memory modules corresponding
Subdata, to guarantee that the data obtained are accurate.
Fig. 4 is the flow chart of the data capture method shown in another exemplary embodiment of the present invention.
As shown in figure 4, data capture method provided in this embodiment, comprising:
Step 401, the request message for obtaining data is received, general index corresponding with data is determined according to request message.
Step 402, multiple subindexs are determined according to general index.
Step 401-402 is similar with the concrete principle of step 301-302 and implementation, and details are not described herein again.
Step 403, the memory module mark that subindex includes is obtained, and is identified in corresponding memory module from memory module
Subdata is obtained, and determines the attribute information of subdata according to subindex.
It wherein, may include memory module mark in subindex, memory module mark represents the corresponding subnumber of subindex
It is identified in corresponding memory module according to the memory module is stored in, for example, may include Excel1 in subindex, represents subdata
It is stored in Excel1.
Specifically, can also include the attribute information of subdata in subindex, which can be advises according to fractionation
When data being then split as multiple subdatas, determined according to the fractionation rule, such as position, the behavior type of subdata.Example
Such as data to be stored is split according to data length, then subdata mark can be the information such as first segment, second segment, if pressing
Data to be stored is split according to behavior type, then subdata mark, which can be, is transferred to data, produces data.
Further, the memory module includes submodule.It, can be according to data class if the composition of subdata is more complex
A data in subdata are not split as each sub- subdata, and are respectively stored in the submodule of memory module, such as subnumber
According to for telephone expenses list data, then communicating data, flow note data, other data can also be wherein specifically included.
Correspondingly, including submodule in memory module, each submodule is for storing a kind of sub- subdata.For example, list 5
It again include multiple sublists in list 5 for storing telephone expenses list data, if table B, C are for storing communicating data, table D, E are used for
Storing data flow and note data, table F, G are for storing other data.It is similar, using multiple sublists storage same class
Subdata, when can be avoided one of sublist and being attacked, there is mistake in the sub- subdata of acquisition.
In this embodiment, it is identified in corresponding memory module from memory module and obtains subdata, comprising:
Sub- subindex is obtained from subindex；
The submodule block identification that sub- subindex includes is obtained, and obtains subnumber from the corresponding submodule of submodule block identification
According to；
Subdata is determined according to the sub- subdata of acquisition.
It may include multiple sub- subindexs in subindex, every sub- subindex is corresponding with a sub- subdata, and subdata
It is then and multiple sub- subdatas is constituted.
It may include submodule block identification in sub- subindex, therefore, can be obtained from the corresponding submodule of submodule block identification
Sub- subdata.
In addition, can also include the attribute information of each sub- subdata in sub- subindex, it can be according to the attribute information pair
Each sub- subdata is combined, and then obtains subdata.Attribute information can be the data category of sub- subdata, can basis
Preset rules splice and combine sub- subdata according to data category.
Further, it when multiple memory modules store the same subdata, can be wrapped in each memory module
Enclosed tool module stores respectively for the sub- subdata in subdata.
Step 404, it is grouped according to attribute information subdata, and determines target subdata in every group of subdata.
Step 404 is similar with the concrete principle of step 303 and implementation, and details are not described herein again.
Step 405, target subdata is combined according to the attribute information of target subdata, obtains target data.
It, can if the attribute information of target subdata is the location informations such as first segment, second segment in a kind of real-time mode
Directly to combine each target subdata according to location information, target data corresponding with request message is obtained.
It in another embodiment, can be according to preset if the attribute information of target subdata is classification information
Rule or template, are combined target subdata according to classification information, obtain target data corresponding with request message.
Fig. 5 is the structure chart of the data storage device shown in an exemplary embodiment of the invention.
As shown in figure 5, data storage device provided in this embodiment, comprising:
It splits module 51 and obtains subdata information for splitting according to the split rule to data to be stored；Wherein,
The subdata packet enclosed tool data and its attribute information；
The subdata information is sent to multiple memory modules 52 by the fractionation module 51, so that the memory module 52
The subdata is stored respectively, and the corresponding sub- rope of the subdata is generated according to the attribute information of the subdata
Draw；
First determining module 53, for determining the corresponding general index of the data to be stored according to the subindex.
The concrete principle and implementation of data storage device provided in this embodiment with embodiment class shown in FIG. 1
Seemingly, details are not described herein again.
Fig. 6 is the structure chart of the data storage device shown in another exemplary embodiment of the present invention.
As shown in fig. 6, on the basis of the above embodiments, data storage device provided in this embodiment, further includes:
Second determining module 54, for determining storage model according to the data to be stored, and according to the storage model
Determine the fractionation rule and/or the memory module.
Optionally, the subdata includes the sub- subdata of multiple classifications；The memory module 52 includes submodule 521；
Correspondingly, the subdata information is sent to the memory module 52 by the fractionation module 51, so that described deposit
It stores up module 52 and submodule 521 is determined according to the classification of the sub- subdata, and the subnumber is stored by the submodule 521
According to.
The concrete principle and implementation of data storage device provided in this embodiment with embodiment class shown in Fig. 2
Seemingly, details are not described herein again.
Fig. 7 is the structure chart of the data acquisition facility shown in an exemplary embodiment of the invention.
As shown in fig. 7, data acquisition facility provided in this embodiment, comprising:
Receiving module 71, for receiving the request message for obtaining data, according to request message determination and the data
Corresponding general index；
Subindex determining module 72, for determining multiple subindexs according to the general index；
Module 73 is obtained, for obtaining subdata from multiple memory modules 74 according to multiple subindexs, and according to
The subindex determines the attribute information of the subdata；
Target subdata determining module 75, for being grouped according to the attribute information to the subdata, and every
Target subdata is determined in group subdata；
Target data determining module 76, for according to the target subdata and its attribute information, the determining and request
The corresponding target data of message.
The concrete principle and implementation of data acquisition facility provided in this embodiment with embodiment class shown in Fig. 3
Seemingly, details are not described herein again.
Fig. 8 is the structure chart of the data acquisition facility shown in another exemplary embodiment of the present invention.
As shown in figure 8, on the basis of the above embodiments, data acquisition facility provided in this embodiment, the acquisition mould
Block 73 includes:
Acquiring unit 731, the memory module mark for including for obtaining the subindex, and identified from the memory module
Subdata is obtained in corresponding memory module 74.
Optionally, the memory module 74 includes submodule 741；
Correspondingly, the acquiring unit 731 is specifically used for:
Sub- subindex is obtained from the subindex；
The submodule block identification that the sub- subindex includes is obtained, and from the corresponding submodule 741 of the submodule block identification
Obtain sub- subdata；
The subdata is determined according to the sub- subdata of acquisition.
Optionally, the target data determining module 76, comprising:
Assembled unit 761, for being combined according to the attribute information of the target subdata to the target subdata,
Obtain the target data.
The concrete principle and implementation of data acquisition facility provided in this embodiment with embodiment class shown in Fig. 4
Seemingly, details are not described herein again.
Fig. 9 is the structure chart of the data storage device shown in an exemplary embodiment of the invention.
As shown in figure 9, data storage device provided in this embodiment includes:
Memory 91；
Processor 92；And
Computer program；
Wherein, the computer program is stored in the memory 91, and be configured to by the processor 92 execute with
Realize any date storage method as described above.
The present embodiment also provides a kind of computer readable storage medium, is stored thereon with computer program,
The computer program is executed by processor to realize any date storage method as described above.
Figure 10 is the structure chart of the data acquisition facility shown in an exemplary embodiment of the invention.
As shown in Figure 10, data acquisition facility provided in this embodiment includes:
Memory 1001；
Processor 1002；And
Computer program；
Wherein, the computer program is stored in the memory 1001, and is configured to be held by the processor 1002
Row is to realize any data capture method as described above.
The present embodiment also provides a kind of computer readable storage medium, is stored thereon with computer program,
The computer program is executed by processor to realize any data capture method as described above.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above-mentioned each method embodiment can lead to
The relevant hardware of program instruction is crossed to complete.Program above-mentioned can be stored in a computer readable storage medium.The journey
When being executed, execution includes the steps that above-mentioned each method embodiment to sequence；And storage medium above-mentioned include: ROM, RAM, magnetic disk or
The various media that can store program code such as person's CD.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement；And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution
The range of scheme.
Claims (18)
1. a kind of date storage method characterized by comprising
Data to be stored is split according to the split rule, obtains subdata information；Wherein, the subdata packet enclosed tool
Data and its attribute information；
The subdata information is sent to multiple memory modules, so that the memory module respectively deposits the subdata
Storage, and the corresponding subindex of the subdata is generated according to the attribute information of the subdata；
The corresponding general index of the data to be stored is determined according to the subindex.
2. the method according to claim 1, wherein further include:
Storage model is determined according to the data to be stored, and the fractionation rule and/or institute are determined according to the storage model
State memory module.
3. the method according to claim 1, wherein the subdata includes the sub- subdata of multiple classifications；Institute
Stating memory module includes submodule；
Correspondingly, the subdata information is sent to multiple memory modules, so that the memory module is respectively to the subnumber
According to being stored, comprising:
The subdata information is sent to the memory module, so that classification of the memory module according to the sub- subdata
It determines submodule, and the sub- subdata is stored by the submodule.
4. a kind of data capture method characterized by comprising
The request message for obtaining data is received, general index corresponding with the data is determined according to the request message；
Multiple subindexs are determined according to the general index, obtain subnumber from multiple memory modules according to multiple subindexs
According to, and determine according to the subindex attribute information of the subdata；
The subdata is grouped according to the attribute information, and determines target subdata in every group of subdata；
According to the target subdata and its attribute information, target data corresponding with the request message is determined.
5. according to the method described in claim 4, it is characterized in that, it is described according to multiple subindexs from multiple memory modules
Middle acquisition subdata, comprising:
The memory module mark that the subindex includes is obtained, and identifies in corresponding memory module and obtains from the memory module
Subdata.
6. according to the method described in claim 5, it is characterized in that, the memory module includes submodule；
Subdata is obtained correspondingly, identifying in corresponding memory module from the memory module, comprising:
Sub- subindex is obtained from the subindex；
The submodule block identification that the sub- subindex includes is obtained, and obtains son from the corresponding submodule of the submodule block identification
Data；
The subdata is determined according to the sub- subdata of acquisition.
7. according to the method described in claim 4, it is characterized in that, described according to the target subdata and its attribute information,
Determine target data corresponding with the request message, comprising:
The target subdata is combined according to the attribute information of the target subdata, obtains the target data.
8. a kind of data storage device characterized by comprising
It splits module and obtains subdata information for splitting according to the split rule to data to be stored；Wherein, the son
Data packets enclosed tool data and its attribute information；
The subdata information is sent to multiple memory modules by the fractionation module, so that the memory module is respectively to described
Subdata is stored, and generates the corresponding subindex of the subdata according to the attribute information of the subdata；
First determining module, for determining the corresponding general index of the data to be stored according to the subindex.
9. device according to claim 8, which is characterized in that further include:
Second determining module for determining storage model according to the data to be stored, and determines institute according to the storage model
State fractionation rule and/or the memory module.
10. device according to claim 8, which is characterized in that the subdata includes the sub- subdata of multiple classifications；Institute
Stating memory module includes submodule；
Correspondingly, the subdata information is sent to the memory module by the fractionation module, so that the memory module root
Submodule is determined according to the classification of the sub- subdata, and the sub- subdata is stored by the submodule.
11. a kind of data acquisition facility characterized by comprising
Receiving module, it is corresponding with the data according to request message determination for receiving the request message for obtaining data
General index；
Subindex determining module, for determining multiple subindexs according to the general index；
Module is obtained, for obtaining subdata from multiple memory modules according to multiple subindexs, and according to the sub- rope
Draw the attribute information for determining the subdata；
Target subdata determining module, for being grouped according to the attribute information to the subdata, and in every group of subnumber
According to middle determining target subdata；
Target data determining module, for according to the target subdata and its attribute information, the determining and request message pair
The target data answered.
12. device according to claim 11, which is characterized in that the acquisition module includes:
Acquiring unit, the memory module mark for including for obtaining the subindex, and it is corresponding from memory module mark
Subdata is obtained in memory module.
13. device according to claim 12, which is characterized in that the memory module includes submodule；
Correspondingly, the acquiring unit is specifically used for:
Sub- subindex is obtained from the subindex；
The submodule block identification that the sub- subindex includes is obtained, and obtains son from the corresponding submodule of the submodule block identification
Data；
The subdata is determined according to the sub- subdata of acquisition.
14. device according to claim 11, which is characterized in that the target data determining module, comprising:
Assembled unit obtains institute for being combined according to the attribute information of the target subdata to the target subdata
State target data.
15. a kind of data storage device characterized by comprising
Memory；
Processor；And
Computer program；
Wherein, the computer program stores in the memory, and is configured to be executed by the processor to realize such as power
Benefit requires any method of 1-3.
16. a kind of computer readable storage medium, which is characterized in that it is stored thereon with computer program,
The computer program is executed by processor to realize the method as described in claim 1-3 is any.
17. a kind of data storage device characterized by comprising
Memory；
Processor；And
Computer program；
Wherein, the computer program stores in the memory, and is configured to be executed by the processor to realize such as power
Benefit requires any method of 4-7.
18. a kind of computer readable storage medium, which is characterized in that it is stored thereon with computer program,
The computer program is executed by processor to realize the method as described in claim 4-7 is any.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810821435.0A CN109213758B (en) | 2018-07-24 | 2018-07-24 | Data access method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810821435.0A CN109213758B (en) | 2018-07-24 | 2018-07-24 | Data access method, device, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109213758A true CN109213758A (en) | 2019-01-15 |
| CN109213758B CN109213758B (en) | 2021-03-30 |
Family
ID=64990257
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810821435.0A Active CN109213758B (en) | 2018-07-24 | 2018-07-24 | Data access method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109213758B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110188537A (en) * | 2019-04-26 | 2019-08-30 | 北京奇安信科技有限公司 | Separate-storage method and device, storage medium, the electronic device of data |
| CN110730185A (en) * | 2019-10-22 | 2020-01-24 | 张瑞 | Block chain big data processing method and system based on distributed computation |
| CN112988331A (en) * | 2021-04-23 | 2021-06-18 | 广州大一互联网络科技有限公司 | Safety data exchange method between cloud platform virtual machines |
| WO2021218278A1 (en) * | 2020-04-28 | 2021-11-04 | 华为技术有限公司 | Method for processing data, and computing device |
| WO2022068560A1 (en) * | 2020-09-29 | 2022-04-07 | 华为技术有限公司 | Data processing method and apparatus, and device |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030065709A1 (en) * | 2001-10-01 | 2003-04-03 | International Business Machines Corporation | Dynamically determining whether to process requests synchronously or asynchronously |
| CN101021858A (en) * | 2007-01-29 | 2007-08-22 | 华为技术有限公司 | Data storing method and device, and data seeking, adding and deleting method |
| CN101075252A (en) * | 2007-06-21 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method and system for searching network |
| CN101101563A (en) * | 2007-07-23 | 2008-01-09 | 清华大学 | Migration management based on massive data classified memory system |
| US20080028151A1 (en) * | 2006-07-28 | 2008-01-31 | Fujitsu Limited | Cache memory control method and cache memory apparatus |
| CN101276367A (en) * | 2007-03-30 | 2008-10-01 | 西门子公司 | Method for digital storage of data on a data memory |
| CN101286127A (en) * | 2008-05-08 | 2008-10-15 | 华中科技大学 | Multi-fork diary memory continuous data protecting and restoration method |
| CN101515284A (en) * | 2009-03-02 | 2009-08-26 | 南京航空航天大学 | Parallel space topology analyzing method based on discrete grid |
| CN102123198A (en) * | 2011-01-11 | 2011-07-13 | 中国联合网络通信集团有限公司 | Memory management method and memory manager for media player |
| CN103902698A (en) * | 2014-03-31 | 2014-07-02 | 北京车商汇软件有限公司 | Data storage system and data storage method |
| CN108287889A (en) * | 2018-01-17 | 2018-07-17 | 清华大学 | A kind of multi-source heterogeneous date storage method and system based on elastic table model |
| CN108519930A (en) * | 2018-01-31 | 2018-09-11 | 万达信息股份有限公司 | Transmission, relevance storage and the data safety safeguards system of big data |
| CN110019199A (en) * | 2017-09-29 | 2019-07-16 | 株式会社理光 | Data storage, querying method, device, equipment, computer readable storage medium |
-
2018
- 2018-07-24 CN CN201810821435.0A patent/CN109213758B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030065709A1 (en) * | 2001-10-01 | 2003-04-03 | International Business Machines Corporation | Dynamically determining whether to process requests synchronously or asynchronously |
| US20080028151A1 (en) * | 2006-07-28 | 2008-01-31 | Fujitsu Limited | Cache memory control method and cache memory apparatus |
| CN101021858A (en) * | 2007-01-29 | 2007-08-22 | 华为技术有限公司 | Data storing method and device, and data seeking, adding and deleting method |
| CN101276367A (en) * | 2007-03-30 | 2008-10-01 | 西门子公司 | Method for digital storage of data on a data memory |
| CN101075252A (en) * | 2007-06-21 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method and system for searching network |
| CN101101563A (en) * | 2007-07-23 | 2008-01-09 | 清华大学 | Migration management based on massive data classified memory system |
| CN101286127A (en) * | 2008-05-08 | 2008-10-15 | 华中科技大学 | Multi-fork diary memory continuous data protecting and restoration method |
| CN101515284A (en) * | 2009-03-02 | 2009-08-26 | 南京航空航天大学 | Parallel space topology analyzing method based on discrete grid |
| CN102123198A (en) * | 2011-01-11 | 2011-07-13 | 中国联合网络通信集团有限公司 | Memory management method and memory manager for media player |
| CN103902698A (en) * | 2014-03-31 | 2014-07-02 | 北京车商汇软件有限公司 | Data storage system and data storage method |
| CN110019199A (en) * | 2017-09-29 | 2019-07-16 | 株式会社理光 | Data storage, querying method, device, equipment, computer readable storage medium |
| CN108287889A (en) * | 2018-01-17 | 2018-07-17 | 清华大学 | A kind of multi-source heterogeneous date storage method and system based on elastic table model |
| CN108519930A (en) * | 2018-01-31 | 2018-09-11 | 万达信息股份有限公司 | Transmission, relevance storage and the data safety safeguards system of big data |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110188537A (en) * | 2019-04-26 | 2019-08-30 | 北京奇安信科技有限公司 | Separate-storage method and device, storage medium, the electronic device of data |
| CN110730185A (en) * | 2019-10-22 | 2020-01-24 | 张瑞 | Block chain big data processing method and system based on distributed computation |
| WO2021218278A1 (en) * | 2020-04-28 | 2021-11-04 | 华为技术有限公司 | Method for processing data, and computing device |
| WO2022068560A1 (en) * | 2020-09-29 | 2022-04-07 | 华为技术有限公司 | Data processing method and apparatus, and device |
| CN112988331A (en) * | 2021-04-23 | 2021-06-18 | 广州大一互联网络科技有限公司 | Safety data exchange method between cloud platform virtual machines |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109213758B (en) | 2021-03-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109213758A (en) | Data access method, device, equipment and computer readable storage medium | |
| CN108287857B (en) | Expression picture recommendation method and device | |
| CN106530015A (en) | Information releasing control method and apparatus | |
| CN113283675B (en) | Index data analysis method, device, equipment and storage medium | |
| CN110442737A (en) | The twin method and system of number based on chart database | |
| CN109743346A (en) | Session process configuration method, device and computer readable storage medium | |
| CN107563798A (en) | Prize-winning data processing method and device | |
| CN107918618A (en) | Data processing method and device | |
| CN112686717B (en) | Data processing method and system for advertisement recall | |
| CN108446659A (en) | Method and apparatus for detecting facial image | |
| JP7177294B2 (en) | Individual flight training scheme generation system, method and apparatus | |
| CN109871791A (en) | Image processing method and device | |
| CN113822974A (en) | Method, apparatus, electronic device, medium, and program for generating avatar | |
| CN114860742A (en) | Artificial intelligence-based AI customer service interaction method, device, equipment and medium | |
| CN107122805A (en) | A kind of user clustering method and apparatus | |
| CN114297245A (en) | Image tag processing method, image tag processing device, storage medium, processor, and electronic device | |
| CN113536770A (en) | Text analysis method, device and equipment based on artificial intelligence and storage medium | |
| CN112132291B (en) | Intelligent brain optimization method, device, medium and terminal applied to government affair system | |
| CN113705792A (en) | Personalized recommendation method, device, equipment and medium based on deep learning model | |
| CN110209780A (en) | A kind of question template generation method, device, server and storage medium | |
| CN112053058A (en) | Index model generation method and device | |
| CN107609171A (en) | Data source tracing method and device based on data warehouse | |
| CN113762421B (en) | Classification model training method, flow analysis method, device and equipment | |
| CN113283677B (en) | Index data processing method, device, equipment and storage medium | |
| CN115374141A (en) | Virtual image updating method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |