CN102722485A - Memory data set perception method and apparatus - Google Patents

Memory data set perception method and apparatus Download PDF

Info

Publication number
CN102722485A
CN102722485A CN2011100770188A CN201110077018A CN102722485A CN 102722485 A CN102722485 A CN 102722485A CN 2011100770188 A CN2011100770188 A CN 2011100770188A CN 201110077018 A CN201110077018 A CN 201110077018A CN 102722485 A CN102722485 A CN 102722485A
Authority
CN
China
Prior art keywords
data
visit
data set
data structure
perception
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011100770188A
Other languages
Chinese (zh)
Other versions
CN102722485B (en
Inventor
李文松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hundsun Technologies Inc
Original Assignee
Hundsun Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hundsun Technologies Inc filed Critical Hundsun Technologies Inc
Priority to CN201110077018.8A priority Critical patent/CN102722485B/en
Publication of CN102722485A publication Critical patent/CN102722485A/en
Application granted granted Critical
Publication of CN102722485B publication Critical patent/CN102722485B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to a memory data set perception method and an apparatus. The method comprises: creating an inheritance data set object; generating a data structure description string according to the inheritance data set object, and distributing an internal memory to the data structure description string; determining whether a data perception access is needed; if so, using the data structure description string to create a standard data structure; associating an object of the standard data structure with a data perception control; and performing a read-write operation to the inheritance data set object in the internal memory using the standard data structure when an access operating command sent by the data perception control is received. The method and the apparatus are compatible to all data perception controls through a standard data set method, solving technical problems of poor perception and low access efficiency to mass data in prior art, thereby improving access efficiency for mass data.

Description

A kind of internal storage data collection cognitive method and device
Technical field
The present invention relates to technical field of data processing, particularly a kind of internal storage data collection cognitive method and device.
Background technology
Internal storage data collection (Dataset), the general structured record (Record) of two dimension that adopts representes that similar database table (Table) is widely used in the field of software development, and the key expressed of service logic often.How to improve the performance of mass data visit, and can have good maintainability, be the target that the developer pursues always, below is common data set technology, characteristics and access performance:
The structuring array is supported higher level lanquage usually, C/C++ for example, and Delphi etc. are integrated in the developing instrument, and array index visit data performance is good, but convenient visual representing, and dirigibility is low, and editor, mutual GUI exploitation are complicated, do not have reusability;
Internal storage data collection control, such as, ClientDataSet; KdmMemTable, AnyDAC, dxMemData etc.; Be integrated in the developing instrument, convential memory data control mode is developed the structure definable; Can do middleware, not good for the mass data access performance, promptly can not satisfy the application (millions record number) of extreme occasion big data quantity;
Small-sized local data base, such as, FoxPro, InterBase, Access etc., non-integrated, need to buy in addition and dispose, increase user cost, and moving costs and risk are higher, are not suitable for doing three layers of middleware, access performance is general.
Based on this, inventor of the present invention finds, in the existing implementation; Most of data set technology are poor to the perceptibility of mass data visit, even pair data set that the data access performance is good technology is arranged, but its dirigibility is low; Compatible bad and editor, GUI develops complicacy, do not have reusability, therefore; In the prior art, the access efficiency that how to improve mass data is that problem to be solved is arranged at present.
Summary of the invention
The embodiment of the invention provides a kind of internal storage data collection cognitive method and device, to solve in the prior art mass data perceptibility difference and the low technical matters of access efficiency.
For solving the problems of the technologies described above, the embodiment of the invention provides a kind of internal storage data collection cognitive method, and said method comprises:
Create and inherit object data set;
Generate the data structure description string according to said succession object data set, and be said data structure description string storage allocation;
Need to judge whether the data perception visit, if then utilize said data structure description string creating a standard data structure; And the object in the said standard data structure is associated with data aware control;
When the accessing operation order that receives said data aware control transmission, utilize said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
Preferably, said method also comprises:
If judge when not needing the data perception visit, then continue need to judge whether the immediate data visit, if then utilize said data structure description string to obtain the address that the internal memory of object data set is inherited in storage; Directly the succession object data set in the internal memory is carried out read-write operation according to said address.
Preferably, said object in the said standard data structure is associated with data aware control specifically comprises:
It is related with former data set to inherit object data set;
Arbitrary data perception control is related with former data set.
Preferably, said method also comprises:
Judge whether the end data visit, if, then end data visit, and discharge the succession object data set; Otherwise, carry out the said step that need to judge whether the data perception visit.
The present invention also provides a kind of internal storage data collection cognitive method, said comprising:
Create and inherit object data set;
Generate the data structure description string according to said succession object data set, and be this data structure description string storage allocation;
Need to judge whether the immediate data visit, if then utilize said data structure description string to obtain the address that the internal memory of object data set is inherited in storage;
Directly the succession object data set in the internal memory is carried out read-write operation according to said address.
Preferably, said method also comprises:
If judging does not need the immediate data visit, then continue need to judge whether the data perception visit, if then utilize said data structure description string creating a standard data structure; And the object in the said standard data structure is associated with data aware control; When the accessing operation order that receives said data aware control transmission, utilize said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
Preferably, said object in the said standard data structure is associated with data aware control specifically comprises:
It is related with former data set to inherit object data set;
Arbitrary data perception control is related with former data set.
Preferably, said method also comprises:
Judge whether the end data visit, if, then end data visit, and discharge the succession object data set; Otherwise, carry out the said step that need to judge whether the immediate data visit.
Accordingly, the present invention also provides a kind of internal storage data collection sensing device, and said device comprises:
The first establishment unit is used for creating the succession object data set;
Generation unit is used for generating the data structure description string according to said succession object data set;
Allocation units are used to said data structure description string storage allocation;
First judging unit is used to need to judge whether the data perception visit, and sends judged result;
The second establishment unit, the judged result that is used at first judging unit is to utilize said data structure description string creating a standard data structure for the visit of needs data perception;
Associative cell is used for the object of said standard data structure is associated with data aware control;
First operating unit is used for when the accessing operation order that receives said data aware control transmission, utilizing said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
Preferably, said device also comprises:
Second judging unit is used for when the judged result that receives judging unit is visited for not needing data perception, then continuing need to judge whether the immediate data visit, and sending judged result;
Acquiring unit is used for when the judged result that receives second judging unit is visited for the needs immediate data, utilizes said data structure description string to obtain the address that the internal memory of object data set is inherited in storage;
Second operating unit directly carries out read-write operation to the succession object data set in the internal memory according to said address.
Preferably, said device also comprises:
The 3rd judging unit is used to judge whether the end data visit, and sends judged result;
Releasing unit is used for when the judged result that receives said the 3rd judging unit is the end data visit, discharging the succession object data set of visit;
Said first judging unit also is used for during for the visit of end data not, continuing need to judge whether the data perception visit in the judged result that receives said the 3rd judging unit.
The present invention also provides a kind of internal storage data collection sensing device, and said device comprises:
The first establishment unit is used for creating the succession object data set;
Generation unit is used for generating the data structure description string according to said succession object data set;
Allocation units are used to said data structure description string storage allocation;
First judging unit is used to need to judge whether the immediate data visit, and sends judged result;
Acquiring unit is used for when the judged result that receives first judging unit is visited for the needs immediate data, utilizes said data structure description string to obtain the address that the internal memory of object data set is inherited in storage;
Operating unit is used for directly the succession object data set of internal memory being carried out read-write operation according to said address.
Preferably, said device also comprises:
Second judging unit is used for when the judged result of first judging unit is visited for not needing immediate data, continuing need to judge whether the data perception visit, and sending judged result;
The second establishment unit is used for when the judged result that receives second judging unit is visited for the needs data perception, utilizing said data structure description string creating a standard data structure;
Associative cell is used for the object of said standard data structure is associated with data aware control;
Operating unit is used for when the accessing operation order that receives said data aware control transmission, utilizing said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
Preferably, said device also comprises:
The 3rd judging unit is used to judge whether the end data visit, and sends judged result;
Releasing unit is used for when the judged result that receives the 3rd judging unit is the end data visit, discharges and inherits object data set;
Said first judging unit also is used for during for the visit of end data not, continuing need to judge whether the immediate data visit in the judged result that receives the 3rd judging unit.
The embodiment of the invention has been created the succession object data set; And according to said succession object data set generation data structure description string; And be said data structure description string storage allocation; And utilize said data structure description string creating a standard data structure (being about to generate the data structure that the data structure description string is mapped as standard), through compatible all the data perception class controls of normal data diversity method, so that legacy data perception class control can both use; Further; The present invention can provide the possibility of direct memory address service data again through the direct memory access method; Promptly on data access, support 2 kinds of modes of data diversity method and the direct access method of memory array, in the face of mass data the time, have excellent access performance.Thereby improved the efficient of visit mass data.
Description of drawings
The process flow diagram of a kind of internal storage data collection cognitive method that Fig. 1 provides for the embodiment of the invention;
The process flow diagram of the another kind of internal storage data collection cognitive method that Fig. 2 provides for the embodiment of the invention;
The application example of a kind of internal storage data collection cognitive method that Fig. 3 provides for the embodiment of the invention;
The structural representation of a kind of internal storage data collection sensing device that Fig. 4 provides for the embodiment of the invention;
The structural representation of the another kind of internal storage data collection sensing device that Fig. 5 provides for the embodiment of the invention.
Embodiment
In order to make those skilled in the art person understand the scheme of the embodiment of the invention better, the embodiment of the invention is done further to specify below in conjunction with accompanying drawing and embodiment.
See also Fig. 1, the process flow diagram of a kind of internal storage data collection cognitive method that provides for the embodiment of the invention; Said method comprises:
Step 101: create and inherit data set (BinDataSet) object;
Step 102: generate data structure description string S according to said succession object data set, and be said data structure description string storage allocation M;
Step 103: need to judge whether the data perception visit, if then utilize said data structure description string S creating a standard data structure; And the object in the said standard data structure is associated with data aware control;
Wherein, said object in the said standard data structure is associated with data aware control specifically comprises: will inherit object data set and former data set is related; Arbitrary data perception control is related with former data set.Such as, adopt the object mode, create data set organization with S, and object is related with data aware control,
DataSource1.Dataset:=BinDataSet; // BinDataSet1 is related with TDataSource1;
Control1.DataSource:=Datasource1; // the perception control is related with DataSource1 arbitrarily.
Wherein, the data aware control in the embodiment of the invention can be that various visual controls, chart, grid Grid, form, data migtation, database are mutual etc.
Step 104: when the accessing operation order that receives said data aware control transmission, utilize said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
Corresponding, data aware control can utilize DataSource to find BinDataSet1; And utilize standard object way access data.For example: open, close, increase, delete, revise, search or other the operation etc.Present embodiment does not limit.
Preferably, said method can also comprise: if judge when not needing the data perception visit, then continue need to judge whether the immediate data visit, if then utilize said data structure description string S to obtain the address that the internal memory M of object data set is inherited in storage; Directly the succession object data set in the internal memory is carried out read-write operation according to said address.That is to say, improve the access efficiency of datarams if desired, can directly use the direct access modes of data.
Preferably, on the basis of the foregoing description, said method can also comprise: judge whether the end data visit, if, then end data visit, and discharge the succession object data set; Otherwise, carry out the said step that need to judge whether the data perception visit.That is to say, can comprise two kinds of estimate of situations, a kind ofly judge whether end data perception visit; Another kind is to judge whether to finish the immediate data visit; Can be to comprise any one estimate of situation, present embodiment limit yet.
The embodiment of the invention has been created the succession object data set; And according to said succession object data set generation data structure description string S; And be said data structure description string storage allocation M; And utilize said data structure description string creating a standard data structure (being about to generate the data structure that data structure description string S is mapped as standard), through compatible all the data perception class controls of normal data diversity method, so that legacy data perception class control can both use.
Further; The present invention can provide the possibility of direct memory address service data again through the direct memory access method; Promptly on data access, support 2 kinds of modes of data diversity method and the direct access method of memory array, in the face of mass data the time, have excellent access performance.Thereby improved the efficient of visit mass data.
Also see also Fig. 2, the process flow diagram of the another kind of internal storage data collection cognitive method that provides for the embodiment of the invention, said method comprises:
Step 201: create and inherit object data set;
Step 202: generate data structure description string S according to said succession object data set, and be this data structure description string storage allocation M;
Step 203: need to judge whether the immediate data visit, if then utilize said data structure description string S to obtain the address that the internal memory M of object data set is inherited in storage;
Step 204: directly the succession object data set in the internal memory is carried out read-write operation according to said address.
Preferably, said method can also comprise: if judgement does not need the immediate data visit, then continue need to judge whether the data perception visit, if then utilize said data structure description string S creating a standard data structure; And the object in the said standard data structure is associated with data aware control; When the accessing operation order that receives said data aware control transmission, utilize said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
Wherein, said object in the said standard data structure is associated with data aware control specifically comprises: will inherit object data set and former data set is related; Arbitrary data perception control is related with former data set.
Preferably, said method can also comprise: judge whether the end data visit, if, then end data visit, and discharge the succession object data set; Otherwise, carry out the said step that need to judge whether the immediate data visit.
The embodiment of the invention is created earlier and is inherited object data set; Generate data structure description string S according to said succession object data set; And be this data structure description string storage allocation M; When the user need improve the access efficiency to mass data, can directly select immediate data visit (being the direct memory access method); Further, compatible all if desired data perception class controls (being data aware control) can be selected the data perception access modes, promptly through compatible all the data perception class controls of normal data diversity method, so that legacy data perception class control can both use; Promptly on data access, support 2 kinds of modes of data diversity method and the direct access method of memory array, in the face of mass data the time, have excellent access performance.Thereby improved the efficient of visit mass data.
Certainly, in embodiments of the present invention, can directly select data perception visit or immediate data visit as required; Such as; Improve access message if desired, can select the immediate data access mode, compatible if desired all data perception class controls data; Improve access efficiency again, then can select the data perception access modes; Also can change the immediate data access modes into using the data perception access modes after visit a period of time, on the contrary also can, present embodiment does not limit.Therefore, the embodiment of the invention can be selected different data access modes as required, thereby realizes the access efficiency to mass data.
To select the data perception access modes that data are conducted interviews earlier, be example below in the process that data are conducted interviews of selecting the immediate data access modes.
Also see also Fig. 3, the application example of a kind of internal storage data collection cognitive method that provides for the embodiment of the invention comprises:
Step 301: create and inherit data set (BindataSet) object;
At first, the method for inheriting standard object has a lot, and the embodiment of the invention is example with following:
1) 2 memory allocation methods:
function?AllocRecordBuffer:PChar;override;
procedure?FreeRecordBuffer(var?Buffer:PChar);override;
2) 4 bookmark methods of operating:
procedure?GetBookmarkData(Buffer:PChar;Data:Pointer);override;
function?GetBookmarkFlag(Buffer:PChar):TBookmarkFlag;override;
procedure?SetBookmarkFlag(Buffer:PChar;Value:TBookmarkFlag);override;
procedure?SetBookmarkData(Buffer:PChar;Data:Pointer);override;
procedure?InternalGotoBookmark(Bookmark:Pointer);override;
3) 3 record access methods:
function?GetRecord:TGetResult;override;
function?GetRecordSize:Word;override;
procedure?SetFieldData(Field:TField;Buffer:Pointer);override;
4) data edition and method of operating (9):
procedure?InternalOpen;override;
procedure?InternalClose;override;
procedure?InternalDelete;override;
procedure?InternalFirst;override;
procedure?InternalPost;override;
procedure?InternalHandleException;override;
procedure?InternalInitFieldDefs;override;
procedure?InternalInitRecord(Buffer:PChar);override;
procedure?InternalLast;override;
The embodiment of the invention and has increased visit (being that the immediate data is visited) method of self-defined internal memory, face introduction as follows when inheriting above these normal data diversity methods.
Step 302: generate data structure description string S according to said succession object data set, and be S distribute data internal memory M;
Step 303: need to judge whether the data perception visit, if, execution in step 304; Otherwise, execution in step 308;
Step 304: adopt the object data set mode, create data set organization, and will inherit object data set and be associated with data aware control with S;
Wherein, object data set mode access modes is such as, BDataSet1.Values [' Num '] :=123; (promptly using the Values way access of object data set)
A kind of interrelational form is:
1.DataSource1.Dataset:=BinDataSet; // BinDataSet1 is related with TDataSource1
2.Control1.DataSource:=Datasource1; // the perception control is related with DataSource1 arbitrarily
Step 305: data aware control can utilize data source (DataSource) to find and inherit data set (BinDataSet1) object; And utilize standard object way access data, promptly the standard interface through standard data set increases (Append) data, deletion (Delete) data, modification (Update) data or inquiry (Select) data to the succession object data set in the internal memory; But be not limited to this, can also be: operation such as open, close, present embodiment limit.
Step 306: judge whether to need to select the immediate data visit, if, execution in step 307; If select the immediate data access mode, then can improve speed; Otherwise, execution in step 309;
Wherein, to the visit of the immediate data in this step, need to increase following crucial function
Figure BDA0000052726100000101
Figure BDA0000052726100000111
Wherein the CreateFieldsByStrings method has converted the binary structure definition to the data set Field Definition, has realized both functions served as bridge.
The internal storage data of this mapping both can be the address of original array, also can come automatic storage allocation by object of the present invention.Other existing data sets are only supported from distributing internal memory at present.
Step 307: definition structure body S in code, and use the address of inheriting data set (BinDataSet) object acquisition internal memory M, and be output as pointer P; Be P:=M;
Step 308: utilize data pointer P^, the direct read internal memory; Promptly the succession object data set in the internal memory is carried out read-write operation;
Step 309: judge whether the end data visit; If, execution in step 310; Otherwise, return step 303;
Step 310: the end data visit, and discharge succession data set (BinDataSet1) object.
Certainly, in this embodiment, also can select the immediate data access modes earlier, select the data perception access modes again, its implementation procedure is similar to the above embodiments, repeats no more at this.
The concrete following advantage of technical scheme according to the invention:
1, compatible good, possess the whole advantages of legacy data perception control data exhibiting and editor, the thousands of outstanding data aware controls flexibly in a large number of compatibility, mutual like various visual controls, chart, Grid, form, data migtation, database.
2, excellent performance supports data diversity method and memory array directly to visit 2 kinds of modes on data access.In the face of mass data the time, has excellent performance.The actual measurement access speed improves than standard method more than fast hundred times.Such as, on same PC, use standard CD S and new 20000 data recorded collection of BDS operation modification respectively, consuming time as shown in table 1:
Table 1
Title Consuming time
TClientDataSet (standard DS method) 2.147 second
TBinDataSet (standard DS method) 0.913 second
TBinDataSet (directly access method) 0.002 second
It is thus clear that 2 kinds of methods of the embodiment of the invention are all faster than original standard method, especially directly the internal memory mode is fast nearly 1000 times.Huge to the lifting of batch data access performance, can operate other data set of ten million bar record level.
3, supporting pointer visit is different from other convential memory data set technology, has avoided internal memory to duplicate, and has further improved performance.
4, exploitation and transplanting all are easy to, and for legacy data perceptive mode and memory array mode fine compatibility are arranged all, and the change amount is very little.
5, structuring mapping techniques easily, organization definition is very convenient.
The organization definition character string that has adopted among the present invention is very close with syntactic definition in the original higher level lanquage.
The developer very the aspect original binary structure body is transplanted to the embodiment of the invention.
And define and can when operation, revise, and, can configuration be put in definition not only in the design period definition, avoided recompility.
Under the prerequisite of compatible Delphi legacy data perception control system, inherit out a kind of internal storage data collection control.Keeping supporting the direct structure of arrays mapping techniques of internal memory under the legacy data perception internal storage data collection characteristics prerequisite, keeping and compatible each technological original data access method.
Based on the implementation procedure of said method, the embodiment of the invention also provides a kind of internal storage data collection sensing device, and its structural representation sees Fig. 4 for details; Said device comprises: the first establishment unit 41, generation unit 42, allocation units 43; First judging unit, 44, the second establishment unit 45, the associative cell 46 and first operating unit 47; Wherein
The said first establishment unit 41 is used for creating the succession object data set; Said generation unit 42 is used for generating data structure description string S according to said succession object data set; Said allocation units 43 are used to said data structure description string storage allocation M; Said first judging unit 44 is used to need to judge whether the data perception visit, and sends judged result; The said second establishment unit 45 is used for when the judged result of first judging unit is visited for the needs data perception, utilizing said data structure description string S creating a standard data structure; Said associative cell 46 is used for the object of said standard data structure is associated with data aware control; Said first operating unit 47 is used for when the accessing operation order that receives said data aware control transmission, utilizing said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
Preferably, said device can also comprise: second judging unit, acquiring unit; Second operating unit; Wherein, said second judging unit is used for when the judged result that receives judging unit is visited for not needing data perception; Then continue need to judge whether the immediate data visit, and send judged result; Said acquiring unit is used for when the judged result that receives second judging unit is visited for the needs immediate data, utilizes said data structure description string S to obtain the address that the internal memory M of object data set is inherited in storage; Said second operating unit directly carries out read-write operation to the succession object data set in the internal memory according to said address.
Preferably, said device can also comprise: the 3rd judging unit and releasing unit, and wherein, said the 3rd judging unit is used to judge whether the end data visit, and sends judged result; Said releasing unit is used for when the judged result that receives said the 3rd judging unit is the end data visit, discharging the succession object data set of visit; Said first judging unit also is used for during for the visit of end data not, continuing need to judge whether the data perception visit in the judged result that receives said the 3rd judging unit.
Said device can be integrated on the PC, also can be integrated on the server, can also independently dispose, and present embodiment does not limit.
The implementation procedure of the function of each unit and effect in the said device sees implementation procedure corresponding in the said method for details, repeats no more at this.
Also see also Fig. 5, the structural representation of the another kind of internal storage data collection sensing device that provides for the embodiment of the invention, said device comprises: the first establishment unit 51; Generation unit 52, allocation units 53, the first judging units 54; The acquiring unit 55 and first operating unit 56; Wherein, the said first establishment unit 51 is used for creating the succession object data set; Said generation unit 52 is used for generating data structure description string S according to said succession object data set; Said allocation units 53 are used to said data structure description string storage allocation M; Said first judging unit 54 is used to need to judge whether the immediate data visit, and sends judged result; Said acquiring unit 55 is used for when the judged result that receives first judging unit is visited for the needs immediate data, utilizes said data structure description string S to obtain the address that the internal memory M of object data set is inherited in storage; Said first operating unit 56 is used for directly the succession object data set of internal memory being carried out read-write operation according to said address.
Preferably, said device can also comprise: second judging unit, the second establishment unit; The associative cell and second operating unit; Wherein, said second judging unit is used for when the judged result of first judging unit is visited for not needing immediate data; Continue need to judge whether the data perception visit, and send judged result; The said second establishment unit is used for when the judged result that receives second judging unit is visited for the needs data perception, utilizes said data structure description string S creating a standard data structure; Said associative cell is used for the object of said standard data structure is associated with data aware control; Said second operating unit is used for when the accessing operation order that receives said data aware control transmission, utilizing said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
Preferably, said device can also comprise: the 3rd judging unit and releasing unit, and wherein, said the 3rd judging unit is used to judge whether the end data visit, and sends judged result; Said releasing unit is used for when the judged result that receives the 3rd judging unit is the end data visit, discharges and inherits object data set; Said first judging unit also is used for during for the visit of end data not, continuing need to judge whether the immediate data visit in the judged result that receives the 3rd judging unit.
Said device can be integrated in the server, can also be integrated in the stock price index futures system, or in this performance evaluation formula engine etc., also can independently dispose, and present embodiment does not limit.
The present invention is in order to improve data access performance; A kind of collection of internal storage data efficiently (in-memory Dataset) object is provided; Kept autosense convenience; Through direct memory access, solved legacy data cognition technology performance bottleneck, the fast access of number of support ten million more than one hundred million records.Can be used as a kind of novel three-tier architecture software middleware.
Also need to prove; In this article; Relational terms such as first and second grades only is used for an entity or operation are made a distinction with another entity or operation, and not necessarily requires or hint relation or the order that has any this reality between these entities or the operation.And; Term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability; Thereby make and comprise that process, method, article or the equipment of a series of key elements not only comprise those key elements; But also comprise other key elements of clearly not listing, or also be included as this process, method, article or equipment intrinsic key element.Under the situation that do not having much more more restrictions, the key element that limits by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises said key element and also have other identical element.
Description through above embodiment; Those skilled in the art can be well understood to the embodiment of the invention and can realize by the mode that software adds essential general hardware platform; Can certainly pass through hardware, but the former is better embodiment under a lot of situation.Based on such understanding; The part that the technical scheme of the embodiment of the invention contributes to prior art in essence in other words can be come out with the embodied of software product; This computer software product can be stored in the storage medium, like ROM/RAM, magnetic disc, CD etc., comprises that some instructions are with so that a computer equipment (can be a personal computer; Server, the perhaps network equipment etc.) carry out the described method of some part of each embodiment of the embodiment of the invention or embodiment.
The above only is the preferred implementation of the embodiment of the invention; Should be understood that; For those skilled in the art; Under the prerequisite that does not break away from embodiment of the invention principle, can also make some improvement and retouching, these improvement and retouching also should be regarded as the protection domain of the embodiment of the invention.

Claims (14)

1. an internal storage data collection cognitive method is characterized in that, comprising:
Create and inherit object data set;
Generate the data structure description string according to said succession object data set, and be said data structure description string storage allocation;
Need to judge whether the data perception visit, if then utilize said data structure description string creating a standard data structure; And the object in the said standard data structure is associated with data aware control;
When the accessing operation order that receives said data aware control transmission, utilize said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
2. method according to claim 1 is characterized in that, said method also comprises:
If judge when not needing the data perception visit, then continue need to judge whether the immediate data visit, if then utilize said data structure description string to obtain the address that the internal memory of object data set is inherited in storage; Directly the succession object data set in the internal memory is carried out read-write operation according to said address.
3. method according to claim 1 and 2 is characterized in that, said object in the said standard data structure is associated with data aware control specifically comprises:
It is related with former data set to inherit object data set;
Arbitrary data perception control is related with former data set.
4. method according to claim 1 and 2 is characterized in that, said method also comprises:
Judge whether the end data visit, if, then end data visit, and discharge the succession object data set; Otherwise, carry out the said step that need to judge whether the data perception visit.
5. an internal storage data collection cognitive method is characterized in that, comprising:
Create and inherit object data set;
Generate the data structure description string according to said succession object data set, and be this data structure description string storage allocation;
Need to judge whether the immediate data visit, if then utilize said data structure description string to obtain the address that the internal memory of object data set is inherited in storage;
Directly the succession object data set in the internal memory is carried out read-write operation according to said address.
6. method according to claim 5 is characterized in that, said method also comprises:
If judging does not need the immediate data visit, then continue need to judge whether the data perception visit, if then utilize said data structure description string creating a standard data structure; And the object in the said standard data structure is associated with data aware control; When the accessing operation order that receives said data aware control transmission, utilize said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
7. method according to claim 6 is characterized in that, said object in the said standard data structure is associated with data aware control specifically comprises:
It is related with former data set to inherit object data set;
Arbitrary data perception control is related with former data set.
8. according to claim 5 or 6 described methods, it is characterized in that said method also comprises:
Judge whether the end data visit, if, then end data visit, and discharge the succession object data set; Otherwise, carry out the said step that need to judge whether the immediate data visit.
9. an internal storage data collection sensing device is characterized in that, comprising:
The first establishment unit is used for creating the succession object data set;
Generation unit is used for generating the data structure description string according to said succession object data set;
Allocation units are used to said data structure description string storage allocation;
First judging unit is used to need to judge whether the data perception visit, and sends judged result;
The second establishment unit, the judged result that is used at first judging unit is to utilize said data structure description string creating a standard data structure for the visit of needs data perception;
Associative cell is used for the object of said standard data structure is associated with data aware control;
First operating unit is used for when the accessing operation order that receives said data aware control transmission, utilizing said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
10. device according to claim 9 is characterized in that, also comprises:
Second judging unit is used for when the judged result that receives judging unit is visited for not needing data perception, then continuing need to judge whether the immediate data visit, and sending judged result;
Acquiring unit is used for when the judged result that receives second judging unit is visited for the needs immediate data, utilizes said data structure description string to obtain the address that the internal memory of object data set is inherited in storage;
Second operating unit directly carries out read-write operation to the succession object data set in the internal memory according to said address.
11. according to claim 9 or 10 described devices, it is characterized in that, also comprise:
The 3rd judging unit is used to judge whether the end data visit, and sends judged result;
Releasing unit is used for when the judged result that receives said the 3rd judging unit is the end data visit, discharging the succession object data set of visit;
Said first judging unit also is used for during for the visit of end data not, continuing need to judge whether the data perception visit in the judged result that receives said the 3rd judging unit.
12. an internal storage data collection sensing device is characterized in that, comprising:
The first establishment unit is used for creating the succession object data set;
Generation unit is used for generating the data structure description string according to said succession object data set;
Allocation units are used to said data structure description string storage allocation;
First judging unit is used to need to judge whether the immediate data visit, and sends judged result;
Acquiring unit is used for when the judged result that receives first judging unit is visited for the needs immediate data, utilizes said data structure description string to obtain the address that the internal memory of object data set is inherited in storage;
Operating unit is used for directly the succession object data set of internal memory being carried out read-write operation according to said address.
13. device according to claim 12 is characterized in that, also comprises:
Second judging unit is used for when the judged result of first judging unit is visited for not needing immediate data, continuing need to judge whether the data perception visit, and sending judged result;
The second establishment unit is used for when the judged result that receives second judging unit is visited for the needs data perception, utilizing said data structure description string creating a standard data structure;
Associative cell is used for the object of said standard data structure is associated with data aware control;
Operating unit is used for when the accessing operation order that receives said data aware control transmission, utilizing said standard data structure that the succession object data set in the internal memory is carried out read-write operation.
14. according to claim 12 or 13 described devices, it is characterized in that, also comprise:
The 3rd judging unit is used to judge whether the end data visit, and sends judged result;
Releasing unit is used for when the judged result that receives the 3rd judging unit is the end data visit, discharges and inherits object data set;
Said first judging unit also is used for during for the visit of end data not, continuing need to judge whether the immediate data visit in the judged result that receives the 3rd judging unit.
CN201110077018.8A 2011-03-29 2011-03-29 Memory data set perception method and apparatus Active CN102722485B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110077018.8A CN102722485B (en) 2011-03-29 2011-03-29 Memory data set perception method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110077018.8A CN102722485B (en) 2011-03-29 2011-03-29 Memory data set perception method and apparatus

Publications (2)

Publication Number Publication Date
CN102722485A true CN102722485A (en) 2012-10-10
CN102722485B CN102722485B (en) 2014-09-03

Family

ID=46948252

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110077018.8A Active CN102722485B (en) 2011-03-29 2011-03-29 Memory data set perception method and apparatus

Country Status (1)

Country Link
CN (1) CN102722485B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6161148A (en) * 1996-09-27 2000-12-12 Kodak Limited Computer method and apparatus for interactive objects controls
CN101067820A (en) * 2007-06-08 2007-11-07 北京大学 Method for prefetching object

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6161148A (en) * 1996-09-27 2000-12-12 Kodak Limited Computer method and apparatus for interactive objects controls
CN101067820A (en) * 2007-06-08 2007-11-07 北京大学 Method for prefetching object

Also Published As

Publication number Publication date
CN102722485B (en) 2014-09-03

Similar Documents

Publication Publication Date Title
CN108874971B (en) Tool and method applied to mass tagged entity data storage
CN100468402C (en) Sort data storage and split catalog inquiry method based on catalog tree
CN104794123B (en) A kind of method and device building NoSQL database indexes for semi-structured data
US11494339B2 (en) Multi-level compression for storing data in a data store
CN104021161B (en) A kind of clustering storage method and device
US9298384B2 (en) Method and device for storing data in a flash memory using address mapping for supporting various block sizes
CN103608809B (en) Recommending data is enriched with
CN104765731B (en) Database inquiry optimization method and apparatus
CN108932257B (en) Multi-dimensional data query method and device
CN101782922B (en) Multi-level bucket hashing index method for searching mass data
CN103812939A (en) Big data storage system
CN104054071A (en) Method for accessing storage device and storage device
CN103186622A (en) Updating method of index information in full text retrieval system and device thereof
US8738580B2 (en) Copying files from one directory to another
CN103455335A (en) Multilevel classification Web implementation method
CN104615637A (en) Data exchange method and data exchange intermediate device
CN105468644A (en) Method and device for performing query in database
CN105468541A (en) Cache management method for transparent-computing-oriented intelligent terminal
CN109697068A (en) One kind dividing logic SQL statement interpretation method and device under the table mode of library
US10095738B1 (en) Dynamic assignment of logical partitions according to query predicate evaluations
CN101145155A (en) Electronic dictionary data memory format and its searching method
CN104951370B (en) A kind of EMS memory management process and device
CN108920110A (en) A kind of parallel processing big data storage system and method calculating mode based on memory
CN113297171A (en) Database migration method and device and database cluster
US7185020B2 (en) Generating one or more block addresses based on an identifier of a hierarchical data structure

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant