KR20150057967A - System for saving sensing data, apparatus for saving data, method for saving data - Google Patents
System for saving sensing data, apparatus for saving data, method for saving data Download PDFInfo
- Publication number
- KR20150057967A KR20150057967A KR1020140138580A KR20140138580A KR20150057967A KR 20150057967 A KR20150057967 A KR 20150057967A KR 1020140138580 A KR1020140138580 A KR 1020140138580A KR 20140138580 A KR20140138580 A KR 20140138580A KR 20150057967 A KR20150057967 A KR 20150057967A
- Authority
- KR
- South Korea
- Prior art keywords
- data
- identification information
- latest
- data table
- storage device
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
The present invention relates to a storage system and method for storing large-capacity sensing data in which sensing data directly measured by an object or sensing information about objects measured by the sensor are stored in a real-time manner in a cloud system and provided.
Recently, as the demand for Internet (IoT) connection of the objects has been rapidly increased, there has been a need for a method of storing the sensing data measured by the objects or the data of the objects measured by the sensors in the cloud and efficiently providing the data to users. It is expected that the amount of data will increase exponentially as the various objects are connected to the Internet and the measured sensing data is accumulated on the cloud system, and accordingly, an efficient data storage and providing system is expected.
In the pre-built cloud environment, large-scale clusters are constructed for large-scale data processing called big data, and research on large-scale data collection, processing, management, and distributed parallel processing is being studied. The distributed database for storing regular data is called NoSQL (Not Only SQL). Typical NoSQL systems include MongoDB and Casandra. Typically, Google is building and operating a system called BigTable to store data, and has published a paper on the configuration and data processing methods of the BigTable system. Therefore, Apache, an open source group, has implemented the same HBase system based on the BigTable paper and made it open source.
In addition, Google uses the MapReduce programming model for data analysis of large-scale distributed data nodes. Apache also has an open source Hadoop system that consists of a distributed file system and a distributed processing model.
The problem to be solved by the present invention is to store sensing data collected from an object or data about objects measured by a sensor, store the data in a system on the cloud, open the data on the Internet, provide search and analysis results And to provide a system and a method for storing data for a mobile terminal.
According to an aspect of the present invention, there is provided a data collecting apparatus for collecting data generated from a sensor; A data storage device for storing the data in a database corresponding to the cumulative data table and the latest data table; A data providing device for transmitting a query requesting retrieval of data to the data storage device and acquiring the accumulated data table or the data stored in the latest data table according to the inquiry; And a data service device for providing the data to a user terminal.
The sensing data storage system transmits a query requesting data retrieval to the data storage device, receives data retrieved from the data storage device according to the inquiry, analyzes the retrieved data according to a predetermined method, And a data analyzing device for generating the data.
The cumulative data table is a table having data identification information as a key, and the latest data table may be a table having sensor identification information of the data as a key.
The data storage device may update a row of the latest data table corresponding to the sensor identification information of the data according to the data.
According to another aspect of the present invention, there is provided a data storage device comprising: a communication interface for receiving data via a communication network; A processor for storing and retrieving the data according to a predetermined program; And a memory for storing the program, wherein the program, when executed on the processor, causes the data storage device to issue data identification information for the input data, and to store the input data in a cumulative data table and a latest data table And retrieves the data from the latest data table using the sensor identification information of the data when the inquiry is a query on the latest data, A data storage device is provided.
The cumulative data table is a table having data identification information as a key, and the latest data table may be a table having sensor identification information of the data as a key.
When executed on the processor, cause the data storage device to perform a process of, when a row of the latest data table corresponding to the sensor identification information of the input data exists, And update the row of the latest data table according to the input data.
Wherein when the program is executed on the processor, when the row of the latest data table corresponding to the sensor identification information of the input data does not exist, the data storage stores the data corresponding to the sensor identification information of the input data To generate a row of the latest data table.
The program, when executed on the processor, may be configured to cause the data storage device to generate a row of the cumulative data table corresponding to the data identification information of the input data.
The program may be configured to, when executed on the processor, cause the data storage device to retrieve search data from the cumulative data table using sensor identification information of the data, if the query is not a query on the most recent data have.
According to another aspect of the present invention, there is provided a method of storing input data in a data storage device, the method comprising: issuing data identification information on the input data; Storing the input data in a cumulative data table and a most recent data table; Receiving a query requesting retrieval of data; Retrieving data from the latest data table using sensor identification information of the data if the query is a query on the latest data; And outputting the retrieved data.
The cumulative data table is a table having data identification information as a key, and the latest data table may be a table having sensor identification information of the data as a key.
Wherein the step of storing the input data in the cumulative data table and the latest data table comprises the steps of: when a row of the latest data table corresponding to the sensor identification information of the input data exists, And updating the row of the latest data table according to the input data.
Wherein the step of storing the input data in the cumulative data table and the latest data table comprises the steps of: if there is no row of the latest data table corresponding to the sensor identification information of the input data, And generating a row of the corresponding latest data table.
The step of storing the input data in the cumulative data table and the latest data table may be a step of generating a row of the cumulative data table corresponding to the data identification information of the input data.
The method may further include retrieving search data in the cumulative data table using the sensor identification information of the data when the query is not a query on the latest data.
The present invention stores sensing data generated in a large capacity on a cloud, and allows a user to inquire data through the web.
In addition, since the present invention separately configures tables for accumulated data and latest data for storing large amounts of data, it is possible to efficiently store the accumulated data and the latest data according to whether the cumulative data used for analysis is used for querying the sensed data, Search can be performed.
FIG. 1 illustrates a sensing data storage system in accordance with an embodiment of the present invention. FIG.
2 is a block diagram illustrating a data storage device in accordance with one embodiment of the present invention.
3 is a flowchart illustrating a process of storing and retrieving data by a data storage device according to an exemplary embodiment of the present invention;
4 is a diagram illustrating an accumulated data table stored in a data storage device according to an embodiment of the present invention;
5 is a diagram illustrating an up-to-date data table stored by a data storage device according to an exemplary embodiment of the present invention;
While the present invention has been described in connection with certain exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In addition, numerals (e.g., first, second, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another.
Also, in this specification, when an element is referred to as being "connected" or "connected" with another element, the element may be directly connected or directly connected to the other element, It should be understood that, unless an opposite description is present, it may be connected or connected via another element in the middle.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In order to facilitate a thorough understanding of the present invention, the same reference numerals are used for the same means regardless of the number of the drawings.
1 is a diagram illustrating a sensing data storage system according to an embodiment of the present invention.
1, a sensing data storage system includes a
The
The
The
The
Accordingly, when receiving the analysis data request, which is a signal for requesting analysis data from the
The
The
Accordingly, the sensing data storage system according to an embodiment of the present invention stores a large amount of data generated from the
2 is a block diagram illustrating a data storage device in accordance with an embodiment of the present invention. The
2, the
The
The
The
Hereinafter, a process of storing and retrieving data by the
3 is a flowchart illustrating a process of storing and retrieving data by a data storage device according to an exemplary embodiment of the present invention. Each of the processes described below may be performed by a
Referring to FIG. 3, in
In
In
In
In
If it is determined in
If it is determined in
In
FIG. 4 is a diagram illustrating an accumulated data table stored in a data storage device according to an embodiment of the present invention. FIG. 5 is a diagram illustrating a latest data table stored in a data storage device according to an embodiment of the present invention. to be.
Referring to FIG. 4, the accumulated data table may include a column corresponding to data identification information, sensor identification information, sensing type, sensing time, and sensing data. In this case, the sensing type indicates the type of information collected by the sensor such as temperature, humidity, and illumination, the sensing data is data including a value calculated by measuring a specific object or environment, ) Represents the time at which the sensing data is generated. The data generated by the
The latest data table may include the sensor identification information, the data identification information, the sensing type, the sensing time, and the column corresponding to the sensing data. At this time, the latest data table may be a table in which sensor identification information is set as a key. Accordingly, when receiving the query including the specific sensor identification information, the
Therefore, when searching for the latest data, the sensing data storage system according to an embodiment of the present invention can provide the fast search by setting the sensor identification information as a parameter and referring to the latest data table in which the sensor identification information is set as the key .
In addition, when the sensing data storage system searches for data other than the latest data, it can search the column of the accumulated data table corresponding to the sensor identification information to provide the accumulated data as well as the latest data although the searching speed is slow.
Meanwhile, the data storage method according to an embodiment of the present invention may be implemented in the form of a program command that can be executed through a variety of means for processing information electronically and recorded in a storage medium. The storage medium may include program instructions, data files, data structures, and the like, alone or in combination.
Program instructions to be recorded on the storage medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of software. Examples of storage media include magnetic media such as hard disks, floppy disks and magnetic tape, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, magneto-optical media and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. The above-mentioned medium may also be a transmission medium such as a light or metal wire, wave guide, etc., including a carrier wave for transmitting a signal designating a program command, a data structure and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as devices for processing information electronically using an interpreter or the like, for example, a high-level language code that can be executed by a computer.
The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the appended claims. It will be understood that the invention may be varied and varied without departing from the scope of the invention.
Claims (16)
A data storage device for storing the data in a database corresponding to the cumulative data table and the latest data table;
A data providing device for transmitting a query requesting retrieval of data to the data storage device and acquiring the accumulated data table or the data stored in the latest data table according to the inquiry; And
The data service apparatus providing the data to the user terminal
The sensing data storage system comprising:
A data analyzing apparatus for analyzing the retrieved data according to a predetermined method to generate analysis data, the data analyzing apparatus comprising: a data analyzing unit for analyzing the retrieved data in response to the inquiry,
The sensing data storage system further comprising:
Wherein the cumulative data table is a table having data identification information of the data as a key,
Wherein the latest data table is a table having sensor identification information of the data as a key.
The data storage device includes:
And updates the row of the latest data table corresponding to the sensor identification information of the data according to the data.
A communication interface for receiving data via a communication network;
A processor for storing and retrieving the data according to a predetermined program; And
A memory for storing the program
, ≪ / RTI &
Wherein the program, when executed on the processor, causes the data storage device to:
Issuing data identification information on the input data,
Storing the input data in a cumulative data table and a latest data table,
Receiving a query requesting retrieval of data,
Retrieving the data from the latest data table using sensor identification information of the data if the query is a query on the latest data,
And to output the data.
Wherein the cumulative data table is a table having data identification information of the data as a key,
Wherein the latest data table is a table having sensor identification information of the data as a key.
Wherein the program, when executed on the processor, causes the data storage device to:
And update the row of the latest data table corresponding to the sensor identification information of the input data according to the input data when a row of the latest data table corresponding to the sensor identification information of the input data exists Data storage device.
Wherein the program, when executed on the processor, causes the data storage device to:
And to generate a row of the latest data table corresponding to the sensor identification information of the input data when a row of the latest data table corresponding to the sensor identification information of the input data does not exist.
Wherein the program, when executed on the processor, causes the data storage device to:
And generate a row of the cumulative data table corresponding to the data identification information of the input data.
Wherein the program, when executed on the processor, causes the data storage device to:
And to retrieve search data from the cumulative data table using sensor identification information of the data if the query is not a query on the latest data.
Issuing data identification information on the input data;
Storing the input data in a cumulative data table and a most recent data table;
Receiving a query requesting retrieval of data;
Retrieving data from the latest data table using sensor identification information of the data if the query is a query on the latest data; And
Outputting the retrieved data;
Lt; / RTI >
Wherein the cumulative data table is a table having data identification information of the data as a key,
Wherein the latest data table is a table having sensor identification information of the data as a key.
Wherein the step of storing the input data in a cumulative data table and a latest data table comprises:
Updating the row of the latest data table corresponding to the sensor identification information of the input data according to the input data when a row of the latest data table corresponding to the sensor identification information of the input data exists, And storing the data.
Wherein the step of storing the input data in a cumulative data table and a latest data table comprises:
And generating a row of the latest data table corresponding to sensor identification information of the input data when a row of the latest data table corresponding to the sensor identification information of the input data does not exist How to store data.
Wherein the step of storing the input data in a cumulative data table and a latest data table comprises:
And generating a row of the accumulated data table corresponding to the data identification information of the input data.
Retrieving search data from the cumulative data table using sensor identification information of the data if the query is not a query on the latest data;
≪ / RTI >
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/543,611 US20150142731A1 (en) | 2013-11-19 | 2014-11-17 | System for saving sensing data, apparatus for saving data, method for saving data |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR20130140899 | 2013-11-19 | ||
KR1020130140899 | 2013-11-19 |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20150057967A true KR20150057967A (en) | 2015-05-28 |
Family
ID=53392681
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020140138580A KR20150057967A (en) | 2013-11-19 | 2014-10-14 | System for saving sensing data, apparatus for saving data, method for saving data |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20150057967A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102274268B1 (en) * | 2020-08-20 | 2021-07-07 | 주식회사 더키 | Apparatus and method for managing energy using a plurality of database server |
-
2014
- 2014-10-14 KR KR1020140138580A patent/KR20150057967A/en not_active Application Discontinuation
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102274268B1 (en) * | 2020-08-20 | 2021-07-07 | 주식회사 더키 | Apparatus and method for managing energy using a plurality of database server |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105786808B (en) | A kind of method and apparatus for distributed execution relationship type computations | |
CN104516894B (en) | Method and apparatus for managing time series databases | |
US20210319002A1 (en) | Method and system for indexing of time-series data | |
JP7038113B2 (en) | Permitting Semantic Mashups on the Internet of Things | |
CN103702053A (en) | Video storage and search method and system as well as monitoring system | |
WO2015140927A1 (en) | Data transfer monitoring system, data transfer monitoring method, and site system | |
US20130185429A1 (en) | Processing Store Visiting Data | |
CN107016056B (en) | Distributed storage system and method for large-volume heterogeneous sensing data in Internet of things | |
CN104933175B (en) | Performance data correlation analysis method and performance monitoring system | |
KR102233867B1 (en) | Extracting similar group elements | |
WO2016127093A1 (en) | Wire diagram tagging system | |
US9558252B2 (en) | Information processing system, data management method, information processing apparatus, and control method and control program therefor | |
CN111859132A (en) | Data processing method and device, intelligent equipment and storage medium | |
US11567930B2 (en) | Adaptive data retrieval with runtime authorization | |
JP2015114937A (en) | Extraction device, data processing system, extraction method, and extraction program | |
US10565224B2 (en) | Data provision apparatus and data provision method | |
US11709831B2 (en) | Cost-based query optimization for array fields in database systems | |
CN112035413B (en) | Metadata information query method, device and storage medium | |
KR20150057967A (en) | System for saving sensing data, apparatus for saving data, method for saving data | |
KR20210000041A (en) | Method and apparatus for analyzing log data in real time | |
KR101648401B1 (en) | Database apparatus, storage unit and method for data management and data analysys | |
KR20140007300A (en) | System and method for processing sensor stream data based hadoop | |
KR101638986B1 (en) | Server, method and system for information service with big data classification user-based and recording medium thereof | |
US20170180511A1 (en) | Method, system and apparatus for dynamic detection and propagation of data clusters | |
CN113608981A (en) | Time sequence database testing method and device, computer equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WITB | Written withdrawal of application |