CN106897031A - It is applied to the storage method and system of big data - Google Patents
It is applied to the storage method and system of big data Download PDFInfo
- Publication number
- CN106897031A CN106897031A CN201710117389.1A CN201710117389A CN106897031A CN 106897031 A CN106897031 A CN 106897031A CN 201710117389 A CN201710117389 A CN 201710117389A CN 106897031 A CN106897031 A CN 106897031A
- Authority
- CN
- China
- Prior art keywords
- storage
- big data
- logical address
- network logical
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a kind of storage method for being applied to big data, methods described comprises the following steps：Server receives the big data for needing storage；Server extracts the amount of storage of the big data, and the network logical address flux matched with the storage is inquired from network logical address according to the amount of storage；Server sends to the network logical address storage big data.The technical scheme that the present invention is provided has the advantages that user experience is high.
Description
Technical field
The present invention relates to data processing field, more particularly to a kind of storage method and system for being applied to big data.
Background technology
The strategic importance of big data technology does not lie in grasps huge data message, and is to contain significant number to these
According to carrying out specialized process.In other words, if big data is compared to a kind of industry, then this industry realizes the pass of profit
Key, is to improve " working ability " to data, and " increment " of data is realized by " processing ".Technically, big data with
The relation of cloud computing is inseparable just as one piece of positive and negative of coin.Big data cannot necessarily be carried out with the computer of separate unit
Treatment, it is necessary to use distributed structure/architecture.Its characteristic is to carry out distributed data digging to mass data.But it must be relied on
The distributed treatment of cloud computing, distributed data base and cloud storage, Intel Virtualization Technology.With the arriving of cloud era, big data
(Big data) has also attracted increasing concern.《Write head》Analyst team think, big data (Big data) lead to
It is commonly used to describe a large amount of unstructured datas and semi-structured data that a company creates, these data are downloading to relationship type
Database can overspending time and money when being used to analyze.Big data analysis is often linked together with cloud computing, because in real time
Large data set analysis need framework as MapReduce to distribute work to tens of, hundreds of or even thousands of computers
Make.
Existing big data storage efficiency is low, and user experience is low.
The content of the invention
The application provides a kind of storage method for being applied to big data.Its technical scheme Consumer's Experience for solving prior art
The low shortcoming of degree.
On the one hand, there is provided a kind of storage method for being applied to big data, methods described comprises the following steps：It is applied to big number
According to storage method, methods described comprises the following steps：
Server receives the big data for needing storage；
Server extracts the amount of storage of the big data, is inquired from network logical address and the storage according to the amount of storage
Flux matched network logical address；
Server sends to the network logical address storage big data.
Optionally, methods described also includes：
Server sets up storage distribution list, and the storage distribution list includes that big data is identified and corresponding cellular logic
Address.
Optionally, methods described also includes：
Server such as gets the successful message of storage, determines that the big data is stored successfully, otherwise, from network logical address
In inquire another network logical address.
Second aspect, there is provided a kind of storage system for being applied to big data, the system includes：
Transmit-Receive Unit, the big data of storage is needed for receiving；
Processing unit, the amount of storage for extracting the big data, inquires according to the amount of storage from network logical address
The network logical address flux matched with the storage, the big data is sent to network logical address storage.
Optionally, the system also includes：
Processing unit, for server set up storage distribution list, the storage distribution list include big data identify and
Corresponding network logical address.
Optionally, the system also includes：
Processing unit, for such as getting the successful message of storage, determines that the big data is stored successfully, otherwise, from network
Another network logical address is inquired in logical address.
A kind of third aspect, there is provided server, including：Processor, wireless transceiver, memory and bus, the treatment
Device, wireless transceiver, memory are connected by bus, the wireless transceiver, and the big data of storage is needed for receiving；
The processor, the amount of storage for extracting the big data, inquires about according to the amount of storage from network logical address
Go out the network logical address flux matched with the storage, the big data is sent to network logical address storage.
Optionally, the processor, storage distribution list is set up for server, and the storage distribution list includes big data
Mark and corresponding network logical address.
Optionally, the processor, for such as getting the successful message of storage, determines that the big data is stored successfully, no
Then, another network logical address is inquired from network logical address.
The present invention provide technical scheme by network logical address and amount of storage come dynamically distributes, so it has depositing
Storage efficiency high, user experience advantage high.
Brief description of the drawings
Technical scheme in order to illustrate more clearly the embodiments of the present invention, below will be to that will use needed for embodiment description
Accompanying drawing be briefly described, it should be apparent that, drawings in the following description are some embodiments of the present invention, for this area
For those of ordinary skill, on the premise of not paying creative work, other accompanying drawings can also be obtained according to these accompanying drawings.
A kind of flow chart of storage method for being applied to big data that Fig. 1 is provided for the first better embodiment of the invention；
A kind of structure chart of storage system for being applied to big data that Fig. 2 is provided for the second better embodiment of the invention.
A kind of hardware structure diagram of server that Fig. 3 is provided for the second better embodiment of the invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is a part of embodiment of the invention, rather than whole embodiments.Based on this hair
Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example, belongs to the scope of protection of the invention.
Fig. 1 is refer to, Fig. 1 is a kind of storage side for being applied to big data that the first better embodiment of the invention is proposed
Method, the method are as shown in figure 1, comprise the following steps：
Step S101, server receive the big data for needing storage.
Step S102, server extract the amount of storage of the big data, are inquired about from network logical address according to the amount of storage
Go out the network logical address flux matched with the storage.
Step S103, server send to the network logical address storage big data.
The present invention provide technical scheme by network logical address and amount of storage come dynamically distributes, so it has depositing
Storage efficiency high, user experience advantage high.
Optionally, server sets up storage distribution list, and the storage distribution list includes that big data is identified and corresponding
Network logical address.
Optionally, server such as gets the successful message of storage, determines that the big data is stored successfully, otherwise, from network
Another network logical address is inquired in logical address.
Fig. 2 is refer to, Fig. 2 is a kind of storage system for being applied to big data that the second better embodiment of the invention is proposed
System, the system as shown in Fig. 2 including：
Transmit-Receive Unit 201, the big data of storage is needed for receiving；
Processing unit 202, the amount of storage for extracting the big data, inquires about according to the amount of storage from network logical address
Go out the network logical address flux matched with the storage, the big data is sent to network logical address storage.
The present invention provide technical scheme by network logical address and amount of storage come dynamically distributes, so it has depositing
Storage efficiency high, user experience advantage high.
Optionally, processing unit 202, storage distribution list is set up for server, and the storage distribution list includes big number
According to mark and corresponding network logical address.
Optionally, processing unit 202, for such as getting the successful message of storage, determine that the big data is stored successfully, no
Then, another network logical address is inquired from network logical address.
Refering to Fig. 3, Fig. 3 is a kind of server 30, including：Processor 301, wireless transceiver 302, memory 303 and total
Line 304, wireless transceiver 302 is used for the transceiving data between external equipment.The quantity of processor 301 can be one or many
It is individual.In some embodiments of the present application, processor 301, memory 302 and transceiver 303 can be by bus 304 or other modes
Connection.Server 30 can be used for the step of performing Fig. 1.The implication of the term being related on the present embodiment and citing, can be with
With reference to the corresponding embodiments of Fig. 1.Here is omitted.
Wireless transceiver 302, the big data of storage is needed for receiving.
Wherein, store program codes in memory 303.Processor 901 is used to call the program generation stored in memory 903
Code, for performing following operation：
Processor 301, the amount of storage for extracting the big data, inquires according to the amount of storage from network logical address
The network logical address flux matched with the storage, the big data is sent to network logical address storage.
It should be noted that processor 301 here can be a treatment element, or multiple treatment elements
It is referred to as.For example, the treatment element can be central processing unit (Central Processing Unit, CPU), or spy
Determine integrated circuit (Application Specific Integrated Circuit, ASIC), or be arranged to implement this
Apply for one or more integrated circuits of embodiment, for example：One or more microprocessors (digital singnal
Processor, DSP), or, one or more field programmable gate array (Field Programmable Gate Array,
FPGA)。
Memory 303 can be the general designation of a storage device, or multiple memory elements, and can be held for storing
Line program code or parameter, data etc. required for the operation of application program running gear.And memory 303 can include random storage
Device (RAM), it is also possible to including nonvolatile memory (non-volatile memory), such as magnetic disk storage, flash memory
(Flash) etc..
Bus 304 can be total industry standard architecture (Industry Standard Architecture, ISA)
Line, external equipment interconnection (Peripheral Component, PCI) bus or extended industry-standard architecture (Extended
Industry Standard Architecture, EISA) bus etc..The bus can be divided into address bus, data/address bus, control
Bus processed etc..For ease of representing, only represented with a thick line in Fig. 3, it is not intended that only one bus or a type of
Bus.
The terminal can also include input/output unit, be connected to bus 304, with by bus and the grade of processor 301 its
Its part connects.The input/output unit can provide an inputting interface for operating personnel, so that operating personnel are by the input
Interface selects item of deploying to ensure effective monitoring and control of illegal activities, and can also be other interfaces, can be by the external miscellaneous equipment of the interface.
It should be noted that for each foregoing embodiment of the method, in order to be briefly described, therefore it is all expressed as one it is
The combination of actions of row, but those skilled in the art should know, and the present invention is not limited by described sequence of movement, because
It is that, according to the present invention, certain some step can sequentially or simultaneously be carried out using other.Secondly, those skilled in the art also should
Know, embodiment described in this description belongs to preferred embodiment, involved action and module not necessarily this hair
Necessary to bright.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and is not described in certain embodiment
Part, may refer to the associated description of other embodiment.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
Completed with instructing the hardware of correlation by program, the program can be stored in a computer-readable recording medium, storage
Medium can include：Flash disk, read-only storage (English：Read-Only Memory, referred to as：ROM), random access device (English
Text：Random Access Memory, referred to as：RAM), disk or CD etc..
The content download method and relevant device that are there is provided the embodiment of the present invention above, system are described in detail,
Specific case used herein is set forth to principle of the invention and implementation method, and the explanation of above example is use
Understand the method for the present invention and its core concept in help；Simultaneously for those of ordinary skill in the art, according to of the invention
Thought, will change in specific embodiments and applications, and in sum, this specification content should not be construed as
Limitation of the present invention.
Claims (9)
1. a kind of storage method for being applied to big data, it is characterised in that methods described comprises the following steps：
Server receives the big data for needing storage；
Server extracts the amount of storage of the big data, is inquired from network logical address and the amount of storage according to the amount of storage
The network logical address matched somebody with somebody；
Server sends to the network logical address storage big data.
2. method according to claim 1, it is characterised in that methods described also includes：
Server sets up storage distribution list, and the storage distribution list includes that big data is identified and corresponding cellular logic ground
Location.
3. according to power require 2 described in method, it is characterised in that methods described also includes：
Server such as gets the successful message of storage, determines that the big data is stored successfully, otherwise, is looked into from network logical address
Ask out another network logical address.
4. a kind of storage system for being applied to big data, it is characterised in that the system includes：
Transmit-Receive Unit, the big data of storage is needed for receiving；
Processing unit, the amount of storage for extracting the big data, inquires and this according to the amount of storage from network logical address
The flux matched network logical address of storage, the big data is sent to network logical address storage.
5. system according to claim 4, it is characterised in that the system also includes：
Processing unit, storage distribution list is set up for server, and the storage distribution list includes that big data is identified and corresponded to
Network logical address.
6. system according to claim 5, it is characterised in that the system also includes：
Processing unit, for such as getting the successful message of storage, determines that the big data is stored successfully, otherwise, from cellular logic
Another network logical address is inquired in address.
7. a kind of server, including：Processor, wireless transceiver, memory and bus, the processor, wireless transceiver, deposit
Reservoir is connected by bus, it is characterised in that
The wireless transceiver, the big data of storage is needed for receiving；
The processor, the amount of storage for extracting the big data, according to the amount of storage inquired from network logical address with
The flux matched network logical address of the storage, the big data is sent to network logical address storage.
8. server according to claim 7, it is characterised in that the processor, storage distribution is set up for server
List, the storage distribution list includes that big data is identified and corresponding network logical address.
9. server according to claim 7, it is characterised in that the processor, it is successful for such as getting storage
Message, determines that the big data is stored successfully, otherwise, another network logical address is inquired from network logical address.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710117389.1A CN106897031A (en) | 2017-03-01 | 2017-03-01 | It is applied to the storage method and system of big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710117389.1A CN106897031A (en) | 2017-03-01 | 2017-03-01 | It is applied to the storage method and system of big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106897031A true CN106897031A (en) | 2017-06-27 |
Family
ID=59184775
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710117389.1A Pending CN106897031A (en) | 2017-03-01 | 2017-03-01 | It is applied to the storage method and system of big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106897031A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102541755A (en) * | 2010-12-29 | 2012-07-04 | 深圳市硅格半导体有限公司 | Flash memory and data receiving method thereof |
| CN102650931A (en) * | 2012-04-01 | 2012-08-29 | 华为技术有限公司 | Method and system for writing data |
| CN103425785A (en) * | 2013-08-22 | 2013-12-04 | 新浪网技术(中国)有限公司 | Data storage system and user data storage and reading method thereof |
| CN106201350A (en) * | 2016-07-07 | 2016-12-07 | 华为技术有限公司 | The storage method of data, memorizer and computer system |
| CN106294010A (en) * | 2016-08-08 | 2017-01-04 | 马岩 | The storage method and system of big data in distributed system |
| CN106293528A (en) * | 2016-08-08 | 2017-01-04 | 马岩 | Dropbox stores the method and system of big data |
-
2017
- 2017-03-01 CN CN201710117389.1A patent/CN106897031A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102541755A (en) * | 2010-12-29 | 2012-07-04 | 深圳市硅格半导体有限公司 | Flash memory and data receiving method thereof |
| CN102650931A (en) * | 2012-04-01 | 2012-08-29 | 华为技术有限公司 | Method and system for writing data |
| CN103425785A (en) * | 2013-08-22 | 2013-12-04 | 新浪网技术(中国)有限公司 | Data storage system and user data storage and reading method thereof |
| CN106201350A (en) * | 2016-07-07 | 2016-12-07 | 华为技术有限公司 | The storage method of data, memorizer and computer system |
| CN106294010A (en) * | 2016-08-08 | 2017-01-04 | 马岩 | The storage method and system of big data in distributed system |
| CN106293528A (en) * | 2016-08-08 | 2017-01-04 | 马岩 | Dropbox stores the method and system of big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Olaitan et al. | A framework to test South Africa's readiness for the fourth industrial revolution | |
| CN107632825A (en) | A kind of business software development approach and device | |
| CN110199302A (en) | Event driven block chain workflow processing | |
| CN112204557A (en) | System and method for automated decentralized multilateral transaction processing | |
| CN103842972A (en) | Automated selection of functions to reduce storage capacity based on performance requirements | |
| CN108446976B (en) | A kind of common reserve fund transfer method, computer readable storage medium and terminal device | |
| CN103988199A (en) | Removal of data remanence in deduplicated storage clouds | |
| CN106934027A (en) | Distributed reptile realization method and system | |
| CN104937544A (en) | Computing regression models | |
| CN107528912A (en) | A kind of automatic method, system and relevant apparatus for realizing distributing real time system | |
| CN109522314A (en) | Data archiving method and terminal device based on block chain | |
| CN105988911A (en) | Establishing a chain of trust in a system log | |
| CN107609797A (en) | Electric operating checking method and terminal device | |
| CN106910025A (en) | The method and system of big data valuation of enterprise | |
| CN106845869A (en) | The method and system of affiliated enterprise are determined based on big data | |
| Cole | (Infra) structural discontinuity: capital, labour, and technological change | |
| CN108876388A (en) | A kind of identity identifying method, device and terminal device | |
| CN111951112A (en) | Intelligent contract execution method based on block chain, terminal equipment and storage medium | |
| CN107169754A (en) | The golden management method of maintenance, device, terminal and computer-readable recording medium | |
| CN106897149A (en) | Process the method and system of big data | |
| CN106897443A (en) | The division methods and system of big data | |
| SEbASTIAN et al. | Churn analysis in telecommunication using Logistic Regression | |
| CN106897031A (en) | It is applied to the storage method and system of big data | |
| CN108364162A (en) | A kind of task interface management method, system and terminal device | |
| CN104935673A (en) | Meshing big data mining system based on cloud computing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170627 |