CN117591456A - Network shared data storage system - Google Patents

Network shared data storage system Download PDF

Info

Publication number
CN117591456A
CN117591456A CN202311559023.1A CN202311559023A CN117591456A CN 117591456 A CN117591456 A CN 117591456A CN 202311559023 A CN202311559023 A CN 202311559023A CN 117591456 A CN117591456 A CN 117591456A
Authority
CN
China
Prior art keywords
data
solid state
reading
bridge chip
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311559023.1A
Other languages
Chinese (zh)
Inventor
曹桢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Aoxing Technology Co ltd
Original Assignee
Beijing Aoxing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Aoxing Technology Co ltd filed Critical Beijing Aoxing Technology Co ltd
Priority to CN202311559023.1A priority Critical patent/CN117591456A/en
Publication of CN117591456A publication Critical patent/CN117591456A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • G06F13/40Bus structure
    • G06F13/4063Device-to-bus coupling
    • G06F13/4068Electrical coupling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38Information transfer, e.g. on bus
    • G06F13/42Bus transfer protocol, e.g. handshake; Synchronisation
    • G06F13/4282Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2213/00Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F2213/0026PCI express
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a network shared data storage system, comprising: the system comprises a central processing unit, a system disk, a domestic bridge chip, a plurality of solid state disks and two interface conversion chips; the domestic bridge chip is in communication connection with the central processing unit and each interface conversion chip; the domestic bridge chip is in communication connection with each solid state disk based on the PCIE interface; the first interface conversion chip sends the data request to the central processing unit through the domestic bridge chip; the central processing unit sends storage control information or reading control information to the domestic bridge chip based on the data request; when the domestic bridge chip receives the storage control information, performing data storage operation; and when receiving the reading control information, performing data reading operation to obtain target data, and externally feeding back the target data by the second interface conversion chip. By applying the system provided by the invention, data can be read and written to a plurality of solid state disks based on the PCIE interface at the same time, so that the data reading and writing speed can be increased, and the reading and writing performance can be improved.

Description

Network shared data storage system
Technical Field
The invention relates to the technical field of data storage, in particular to a network sharing data storage system.
Background
With the development of computer technology, various computer systems have been widely used in various fields. In a practical application environment, various types of computer systems are typically deployed in the form of small-sized and reinforced devices, such as 3U devices, 6uv px devices, and the like.
Solid State Disk (SSD) is one of the common storage media in the small-sized reinforcement device, but because the computing unit inside the computing module of the small-sized reinforcement device occupies a large amount of space and circuit interfaces, it is difficult to implement data storage by using the SSD, and it is generally required to construct a data storage system based on the SSD, that is, construct a storage module, so that the computing module accesses the data storage system through a network to perform data access. The data storage system in the existing small-sized reinforcement equipment is generally based on an SATA interface to interface with an SSD, so as to realize data access. The SATA interface refers to a serial ATA (Serial ATA) interface.
In practical application scenarios, requirements for high-performance storage of small-sized reinforcement equipment are increasing. Based on the existing data storage system, data transmission is realized in the data storage system through the SATA interface, and the upper limit of the bandwidth which can be achieved by the SATA interface is lower, so that the read-write performance of the existing data storage system in the data access process is very limited, and the working efficiency of the small-sized reinforcement equipment is lower.
Disclosure of Invention
In view of the above, the embodiment of the invention provides a network shared data storage system, so as to solve the problem that the working efficiency of equipment is low due to poor read-write performance when the data is read based on an SATA interface in the existing data storage system.
In order to achieve the above object, the embodiment of the present invention provides the following technical solutions:
a network shared data storage system, comprising:
the system comprises a central processing unit, a system disk, a domestic bridge chip, a plurality of solid state disks, a first interface conversion chip and a second interface conversion chip;
the domestic bridge chip is respectively in communication connection with the central processor, the first interface conversion chip and the second interface conversion chip;
the domestic bridge chip is respectively connected with each solid state disk in a communication way based on a high-speed serial computer expansion bus standard PCIE interface;
the system disk is used for deploying an operating system;
the first interface conversion chip is used for receiving a data request sent by an external module through a network, performing interface conversion on the data request, and sending the data request to the central processing unit through the domestic bridge chip;
The central processing unit is used for determining storage control information corresponding to the data request when the data request is a data storage request, and sending the storage control information to the domestic bridge chip; when the data request is a data reading request, judging whether the data request accords with a preset reading condition, if so, determining reading control information corresponding to the data request, and sending the reading control information to the domestic bridge chip;
the domestic bridge chip is used for determining data to be stored when the storage control information is received, and performing data storage processing on the data to be stored so that the data to be stored are stored in each solid state disk; when the reading control information is received, carrying out data reading processing on each solid state disk to obtain target data, and sending the target data to the second interface conversion chip;
the second interface conversion chip is used for performing interface conversion on the target data so as to send the target data to the external module through a network.
The above network sharing data storage system, optionally, further includes: a power supply unit;
The power supply unit is used for supplying power to the central processing unit, the system disk, the domestic bridge chip, each solid state disk, the first interface conversion chip and the second interface conversion chip.
In the above network sharing data storage system, optionally, the domestic bridge chip is an LS7a1000 bridge chip.
In the above network sharing data storage system, optionally, the mode that the central processing unit is connected with the system disk in a communication manner is as follows: performing communication connection based on the SATA interface;
the mode of communication connection between the domestic bridge chip and the central controller is as follows: communication connection is carried out based on an HT bus interface;
the mode of communication connection between the domestic bridge chip and the first interface conversion chip and the mode of communication connection between the domestic bridge chip and the second interface conversion chip are as follows: communication connection is performed based on the GMAC interface.
In the network sharing data storage system, optionally, the number of the plurality of solid state disks is four.
In the above network sharing data storage system, optionally, the determining storage control information corresponding to the data request includes:
randomly generating a first key file;
generating a data storage instruction corresponding to the data request;
And taking the first key file and the data storage instruction as the storage control information.
In the above network sharing data storage system, optionally, the performing data storage processing on the data to be stored includes:
carrying out data splitting processing on the data to be stored to obtain a plurality of groups of split data corresponding to the data to be stored; the multiple groups of split data are in one-to-one correspondence with the multiple solid state disks;
respectively carrying out data encryption processing on each group of split data according to the first key file to obtain encrypted data corresponding to each group of split data;
and storing the encrypted data corresponding to each group of split data into the solid state disk corresponding to the split data.
In the above network sharing data storage system, optionally, the determining whether the data request meets a preset reading condition includes:
determining a second key file; the second key file is a key file carried in the data request;
determining a third key file corresponding to the data request in each generated key file;
judging whether the second key file is matched with the third key file or not;
And if the second key file is matched with the third key file, determining that the data request meets the reading condition.
In the above network shared data storage system, optionally, the determining the read control information corresponding to the data request includes:
generating a data reading instruction corresponding to the data request;
and taking the second key file and the data reading instruction as the reading control information.
In the above network sharing data storage system, optionally, the performing data reading processing on each of the solid state disks to obtain target data includes:
for each solid state disk, reading data corresponding to the data reading instruction from the solid state disk, and taking the read data as grouping data corresponding to the solid state disk;
respectively carrying out data decryption processing on the packet data corresponding to each solid state disk according to the second key file to obtain decrypted data corresponding to each packet data;
and carrying out data combination processing on each decrypted data to obtain combined data, and taking the combined data as the target data.
Based on the above-mentioned embodiment of the present invention, a network shared data storage system includes: the system comprises a central processing unit, a system disk for deploying an operating system, a domestic bridge chip, a plurality of solid state disks, a first interface conversion chip and a second interface conversion chip; the domestic bridge chip is respectively in communication connection with the central processor, the first interface conversion chip and the second interface conversion chip; the domestic bridge chip is respectively connected with each solid state disk in a communication way based on the PCIE interface; the first interface conversion chip is used for receiving the data request sent by the external module through the network, carrying out interface conversion on the data request and sending the data request to the central processing unit through the domestic bridge chip; the central processing unit is used for determining storage control information and sending the storage control information to the domestic bridge chip when the data request is a data storage request; when the data request is a data reading request, judging whether the data request meets a preset reading condition, if so, determining reading control information, and sending the reading control information to a domestic bridge chip; the domestic bridge chip is used for determining data to be stored when receiving the storage control information, and carrying out data storage processing on the data to be stored so as to store the data to be stored into each solid state disk; when receiving the reading control information, performing data reading processing on each solid state disk to obtain target data, and sending the target data to a second interface conversion chip; and the second interface conversion chip is used for performing interface conversion on the target data so as to send the target data to the external module through the network. By applying the system provided by the embodiment of the invention, the data access is realized by adopting the domestic bridge chip and the solid state disk which can be connected based on the PCIE interface communication, in the data access process, the data read-write is performed based on the PCIE interface, and the upper bandwidth limit of the PCIE interface is far higher than that of the SATA interface, so that the data read-write speed can be improved, the read-write performance of the data storage system can be improved, and the work efficiency of the equipment can be improved. Secondly, a plurality of solid state disks are deployed in the system, data can be stored in each solid state disk in a split mode, and in the data reading and writing process, synchronous reading and writing can be carried out on each solid state disk, so that the data reading and writing speed can be further improved, and the reading and writing performance is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a network shared data storage system according to an embodiment of the present invention;
FIG. 2 is an exemplary diagram of a network shared data storage system according to an embodiment of the present invention;
FIG. 3 is an exemplary diagram of a data flow in a data storage process according to an embodiment of the present invention;
fig. 4 is an exemplary diagram of a data flow in a data reading process according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In this application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
As known from the background art, in the existing data storage system, a storage management chip of a SATA interface and a corresponding SSD are generally adopted, but the upper limit of the interface bandwidth of the SATA interface is 6Gbps at present, which can achieve poor read-write performance, so that the data reading speed is low, and the working efficiency of the application device is affected.
Therefore, the embodiment of the invention provides a network shared data storage system, which can realize data storage by using a domestic bridge chip and SSD which are in communication connection based on a PCIE interface, and can read and write data based on the PCIE interface, so that the data reading speed is improved, and the read and write performance is improved.
The embodiment of the invention provides a network sharing data storage system which can be applied to small-sized reinforcement equipment, and each module in the equipment can access data through a network access data storage system (namely the network sharing data storage system). A schematic structural diagram of a system provided by an embodiment of the present invention is shown in FIG. 1, and the system includes:
the system comprises a central processor 101, a system disk 102, a domestic bridge chip 103, a plurality of solid state disks 104, a first interface conversion chip 105 and a second interface conversion chip 106;
the central processing unit 101 is in communication connection with the system disk 102, and the domestic bridge chip 103 is in communication connection with the central processing unit 101, the first interface conversion chip 105 and the second interface conversion chip 106 respectively;
the domestic bridge chip 103 is respectively in communication connection with each solid state disk 104 based on a high-speed serial computer expansion bus standard PCIE interface;
the system disk 102 is used for deploying an operating system;
the first interface conversion chip 105 is configured to receive a data request sent by an external module through a network, and perform interface conversion on the data request, so as to send the data request to the central processing unit through the domestic bridge chip;
The central processing unit 101 is configured to determine storage control information corresponding to the data request when the data request is a data storage request, and send the storage control information to the domestic bridge chip; when the data request is a data reading request, judging whether the data request accords with a preset reading condition, if so, determining reading control information corresponding to the data request, and sending the reading control information to the domestic bridge chip;
the domestic bridge chip 103 is configured to determine data to be stored when the storage control information is received, and perform data storage processing on the data to be stored, so that the data to be stored is stored in each solid state disk; when the reading control information is received, carrying out data reading processing on each solid state disk to obtain target data, and sending the target data to the second interface conversion chip;
the second interface conversion chip 106 is configured to perform interface conversion on the target data, so as to send the target data to the external module through a network.
In the system provided by the embodiment of the invention, a central processing unit (Central Processing Unit, CPU) and a system disk are deployed. The system disk is provided with an operating system, the CPU is in communication connection with the system disk, when the data storage system is powered on, the CPU can start the operating system in the system disk, and when the loading of the operating system is completed, the CPU can execute corresponding control functions based on the operating system.
In the system provided by the embodiment of the invention, domestic bridge chips provided with a plurality of PCIE interfaces are deployed. A plurality of Solid State Disks (SSDs) with PCIE interfaces are deployed in the system, wherein the solid state disks 1, 2 and … and the solid state disks n shown in fig. 1 represent the number of the solid state disks, and n is a positive integer. The PCIE interface is a high-speed serial computer expansion bus standard (Peripheral Component Interconnect Express, PCIE) interface, which is a high-speed serial communication interface. And the n PCIE interfaces on the domestic bridge chip are applied to communication connection with each solid state disk, namely, the n PCIE interfaces on the domestic bridge chip are in one-to-one correspondence with the n solid state disks, and the PCIE interfaces on the domestic bridge chip are connected with the PCIE interfaces on the corresponding solid state disks, so that the communication connection between the domestic bridge chip and the solid state disks is realized. And the domestic bridge chip can read and write data of the corresponding solid state disk through the PCIE interface.
In the system provided by the embodiment of the invention, two interface conversion chips, namely a first interface conversion chip and a second interface conversion chip, are deployed. And two signal interfaces on the domestic bridge chip are respectively connected with the two interface conversion chips in a communication way. The two interface conversion chips are used for realizing the communication between the data storage system and the outside, the first interface conversion chip receives the data signals sent by the outside module through the network interface, performs interface conversion on the data signals, performs signal output through the signal port connected with the domestic bridge chip, and sends the data signals to the domestic bridge chip, and the domestic bridge chip sends the data signals to the CPU through the signal port connected with the CPU. The second interface conversion chip receives the data signals sent by the domestic bridge chip through a signal port connected with the domestic bridge chip, performs interface conversion on the data signals, outputs the data signals through a network interface, and sends the data signals to an external module through a network. The network in the embodiment of the invention refers to the ethernet, and the network interface is the ethernet interface.
When external modules such as a computing module of the device need to access data, the data request can be sent to a first interface conversion chip of the data storage system through a network, and the service born by the data storage system comprises data storage and data reading, so that the corresponding data request can be a data storage request or a data reading request. If the data request is a data storage request, the data request carries data to be stored, i.e. data to be stored. If the data request is a data reading request, the data request carries a data identifier representing the data to be read.
When the first interface conversion chip receives the data request, the first interface conversion chip performs interface conversion on the data request, the data request is sent to the domestic bridge chip through communication connection with the domestic bridge chip, and after the domestic bridge chip receives the data request, the data request is sent to the CPU through communication connection with the CPU.
When the CPU receives a data request, the data request is analyzed, if the received data request is a data storage request, storage control information is determined based on the data request, and the storage control information is information for indicating a domestic bridge chip to perform data storage processing on data to be stored according to a preset data storage strategy.
In the system provided by the embodiment of the invention, the reading condition can be preset according to the actual requirement, namely, the condition which needs to be met by the external module for reading the data can be understood as the condition for identifying whether the external module has the reading authority of the data to be read. If the data request received by the CPU is a data reading request, the CPU firstly judges whether the data request meets a preset reading condition, and if so, the CPU determines reading control information based on the data request, wherein the reading control information is information for indicating a domestic bridge chip to read corresponding data from each solid state disk according to a preset data reading strategy.
After the CPU obtains the storage control information or reads the control information, the CPU can send corresponding information to the domestic bridge chip through communication connection with the domestic bridge chip to control the domestic bridge chip to perform corresponding data processing operation.
When the domestic bridge chip receives the storage control information, the data to be stored can be obtained based on the storage control information, the data to be stored is written into the solid state disk through the PCIE interface according to a preset data storage strategy, the data to be stored is stored in each solid state disk, specifically, the data to be stored can be split and stored, for example, the data to be stored is split into a plurality of parts according to the number of the solid state disks, the split data is respectively stored in each solid state disk, and one part of data is stored in each solid state disk. It should be noted that, the data storage policy may be set according to actual requirements, for example, the data to be stored may also be stored in a solid state disk or a part of solid state disk separately, which does not affect the system implementation function provided by the embodiment of the present invention.
When the domestic bridge chip receives the read control information, the data identification of the data to be read can be obtained based on the read control information, data reading processing is carried out on each solid state disk according to a preset data reading strategy, corresponding data are read from the solid state disk based on the PCIE interface, target data corresponding to the data identification are obtained, and the target data are sent to the second interface conversion chip through communication connection with the second interface conversion chip. The data reading strategy corresponds to the data storage strategy, for example, if the data is stored in a split storage mode, when the data is read, the corresponding data are respectively read from each solid state disk, and the read data are combined to obtain the whole data.
The system provided by the embodiment of the invention comprises: the system comprises a Central Processing Unit (CPU), a system disk, a domestic bridge chip, a plurality of solid state disks, a first interface conversion chip and a second interface conversion chip; each object with interaction requirements is in communication connection, wherein the domestic bridge chip is in communication connection with each solid state disk based on the PCIE interface; the first interface conversion chip is used for receiving the data request sent by the external module through the network, carrying out interface conversion on the data request and sending the data request to the CPU through the domestic bridge chip; when the data request is a data storage request, the CPU determines storage control information and sends the information to the domestic bridge chip; when the data request is a data reading request, the CPU judges whether the data request meets a preset reading condition, if so, the CPU determines reading control information and sends the information to a domestic bridge chip; when the domestic bridge chip receives the storage control information, carrying out data storage processing on the data to be stored, so that the data to be stored is stored in each solid state disk; when the reading control information is received, data reading processing is carried out to obtain target data, the target data is sent to the second interface conversion chip, the second interface conversion chip carries out interface conversion on the target data, and the target data is sent to an external module through a network. By applying the system provided by the embodiment of the invention, the data access is realized by adopting the domestic bridge chip and the solid state disk which can be connected based on the PCIE interface communication, in the data access process, the data read-write is performed based on the PCIE interface, and the upper bandwidth limit of the PCIE interface is far higher than that of the SATA interface, so that the data read-write speed can be improved, the read-write performance of the data storage system can be improved, and the work efficiency of the equipment can be improved. Secondly, a plurality of solid state disks are deployed in the system, data can be stored in each solid state disk in a split mode, and in the data reading and writing process, synchronous reading and writing can be carried out on each solid state disk, so that the data reading and writing speed can be further improved, and the reading and writing performance is improved.
On the basis of the system shown in fig. 1, the system provided by the embodiment of the invention further includes: a power supply unit;
the power supply unit is used for supplying power to the central processing unit, the system disk, the domestic bridge chip, each solid state disk, the first interface conversion chip and the second interface conversion chip.
The power supply unit is deployed in the system provided by the embodiment of the invention, and can supply power for the object with power consumption requirement in the system through the power supply unit in the system.
Based on the system shown in fig. 1, in the system provided by the embodiment of the invention, the domestic bridge chip is an LS7a1000 bridge chip.
In the system provided by the embodiment of the invention, the LS7A1000 bridge chip is adopted, and the LS7A1000 bridge chip is an existing domestic chip and is not described in detail herein.
Based on the system shown in fig. 1, in the system provided by the embodiment of the present invention, the manner in which the central processing unit is communicatively connected to the system disk is: performing communication connection based on the SATA interface;
the mode of communication connection between the domestic bridge chip and the central controller is as follows: communication connection is carried out based on an HT bus interface;
the mode of communication connection between the domestic bridge chip and the first interface conversion chip and the mode of communication connection between the domestic bridge chip and the second interface conversion chip are as follows: communication connection is performed based on the GMAC interface.
In the system provided by the embodiment of the invention, the CPU is provided with the SATA interface and the HT bus interface, the system disk is provided with the SATA interface, the domestic bridge chip is provided with the HT bus interface and the GMAC interface, and the first interface conversion chip and the second interface conversion chip are respectively provided with the GMAC interface. The HT bus interface refers to an interface based on the HyperTransport bus technology, which may also be referred to as an HT interface, which is a high-speed communication interface between a CPU and a bridge. The GMAC interface refers to an interface based on gigabit network media access control technology (Gigabit Media Access Controlle, GMAC), which is a high-speed network interface.
One SATA interface on the CPU is connected to one SATA interface on the system disk, and both are in communication connection based on the SATA interface. An HT bus interface on the CPU is connected with an HT bus interface on the domestic bridge chip, and the HT bus interface are in communication connection. One GMAC interface on the domestic bridge chip is connected with one GMAC interface on the first interface conversion chip, the other GMAC interface on the domestic bridge chip is connected with one GMAC interface on the second interface conversion chip, and the domestic bridge chip and the two interface conversion chips are respectively connected in a communication mode based on the GMAC interfaces.
Based on the system shown in fig. 1, in the system provided by the embodiment of the invention, the number of the hard disks of the plurality of solid state disks is four.
The plurality of solid state disks deployed in the system provided by the embodiment of the invention are specifically four solid state disks.
Based on the system shown in fig. 1, in the system provided by the embodiment of the present invention, the determining storage control information corresponding to the data request includes:
randomly generating a first key file;
generating a data storage instruction corresponding to the data request;
and taking the first key file and the data storage instruction as the storage control information.
In the system provided by the embodiment of the invention, when data is required to be stored, the CPU randomly generates a key file, namely the first key file, generates a corresponding data storage instruction, and takes the first key file and the data storage instruction as storage control information to instruct the domestic bridge chip to encrypt and store the data to be stored based on the first key file. Meanwhile, the CPU can send the first key file to the second interface conversion chip through the domestic bridge chip, and send the first key file to the external module through the second interface conversion chip, so that the subsequent external module can read the currently stored data based on the first key file.
Based on the system provided by the above embodiment, in the system provided by the embodiment of the present invention, the data storage processing for the data to be stored includes:
carrying out data splitting processing on the data to be stored to obtain a plurality of groups of split data corresponding to the data to be stored; the multiple groups of split data are in one-to-one correspondence with the multiple solid state disks;
in the system provided by the embodiment of the invention, the data is stored in a data splitting encryption mode. When the domestic bridge chip performs data storage processing, splitting the data to be stored into multiple groups of data according to the number of the solid state disks, namely the multiple groups of split data. The number of the split data is the same as the number of the solid state disks, and the split data corresponds to the solid state disks one by one.
Respectively carrying out data encryption processing on each group of split data according to the first key file to obtain encrypted data corresponding to each group of split data;
in the system provided by the embodiment of the invention, the first key file is respectively embedded into each split data so as to encrypt the data of each split data to obtain a plurality of encrypted data.
And storing the encrypted data corresponding to each group of split data into the solid state disk corresponding to the split data.
In the system provided by the embodiment of the invention, each encrypted data is written into the corresponding solid state disk, namely, the encrypted data is written into the solid state disk corresponding to the split data. For example, the system is provided with a solid state disk 1, a solid state disk 2, a solid state disk 3 and a solid state disk 4, and data to be stored are split into: splitting data a corresponding to the solid state disk 1, splitting data b corresponding to the solid state disk 2, splitting data c corresponding to the solid state disk 3 and splitting data d corresponding to the solid state disk 4, then writing the encrypted data of the splitting data a into the solid state disk 1, writing the encrypted data of the splitting data b into the solid state disk 2, writing the encrypted data of the splitting data c into the solid state disk 3, and writing the encrypted data of the splitting data d into the solid state disk 4.
The system provided by the embodiment of the invention can encrypt and store the data based on the key file, and if the data in the solid state disk is separated from the system to extract, the actual data information cannot be obtained, so that the data security is guaranteed. Secondly, the system adopts split storage, and the data to be stored is split and stored in each solid state disk, so that the writing operation can be carried out on each solid state disk at the same time, and the data volume written in a single solid state disk is only partial data volume, thereby being beneficial to improving the overall processing speed of data writing and further improving the reading and writing performance.
Based on the system shown in fig. 1, in the system provided by the embodiment of the present invention, the determining whether the data request meets a preset reading condition includes:
determining a second key file; the second key file is a key file carried in the data request;
in the system provided by the embodiment of the invention, a data encryption storage mode is adopted, and when a data request is a data reading request, whether the data request provides a matched key file is judged as a reading condition, namely the condition requirement of the reading condition is that the key file matched with the data to be read is provided.
And when judging whether the data request accords with the preset reading condition, analyzing the data request to acquire a key file carried in the data request, and taking the key file as a second key file.
In the actual application process, if the data request does not carry the key file in the scene of data encryption storage, the data request can be directly determined that the data request does not accord with the preset reading condition, and the data request is refused.
Determining a third key file corresponding to the data request in each generated key file;
in the system provided by the embodiment of the invention, the data to be extracted can be indicated based on the data request, and the key file matched with the data request is found out from the generated key files and is used as the third key file. Each generated key file is a key file generated when data is previously stored in the data storage system during operation, and the third key file is a key file generated when the data request indicates read data is stored, that is, a key file applied to encrypt the data.
Judging whether the second key file is matched with the third key file or not;
in the system provided by the embodiment of the invention, the second key file and the third key file can be compared, if the second key file and the third key file are the same file, the second key file and the third key file are considered to be matched, and if the second key file and the third key file are different, the second key file and the third key file are considered to be unmatched.
And if the second key file is matched with the third key file, determining that the data request meets the reading condition.
In the system provided by the embodiment of the invention, if the second key file is matched with the third key file, the data request is considered to be in accordance with the reading condition. And if the second key file is not matched with the third key file, the data request is not considered to be in accordance with the reading condition.
Based on the system provided by the foregoing embodiment, in the system provided by the embodiment of the present invention, the determining the read control information corresponding to the data request includes:
generating a data reading instruction corresponding to the data request;
and taking the second key file and the data reading instruction as the reading control information.
In the system provided by the embodiment of the invention, when data reading is needed, the CPU generates a corresponding data reading instruction based on the data request, takes the second key file and the data reading instruction as reading control information, instructs the domestic bridge chip to read the corresponding data, and decrypts the data based on the second key file.
Based on the system provided by the above embodiment, in the system provided by the embodiment of the present invention, the data reading processing is performed on each of the solid state disks to obtain target data, including:
for each solid state disk, reading data corresponding to the data reading instruction from the solid state disk, and taking the read data as grouping data corresponding to the solid state disk;
in the system provided by the embodiment of the invention, a storage mode of splitting and storing data is adopted, so that when data is read, the data stored in the solid state disk in a splitting way is required to be read in groups, namely the data are required to be read from each solid state disk respectively. The domestic bridge chip can read corresponding data from each solid state disk based on the data reading instruction, and the data read from the solid state disk is used as grouping data corresponding to the solid state disk.
Respectively carrying out data decryption processing on the packet data corresponding to each solid state disk according to the second key file to obtain decrypted data corresponding to each packet data;
in the system provided by the embodiment of the invention, for each piece of packet data, the data is decrypted through the second key file to obtain the decrypted data of the packet data.
And carrying out data combination processing on each decrypted data to obtain combined data, and taking the combined data as the target data.
In the system provided by the embodiment of the invention, the decryption data of each packet data are combined, and the combined data are used as target data, namely the data which need to be read by the current external module.
Based on the system provided by the embodiment of the invention, the data can be extracted in a grouping way under the condition of splitting, encrypting and storing the data, decrypted and combined, and the complete original data is provided for an external module, so that the normal data reading service is provided under the condition of guaranteeing the safety of storing the data, and the external module is not required to perform additional operation. And secondly, the system extracts data in groups, and can simultaneously perform data reading operation on each solid state disk, wherein the data quantity read from a single solid state disk is only partial data quantity, thereby being beneficial to improving the overall processing speed of data reading and further improving the reading and writing performance.
In order to better illustrate the system provided by the embodiment of the present invention, on the basis of the system provided by the foregoing embodiment, in combination with an actual application scenario, the embodiment of the present invention provides another network sharing data storage system. The system is applied to small-sized reinforcement equipment, can be regarded as a storage module of the equipment, and is used for realizing data storage of a calculation module of the equipment.
An exemplary diagram of a structure of a memory module, i.e., a data storage system, provided in an embodiment of the present invention may be shown in fig. 2.
The storage module provided by the embodiment of the invention consists of a CPU, an LS7A1000 bridge chip, four solid state disks SSD, two interface conversion chips, a system disk and a power supply unit.
As shown in fig. 2, the SATA interface of the CPU is connected to a system disk and is in communication with the LS7a1000 bridge chip through an HT interface, the four SSDs are respectively connected to four PCIE interfaces (PCIE 2.0 versions) of the LS7a1000 bridge chip, each PCIE interface provides four groups of high-speed lines (each group of PCIE high-speed lines has a bandwidth of 5 Gbps), that is, the LS7a1000 bridge chip is respectively in communication with the four SSDs through four PCIE 2.0x4 interfaces, and the total bandwidth of four groups of high-speed lines in each PCIE 2.0x4 interface is 20Gbps. The interface conversion chip A converts the GMAC interface of the LS7A1000 bridge chip into a network interface, and the interface conversion chip B converts the network interface into the GMAC interface, so that the LS7A1000 bridge chip and the computing module are interconnected. The computing module can communicate with the LS7A1000 bridge chip through a network and an interface conversion chip. The power supply unit provides the required electric energy for the CPU, the LS7A1000 bridge chip, the interface conversion chips and the SSD.
The computing module and the storage module are interconnected through two groups of networks, wherein one group is used for extracting data, and the other group is used for storing data. When the storage module starts to work, the power supply unit provides necessary electric energy for the storage module to support the CPU, LS7A1000 bridge chip, interface conversion chip and SSD to work. When the storage module is powered on to work, the CPU starts an operating system in a system disk, and after the operating system is loaded, the CPU can access the LS7A1000 bridge chip through the HT interface. Under the operating system, the CPU recognizes four SSDs through the PCIE 2.0x4 interface of the LS7A1000 bridge chip. The CPU combines the four SSDs into a large storage space (the storage capacity is the sum of the four SSDs), the disk symbol displayed under the operating system is a D disk, the storage capacity of the D disk is the sum of the four SSDs, the bandwidth of each PCIE 2.0x4 interface is 20Gbps, the four disks use 4 PCIE 2.0x4 interfaces, and the total data read-write bandwidth is 80Gbps.
In the data storage process of the storage module, the data flow of the data signal may be as shown in fig. 3, and the data storage process mainly includes:
when the calculation module stores data into the SSD, the data in the calculation module enters a GMAC1 interface of the LS7A1000 bridge chip through the interface conversion chip B by a network. The CPU on the storage module randomly generates a key file, the LS7A1000 bridge chip is controlled to split data into four parts according to a preset algorithm, each part of data is encrypted based on the key file, the four parts of encrypted data are in one-to-one correspondence with four SSDs, the corresponding part of data is stored in each SSD, and the LS7A1000 bridge chip can write the encrypted data into corresponding positions of the SSDs in the D disk respectively and simultaneously through PCIE0, PCIE1, PCIE2 and PCIE 3. Meanwhile, the key file can be sent to the computing module through the interface conversion chip A so as to be convenient for the computing module to read the data subsequently.
In the process of reading data from the memory module, the data flow of the data signal may be as shown in fig. 4, and the process of reading data mainly includes:
when the computing module reads the data in the SSD, the reading notification of the computing module enters a GMAC1 interface of the LS7A1000 bridge chip through the interface conversion chip B and then is sent to the CPU through an HT interface of the LS7A1000 bridge chip. And a CPU on the storage module reads the key file carried in the notification to confirm, if the key file is confirmed to be correct, the LS7A1000 bridge chip is accessed to the D disk, the LS7A1000 bridge chip is controlled to acquire data required by the calculation module from the corresponding position of each SSD, the data are simultaneously extracted to the LS7A1000 bridge chip through PCIE0, PCIE1, PCIE2 and PCIE3 interfaces, the CPU controls the LS7A1000 bridge chip to decrypt the four data according to a preset algorithm based on the key file, the decrypted four data are combined into one complete data, the four complete data are accessed to the network through the interface conversion chip A by the GMAC0 interface of the LS7A1000 bridge chip, and the calculation module reads the data in the SSD through the network.
Based on the system provided by the embodiment of the invention, the domestic LS7A1000 bridge chip is adopted for storage management, so that the nationwide production of the storage module can be realized, the domestic LS7A1000 bridge chip can be adopted for realizing the high-bandwidth storage performance, and the confidentiality function of data can be realized while the data is accessed.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. The systems and system embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A network shared data storage system, comprising:
the system comprises a central processing unit, a system disk, a domestic bridge chip, a plurality of solid state disks, a first interface conversion chip and a second interface conversion chip;
the domestic bridge chip is respectively in communication connection with the central processor, the first interface conversion chip and the second interface conversion chip;
the domestic bridge chip is respectively connected with each solid state disk in a communication way based on a high-speed serial computer expansion bus standard PCIE interface;
the system disk is used for deploying an operating system;
The first interface conversion chip is used for receiving a data request sent by an external module through a network, performing interface conversion on the data request, and sending the data request to the central processing unit through the domestic bridge chip;
the central processing unit is used for determining storage control information corresponding to the data request when the data request is a data storage request, and sending the storage control information to the domestic bridge chip; when the data request is a data reading request, judging whether the data request accords with a preset reading condition, if so, determining reading control information corresponding to the data request, and sending the reading control information to the domestic bridge chip;
the domestic bridge chip is used for determining data to be stored when the storage control information is received, and performing data storage processing on the data to be stored so that the data to be stored are stored in each solid state disk; when the reading control information is received, carrying out data reading processing on each solid state disk to obtain target data, and sending the target data to the second interface conversion chip;
The second interface conversion chip is used for performing interface conversion on the target data so as to send the target data to the external module through a network.
2. The network shared data storage system of claim 1, further comprising: a power supply unit;
the power supply unit is used for supplying power to the central processing unit, the system disk, the domestic bridge chip, each solid state disk, the first interface conversion chip and the second interface conversion chip.
3. The network shared data storage system of claim 1, wherein the homemade bridge chip is an LS7a1000 bridge.
4. The network shared data storage system of claim 1, wherein the central processing unit is communicatively coupled to the system disk in the manner of: performing communication connection based on the SATA interface;
the mode of communication connection between the domestic bridge chip and the central controller is as follows: communication connection is carried out based on an HT bus interface;
the mode of communication connection between the domestic bridge chip and the first interface conversion chip and the mode of communication connection between the domestic bridge chip and the second interface conversion chip are as follows: communication connection is performed based on the GMAC interface.
5. The network shared data storage system of claim 1, wherein the number of hard disks of the plurality of solid state disks is four.
6. The network shared data storage system of claim 1, wherein the determining storage control information corresponding to the data request comprises:
randomly generating a first key file;
generating a data storage instruction corresponding to the data request;
and taking the first key file and the data storage instruction as the storage control information.
7. The network shared data storage system of claim 6, wherein the data storage processing of the data to be stored comprises:
carrying out data splitting processing on the data to be stored to obtain a plurality of groups of split data corresponding to the data to be stored; the multiple groups of split data are in one-to-one correspondence with the multiple solid state disks;
respectively carrying out data encryption processing on each group of split data according to the first key file to obtain encrypted data corresponding to each group of split data;
and storing the encrypted data corresponding to each group of split data into the solid state disk corresponding to the split data.
8. The network shared data storage system of claim 1, wherein the determining whether the data request meets a preset read condition comprises:
determining a second key file; the second key file is a key file carried in the data request;
determining a third key file corresponding to the data request in each generated key file;
judging whether the second key file is matched with the third key file or not;
and if the second key file is matched with the third key file, determining that the data request meets the reading condition.
9. The network shared data storage system of claim 8, wherein the determining the read control information corresponding to the data request comprises:
generating a data reading instruction corresponding to the data request;
and taking the second key file and the data reading instruction as the reading control information.
10. The network shared data storage system according to claim 9, wherein the performing data reading processing on each of the solid state disks to obtain target data includes:
for each solid state disk, reading data corresponding to the data reading instruction from the solid state disk, and taking the read data as grouping data corresponding to the solid state disk;
Respectively carrying out data decryption processing on the packet data corresponding to each solid state disk according to the second key file to obtain decrypted data corresponding to each packet data;
and carrying out data combination processing on each decrypted data to obtain combined data, and taking the combined data as the target data.
CN202311559023.1A 2023-11-21 2023-11-21 Network shared data storage system Pending CN117591456A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311559023.1A CN117591456A (en) 2023-11-21 2023-11-21 Network shared data storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311559023.1A CN117591456A (en) 2023-11-21 2023-11-21 Network shared data storage system

Publications (1)

Publication Number Publication Date
CN117591456A true CN117591456A (en) 2024-02-23

Family

ID=89909404

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311559023.1A Pending CN117591456A (en) 2023-11-21 2023-11-21 Network shared data storage system

Country Status (1)

Country Link
CN (1) CN117591456A (en)

Similar Documents

Publication Publication Date Title
CN108345806A (en) A kind of hardware encryption card and encryption method
CN107256363B (en) High-speed encryption and decryption device composed of encryption and decryption module array
KR20170034425A (en) Technologies for accelerating compute intensive operations using solid state drives
CN102255888A (en) Method and apparatus for secure scan of Data storage device from remote server
CN104364760B (en) Using the parallel computation of multiple memory devices
CN209803788U (en) PCIE credible password card
CN111131130B (en) Key management method and system
CN109067523A (en) A kind of data ciphering method of encrypted card
CN114417436A (en) Security subsystem
CN109104275A (en) A kind of HSM equipment
CN113168365A (en) Memory device and managed memory system with wireless debug communications port and method of operating the same
US11416615B2 (en) Configuring trusted remote management communications using UEFI
CN111967065B (en) Data protection method, processor and electronic equipment
US9282083B2 (en) Encryption system and method
CN115408707A (en) Data transmission method, device and system, electronic equipment and storage medium
US20240184899A1 (en) Methods and apparatus for offloading encryption
US11544205B2 (en) Peer storage devices sharing host control data
US10678708B2 (en) Encrypted raid drive management
CN113449349A (en) Platform security mechanism
TWI789291B (en) Module and method for authenticating data transfer between a storage device and a host device
CN117591456A (en) Network shared data storage system
US20220368851A1 (en) Removable Storage Device with a Virtual Camera for Video Surveillance as a Service
CN104580181A (en) Device and method for data encryption and encryption accelerator engine
CN117473573B (en) SATA interface system and data security ferrying method
CN210246806U (en) Storage system for container cluster

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination