CN113452730B - Object reading management method and device, electronic equipment and computer storage medium - Google Patents

Object reading management method and device, electronic equipment and computer storage medium Download PDF

Info

Publication number
CN113452730B
CN113452730B CN202010216577.1A CN202010216577A CN113452730B CN 113452730 B CN113452730 B CN 113452730B CN 202010216577 A CN202010216577 A CN 202010216577A CN 113452730 B CN113452730 B CN 113452730B
Authority
CN
China
Prior art keywords
target object
reading
request
server
cloud gateway
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010216577.1A
Other languages
Chinese (zh)
Other versions
CN113452730A (en
Inventor
袁经凯
王磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Cloud Computing Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN202010216577.1A priority Critical patent/CN113452730B/en
Publication of CN113452730A publication Critical patent/CN113452730A/en
Application granted granted Critical
Publication of CN113452730B publication Critical patent/CN113452730B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/143Termination or inactivation of sessions, e.g. event-controlled end of session
    • H04L67/145Termination or inactivation of sessions, e.g. event-controlled end of session avoiding end of session, e.g. keep-alive, heartbeats, resumption message or wake-up for inactive or interrupted session

Landscapes

  • Health & Medical Sciences (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention discloses an object reading management method, an object reading management device, electronic equipment and a computer storage medium, wherein the method comprises the following steps: receiving a target object reading request sent by an object reading requester through a server; acquiring the target object identification information according to the target object reading request, generating an acquisition target object request according to the target object identification information, and sending the acquisition target object request to an object storage service system; and responding to the received waiting target object instruction sent by the object storage service system, and forwarding the waiting target object instruction to the server. Compared with the prior art, the technical scheme improves the working efficiency, reduces the waste of time cost and resource cost, and can effectively avoid potential safety risk hazards.

Description

Object reading management method and device, electronic equipment and computer storage medium
Technical Field
The embodiment of the invention relates to the technical field of object storage, in particular to an object reading management method and device, electronic equipment and a computer storage medium.
Background
With the development of data technology, an object storage scheme capable of realizing automatic and intelligent storage and improving storage efficiency is widely applied. The object storage is a general mass distributed storage system, and can perform archival storage on mass cold data in order to reduce the Total Cost of Ownership (TCO) of the whole. However, most of the existing applications of users use a standard POSIX (Portable Operating System Interface of UNIX) file Interface to store and manage data, so for the management of archive storage, users cannot directly operate an object Interface, or the users use the object Interface to unfreeze an object first and then switch tools to access the object by means of the file Interface; or make a major transformation of the user's existing applications. The first processing method involves switching tools, so that the working efficiency is low, and the second processing method needs to spend a large amount of time cost and resource cost and also brings safety risk.
Disclosure of Invention
The embodiment of the invention provides an object reading management method and device, electronic equipment and a computer storage medium.
In a first aspect, an embodiment of the present invention provides an object reading management method, which is applicable to a cloud gateway.
Specifically, the object reading management method includes:
receiving a target object reading request sent by an object reading requester through a server, wherein the target object reading request at least carries target object identification information;
acquiring the target object identification information according to the target object reading request, generating an acquisition target object request according to the target object identification information, and sending the acquisition target object request to an object storage service system so that the object storage service system acquires and returns the target object according to the acquisition target object request, wherein the target object request at least carries the target object identification information;
and responding to a waiting target object instruction sent by the object storage service system, forwarding the waiting target object instruction to the server so as to enable the server and the object reading requester to keep connection without interruption, and further enable the object reading requester to send a target object re-reading request.
With reference to the first aspect, in a first implementation manner of the first aspect, the obtaining, according to the target object read request, the target object identification information, generating a target object obtaining request according to the target object identification information, and sending the target object obtaining request to an object storage service system further includes:
the method comprises the steps of responding to a received target object non-acquirable message sent by an object storage service system, sending a request for acquiring a target object storage type to the object storage service system, responding to a received target object storage type notification message sent by the object storage service system, and sending a target object unfreezing request to the object storage service system when the target object storage type is in a file, so that the object storage service system unfreezes the target object, and sending a target object waiting instruction to the cloud gateway.
With reference to the first aspect and the first implementation manner of the first aspect, in a second implementation manner of the first aspect, an embodiment of the present invention further includes:
and responding to the target object sent by the object storage service system, and sending the target object to the object reading requester through the server.
With reference to the first aspect, the first implementation manner of the first aspect, and the second implementation manner of the first aspect, in a third implementation manner of the first aspect, the present disclosure further includes:
responding to a target object re-reading request sent by the object reading requester through the server, acquiring the target object identification information according to the target object re-reading request, generating a re-acquisition target object request according to the target object identification information, sending the re-acquisition target object request to an object storage service system until a target object sent by the object storage service system is received, and sending the target object to the object reading requester through the server, wherein the target object re-reading request at least carries the target object identification information.
In a second aspect, an embodiment of the present invention provides an object reading management method, which is applicable to an object storage service system.
Specifically, the object reading management method includes:
in response to receiving a target object obtaining request sent by a cloud gateway, obtaining target object identification information according to the target object obtaining request, wherein the target object request at least carries the target object identification information;
reading the target object according to the target object identification information;
and when the storage type of the target object is determined to be archived, sending a target object waiting instruction to the cloud gateway, so that the cloud gateway forwards the target object waiting instruction to the server, keeping the connection between the server and the object reading requester uninterrupted, and further enabling the object reading requester to send a target object re-reading request.
With reference to the second aspect, in a first implementation manner of the second aspect, the sending a target object waiting instruction to the cloud gateway when it is determined that the target object storage type is archive includes:
when the storage type of the target object is determined to be archived, sending a message that the target object cannot acquire to the cloud gateway;
sending a target object storage type notification message to the cloud gateway in response to receiving a target object storage type acquisition request sent by the cloud gateway;
and in response to receiving a target object unfreezing request sent by the cloud gateway, unfreezing the target object, and sending a target object waiting instruction to the cloud gateway.
With reference to the second aspect and the first implementation manner of the second aspect, in a second implementation manner of the second aspect, the embodiment of the present invention further includes:
responding to a request for obtaining a target object again sent by the cloud gateway, obtaining target object identification information according to the request for obtaining the target object again, reading the target object according to the target object identification information until the target object is obtained by reading, and sending the target object to the cloud gateway so that the cloud gateway sends the target object to the object reading requester through the server, wherein the request for obtaining the target object again at least carries the target object identification information.
In a third aspect, an embodiment of the present invention provides an object reading management method, which is applicable to a server.
Specifically, the object reading management method includes:
responding to a target object reading request sent by the object reading requester, and forwarding the target object reading request to a cloud gateway, wherein the target object reading request at least carries target object identification information;
in response to receiving a target object waiting instruction sent by the cloud gateway, sending a preset message to the object reading requester so as to keep the connection between the server and the object reading requester uninterrupted, and further enabling the object reading requester to send a target object re-reading request;
and in response to receiving a target object re-reading request sent by the object reading requester, forwarding the target object re-reading request to the cloud gateway, wherein the target object re-reading request at least carries target object identification information.
With reference to the third aspect, in a first implementation manner of the third aspect, the preset message is an error message, a target object reading failure message, a waiting prompt message, a message that the target object fails to read but needs to wait, a holding prompt message, or a server object reading requester preset private message.
With reference to the third aspect and the first implementation manner of the third aspect, in a second implementation manner of the third aspect, the embodiment of the present invention further includes:
and responding to the received target object sent by the cloud gateway, and forwarding the target object to the object reading requester.
In a fourth aspect, an embodiment of the present invention provides an object reading management method, which is applicable to an object reading requester.
Specifically, the object reading management method includes:
sending a target object reading request to a cloud gateway through a server, so that the cloud gateway sends a target object obtaining request to an object storage service system according to the target object reading request, and the object storage service system obtains and returns the target object according to the target object obtaining request, wherein the target object reading request and the target object obtaining request at least carry target object identification information;
responding to the received preset message sent by the server, and sending a target object re-reading request to the cloud gateway through the server after preset time until the target object sent by the server is received;
and receiving the target object sent by the server.
With reference to the fourth aspect, in a first implementation manner of the fourth aspect, in the embodiment of the present invention, the preset message is an error message, a target object reading failure message, a waiting prompt message, a message that the target object fails to read but needs to wait, a holding prompt message, or a server object reading requester preset private message.
In a fifth aspect, an embodiment of the present invention provides an object reading management method, which is applicable to an object reading management system including an object reading requester, a server, a cloud gateway, and an object storage service system.
Specifically, the object reading management method includes:
the object reading request direction sends a target object reading request to the server, wherein the target object reading request at least carries target object identification information;
the server responds to a target object reading request sent by the object reading requester, and forwards the target object reading request to the cloud gateway;
the cloud gateway responds to a target object reading request sent by the server, generates a target object obtaining request according to target object identification information carried by the target object reading request and sends the target object obtaining request to an object storage service system;
the object storage service system responds to a received target object acquisition request sent by the cloud gateway, reads a target object according to target object identification information carried by the target object acquisition request, and sends a target object waiting instruction to the cloud gateway when the target object storage type is determined to be archived;
the cloud gateway responds to a target object waiting instruction sent by the object storage service system and forwards the target object waiting instruction to the server;
the server responds to a target object waiting instruction sent by the cloud gateway and sends a preset message to the object reading requester;
the object reading requester responds to the preset message sent by the server and sends a target object re-reading request to the server after a preset time until the target object sent by the server is received;
the server responds to a target object re-reading request sent by the object reading requester, forwards the target object re-reading request to the cloud gateway, and responds to the target object sent by the cloud gateway, forwards the target object to the object reading requester, wherein the target object re-reading request at least carries target object identification information;
the cloud gateway responds to a target object re-reading request sent by the server, generates a re-acquisition target object request according to target object identification information carried by the target object re-reading request, sends the re-acquisition target object request to an object storage service system until receiving a target object sent by the object storage service system, and sends the target object to the server;
and the object storage service system responds to the received request for obtaining the target object again sent by the cloud gateway, reads the target object according to the target object identification information carried by the request for obtaining the target object again until the target object is obtained by reading, and sends the target object to the cloud gateway.
With reference to the fifth aspect, in a first implementation manner of the fifth aspect, when determining that the target object storage type is archive, the object storage service system sends a target object waiting instruction to the cloud gateway, where the target object waiting instruction is implemented as:
when the storage type of the target object is determined to be archived, sending a target object non-acquirable message to the cloud gateway, responding to a received target object storage type acquiring request sent by the cloud gateway, sending a target object storage type notification message to the cloud gateway, responding to a received target object unfreezing request sent by the cloud gateway, performing unfreezing operation on the target object, and sending a target object waiting instruction to the cloud gateway;
after the cloud gateway generates a target object obtaining request according to the target object identification information carried by the target object reading request and sends the target object obtaining request to the object storage service system, the cloud gateway further comprises: the method comprises the steps of responding to a received target object non-acquirable message sent by an object storage service system, sending a request for acquiring a target object storage type to the object storage service system, responding to a received target object storage type notification message sent by the object storage service system, and sending a target object unfreezing request to the object storage service system when the target object storage type is in an archive state.
With reference to the fifth aspect and the first implementation manner of the fifth aspect, in a second implementation manner of the fifth aspect, the preset message is an error message, a target object reading failure message, a waiting prompt message, a message that the target object fails to read but needs to wait, a holding prompt message, or a server object reading requester preset private message.
In a sixth aspect, an embodiment of the present invention provides an object reading management apparatus, which is suitable for a cloud gateway.
Specifically, the object reading management apparatus includes:
the device comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is configured to receive a target object reading request sent by an object reading requester through a server, and the target object reading request at least carries target object identification information;
a first generating module, configured to obtain the target object identification information according to the target object reading request, generate a target object obtaining request according to the target object identification information, and send the target object obtaining request to an object storage service system, so that the object storage service system obtains and returns the target object according to the target object obtaining request, where the target object request at least carries the target object identification information;
the first forwarding module is configured to forward a waiting target object instruction to the server in response to receiving the waiting target object instruction sent by the object storage service system, so that the connection between the server and the object reading requester is maintained without interruption, and the object reading requester sends a target object re-reading request.
In a seventh aspect, an embodiment of the present invention provides an object reading management apparatus, which is applied to an object storage service system.
Specifically, the object reading management apparatus includes:
the cloud gateway comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is configured to respond to a received target object acquisition request sent by the cloud gateway and acquire target object identification information according to the target object acquisition request, and the target object request at least carries the target object identification information;
a first reading module configured to read a target object according to the target object identification information;
and the third sending module is configured to send a target object waiting instruction to the cloud gateway when the storage type of the target object is determined to be archived, so that the cloud gateway forwards the target object waiting instruction to the server, the connection between the server and the object reading requester is kept uninterrupted, and the object reading requester sends a target object re-reading request.
In an eighth aspect, an embodiment of the present invention provides an object reading management apparatus, which is suitable for a server.
Specifically, the object reading management apparatus includes:
the second forwarding module is configured to forward a target object reading request to a cloud gateway in response to receiving the target object reading request sent by the object reading requester, wherein the target object reading request at least carries target object identification information;
a fourth sending module, configured to send a preset message to the object reading requester in response to receiving a target object waiting instruction sent by the cloud gateway, so as to keep a connection between the server and the object reading requester uninterrupted, and further enable the object reading requester to send a target object re-reading request;
and the third forwarding module is configured to forward the target object re-reading request to the cloud gateway in response to receiving the target object re-reading request sent by the object reading requester, wherein the target object re-reading request at least carries target object identification information.
In a ninth aspect, an embodiment of the present invention provides an object reading management apparatus, which is suitable for an object reading requester.
Specifically, the object reading management apparatus includes:
a fifth sending module, configured to send a target object reading request to a cloud gateway through a server, so that the cloud gateway sends a target object obtaining request to an object storage service system according to the target object reading request, so that the object storage service system obtains and returns the target object according to the target object obtaining request, where at least target object identification information is carried in the target object reading request and the target object obtaining request;
a sixth sending module, configured to respond to receiving a preset message sent by the server, and send a target object re-reading request to the cloud gateway through the server after a preset time until receiving a target object sent by the server;
a second receiving module configured to receive the target object sent by the server.
In a tenth aspect, an embodiment of the present invention provides an object reading management apparatus, which is suitable for an object reading management system including an object reading requester, a server, a cloud gateway, and an object storage service system.
Specifically, the object reading management apparatus includes:
the object reading requester is configured to send a target object reading request to the server, and in response to receiving a preset message sent by the server, send a target object re-reading request to the server after a preset time until receiving a target object sent by the server, wherein the target object reading request at least carries target object identification information;
the server is configured to forward a target object reading request to a cloud gateway in response to receiving the target object reading request sent by the object reading requester, send the preset message to the object reading requester in response to receiving a target object waiting instruction sent by the cloud gateway, forward the target object re-reading request to the cloud gateway in response to receiving the target object re-reading request sent by the object reading requester, and forward the target object to the object reading requester in response to receiving the target object sent by the cloud gateway, wherein the target object re-reading request at least carries target object identification information;
the cloud gateway configured to, in response to receiving a target object read request sent by the server, generating a target object obtaining request according to target object identification information carried by the target object reading request, sending the target object obtaining request to an object storage service system, responding to a target object waiting instruction sent by the object storage service system, forwarding the target object waiting instruction to the server, responding to a target object re-reading request sent by the server, generating a target object re-acquisition request according to target object identification information carried by the target object re-reading request, sending the target object re-acquisition request to an object storage service system until a target object sent by the object storage service system is received, and sending the target object to the server, wherein the target object re-reading request at least carries the target object identification information;
the object storage service system is configured to respond to a received target object obtaining request sent by the cloud gateway, read a target object according to target object identification information carried by the target object obtaining request, send a target object waiting instruction to the cloud gateway when the storage type of the target object is determined to be archived, respond to a received target object obtaining request sent by the cloud gateway again, read the target object according to the target object identification information carried by the target object obtaining request again until the target object is obtained by reading, and send the target object to the cloud gateway.
In an eleventh aspect, an embodiment of the present invention provides an electronic device, including a memory and a processor, where the memory is used to store one or more computer instructions for supporting an object reading management apparatus to execute the object reading management method, and the processor is configured to execute the computer instructions stored in the memory. The object reading management device may further include a communication interface for the object reading management device to communicate with other devices or a communication network.
In a twelfth aspect, an embodiment of the present invention provides a computer-readable storage medium, configured to store computer instructions for an object reading management apparatus, where the computer instructions include computer instructions for executing the object reading management method to the object reading management apparatus.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
according to the technical scheme, the target object of the object reading requester is failed to be read but the information needs to be waited for is informed through the preset information in the network file system, so that normal link can be kept between the object reading requester and the server before the archived object is thawed, the condition of front-end input and output errors is avoided, meanwhile, the mapping of file operation and object operation is realized by utilizing the extended attribute of the POSIX interface, and the state detection and automatic thawing of the archived object are easier. Compared with the prior art, the technical scheme improves the working efficiency, reduces the waste of time cost and resource cost, and can effectively avoid potential safety risk hazards.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of embodiments of the invention.
Drawings
Other features, objects and advantages of embodiments of the invention will become more apparent from the following detailed description of non-limiting embodiments thereof, when taken in conjunction with the accompanying drawings. In the drawings:
1-4 illustrate flow diagrams of object read management methods according to various embodiments of the invention;
FIG. 5 illustrates an overall flow diagram of an object read management method according to an embodiment of the invention;
6-10 show block diagrams of structures of object reading management devices according to various embodiments of the present invention;
fig. 11 is a schematic structural diagram of a computer system suitable for implementing an object reading management method according to an embodiment of the present invention.
Detailed Description
Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement them. Also, for the sake of clarity, parts not relevant to the description of the exemplary embodiments are omitted in the drawings.
In the embodiments of the present invention, it is to be understood that terms such as "including" or "having", etc., are intended to indicate the presence of the features, numbers, steps, actions, components, parts, or combinations thereof disclosed in the present specification, and are not intended to exclude the possibility that one or more other features, numbers, steps, actions, components, parts, or combinations thereof may be present or added.
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. Embodiments of the present invention will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
The technical scheme provided by the embodiment of the invention realizes the notification of the target object reading failure of the object reading requester but the waiting message through the preset message based on the inside of the network file system, so as to ensure that the object reading requester and the server can keep normal link before the archiving object is defrosted, avoid the condition of front-end input and output errors, and simultaneously realize the mapping of file operation and object operation by utilizing the extended attribute of the POSIX interface, so that the state detection and automatic unfreezing of the archiving object are easier. Compared with the prior art, the technical scheme improves the working efficiency, reduces the waste of time cost and resource cost, and can effectively avoid potential safety risk hazards.
Fig. 1 shows a flowchart of an object reading management method according to an embodiment of the present invention, which is suitable for a cloud gateway, and as shown in fig. 1, the object reading management method includes the following steps S101 to S103:
in step S101, a target object reading request sent by an object reading requester through a server is received, where the target object reading request at least carries target object identification information;
in step S102, obtaining the target object identification information according to the target object reading request, generating a target object obtaining request according to the target object identification information, and sending the target object obtaining request to an object storage service system, so that the object storage service system obtains and returns the target object according to the target object obtaining request, wherein the target object request at least carries the target object identification information;
in step S103, in response to receiving the target object waiting instruction sent by the object storage service system, forwarding the target object waiting instruction to the server, so that the server and the object reading requester keep the connection without interruption, and further the object reading requester sends a target object re-reading request.
As mentioned above, with the development of data technology, an object storage scheme capable of realizing automatic and intelligent storage and improving storage efficiency is widely used. The object storage is a general mass distributed storage system, and can perform archival storage on mass cold data in order to reduce the Total Cost of Ownership (TCO) of the whole. However, most of the existing applications of users use a standard POSIX (Portable Operating System Interface of UNIX) file Interface to store and manage data, so for the management of archive storage, users cannot directly operate an object Interface, or the users use the object Interface to unfreeze an object first and then switch tools to access the object by means of the file Interface; or make a major transformation of the user's existing applications. The first processing method involves switching tools, so that the working efficiency is low, and the second processing method needs to spend a large amount of time cost and resource cost and also brings safety risk.
In view of the above problem, in this embodiment, an object reading management method is proposed, which implements notification of a target object reading failure of an object reading requester but needs to wait for a message based on a preset message inside a network file system, so as to ensure that a normal link can be maintained between the object reading requester and a server before an archived object is thawed, avoid a situation of a front-end input/output error, and implement mapping between a file operation and an object operation by using an extended attribute of a POSIX interface, so that state detection and automatic thawing of the archived object are easier. Compared with the prior art, the technical scheme improves the working efficiency, reduces the waste of time cost and resource cost, and can effectively avoid potential safety risk hazards.
In an embodiment of the present invention, the object reading requester may be a user, an application, or another subject capable of sending an object reading request, such as a network file system client, and the present invention is not limited in particular.
In an embodiment of the present invention, the server refers to a server for forwarding a target object read request of the object read requester to a cloud gateway, and may be a network file system server, for example.
When the object reading requester is a requester facing a network file system client, such as a user, an application, and the like, the object reading requester firstly sends a target object reading request to the network file system client, and then the network file system client sends the target object reading request to the cloud gateway through the server, wherein the target object reading request sent by the object reading requester to the network file system client may be a request message based on a POSIX interface, and the target object reading request sent by the network file system client to the server may be a request message based on remote procedure call. Similarly, after the object storage service system reads the corresponding target object, the target object is also sent to the object read requester through the cloud gateway, the server and the network file system client.
In an embodiment of the present invention, the target object reading request is used to read a certain target object, and therefore, in order to make the object storage service system determine which object is the object to be read, at least target object identification information needs to be carried in the target object reading request and in a target object obtaining request generated by the cloud gateway, where the target object identification information is used to perform a distinctive identification on the target object to be read. Thus, after receiving the target object acquisition request, the object storage service system can determine the target object to be read according to the target object identification information carried by the target object acquisition request, read the target object, and return to the read target object.
In an embodiment of the present invention, the object storage service system refers to a system for storing objects, which can store object data according to a preset storage type, read the object data, and further obtain a storage status of the object data and change the storage type of the object data.
In an embodiment of the present invention, the target object waiting instruction is used to notify the cloud gateway, and then notify the server through the cloud gateway that the related target object data cannot be read currently and needs to wait, so that the server sends a preset message to the object read requester, keeps the connection between the server and the object read requester uninterrupted, and finally enables the object read requester to send a target object re-read request and request the target object to be read again.
The reason why the related target object data cannot be read at present and needs to be waited for is that the target object to be read belongs to the type of archived data, the target object cannot be read, and only needs a certain time to unfreeze the target object and then read, so the target object reading requester needs to be informed to wait, and a target object re-reading request is sent to request the target object to be read again, and after the target object to be archived is unfrozen, the target storage service system can gradually return the target object obtained by reading to the target object reading requester.
The preset message refers to a preset message used for informing the object reading requester that the relevant target object data cannot be read currently, and the preset message may be, for example, an error message, a target object reading failure message, a waiting prompt message, a message that the target object fails to be read but needs to be waited, a holding prompt message, or a private message preset by the server object reading requester. The preset message may be generated based on a preset code, convention, or protocol, for example, the message that the target object fails to read but needs to wait may be generated based on an error code preset in the network file system, for example, NFS3ERR _ JUKEBOX or NFS4ERR _ DELAY, where the preset meaning of the error code is that an error occurs or a request cannot be completed but needs to wait, and an effect of informing an object reading requester not to give up waiting for a request to be made again later can be achieved by the preset message.
In an embodiment of the present invention, the step S102, after acquiring the target object identification information according to the target object reading request, generating an acquisition target object request according to the target object identification information, and sending the acquisition target object request to an object storage service system, further includes a step of communicating with the object storage service system, that is, the object reading management method includes the following steps:
receiving a target object reading request sent by an object reading requester through a server, wherein the target object reading request at least carries target object identification information;
acquiring the target object identification information according to the target object reading request, generating an acquisition target object request according to the target object identification information, and sending the acquisition target object request to an object storage service system so that the object storage service system acquires and returns the target object according to the acquisition target object request, wherein the target object request at least carries the target object identification information;
in response to receiving a target object non-acquirable message sent by the object storage service system, sending a request for acquiring a target object storage type to the object storage service system, and in response to receiving a target object storage type notification message sent by the object storage service system, and when the target object storage type is archived, sending a target object unfreezing request to the object storage service system, so that the object storage service system unfreezes the target object, and sending a target object waiting instruction to the cloud gateway;
and responding to a waiting target object instruction sent by the object storage service system, forwarding the waiting target object instruction to the server so as to enable the server and the object reading requester to keep connection without interruption, and further enable the object reading requester to send a target object re-reading request.
As mentioned above, an object belonging to the archived data type needs a certain time to thaw before being read, and therefore, in this embodiment, when the object storage service system receives the target object acquisition request sent by the cloud gateway and determines that the target object to be read is currently unreadable in the archived data type, it needs to send a target object non-acquisition message to the cloud gateway, and after the cloud gateway receives the target object non-acquisition message sent by the object storage service system, in order to determine the reason why the target object is not acquirable, it may continue to send the target object storage type acquisition request to the object storage service system, and if a target object storage type notification message sent by the object storage service system is received and it is determined that the target object storage type is archived, it sends a target object thawing request to the object storage service system, and the object storage service system unfreezes the target object according to the target object unfreezing request, and simultaneously sends a target object waiting instruction to the cloud gateway to inform the cloud gateway that the target object is in a unfrozen state at present and needs to wait.
In an embodiment of the present invention, the method further includes a step of sending the target object to the object reading requester through the server if the target object sent by the object storage service system is received, where the step may be set after the step of forwarding the target object waiting instruction to the server in response to receiving the target object waiting instruction sent by the object storage service system. In this embodiment, if the object storage service system can directly obtain the target object or obtain the target object after thawing the target object, and send the obtained target object to the cloud gateway, the cloud gateway forwards the target object to the object reading requester through the server.
In an embodiment of the present invention, the method further includes a step of requesting again target object reading according to a target object re-reading request sent by the object reading requester, and similarly, this step may be set after the step of forwarding the waiting target object instruction to the server in response to receiving the waiting target object instruction sent by the object storage service system. In this embodiment, when the object read requester sends a target object re-read request through the server, wherein, the target object re-reading request at least carries target object identification information, the cloud gateway can obtain the target object identification information according to the target object re-reading request, and generates a request for acquiring the target object again according to the identification information of the target object, sends the request to an object storage service system, so that the object storage service system acquires and returns the target object according to the target object reacquisition request until the object storage service system can acquire the target object, and after receiving the target object sent by the object storage service system, sending the target object to the object reading requester through the server.
Fig. 2 shows a flowchart of an object reading management method according to another embodiment of the present invention, which is applied to an object storage service system, and as shown in fig. 2, the object reading management method includes the following steps S201 to S203:
in step S201, in response to receiving a target object obtaining request sent by a cloud gateway, obtaining target object identification information according to the target object obtaining request, where the target object request at least carries target object identification information;
in step S202, reading a target object according to the target object identification information;
in step S203, when it is determined that the storage type of the target object is archive, a target object waiting instruction is sent to the cloud gateway, so that the cloud gateway forwards the target object waiting instruction to the server, the connection between the server and the object reading requester is maintained without interruption, and the object reading requester sends a target object re-reading request.
As mentioned above, with the development of data technology, an object storage scheme capable of realizing automatic and intelligent storage and improving storage efficiency is widely used. The object storage is a general mass distributed storage system, and in order to reduce the whole TCO, the archival storage can be performed on mass cold data. However, most of the existing applications of users use a standard POSIX file interface to store and manage data, so for the management of archival storage, users cannot directly operate an object interface, or users use the object interface to unfreeze an object first and then switch tools to access the object by the aid of the file interface; or make a major transformation of the user's existing applications. The first processing method involves switching tools, so that the working efficiency is low, and the second processing method needs to spend a large amount of time cost and resource cost and also brings safety risk.
In view of the above problem, in this embodiment, an object reading management method is provided, where when the object storage service system determines that a storage type of a target object to be read is an archive, a target object waiting instruction is sent to a server through a cloud gateway, so that the server sends a preset message to an object reading requester, and a normal link is maintained between the object reading requester and the server before the archive object is thawed, so that the object reading requester sends a target object re-reading request after waiting. Compared with the prior art, the technical scheme improves the working efficiency and reduces the waste of time cost and resource cost.
In an embodiment of the present invention, in step S203, that is, when it is determined that the target object storage type is archive, the step of sending a target object waiting instruction to the cloud gateway includes the following steps:
when the storage type of the target object is determined to be archived, sending a message that the target object cannot acquire to the cloud gateway;
sending a target object storage type notification message to the cloud gateway in response to receiving a target object storage type acquisition request sent by the cloud gateway;
and in response to receiving a target object unfreezing request sent by the cloud gateway, unfreezing the target object, and sending a target object waiting instruction to the cloud gateway.
As mentioned above, an object belonging to an archived data type needs a certain time to thaw and then can be read, and therefore, in this embodiment, when the object storage service system determines that a target object to be read is an archived data type and cannot be read at present, a target object non-acquisition message needs to be sent to the cloud gateway, and after the cloud gateway receives the target object non-acquisition message sent by the object storage service system, in order to determine a reason why the target object cannot be acquired, a request for acquiring a target object storage type may be continuously sent to the object storage service system. After receiving a target object storage type acquisition request sent by the cloud gateway, the object storage service system acquires the storage type of the target object to be read, and sends a target object storage type notification message generated according to the target object storage type to the cloud gateway, after receiving the target object storage type notification message and determining that the target object storage type is archived, the cloud gateway sends a target object unfreezing request to the object storage service system, and the object storage service system can perform unfreezing operation on the target object according to the target object unfreezing request, and because the unfreezing operation needs a certain time, the object storage service system is prevented from being mistaken for the object storage service system to have data reading errors or cannot be read, and the front end abandons the object storage service system, and the object storage service system also sends a target object waiting instruction to the cloud gateway at the same time so as to inform the cloud gateway that the target object is in a unfrozen state at present and needs to wait.
In an embodiment of the present invention, the method further includes a step of reading the target object again according to the received request for obtaining the target object again, that is, the object reading management method includes the following steps:
in response to receiving a target object obtaining request sent by a cloud gateway, obtaining target object identification information according to the target object obtaining request, wherein the target object request at least carries the target object identification information;
reading the target object according to the target object identification information;
when the storage type of the target object is determined to be archived, sending a target object waiting instruction to the cloud gateway, so that the cloud gateway forwards the target object waiting instruction to the server, keeping the connection between the server and the object reading requester uninterrupted, and further enabling the object reading requester to send a target object re-reading request;
responding to a request for obtaining a target object again sent by the cloud gateway, obtaining target object identification information according to the request for obtaining the target object again, reading the target object according to the target object identification information until the target object is obtained by reading, and sending the target object to the cloud gateway so that the cloud gateway sends the target object to the object reading requester through the server, wherein the request for obtaining the target object again at least carries the target object identification information.
In this embodiment, after the object storage service system receives a target object reacquisition request, which is sent by the cloud gateway and carries at least target object identification information, the target object is read again according to the target object identification information until the target object can be read, for example, the target object is defrosted and becomes a readable target object after completion of the target object thawing operation, and the read target object is sent to the cloud gateway, so that the cloud gateway finally sends the target object to the object reading requester through the server.
Some technical features in the embodiment shown in fig. 2 are the same as or similar to those in the embodiment shown in fig. 1, and for specific explanation and explanation of the technical features, reference may be made to the description of the embodiment shown in fig. 1, and the present invention is not described herein again.
Fig. 3 shows a flowchart of an object reading management method according to another embodiment of the present invention, which is applicable to a server, and as shown in fig. 3, the object reading management method includes the following steps S301 to S303:
in step S301, in response to receiving a target object read request sent by the object read requester, forwarding the target object read request to a cloud gateway, where the target object read request at least carries target object identification information;
in step S302, in response to receiving a target object waiting instruction sent by the cloud gateway, sending a preset message to the object reading requester to keep the connection between the server and the object reading requester uninterrupted, so that the object reading requester sends a target object re-reading request;
in step S303, in response to receiving a target object re-reading request sent by the object reading requester, forwarding the target object re-reading request to the cloud gateway, where the target object re-reading request at least carries target object identification information.
As mentioned above, with the development of data technology, an object storage scheme capable of realizing automatic and intelligent storage and improving storage efficiency is widely used. The object storage is a general mass distributed storage system, and in order to reduce the whole TCO, the archival storage can be performed on mass cold data. However, most of the existing applications of users use a standard POSIX file interface to store and manage data, so for the management of archival storage, users cannot directly operate an object interface, or users use the object interface to unfreeze an object first and then switch tools to access the object by the aid of the file interface; or make a major transformation of the user's existing applications. The first processing method involves switching tools, so that the working efficiency is low, and the second processing method needs to spend a large amount of time cost and resource cost and also brings safety risk.
In view of the above problem, in this embodiment, an object reading management method is provided, where after the server receives a target object waiting instruction sent by a cloud gateway, notification that target object reading of an object reading requester fails but needs to wait for a message is implemented based on a preset message inside a network file system, so as to ensure that a normal link can be maintained between the object reading requester and the server before an archived object is thawed, and avoid a situation of a front-end input/output error. Compared with the prior art, the technical scheme improves the working efficiency and reduces the waste of time cost and resource cost.
In an embodiment of the present invention, the method further includes a step of forwarding the target object received from the cloud gateway to an object reading requester, that is, the object reading management method includes the following steps:
responding to a target object reading request sent by the object reading requester, and forwarding the target object reading request to a cloud gateway, wherein the target object reading request at least carries target object identification information;
in response to receiving a target object waiting instruction sent by the cloud gateway, sending a preset message to the object reading requester so as to keep the connection between the server and the object reading requester uninterrupted, and further enabling the object reading requester to send a target object re-reading request;
responding to a target object re-reading request sent by the object reading requester, and forwarding the target object re-reading request to a cloud gateway, wherein the target object re-reading request at least carries target object identification information;
and responding to the received target object sent by the cloud gateway, and forwarding the target object to the object reading requester.
Some technical features in the embodiment shown in fig. 3 are the same as or similar to those in the embodiment shown in fig. 1-2, and for specific explanation and explanation of the technical features, reference may be made to the description of the embodiment shown in fig. 1-2, and the present invention is not repeated here.
Fig. 4 shows a flowchart of an object reading management method according to another embodiment of the present invention, which is suitable for an object reading requester, and as shown in fig. 4, the object reading management method includes the following steps S401 to S403:
in step S401, a target object reading request is sent to a cloud gateway through a server, so that the cloud gateway sends a target object obtaining request to an object storage service system according to the target object reading request, so that the object storage service system obtains and returns the target object according to the target object obtaining request, where at least target object identification information is carried in the target object reading request and the target object obtaining request;
in step S402, in response to receiving a preset message sent by the server, sending a target object re-reading request to the cloud gateway through the server after a preset time until receiving a target object sent by the server;
in step S403, the target object sent by the server is received.
As mentioned above, with the development of data technology, an object storage scheme capable of realizing automatic and intelligent storage and improving storage efficiency is widely used. The object storage is a general mass distributed storage system, and in order to reduce the whole TCO, the archival storage can be performed on mass cold data. However, most of the existing applications of users use a standard POSIX file interface to store and manage data, so for the management of archival storage, users cannot directly operate an object interface, or users use the object interface to unfreeze an object first and then switch tools to access the object by the aid of the file interface; or make a major transformation of the user's existing applications. The first processing method involves switching tools, so that the working efficiency is low, and the second processing method needs to spend a large amount of time cost and resource cost and also brings safety risk.
In view of the above problem, in this embodiment, an object reading management method is proposed, which, after receiving a preset message sent by a server to instruct to maintain connection and for a preset time, sends a target object re-reading request to the cloud gateway through the server until receiving a target object sent by the server. According to the technical scheme, the connection between the server and the target object is maintained and the target object is quickly read again by means of the preset message, so that the working efficiency is improved, and the waste of time cost and resource cost is reduced compared with the prior art.
As mentioned above, the object reading requester may be a user, an application, or another entity capable of sending an object reading request and directly communicating with the server, such as a network file system client. It should be noted that, when the object read requester is not a main body capable of directly communicating with the server, such as a network file system client, but a requester facing the network file system client, such as a user or an application, the object read requester needs to first send a target object read request to the network file system client, and then send the target object read request to the cloud gateway through the server by the network file system client, where the target object read request sent by the object read requester to the network file system client may be a request message based on a POSIX interface, and the target object read request sent by the network file system client to the server may be a request message based on a remote procedure call. Similarly, after the object storage service system reads the corresponding target object, the target object is also sent to the object read requester through the cloud gateway, the server and the network file system client.
Some technical features in the embodiment shown in fig. 4 are the same as or similar to those in the embodiment shown in fig. 1 to 3, and for specific explanation and explanation of the technical features, reference may be made to the description of the embodiment shown in fig. 1 to 3, and the present invention is not repeated here.
Fig. 5 is a flowchart illustrating an overall object reading management method according to an embodiment of the present invention, which is applied to an object reading management system including an object reading requester, a server, a cloud gateway, and an object storage service system, and as shown in fig. 5, when performing object reading management:
the object reading requester firstly sends a target object reading request to the server, wherein the target object reading request at least carries target object identification information;
the server responds to a target object reading request sent by the object reading requester, and forwards the target object reading request to the cloud gateway;
the cloud gateway responds to a target object reading request sent by the server, generates a target object obtaining request according to target object identification information carried by the target object reading request and sends the target object obtaining request to an object storage service system;
the object storage service system responds to a received target object acquisition request sent by the cloud gateway, reads a target object according to target object identification information carried by the target object acquisition request, and sends a target object waiting instruction to the cloud gateway when the target object storage type is determined to be archived;
the cloud gateway responds to a target object waiting instruction sent by the object storage service system and forwards the target object waiting instruction to the server;
the server responds to a target object waiting instruction sent by the cloud gateway, and sends a preset message to the object reading requester, such as a message that target object reading fails but needs to wait;
the object reading requester responds to the preset message sent by the server, and sends a target object re-reading request to the server after a preset time until the target object sent by the server is received;
the server responds to a target object re-reading request sent by the object reading requester, forwards the target object re-reading request to the cloud gateway, and responds to the target object sent by the cloud gateway, forwards the target object to the object reading requester, wherein the target object re-reading request at least carries target object identification information;
the cloud gateway responds to a target object re-reading request sent by the server, generates a re-acquisition target object request according to target object identification information carried by the target object re-reading request, sends the re-acquisition target object request to an object storage service system until receiving a target object sent by the object storage service system, and sends the target object to the server;
and the object storage service system responds to the received request for obtaining the target object again sent by the cloud gateway, reads the target object according to the target object identification information carried by the request for obtaining the target object again until the target object is obtained by reading, and sends the target object to the cloud gateway.
The object reading requester is a network file system client or a requester facing the network file system client, such as a user and an application.
In an embodiment of the present invention, when determining that the target object storage type is archive, the object storage service system may send a target object waiting instruction to the cloud gateway, where the target object waiting instruction is implemented as:
when the storage type of the target object is determined to be archived, sending a target object non-acquirable message to the cloud gateway, responding to a received target object storage type acquiring request sent by the cloud gateway, sending a target object storage type notification message to the cloud gateway, responding to a received target object unfreezing request sent by the cloud gateway, performing unfreezing operation on the target object, and sending a target object waiting instruction to the cloud gateway;
in this implementation manner, after the step of generating, by the cloud gateway, a target object obtaining request according to the target object identification information carried in the target object reading request and sending the target object obtaining request to the object storage service system, the method may further include: the method comprises the steps of responding to a received target object non-acquirable message sent by an object storage service system, sending a request for acquiring a target object storage type to the object storage service system, responding to a received target object storage type notification message sent by the object storage service system, and sending a target object unfreezing request to the object storage service system when the target object storage type is in an archive state.
Some technical features in the embodiment shown in fig. 5 are the same as or similar to those in the embodiment shown in fig. 1 to 4, and for specific explanation and explanation of the technical features, reference may be made to the description of the embodiment shown in fig. 1 to 4, and the present invention is not repeated here.
The following are embodiments of the apparatus of the present invention that may be used to perform embodiments of the method of the present invention.
Fig. 6 is a block diagram illustrating a structure of an object reading management apparatus according to an embodiment of the present invention, which may be implemented as part or all of an electronic device, and may be implemented as a cloud gateway, through software, hardware, or a combination of both. As shown in fig. 6, the object reading management apparatus includes:
a first receiving module 601, configured to receive a target object reading request sent by an object reading requester through a server, where the target object reading request at least carries target object identification information;
a first generating module 602, configured to obtain the target object identification information according to the target object reading request, generate a target object obtaining request according to the target object identification information, and send the target object obtaining request to an object storage service system, so that the object storage service system obtains and returns the target object according to the target object obtaining request, where the target object request at least carries target object identification information;
a first forwarding module 603, configured to, in response to receiving a wait target object instruction sent by the object storage service system, forward the wait target object instruction to the server, so as to maintain a connection between the server and the object read requester without interruption, and further enable the object read requester to send a target object re-read request.
As mentioned above, with the development of data technology, an object storage scheme capable of realizing automatic and intelligent storage and improving storage efficiency is widely used. The object storage is a general mass distributed storage system, and can perform archival storage on mass cold data in order to reduce the Total Cost of Ownership (TCO) of the whole. However, most of the existing applications of users use a standard POSIX (Portable Operating System Interface of UNIX) file Interface to store and manage data, so for the management of archive storage, users cannot directly operate an object Interface, or the users use the object Interface to unfreeze an object first and then switch tools to access the object by means of the file Interface; or make a major transformation of the user's existing applications. The first processing method involves switching tools, so that the working efficiency is low, and the second processing method needs to spend a large amount of time cost and resource cost and also brings safety risk.
In view of the above problem, in this embodiment, an object reading management apparatus is proposed, which implements notification of a target object reading failure of an object reading requester but waiting for a message based on a preset message inside a network file system, so as to ensure that a normal link can be maintained between the object reading requester and a server before the archived object is thawed, avoid a situation of a front-end input/output error, and simultaneously implement mapping between a file operation and an object operation by using an extended attribute of a POSIX interface, so that status detection and automatic thawing of the archived object are easier. Compared with the prior art, the technical scheme improves the working efficiency, reduces the waste of time cost and resource cost, and can effectively avoid potential safety risk hazards.
In an embodiment of the present invention, the object reading requester may be a user, an application, or another subject capable of sending an object reading request, such as a network file system client, and the present invention is not limited in particular.
In an embodiment of the present invention, the server refers to a server for forwarding a target object read request of the object read requester to a cloud gateway, and may be a network file system server, for example.
When the object reading requester is a requester facing a network file system client, such as a user, an application, and the like, the object reading requester firstly sends a target object reading request to the network file system client, and then the network file system client sends the target object reading request to the cloud gateway through the server, wherein the target object reading request sent by the object reading requester to the network file system client may be a request message based on a POSIX interface, and the target object reading request sent by the network file system client to the server may be a request message based on remote procedure call. Similarly, after the object storage service system reads the corresponding target object, the target object is also sent to the object read requester through the cloud gateway, the server and the network file system client.
In an embodiment of the present invention, the target object reading request is used to read a certain target object, and therefore, in order to make the object storage service system determine which object is the object to be read, at least target object identification information needs to be carried in the target object reading request and in a target object obtaining request generated by the cloud gateway, where the target object identification information is used to perform a distinctive identification on the target object to be read. Thus, after receiving the target object acquisition request, the object storage service system can determine the target object to be read according to the target object identification information carried by the target object acquisition request, read the target object, and return to the read target object.
In an embodiment of the present invention, the object storage service system refers to a system for storing objects, which can store object data according to a preset storage type, read the object data, and further obtain a storage status of the object data and change the storage type of the object data.
In an embodiment of the present invention, the target object waiting instruction is used to notify the cloud gateway, and then notify the server through the cloud gateway that the related target object data cannot be read currently and needs to wait, so that the server sends a preset message to the object read requester, keeps the connection between the server and the object read requester uninterrupted, and finally enables the object read requester to send a target object re-read request and request the target object to be read again.
The reason why the related target object data cannot be read at present and needs to be waited for is that the target object to be read belongs to the type of archived data, the target object cannot be read, and only needs a certain time to unfreeze the target object and then read, so the target object reading requester needs to be informed to wait, and a target object re-reading request is sent to request the target object to be read again, and after the target object to be archived is unfrozen, the target storage service system can gradually return the target object obtained by reading to the target object reading requester.
The preset message refers to a preset message used for informing the object reading requester that the relevant target object data cannot be read currently, and the preset message may be, for example, an error message, a target object reading failure message, a waiting prompt message, a message that the target object fails to be read but needs to be waited, a holding prompt message, or a private message preset by the server object reading requester. The preset message may be generated based on a preset code, convention, or protocol, for example, the message that the target object fails to read but needs to wait may be generated based on an error code preset in the network file system, for example, NFS3ERR _ JUKEBOX or NFS4ERR _ DELAY, where the preset meaning of the error code is that an error occurs or a request cannot be completed but needs to wait, and an effect of informing an object reading requester not to give up waiting for a request to be made again later can be achieved by the preset message.
In an embodiment of the present invention, after the first generating module 602, the object reading management apparatus further includes a part for communicating with an object storage service system, where the object reading management apparatus includes:
the device comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is configured to receive a target object reading request sent by an object reading requester through a server, and the target object reading request at least carries target object identification information;
a first generating module, configured to obtain the target object identification information according to the target object reading request, generate a target object obtaining request according to the target object identification information, and send the target object obtaining request to an object storage service system, so that the object storage service system obtains and returns the target object according to the target object obtaining request, where the target object request at least carries the target object identification information;
a first sending module, configured to send a request for obtaining a target object storage type to the object storage service system in response to receiving a target object unavailable information sent by the object storage service system, and send a target object unfreezing request to the object storage service system in response to receiving a target object storage type notification message sent by the object storage service system and when the target object storage type is archived, so that the object storage service system performs unfreezing operation on the target object, and send a target object waiting instruction to the cloud gateway;
the first forwarding module is configured to forward a waiting target object instruction to the server in response to receiving the waiting target object instruction sent by the object storage service system, so that the server and the object reading requester keep connection without interruption, and further the object reading requester sends a target object re-reading request.
As mentioned above, an object belonging to the archived data type needs a certain time to be thawed before being read, and therefore, in this embodiment, when the object storage service system receives the target object acquisition request sent by the cloud gateway and determines that the target object to be read is currently unreadable in the archived data type, it needs to send a target object non-acquisition message to the cloud gateway, and after the cloud gateway receives the target object non-acquisition message sent by the object storage service system, in order to determine the reason why the target object is not acquirable, the first sending module continues to send the target object storage type acquisition request to the object storage service system, and if a target object storage type notification message sent by the object storage service system is received and it is determined that the target object storage type is archived, sending a target object unfreezing request to the object storage service system so that the object storage service system unfreezes the target object according to the target object unfreezing request, and simultaneously sending a target object waiting instruction to the cloud gateway so as to inform the cloud gateway that the target object is in a unfrozen state at present and needs to wait.
In an embodiment of the present invention, the apparatus further includes a part, which, if receiving a target object sent by the object storage service system, sends the target object to the object reading requester through the server, where the part may be disposed after the first forwarding module. In this embodiment, if the object storage service system can directly obtain the target object or obtain the target object after thawing the target object, and send the obtained target object to the cloud gateway, the cloud gateway forwards the target object to the object reading requester through the server.
In an embodiment of the present invention, the apparatus further includes a portion for requesting target object reading again according to a target object reading request sent by the object reading requester, and similarly, this step may be arranged after the first forwarding module. In this embodiment, when the object read requester sends a target object re-read request through the server, wherein, the target object re-reading request at least carries target object identification information, the cloud gateway can obtain the target object identification information according to the target object re-reading request, and generates a request for acquiring the target object again according to the identification information of the target object, sends the request to an object storage service system, so that the object storage service system acquires and returns the target object according to the target object reacquisition request until the object storage service system can acquire the target object, and after receiving the target object sent by the object storage service system, sending the target object to the object reading requester through the server.
Fig. 7 is a block diagram illustrating a structure of an object reading management apparatus according to another embodiment of the present invention, which may be implemented as part or all of an electronic device, which may be implemented as an object storage service system, through software, hardware, or a combination of both. As shown in fig. 7, the object reading management apparatus includes:
the acquiring module 701 is configured to, in response to receiving a target object acquiring request sent by a cloud gateway, acquire target object identification information according to the target object acquiring request, where the target object request at least carries the target object identification information;
a first reading module 702 configured to read a target object according to the target object identification information;
a third sending module 703, configured to send, when it is determined that the storage type of the target object is archive, a target object waiting instruction to the cloud gateway, so that the cloud gateway forwards the target object waiting instruction to the server, maintain the connection between the server and the object reading requester uninterrupted, and further cause the object reading requester to send a target object re-reading request.
As mentioned above, with the development of data technology, an object storage scheme capable of realizing automatic and intelligent storage and improving storage efficiency is widely used. The object storage is a general mass distributed storage system, and in order to reduce the whole TCO, the archival storage can be performed on mass cold data. However, most of the existing applications of users use a standard POSIX file interface to store and manage data, so for the management of archival storage, users cannot directly operate an object interface, or users use the object interface to unfreeze an object first and then switch tools to access the object by the aid of the file interface; or make a major transformation of the user's existing applications. The first processing method involves switching tools, so that the working efficiency is low, and the second processing method needs to spend a large amount of time cost and resource cost and also brings safety risk.
In view of the above problem, in this embodiment, an object reading management apparatus is provided, which, when the object storage service system determines that the storage type of the target object to be read is archive, sends a target object waiting instruction to a server through a cloud gateway, so that the server sends a preset message to an object reading requester, and maintains a normal link between the object reading requester and the server before the archive object is thawed, so that the object reading requester sends a target object re-reading request after waiting. Compared with the prior art, the technical scheme improves the working efficiency and reduces the waste of time cost and resource cost.
In an embodiment of the present invention, the third sending module 703 includes:
the first sending sub-module is configured to send a message that the target object cannot be acquired to the cloud gateway when the storage type of the target object is determined to be archived;
the second sending submodule is configured to send a target object storage type notification message to the cloud gateway in response to receiving a target object storage type obtaining request sent by the cloud gateway;
the third sending submodule is configured to, in response to receiving a target object unfreezing request sent by the cloud gateway, perform unfreezing operation on the target object, and send a target object waiting instruction to the cloud gateway.
As mentioned above, an object belonging to an archived data type needs a certain time to be thawed before being read, and therefore, in this embodiment, when the object storage service system determines that a target object to be read is an archived data type and cannot be read at present, the first sending sub-module sends a target object non-acquisition message to the cloud gateway, and after receiving the target object non-acquisition message sent by the object storage service system, the cloud gateway may continue to send a target object storage type acquisition request to the object storage service system in order to determine a reason why the target object cannot be acquired. After the object storage service system receives a target object storage type acquisition request sent by the cloud gateway, a second sending submodule acquires the storage type of the target object to be read, and sends a target object storage type notification message generated according to the target object storage type to be read to the cloud gateway, the cloud gateway sends a target object unfreezing request to the object storage service system after receiving the target object storage type notification message and determining that the target object storage type is archived, the object storage service system can unfreeze the target object according to the target object unfreezing request, and due to the fact that certain time is needed for unfreezing operation, the object storage service system is prevented from being mistaken for the object storage service system to have data reading errors or cannot be read, and the front end abandons the object storage service system, and the third sending submodule of the object storage service system simultaneously sends a target object waiting instruction to the cloud gateway so as to inform the cloud gateway that the target object is in a unfrozen state at present and needs to wait.
In an embodiment of the present invention, the apparatus further includes a portion for re-reading the target object according to the received request for re-acquiring the target object, that is, the object reading management apparatus includes:
the cloud gateway comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is configured to respond to a received target object acquisition request sent by the cloud gateway and acquire target object identification information according to the target object acquisition request, and the target object request at least carries the target object identification information;
a first reading module configured to read a target object according to the target object identification information;
a third sending module, configured to send a target object waiting instruction to the cloud gateway when it is determined that the target object storage type is archive, so that the cloud gateway forwards the target object waiting instruction to the server, maintain a connection between the server and the object reading requester uninterrupted, and further enable the object reading requester to send a target object re-reading request;
the second reading module is configured to respond to a request for obtaining a target object again, which is sent by the cloud gateway, obtain target object identification information according to the request for obtaining the target object again, read the target object according to the target object identification information until the target object is obtained by reading, and send the target object to the cloud gateway, so that the cloud gateway sends the target object to the object reading requester through the server, wherein the request for obtaining the target object again at least carries the target object identification information.
In this embodiment, after the object storage service system receives a target object reacquisition request which is sent by the cloud gateway and carries at least target object identification information, the second reading module reads the target object again according to the target object identification information until the target object can be read, for example, the target object is defrosted and becomes a readable target object after completion of the target object defrosting operation, and sends the read target object to the cloud gateway, so that the cloud gateway finally sends the target object to the object reading requester through the server.
Some technical features in the embodiment shown in fig. 7 are the same as or similar to those in the embodiment shown in fig. 6, and for specific explanation and explanation of the technical features, reference may be made to the description of the embodiment shown in fig. 6, and the present invention is not described herein again.
Fig. 8 is a block diagram illustrating a structure of an object reading management apparatus according to another embodiment of the present invention, which may be implemented as a server, as part of or all of an electronic device, by software, hardware, or a combination of both. As shown in fig. 8, the object reading management apparatus includes:
a second forwarding module 801, configured to forward, in response to receiving a target object read request sent by the object read requester, the target object read request to a cloud gateway, where the target object read request at least carries target object identification information;
a fourth sending module 802, configured to send a preset message to the object reading requester in response to receiving a target object waiting instruction sent by the cloud gateway, so as to keep a connection between the server and the object reading requester uninterrupted, and further enable the object reading requester to send a target object re-reading request;
the third forwarding module 803 is configured to forward, in response to receiving a target object re-reading request sent by the object reading requester, the target object re-reading request to the cloud gateway, where the target object re-reading request at least carries target object identification information.
As mentioned above, with the development of data technology, an object storage scheme capable of realizing automatic and intelligent storage and improving storage efficiency is widely used. The object storage is a general mass distributed storage system, and in order to reduce the whole TCO, the archival storage can be performed on mass cold data. However, most of the existing applications of users use a standard POSIX file interface to store and manage data, so for the management of archival storage, users cannot directly operate an object interface, or users use the object interface to unfreeze an object first and then switch tools to access the object by the aid of the file interface; or make a major transformation of the user's existing applications. The first processing method involves switching tools, so that the working efficiency is low, and the second processing method needs to spend a large amount of time cost and resource cost and also brings safety risk.
In view of the above problem, in this embodiment, an object reading management apparatus is proposed, which, after the server receives a target object waiting instruction sent by a cloud gateway, implements notification of a target object reading failure of an object reading requester but a waiting message based on a preset message in a network file system, so as to ensure that a normal link can be maintained between the object reading requester and the server before the archived object is thawed, and avoid a situation of a front-end input/output error. Compared with the prior art, the technical scheme improves the working efficiency and reduces the waste of time cost and resource cost.
In an embodiment of the present invention, the apparatus further includes a part that forwards the target object received from the cloud gateway to an object reading requester, that is, the object reading management apparatus includes:
the second forwarding module is configured to forward a target object reading request to a cloud gateway in response to receiving the target object reading request sent by the object reading requester, wherein the target object reading request at least carries target object identification information;
a fourth sending module, configured to send a preset message to the object reading requester in response to receiving a target object waiting instruction sent by the cloud gateway, so as to keep a connection between the server and the object reading requester uninterrupted, and further enable the object reading requester to send a target object re-reading request;
the third forwarding module is configured to forward a target object re-reading request to the cloud gateway in response to receiving the target object re-reading request sent by the object reading requester, where the target object re-reading request at least carries target object identification information;
the fourth forwarding module is configured to forward the target object to the object reading requester in response to receiving the target object sent by the cloud gateway.
Some technical features in the embodiment shown in fig. 8 are the same as or similar to those in the embodiment shown in fig. 6 to 7, and for specific explanation and explanation of the technical features, reference may be made to the description of the embodiment shown in fig. 6 to 7, and the present invention is not repeated here.
Fig. 9 is a block diagram illustrating a structure of an object reading management apparatus according to another embodiment of the present invention, which may be implemented as part or all of an electronic device, and may be implemented as an object reading requester, through software, hardware, or a combination of both. As shown in fig. 9, the object reading management apparatus includes:
a fifth sending module 901, configured to send a target object reading request to a cloud gateway through a server, so that the cloud gateway sends a target object obtaining request to an object storage service system according to the target object reading request, so that the object storage service system obtains and returns the target object according to the target object obtaining request, where at least target object identification information is carried in the target object reading request and the target object obtaining request;
a sixth sending module 902, configured to, in response to receiving a preset message sent by the server, send a target object re-reading request to the cloud gateway through the server after a preset time until receiving a target object sent by the server;
a second receiving module 903 configured to receive the target object sent by the server.
As mentioned above, with the development of data technology, an object storage scheme capable of realizing automatic and intelligent storage and improving storage efficiency is widely used. The object storage is a general mass distributed storage system, and in order to reduce the whole TCO, the archival storage can be performed on mass cold data. However, most of the existing applications of users use a standard POSIX file interface to store and manage data, so for the management of archival storage, users cannot directly operate an object interface, or users use the object interface to unfreeze an object first and then switch tools to access the object by the aid of the file interface; or make a major transformation of the user's existing applications. The first processing method involves switching tools, so that the working efficiency is low, and the second processing method needs to spend a large amount of time cost and resource cost and also brings safety risk.
In view of the above problem, in this embodiment, an object reading management apparatus is proposed, which, after receiving a preset message sent by a server to instruct to maintain connection and for a preset time, sends a target object re-reading request to the cloud gateway through the server until receiving a target object sent by the server. According to the technical scheme, the connection between the server and the target object is maintained and the target object is quickly read again by means of the preset message, so that the working efficiency is improved, and the waste of time cost and resource cost is reduced compared with the prior art.
As mentioned above, the object reading requester may be a user, an application, or another entity capable of sending an object reading request and directly communicating with the server, such as a network file system client. It should be noted that, when the object read requester is not a main body capable of directly communicating with the server, such as a network file system client, but a requester facing the network file system client, such as a user or an application, the object read requester needs to first send a target object read request to the network file system client, and then send the target object read request to the cloud gateway through the server by the network file system client, where the target object read request sent by the object read requester to the network file system client may be a request message based on a POSIX interface, and the target object read request sent by the network file system client to the server may be a request message based on a remote procedure call. Similarly, after the object storage service system reads the corresponding target object, the target object is also sent to the object read requester through the cloud gateway, the server and the network file system client.
Some technical features in the embodiment shown in fig. 9 are the same as or similar to those in the embodiment shown in fig. 6 to 8, and for specific explanation and explanation of the technical features, reference may be made to the description of the embodiment shown in fig. 6 to 9, and the present invention is not repeated herein.
Fig. 10 shows a block diagram of an object reading management apparatus according to another embodiment of the present invention, which may be implemented as part or all of an electronic device by software, hardware, or a combination of both, and may be implemented as an object reading management system including an object reading requester, a server, a cloud gateway, and an object storage service system. As shown in fig. 10, the object reading management apparatus includes:
an object reading requester 1001 configured to send a target object reading request to the server, and in response to receiving a preset message sent by the server, send a target object re-reading request to the server after a preset time until receiving a target object sent by the server, where the target object reading request at least carries target object identification information;
the server 1002 is configured to forward a target object read request to a cloud gateway in response to receiving the target object read request sent by the object read requester, send the preset message to the object read requester in response to receiving a target object waiting instruction sent by the cloud gateway, forward the target object read request to the cloud gateway in response to receiving the target object read request sent by the object read requester, and forward the target object to the object read requester in response to receiving the target object sent by the cloud gateway, where the target object read request at least carries target object identification information;
a cloud gateway 1003 configured to respond to receiving a target object read request sent by the server, generating a target object obtaining request according to target object identification information carried by the target object reading request, sending the target object obtaining request to an object storage service system, responding to a target object waiting instruction sent by the object storage service system, forwarding the target object waiting instruction to the server, responding to a target object re-reading request sent by the server, generating a target object re-acquisition request according to target object identification information carried by the target object re-reading request, sending the target object re-acquisition request to an object storage service system until a target object sent by the object storage service system is received, and sending the target object to the server, wherein the target object re-reading request at least carries the target object identification information;
the object storage service system 1004 is configured to, in response to receiving a target object obtaining request sent by the cloud gateway, read a target object according to target object identification information carried in the target object obtaining request, send a target object waiting instruction to the cloud gateway when it is determined that the storage type of the target object is archive, in response to receiving a target object re-obtaining request sent by the cloud gateway, read the target object according to the target object identification information carried in the target object re-obtaining request until the target object is read, and send the target object to the cloud gateway.
The object reading requester is a network file system client or a requester facing the network file system client, such as a user and an application.
In an embodiment of the present invention, when determining that the target object storage type is archive, the object storage service system may send a target object waiting instruction to the cloud gateway, and may be configured to:
when the storage type of the target object is determined to be archived, sending a target object non-acquirable message to the cloud gateway, responding to a received target object storage type acquiring request sent by the cloud gateway, sending a target object storage type notification message to the cloud gateway, responding to a received target object unfreezing request sent by the cloud gateway, performing unfreezing operation on the target object, and sending a target object waiting instruction to the cloud gateway;
in this implementation manner, after the cloud gateway generates a request for obtaining a target object according to target object identification information carried in the target object read request and sends the request to the object storage service system, the cloud gateway is further configured to: the method comprises the steps of responding to a received target object non-acquirable message sent by an object storage service system, sending a request for acquiring a target object storage type to the object storage service system, responding to a received target object storage type notification message sent by the object storage service system, and sending a target object unfreezing request to the object storage service system when the target object storage type is in an archive state.
Some technical features in the embodiment shown in fig. 10 are the same as or similar to those in the embodiment shown in fig. 6 to 9, and for specific explanation and explanation of the technical features, reference may be made to the description of the embodiment shown in fig. 6 to 9, and the present invention is not repeated here.
The embodiment of the invention also discloses an electronic device, which comprises a memory and a processor; wherein the content of the first and second substances,
the memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to perform any of the method steps described above.
Fig. 11 is a schematic structural diagram of a computer system suitable for implementing an object reading management method according to an embodiment of the present invention.
As shown in fig. 11, the computer system 1100 includes a processing unit 1101, which can execute various processes in the above-described embodiments according to a program stored in a Read Only Memory (ROM)1102 or a program loaded from a storage section 1108 into a Random Access Memory (RAM) 1103. In the RAM1103, various programs and data necessary for the operation of the system 1100 are also stored. The processing unit 1101, the ROM1102, and the RAM1103 are connected to each other by a bus 1104. An input/output (I/O) interface 1105 is also connected to bus 1104.
The following components are connected to the I/O interface 1105: an input portion 1106 including a keyboard, mouse, and the like; an output portion 1107 including a signal output unit such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage section 1108 including a hard disk and the like; and a communication section 1109 including a network interface card such as a LAN card, a modem, or the like. The communication section 1109 performs communication processing via a network such as the internet. A driver 1110 is also connected to the I/O interface 1105 as necessary. A removable medium 1111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 1110 as necessary, so that a computer program read out therefrom is mounted into the storage section 1108 as necessary. The processing unit 1101 may be implemented as a CPU, a GPU, a TPU, an FPGA, an NPU, or other processing units.
In particular, the above described method may be implemented as a computer software program according to an embodiment of the present invention. For example, embodiments of the present invention include a computer program product comprising a computer program tangibly embodied on a medium readable thereby, the computer program comprising program code for performing the object reading management method. In such an embodiment, the computer program can be downloaded and installed from a network through the communication portion 1109 and/or installed from the removable medium 1111.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowcharts or block diagrams may represent a module, a program segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units or modules described in the embodiments of the present invention may be implemented by software, or may be implemented by hardware. The units or modules described may also be provided in a processor, and the names of the units or modules do not in some cases constitute a limitation of the units or modules themselves.
As another aspect, an embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium may be a computer-readable storage medium included in the apparatus in the foregoing embodiment; or it may be a separate computer readable storage medium not incorporated into the device. The computer readable storage medium stores one or more programs for use by one or more processors in performing the methods described in the embodiments of the present invention.
The foregoing description is only exemplary of the preferred embodiments of the invention and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention according to the embodiments of the present invention is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is made without departing from the inventive concept. For example, the above features and (but not limited to) the features with similar functions disclosed in the embodiments of the present invention are mutually replaced to form the technical solution.

Claims (22)

1. An object reading management method is applicable to a cloud gateway and comprises the following steps:
receiving a target object reading request sent by an object reading requester through a server, wherein the target object reading request at least carries target object identification information;
acquiring the target object identification information according to the target object reading request, generating an acquisition target object request according to the target object identification information, and sending the acquisition target object request to an object storage service system so that the object storage service system acquires and returns the target object according to the acquisition target object request, wherein the target object request at least carries the target object identification information;
in response to receiving a target object waiting instruction sent by the object storage service system, forwarding the target object waiting instruction to the server so as to enable the server and the object reading requester to keep connection without interruption, and further enable the object reading requester to send a target object re-reading request, wherein the target object waiting instruction is sent to the cloud gateway by the object storage service system when the target object storage type is determined to be archived.
2. The method according to claim 1, wherein after the acquiring the target object identification information according to the target object reading request, generating an acquiring target object request according to the target object identification information, and sending the acquiring target object request to an object storage service system, the method further comprises:
the method comprises the steps of responding to a received target object non-acquirable message sent by an object storage service system, sending a request for acquiring a target object storage type to the object storage service system, responding to a received target object storage type notification message sent by the object storage service system, and sending a target object unfreezing request to the object storage service system when the target object storage type is in a file, so that the object storage service system unfreezes the target object, and sending a target object waiting instruction to the cloud gateway.
3. The method of claim 1 or 2, further comprising:
and responding to the target object sent by the object storage service system, and sending the target object to the object reading requester through the server.
4. The method of claim 1 or 2, further comprising:
responding to a target object re-reading request sent by the object reading requester through the server, acquiring the target object identification information according to the target object re-reading request, generating a re-acquisition target object request according to the target object identification information, sending the re-acquisition target object request to an object storage service system until a target object sent by the object storage service system is received, and sending the target object to the object reading requester through the server, wherein the target object re-reading request at least carries the target object identification information.
5. An object reading management method is suitable for an object storage service system and comprises the following steps:
in response to receiving a target object obtaining request sent by a cloud gateway, obtaining target object identification information according to the target object obtaining request, wherein the target object request at least carries the target object identification information;
reading the target object according to the target object identification information;
and when the storage type of the target object is determined to be archived, sending a target object waiting instruction to the cloud gateway, so that the cloud gateway forwards the target object waiting instruction to a server, keeping the connection between the server and the object reading requester uninterrupted, and further enabling the object reading requester to send a target object re-reading request.
6. The method of claim 5, the sending a wait for target object instruction to the cloud gateway when the target object storage type is determined to be archival, comprising:
when the storage type of the target object is determined to be archived, sending a message that the target object cannot acquire to the cloud gateway;
sending a target object storage type notification message to the cloud gateway in response to receiving a target object storage type acquisition request sent by the cloud gateway;
and in response to receiving a target object unfreezing request sent by the cloud gateway, unfreezing the target object, and sending a target object waiting instruction to the cloud gateway.
7. The method of claim 5 or 6, further comprising:
responding to a request for obtaining a target object again sent by the cloud gateway, obtaining target object identification information according to the request for obtaining the target object again, reading the target object according to the target object identification information until the target object is obtained by reading, and sending the target object to the cloud gateway so that the cloud gateway sends the target object to the object reading requester through the server, wherein the request for obtaining the target object again at least carries the target object identification information.
8. An object reading management method is applicable to a server and comprises the following steps:
responding to a target object reading request sent by the object reading requester, and forwarding the target object reading request to a cloud gateway, wherein the target object reading request at least carries target object identification information;
in response to receiving a target object waiting instruction sent by the cloud gateway, sending a preset message to the object reading requester so as to keep the connection between the server and the object reading requester uninterrupted, and further enabling the object reading requester to send a target object re-reading request;
and in response to receiving a target object re-reading request sent by the object reading requester, forwarding the target object re-reading request to a cloud gateway, wherein the target object re-reading request at least carries target object identification information, and the target object waiting instruction is sent to the cloud gateway by an object storage service system when determining that the storage type of the target object is archived, so that the cloud gateway forwards the target object re-reading request to the server.
9. The method of claim 8, wherein the preset message is an error message, a target object reading failure message, a waiting prompt message, a target object reading failure but waiting message, a holding prompt message, or a server object reading requester preset private message.
10. The method of claim 8 or 9, further comprising:
and responding to the received target object sent by the cloud gateway, and forwarding the target object to the object reading requester.
11. An object reading management method is suitable for an object reading requester and comprises the following steps:
sending a target object reading request to a cloud gateway through a server, so that the cloud gateway sends a target object obtaining request to an object storage service system according to the target object reading request, and the object storage service system obtains and returns the target object according to the target object obtaining request, wherein the target object reading request and the target object obtaining request at least carry target object identification information;
in response to receiving a preset message sent by the server, sending a target object re-reading request to the cloud gateway through the server after a preset time until a target object sent by the server is received, wherein the preset message is sent by the server to the object reading requester in response to receiving a target object waiting instruction sent by the cloud gateway so as to keep the connection between the server and the object reading requester uninterrupted, and the target object waiting instruction is sent by the object storage service system to the cloud gateway when the target object storage type is determined to be archived, so that the cloud gateway can forward the target object to the server;
and receiving the target object sent by the server.
12. The method of claim 11, wherein the preset message is an error message, a target object reading failure message, a waiting prompt message, a target object reading failure but waiting message, a holding prompt message, or a server object reading requester preset private message.
13. An object reading management method is suitable for an object reading management system comprising an object reading requester, a server, a cloud gateway and an object storage service system, and comprises the following steps:
the object reading request direction sends a target object reading request to the server, wherein the target object reading request at least carries target object identification information;
the server responds to a target object reading request sent by the object reading requester, and forwards the target object reading request to the cloud gateway;
the cloud gateway responds to a target object reading request sent by the server, generates a target object obtaining request according to target object identification information carried by the target object reading request and sends the target object obtaining request to an object storage service system;
the object storage service system responds to a received target object acquisition request sent by the cloud gateway, reads a target object according to target object identification information carried by the target object acquisition request, and sends a target object waiting instruction to the cloud gateway when the target object storage type is determined to be archived;
the cloud gateway responds to a target object waiting instruction sent by the object storage service system and forwards the target object waiting instruction to the server;
the server responds to a target object waiting instruction sent by the cloud gateway, and sends a preset message to the object reading requester so as to keep the connection between the server and the object reading requester uninterrupted;
the object reading requester responds to the preset message sent by the server, and sends a target object re-reading request to the server after a preset time until the target object sent by the server is received;
the server responds to a target object re-reading request sent by the object reading requester, forwards the target object re-reading request to the cloud gateway, and responds to the target object sent by the cloud gateway, forwards the target object to the object reading requester, wherein the target object re-reading request at least carries target object identification information;
the cloud gateway responds to a target object re-reading request sent by the server, generates a re-acquisition target object request according to target object identification information carried by the target object re-reading request, sends the re-acquisition target object request to an object storage service system until receiving a target object sent by the object storage service system, and sends the target object to the server;
and the object storage service system responds to the received request for obtaining the target object again sent by the cloud gateway, reads the target object according to the target object identification information carried by the request for obtaining the target object again until the target object is obtained by reading, and sends the target object to the cloud gateway.
14. The method of claim 13, the object storage service system, upon determining that the target object storage type is archival, sending a wait for target object instruction to the cloud gateway, implemented to:
when the storage type of the target object is determined to be archived, sending a target object non-acquirable message to the cloud gateway, responding to a received target object storage type acquiring request sent by the cloud gateway, sending a target object storage type notification message to the cloud gateway, responding to a received target object unfreezing request sent by the cloud gateway, performing unfreezing operation on the target object, and sending a target object waiting instruction to the cloud gateway;
after the cloud gateway generates a target object obtaining request according to the target object identification information carried by the target object reading request and sends the target object obtaining request to the object storage service system, the cloud gateway further comprises: the method comprises the steps of responding to a received target object non-acquirable message sent by an object storage service system, sending a request for acquiring a target object storage type to the object storage service system, responding to a received target object storage type notification message sent by the object storage service system, and sending a target object unfreezing request to the object storage service system when the target object storage type is in an archive state.
15. The method according to claim 13 or 14, wherein the preset message is an error message, a target object reading failure message, a waiting prompt message, a target object reading failure but waiting message, a holding prompt message or a server object reading requester preset private message.
16. An object reading management device applicable to a cloud gateway, comprising:
the device comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is configured to receive a target object reading request sent by an object reading requester through a server, and the target object reading request at least carries target object identification information;
a first generating module, configured to obtain the target object identification information according to the target object reading request, generate a target object obtaining request according to the target object identification information, and send the target object obtaining request to an object storage service system, so that the object storage service system obtains and returns the target object according to the target object obtaining request, where the target object request at least carries the target object identification information;
the first forwarding module is configured to forward a waiting target object instruction to the server in response to receiving the waiting target object instruction sent by the object storage service system, so that the server and the object reading requester keep the connection without interruption, and further the object reading requester sends a target object re-reading request, wherein the waiting target object instruction is sent to the cloud gateway by the object storage service system when the object storage service system determines that the target object storage type is archive.
17. An object reading management apparatus adapted to an object storage service system, comprising:
the cloud gateway comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is configured to respond to a received target object acquisition request sent by the cloud gateway and acquire target object identification information according to the target object acquisition request, and the target object request at least carries the target object identification information;
a first reading module configured to read a target object according to the target object identification information;
and the third sending module is configured to send a target object waiting instruction to the cloud gateway when the storage type of the target object is determined to be archived, so that the cloud gateway forwards the target object waiting instruction to the server, the connection between the server and the object reading requester is kept uninterrupted, and the object reading requester sends a target object re-reading request.
18. An object reading management apparatus adapted to a server, comprising:
the second forwarding module is configured to forward a target object reading request to a cloud gateway in response to receiving the target object reading request sent by the object reading requester, wherein the target object reading request at least carries target object identification information;
a fourth sending module, configured to send a preset message to the object reading requester in response to receiving a target object waiting instruction sent by the cloud gateway, so as to keep a connection between the server and the object reading requester uninterrupted, and further enable the object reading requester to send a target object re-reading request, where the target object waiting instruction is sent by an object storage service system to the cloud gateway when determining that a target object storage type is archived, so that the cloud gateway forwards the target object to the server;
and the third forwarding module is configured to forward the target object re-reading request to the cloud gateway in response to receiving the target object re-reading request sent by the object reading requester, wherein the target object re-reading request at least carries target object identification information.
19. An object reading management apparatus adapted to an object reading requester, comprising:
a fifth sending module, configured to send a target object reading request to a cloud gateway through a server, so that the cloud gateway sends a target object obtaining request to an object storage service system according to the target object reading request, so that the object storage service system obtains and returns the target object according to the target object obtaining request, where at least target object identification information is carried in the target object reading request and the target object obtaining request;
a sixth sending module, configured to, in response to receiving a preset message sent by the server, send a target object re-reading request to the cloud gateway through the server after a preset time until receiving a target object sent by the server, where the preset message is sent by the server to the object read requester in response to receiving a target object waiting instruction sent by the cloud gateway, so as to keep a connection between the server and the object read requester uninterrupted, where the target object waiting instruction is sent by the object storage service system to the cloud gateway when determining that a target object storage type is archived, so that the cloud gateway forwards the target object to the server;
a second receiving module configured to receive the target object sent by the server.
20. An object reading management apparatus applied to an object reading management system including an object reading requester, a server, a cloud gateway, and an object storage service system, comprising:
the object reading requester is configured to send a target object reading request to the server, and in response to receiving a preset message sent by the server, send a target object re-reading request to the server after a preset time until receiving a target object sent by the server, wherein the target object reading request at least carries target object identification information;
the server is configured to forward a target object reading request to a cloud gateway in response to receiving the target object reading request sent by the object reading requester, send the preset message to the object reading requester in response to receiving a target object waiting instruction sent by the cloud gateway so as to keep the connection between the server and the object reading requester uninterrupted, forward a target object re-reading request to the cloud gateway in response to receiving the target object re-reading request sent by the object reading requester, and forward the target object to the object reading requester in response to receiving the target object sent by the cloud gateway, wherein the target object re-reading request at least carries target object identification information;
the cloud gateway configured to, in response to receiving a target object read request sent by the server, generating a target object obtaining request according to target object identification information carried by the target object reading request, sending the target object obtaining request to an object storage service system, responding to a target object waiting instruction sent by the object storage service system, forwarding the target object waiting instruction to the server, responding to a target object re-reading request sent by the server, generating a target object re-acquisition request according to target object identification information carried by the target object re-reading request, sending the target object re-acquisition request to an object storage service system until a target object sent by the object storage service system is received, and sending the target object to the server, wherein the target object re-reading request at least carries the target object identification information;
the object storage service system is configured to respond to a received target object obtaining request sent by the cloud gateway, read a target object according to target object identification information carried by the target object obtaining request, send a target object waiting instruction to the cloud gateway when the storage type of the target object is determined to be archived, respond to a received target object obtaining request sent by the cloud gateway again, read the target object according to the target object identification information carried by the target object obtaining request again until the target object is obtained by reading, and send the target object to the cloud gateway.
21. An electronic device comprising a memory and a processor; wherein the content of the first and second substances,
the memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the method steps of any of claims 1-15.
22. A computer readable storage medium having stored thereon computer instructions which, when executed by a processor, carry out the method steps of any of claims 1-15.
CN202010216577.1A 2020-03-25 2020-03-25 Object reading management method and device, electronic equipment and computer storage medium Active CN113452730B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010216577.1A CN113452730B (en) 2020-03-25 2020-03-25 Object reading management method and device, electronic equipment and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010216577.1A CN113452730B (en) 2020-03-25 2020-03-25 Object reading management method and device, electronic equipment and computer storage medium

Publications (2)

Publication Number Publication Date
CN113452730A CN113452730A (en) 2021-09-28
CN113452730B true CN113452730B (en) 2022-04-29

Family

ID=77806680

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010216577.1A Active CN113452730B (en) 2020-03-25 2020-03-25 Object reading management method and device, electronic equipment and computer storage medium

Country Status (1)

Country Link
CN (1) CN113452730B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103095687A (en) * 2012-12-19 2013-05-08 华为技术有限公司 Method and device of metadata processing
CN104813321A (en) * 2013-02-27 2015-07-29 日立数据***有限公司 Decoupled content and metadata in a distributed object storage ecosystem
CN109597791A (en) * 2018-11-30 2019-04-09 华录光存储研究院(大连)有限公司 Filing system based on OpenStack platform
CN110178127A (en) * 2017-01-18 2019-08-27 Netapp股份有限公司 Method and system for the data capsule for restoring to achieve at object-based storage
CN110392876A (en) * 2017-03-10 2019-10-29 净睿存储股份有限公司 Data set and other managed objects are synchronously copied into storage system based on cloud

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2543746C (en) * 2003-10-27 2018-01-16 Archivas, Inc. Policy-based management of a redundant array of independent nodes
US20160140131A1 (en) * 2014-11-19 2016-05-19 Prophetstor Data Services, Inc. Method and system for data transformation for cloud-based archiving and backup
US10742735B2 (en) * 2017-12-12 2020-08-11 Commvault Systems, Inc. Enhanced network attached storage (NAS) services interfacing to cloud storage
US10536522B2 (en) * 2018-04-30 2020-01-14 EMC IP Holding Company LLC Data storage system with LUN archiving to cloud using volume-to-object translation

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103095687A (en) * 2012-12-19 2013-05-08 华为技术有限公司 Method and device of metadata processing
CN104813321A (en) * 2013-02-27 2015-07-29 日立数据***有限公司 Decoupled content and metadata in a distributed object storage ecosystem
CN110178127A (en) * 2017-01-18 2019-08-27 Netapp股份有限公司 Method and system for the data capsule for restoring to achieve at object-based storage
CN110392876A (en) * 2017-03-10 2019-10-29 净睿存储股份有限公司 Data set and other managed objects are synchronously copied into storage system based on cloud
CN109597791A (en) * 2018-11-30 2019-04-09 华录光存储研究院(大连)有限公司 Filing system based on OpenStack platform

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
"Cost Optimization Algorithms for Hot and Cool Tiers Cloud Storage Services";Yaser Mansouri;《2018 IEEE 11th International Conference on Cloud Computing (CLOUD)》;20180910;全文 *
"Distributed archiving storage system based on CAS";Zhu Li-Gu;《2009 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurements Systems》;20090605;全文 *
"基于异构存储设备的分布式对象存储***优化研究";吴林;《中国优秀博士学位论文全文数据库》;20190415;全文 *
"对象存储服务之归档存储对象使用指南";shan0304;《https://bbs.huaweicloud.com/blogs/121664》;20190926;全文 *
"解冻文件";阿里云;《https://help.aliyun.com/knowledge_detail/119181.html?scm=20140722.184.2.173》;20200228;全文 *

Also Published As

Publication number Publication date
CN113452730A (en) 2021-09-28

Similar Documents

Publication Publication Date Title
RU2606052C2 (en) Application consistent snapshots of shared volume
CN111277639B (en) Method and device for maintaining data consistency
CN109150662B (en) Message transmission method, distributed system, device, medium, and unmanned vehicle
CN110753084B (en) Uplink data reading method, cache server and computer readable storage medium
JP6700308B2 (en) Data copy method and device
CN105302676A (en) Method and apparatus for transmitting host and backup mechanism data of distributed file system
US20060069587A1 (en) Retained publish/subscribe system
US20080313349A1 (en) Connecting a client to one of a plurality of servers
CN114461371A (en) Method, device, equipment and medium for optimizing interruption of server system
CN113452730B (en) Object reading management method and device, electronic equipment and computer storage medium
CN111984388A (en) Method, device and medium for coordinating data consistency in distributed transactions of cloud environment
CN113590362A (en) Inter-process message processing method and device, electronic equipment and storage medium
CN111596864A (en) Method, device, server and storage medium for data delayed deletion
CN109743386B (en) Session request sending method and device, electronic equipment and storage medium
CN116643896A (en) Inter-process data interaction method, system, electronic equipment and storage medium
CN111679892A (en) Distributed transaction processing method, device, equipment and medium
CN115811538A (en) Method, apparatus, system and medium for requesting and processing digital key service
CN112783826B (en) Object storage management method, device, electronic equipment and computer storage medium
US9092779B2 (en) Heuristics processing
CN112994949A (en) Private network connection method, device, equipment and storage medium
CN109309583B (en) Information acquisition method and device based on distributed system, electronic equipment and medium
US8989184B2 (en) Message relay apparatus and method
CN113783830B (en) Method and apparatus for data communication
CN111858772A (en) Parallel chain transaction group execution method, device and storage medium
US11218571B2 (en) Methods and storage media for transmitting message

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40059941

Country of ref document: HK

TR01 Transfer of patent right

Effective date of registration: 20230530

Address after: Room 1-2-A06, Yungu Park, No. 1008 Dengcai Street, Sandun Town, Xihu District, Hangzhou City, Zhejiang Province

Patentee after: Aliyun Computing Co.,Ltd.

Address before: Box 847, four, Grand Cayman capital, Cayman Islands, UK

Patentee before: ALIBABA GROUP HOLDING Ltd.

TR01 Transfer of patent right