CN117743353A - Data updating method, device, equipment and storage medium - Google Patents
Data updating method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN117743353A CN117743353A CN202311753739.5A CN202311753739A CN117743353A CN 117743353 A CN117743353 A CN 117743353A CN 202311753739 A CN202311753739 A CN 202311753739A CN 117743353 A CN117743353 A CN 117743353A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- server
- updating
- update
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 81
- 238000013523 data management Methods 0.000 claims abstract description 71
- 238000004590 computer program Methods 0.000 claims description 19
- 238000006243 chemical reaction Methods 0.000 claims description 17
- 238000012360 testing method Methods 0.000 claims description 13
- 230000007246 mechanism Effects 0.000 claims description 10
- 238000005516 engineering process Methods 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 34
- 230000008569 process Effects 0.000 description 12
- 230000015654 memory Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present disclosure provides a data updating method, apparatus, device and storage medium, which can be applied to the technical fields of computer technology and financial science and technology. The method comprises the following steps: responding to a data updating request of a target service, and determining a target cluster identifier corresponding to the target service from a service cluster catalog of a data management platform; determining a target server identifier corresponding to the data updating request in the data management platform according to the target cluster identifier; determining an updating condition for updating target data in the data management platform based on a server function identifier in the target server identifier, wherein the target data is a parameter about a target server stored in the data management platform, and the target server corresponds to the target server identifier; and under the condition that the data updating request meets the updating condition, acquiring the updating data of the target service based on the data loading interface so as to update the target data based on the updating data.
Description
Technical Field
The present disclosure relates to the field of computer technology and financial technology, and in particular, to a data updating method, apparatus, device, medium, and program product.
Background
At present, in order to improve the efficiency of the user accessing the database data, the server side will load some information such as table data, configuration files, etc. which will not change frequently into the server memory in advance, so as to increase the access speed. When these table data changes, the data can be updated by matching the network layer protocol of the corresponding server to facilitate the user's access.
In the process of realizing the disclosed concept, the inventor finds that at least the following problems exist in the related art, because the number of services deployed in the server is large, in the process of updating the data of a certain service, the servers corresponding to the services needing to be updated need to be obtained by matching from a large number of servers, and then the data is updated, so that the data is not updated timely, and the updating efficiency is low.
Disclosure of Invention
In view of the foregoing, the present disclosure provides data update methods, apparatuses, devices, media, and program products.
According to a first aspect of the present disclosure, there is provided a data updating method comprising: responding to a data updating request of a target service, and determining a target cluster identifier corresponding to the target service from a service cluster catalog of a data management platform; determining a target server identifier corresponding to the data updating request in the data management platform according to the target cluster identifier; determining an updating condition for updating target data in the data management platform based on a server function identifier in the target server identifier, wherein the target data is a parameter about a target server stored in the data management platform, and the target server corresponds to the target server identifier; and under the condition that the data updating request meets the updating condition, acquiring the updating data of the target service based on the data loading interface so as to update the target data based on the updating data.
According to an embodiment of the present disclosure, a service cluster directory includes a plurality of service cluster identifiers, and determining, from the service cluster directory of a data management platform, a target cluster identifier corresponding to a target service includes: determining service deployment information corresponding to each server cluster identifier in a data management platform; matching the target service with a plurality of service deployment information to obtain a matching result; based on the matching result, a target cluster identity is determined from the plurality of server clusters.
According to an embodiment of the present disclosure, determining, in a data management platform, a target server identifier corresponding to a data update request according to a target cluster identifier, includes: determining a plurality of server identifications corresponding to the target cluster identifications in a data management platform; and determining a target server identification from the plurality of server identifications according to the server update identification in the data update request.
According to an embodiment of the present disclosure, determining an update condition for updating target data in a data management platform based on a server function identification in a target server identification includes: under the condition that the server function identifier is determined to be a normal operation identifier, determining that the server update identifier in the data update request is a valid identifier; and under the condition that the server function identifier is determined to be the gray test identifier, determining that the update condition is greater than the preset times in the data update request.
According to an embodiment of the present disclosure, before acquiring update data of a target service based on a data loading interface, the data update method further includes: generating an update message based on the data update request and the target server identification; and sending the update message to the data update system by utilizing the data loading interface, so that the data update system sends the update data corresponding to the update message to the data management platform by utilizing the data loading interface.
According to an embodiment of the present disclosure, acquiring update data of a target service based on a data loading interface to update the target data based on the update data includes: acquiring update data of a target service based on a data loading interface; carrying out format conversion on the updated data to obtain converted data; determining an updating method for the conversion data according to a reflection mechanism algorithm; and executing an updating method in the data management platform to finish updating the target data.
According to an embodiment of the present disclosure, a service cluster directory is generated by: determining physical distribution information of each server in a server cluster; dividing servers in the server cluster based on the plurality of physical distribution information to obtain a plurality of server sub-clusters; dividing the server sub-clusters based on service deployment information of each server in the server sub-clusters aiming at each server sub-cluster to obtain a plurality of server cluster units; and generating a service cluster catalog according to the server cluster identification corresponding to each server cluster unit.
A second aspect of the present disclosure provides a data updating apparatus, comprising:
the cluster identification determining module is used for responding to the data updating request of the target service and determining a target cluster identification corresponding to the target service from a service cluster catalog of the data management platform;
the service identification determining module is used for determining a target server identification corresponding to the data updating request in the data management platform according to the target cluster identification;
the updating condition determining module is used for determining updating conditions for updating target data in the data management platform based on the server function identification in the target server identification, wherein the target data are parameters about a target server stored in the data management platform, and the target server corresponds to the target server identification;
and the data updating module is used for acquiring the updating data of the target service based on the data loading interface under the condition that the data updating request meets the updating condition so as to update the target data based on the updating data.
A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method described above.
A fourth aspect of the present disclosure also provides a computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to perform the above-described method.
A fifth aspect of the present disclosure also provides a computer program product comprising a computer program which, when executed by a processor, implements the above method.
According to the data updating method, the device, the equipment, the medium and the program product, through monitoring the data updating request, under the condition that the data of the target service needs to be updated, the target cluster identification is determined from the service cluster catalog of the data management platform according to the target service, so that the target server identification is determined based on the target cluster identification. In the process of determining the target server identification, the target server identification is obtained by step-by-step matching in the data management platform according to the target service and the target cluster identification, and compared with the process of directly matching the target server in all servers, the matching efficiency is effectively improved. After the target server identification is determined, in the process of updating the data, the updating condition for updating the target data is determined according to the server function identification, so that different servers can be updated in a targeted manner, the process of updating the target data is more accurate, and the updating efficiency of the data is effectively improved.
Drawings
The foregoing and other objects, features and advantages of the disclosure will be more apparent from the following description of embodiments of the disclosure with reference to the accompanying drawings, in which:
FIG. 1 schematically illustrates an application scenario diagram of a data update method, apparatus, device, medium and program product according to an embodiment of the present disclosure;
FIG. 2 schematically illustrates a flow chart of a data update method according to an embodiment of the present disclosure;
FIG. 3 schematically illustrates a data management platform of a data update method according to an embodiment of the present disclosure;
FIG. 4 schematically illustrates an update data interface of a data update method according to an embodiment of the present disclosure;
FIG. 5 schematically illustrates a block diagram of a data updating apparatus according to an embodiment of the present disclosure; and
fig. 6 schematically illustrates a block diagram of an electronic device adapted to implement a data update method according to an embodiment of the present disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is only exemplary and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the present disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. In addition, in the following description, descriptions of well-known structures and techniques are omitted so as not to unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and/or the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It should be noted that the terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly formal manner.
Where expressions like at least one of "A, B and C, etc. are used, the expressions should generally be interpreted in accordance with the meaning as commonly understood by those skilled in the art (e.g.," a system having at least one of A, B and C "shall include, but not be limited to, a system having a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
In the technical scheme of the invention, the related user information (including but not limited to user personal information, user image information, user equipment information, such as position information and the like) and data (including but not limited to data for analysis, stored data, displayed data and the like) are information and data authorized by a user or fully authorized by all parties, and the processing of the related data such as collection, storage, use, processing, transmission, provision, disclosure, application and the like are all conducted according to the related laws and regulations and standards of related countries and regions, necessary security measures are adopted, no prejudice to the public welfare is provided, and corresponding operation inlets are provided for the user to select authorization or rejection.
The embodiment of the disclosure provides a data updating method, which comprises the following steps: responding to a data updating request of a target service, and determining a target cluster identifier corresponding to the target service from a service cluster catalog of a data management platform; determining a target server identifier corresponding to the data updating request in the data management platform according to the target cluster identifier; determining an updating condition for updating target data in the data management platform based on a server function identifier in the target server identifier, wherein the target data is a parameter about a target server stored in the data management platform, and the target server corresponds to the target server identifier; and under the condition that the data updating request meets the updating condition, acquiring the updating data of the target service based on the data loading interface so as to update the target data based on the updating data.
Fig. 1 schematically illustrates an application scenario diagram of a data update method, apparatus, device, medium and program product according to an embodiment of the present disclosure.
As shown in fig. 1, an application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is a medium used to provide a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The user may interact with the server 105 through the network 104 using at least one of the first terminal device 101, the second terminal device 102, the third terminal device 103, to receive or send messages, etc. Various communication client applications, such as a shopping class application, a web browser application, a search class application, an instant messaging tool, a mailbox client, social platform software, etc. (by way of example only) may be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103.
The first terminal device 101, the second terminal device 102, the third terminal device 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.
The server 105 may be a server providing various services, such as a background management server (by way of example only) providing support for websites browsed by the user using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as the user request, and feed back the processing result (e.g., the web page, information, or data obtained or generated according to the user request) to the terminal device.
It should be noted that the data updating method provided by the embodiments of the present disclosure may be generally performed by the server 105. Accordingly, the data updating apparatus provided by the embodiments of the present disclosure may be generally provided in the server 105. The data updating method provided by the embodiments of the present disclosure may also be performed by a server or a server cluster that is different from the server 105 and is capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103, and/or the server 105. Accordingly, the data updating apparatus provided by the embodiments of the present disclosure may also be provided in a server or a server cluster that is different from the server 105 and is capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103, and/or the server 105.
It should be understood that the number of terminal devices, networks and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
The data update method of the disclosed embodiment will be described in detail below with reference to fig. 2 to 4 based on the scenario described in fig. 1.
Fig. 2 schematically illustrates a flow chart of a data update method according to an embodiment of the present disclosure.
As shown in fig. 2, the data update of this embodiment includes operations S210 to S240.
In operation S210, a target cluster identification corresponding to the target service is determined from the service cluster directory of the data management platform in response to the data update request of the target service.
In operation S220, a target server identification corresponding to the data update request is determined in the data management platform according to the target cluster identification.
In operation S230, an update condition for updating target data in the data management platform is determined based on the server function identification in the target server identification, wherein the target data is a parameter stored in the data management platform with respect to the target server, and the target server corresponds to the target server identification.
In operation S240, in case it is determined that the data update request satisfies the update condition, update data of the target service is acquired based on the data loading interface to update the target data based on the update data.
According to an embodiment of the present disclosure, the data update request may be a request triggered by a listening configuration update event (ConfigChangeEvent) accessing an Apollo configuration center through a native API interface (Application Programming Interface ) of Apollo. The data management platform is used for managing data of a plurality of servers, and each server corresponds to one server identification.
According to the embodiment of the disclosure, a plurality of servers can be divided into a plurality of service cluster directories according to the attribute of the server, and each service cluster in the service cluster directory corresponds to one service cluster identifier. According to the service cluster to which the server corresponding to the target service belongs, the target cluster identifier corresponding to the target service can be determined, and the target server identifier is determined from the corresponding service cluster.
According to embodiments of the present disclosure, server function identification may be used to identify a function class of a corresponding server, according to which the server may be classified into: a normal server for normal operation business, a gray server for business test points, etc. The update conditions may be conditions respectively formulated according to servers of different functional classifications for judging whether to perform data update.
According to an embodiment of the present disclosure, a data update request is analyzed to determine whether the data update request satisfies an update condition. And under the condition that the data updating request meets the updating condition, acquiring the updating data of the target service based on the data loading interface. The data loading interface may use an IToolkitWithReload interface, which is used to enable each service to access the data management platform and provide a unified message format for the interaction between the service and the data management platform, so that the target service can receive the event sent by the data management platform and update the data. After the update data is determined, the target data may be overwritten to effect an update of the target data.
According to the embodiment of the disclosure, the server function identification of the target server is determined by monitoring the data update request and determining the target server identification from the corresponding service cluster according to the target service. And the server matching process is completed through the twice matching, so that the matching efficiency of the target servers is improved compared with the matching of the target servers in all servers. And determining a target data updating condition corresponding to the target server according to the server function identifier, and determining whether the target data needs to be updated according to the data updating request and the updating condition so as to realize hot updating of the target service under the condition that the target data needs to be updated. Since the determination of the server function identification is made by matching the service cluster directory. Because different updating conditions are set for the target data corresponding to different server function identifiers, the targeted updating of different servers can be realized, the data updating is more accurate, and the data updating efficiency is improved.
According to an embodiment of the present disclosure, a service cluster directory includes a plurality of service cluster identifiers, and determining, from the service cluster directory of a data management platform, a target cluster identifier corresponding to a target service includes: determining service deployment information corresponding to each server cluster identifier in a data management platform; matching the target service with a plurality of service deployment information to obtain a matching result; based on the matching result, a target cluster identity is determined from the plurality of server clusters.
According to the embodiment of the disclosure, according to the corresponding relation between each service cluster and the service cluster identifier, a plurality of service cluster identifiers corresponding to a plurality of service clusters can be determined. The service deployment information corresponding to the server cluster identifier may be determined according to services deployed on a plurality of servers in the service cluster corresponding to the server cluster identifier. The matching result may be used to determine service deployment information to which the target service belongs, thereby determining a corresponding target cluster identifier.
According to an embodiment of the present disclosure, determining, in a data management platform, a target server identifier corresponding to a data update request according to a target cluster identifier, includes: determining a plurality of server identifications corresponding to the target cluster identifications in a data management platform; and determining a target server identification from the plurality of server identifications according to the server update identification in the data update request.
Fig. 3 schematically illustrates a data management platform of a data update method according to an embodiment of the present disclosure.
According to an embodiment of the present disclosure, as shown in fig. 3, the data management platform includes a service cluster directory 310 and a server identification directory 320 under a target cluster identification. The service cluster directory 310 includes a plurality of service cluster identifications, service cluster a, service cluster B, service cluster C, and service cluster D, respectively. And matching the target service with the service deployment information in the service clusters to obtain a matching result. Based on the matching result, it may be determined that the target cluster is identified as the service cluster C.
According to an embodiment of the present disclosure, server identification directory 320 includes a plurality of server identifications corresponding to service cluster C, for example: server a normal identification, server B gray identification, server C normal identification, and server D gray identification. Wherein the server identification may be a namespace corresponding to each server. The data update request may include a server update identification from which the target server identification can be determined from the server identification directory 320. For example: the server update identifier in the data update request is server a, and the target server identifier is determined to be the server a normal identifier based on the server identifier directory 320.
According to the embodiment of the disclosure, the matching of the target servers corresponding to the target service is completed by determining the target cluster identification from the service cluster catalog and then determining the target server identification from the target cluster. The matching time can be reduced, the matching efficiency and accuracy are improved, and the data updating performance is improved.
According to an embodiment of the present disclosure, determining an update condition for updating target data in a data management platform based on a server function identification in a target server identification includes: under the condition that the server function identifier is determined to be a normal operation identifier, determining that the server update identifier in the data update request is a valid identifier; and under the condition that the server function identifier is determined to be the gray test identifier, determining that the update condition is greater than the preset times in the data update request.
According to embodiments of the present disclosure, the data update request may also include a server function identification, a server update identification, and a number of updates. The server function identifier may include a normal operation identifier and a gray test identifier, which respectively correspond to a normal server for normal operation service and a gray server for performing service test points. The same service can be deployed in two servers, and the server function identifiers of the two servers are respectively a normal operation identifier and a gray test identifier. As shown in fig. 3, in the server identifier directory 320, the server a and the server B corresponding to the server a normal identifier and the server B gray identifier may be used to provide the same service, and the corresponding update condition can be determined through the normal operation identifier and the gray test identifier.
According to the embodiment of the disclosure, under the condition that the server function identifier is determined to be a normal operation identifier, the server update identifier can represent whether the target service can be updated normally, and under the condition that the server update identifier is determined to be an effective identifier, the target service can be updated normally; and under the condition that the server updating identification is an invalid identification, the characterization target service cannot be updated normally. According to the embodiment of the disclosure, by setting different updating conditions for the servers with different server function identifications, the data updating of the servers with different functions can be managed in a targeted manner. For the server with the normal operation identifier, the data is updated under the condition that the server updating identifier is an effective identifier, so that the correctness of the target data can be ensured, and the normal operation of the service can be ensured.
According to the embodiment of the disclosure, in the case that the server function identifier is determined to be the gray test identifier, the update times can represent the times of updating the target data corresponding to the target service, and each time the target data is updated, the update times are accumulated by 1. The preset times can be preset updating times thresholds according to the specific type of the target service, and when the updating times are larger than the preset times, updating operation is executed, and the updating times are reset to 0; in the case where the number of updates is smaller than the preset number, only the number of updates is accumulated by 1, and the update operation is not performed.
According to the embodiment of the disclosure, for the server of the gray test identifier, since updating occurs frequently in the test process and a large amount of error data may occur in the test process, updating the target data after each updating may result in waste of service resources, so that the data updating is performed only when the number of updating times is greater than the preset number of times, thereby reducing the number of updating times and improving the efficiency of data updating.
According to an embodiment of the present disclosure, before acquiring update data of a target service based on a data loading interface, the data update method further includes: generating an update message based on the data update request and the target server identification; and sending the update message to the data update system by utilizing the data loading interface, so that the data update system sends the update data corresponding to the update message to the data management platform by utilizing the data loading interface.
According to the embodiment of the disclosure, the data update request and the target server identification are converted into a unified message format, and an update message is obtained. The data updating system can be used for storing the updating condition of the data corresponding to each service, and after receiving the updating message sent by the data loading interface, the data updating system can send the target data of the target server to the data management platform by the data loading interface according to the target server identification and the data updating request, so that the data management platform can judge whether the target data needs to be updated according to the data updating request and the updating condition.
According to the embodiment of the disclosure, after the data corresponding to each service is updated, the data updating system may send an update notification message to the data management platform, where the update notification message may include parameters such as a service name, a corresponding server function identifier, an update time, and an update number of times. After receiving the data updating request, the data management platform can judge whether the data updating request meets the updating conditions, and under the condition that the data updating request meets the updating conditions, the data loading interface requests the data updating system for updating data, so that the storage pressure of the data management platform is reduced.
According to an embodiment of the present disclosure, acquiring update data of a target service based on a data loading interface to update the target data based on the update data includes: acquiring update data of a target service based on a data loading interface; carrying out format conversion on the updated data to obtain converted data; determining an updating method for the conversion data according to a reflection mechanism algorithm; and executing an updating method in the data management platform to finish updating the target data.
According to embodiments of the present disclosure, the converted data after format conversion may be in various preset formats, including extensible markup language (eXtensible Markup Language, XML), high readability, format for expressing data serialization (YAML Ain't Markup Language, YAML), profile format (properties), and the like.
According to an embodiment of the present disclosure, the reflection mechanism may be a Java reflection mechanism, capable of acquiring all information of the conversion data during operation, including an update method for the conversion data. And the updating of the target data can be completed by executing the corresponding updating method. The update method includes adding, deleting, overwriting, rewriting, etc.
Fig. 4 schematically illustrates an update data interface of a data update method according to an embodiment of the present disclosure.
As shown in fig. 4, the interface includes a server identifier directory obtained through the data loading interface, a target server identifier determined according to the server update identifier, and update data corresponding to the target server identifier. The update data corresponding to the server B in fig. 4 is "ABC". And updating the target data by using conversion data obtained after format conversion of the update data according to the update method corresponding to the server B determined by the reflection mechanism.
For example, a target server identifies that an update method determined according to the reflection mechanism is "client update resource", update data is "ABC", and executing the update method may use conversion data corresponding to "ABC" to cover target data of the client. The other target server identifies that the updating method determined according to the reflection mechanism is "updating the regional switch table", the updating data is "BCD", and the target data in the regional switch table can be covered by conversion data corresponding to the "BCD" when the updating method is executed.
According to the embodiment of the disclosure, the data is acquired and sent based on the data loading interface, so that the unification of data formats can be ensured, and redundancy is reduced. The updating method obtained through the reflection mechanism can ensure that the target data is updated by using a proper updating method, and the accuracy of data updating is improved.
According to an embodiment of the present disclosure, a service cluster directory is generated by: determining physical distribution information of each server in a server cluster; dividing servers in the server cluster based on the plurality of physical distribution information to obtain a plurality of server sub-clusters; dividing the server sub-clusters based on service deployment information of each server in the server sub-clusters aiming at each server sub-cluster to obtain a plurality of server cluster units; and generating a service cluster catalog according to the server cluster identification corresponding to each server cluster unit.
According to the embodiment of the disclosure, the physical distribution information of the servers may be physical locations set by the servers, and the servers with similar physical locations may be divided into the same server sub-cluster to obtain a plurality of server sub-clusters. And dividing each server sub-cluster into a plurality of server cluster units according to the service deployment information of each server in each server sub-cluster, wherein the service fields corresponding to the service deployment information of the servers in each server cluster unit are similar or identical. And generating a server cluster identifier according to each server cluster unit, and generating a service cluster catalog according to the plurality of server cluster identifiers.
According to the embodiment of the disclosure, a server is divided into a plurality of server sub-clusters according to physical locations, and then each server sub-cluster is divided into a plurality of server cluster units according to service types corresponding to the server in each sub-cluster, so that a service cluster catalog is generated. The service areas corresponding to the server cluster units in the service cluster catalog are guaranteed to be similar, and meanwhile, the fact that the distance between the servers in the server sub-clusters is smaller in physical position is guaranteed. The operation amount in the matching process of determining the target server identification from the target service is reduced, and the accuracy of identifying and matching is improved.
Based on the data updating method, the disclosure also provides a data updating device. The device will be described in detail below in connection with fig. 5.
Fig. 5 schematically shows a block diagram of a data updating apparatus according to an embodiment of the present disclosure.
As shown in fig. 5, the data updating apparatus 500 of this embodiment includes a cluster identification determining module 510, a service identification determining module 520, an update condition determining module 530, and a data updating module 540.
The cluster identity determining module 510 is configured to determine, in response to a data update request of a target service, a target cluster identity corresponding to the target service from a service cluster directory of the data management platform. In an embodiment, the cluster identity determination module 510 may be configured to perform the operation S210 described above, which is not described herein.
The service identifier determining module 520 is configured to determine, in the data management platform, a target server identifier corresponding to the data update request according to the target cluster identifier. In an embodiment, the service identification determining module 520 may be configured to perform the operation S220 described above, which is not described herein.
The update condition determining module 530 is configured to determine an update condition for updating target data in the data management platform based on a server function identifier in the target server identifier, where the target data is a parameter related to a target server stored in the data management platform, and the target server corresponds to the target server identifier. In an embodiment, the update condition determining module 530 may be used to perform the operation S230 described above, which is not described herein.
The data update module 540 is configured to, in a case where it is determined that the data update request satisfies the update condition, obtain, based on the data loading interface, update data of the target service, so as to update the target data based on the update data. In an embodiment, the data updating module 540 may be used to perform the operation S240 described above, which is not described herein.
According to an embodiment of the present disclosure, the service cluster directory includes a plurality of service cluster identifiers, and the cluster identifier determining module 510 includes a deployment information determining unit, a deployment information matching unit, and a cluster identifier determining unit.
The deployment information determining unit is used for determining service deployment information corresponding to each server cluster identifier in the data management platform.
The deployment information matching unit is used for matching the target service with the plurality of service deployment information to obtain a matching result.
The cluster identity determination unit is used for determining a target cluster identity from a plurality of server clusters based on the matching result.
According to an embodiment of the present disclosure, the service identification determination module 520 includes a service identification determination unit and a target service identification determination unit.
The service identification determining unit is used for determining a plurality of server identifications corresponding to the target cluster identifications in the data management platform.
The target service identifier determining unit is used for determining a target server identifier from a plurality of server identifiers according to the server update identifiers in the data update request.
According to an embodiment of the present disclosure, the update condition determination module 530 includes a normal update condition determination unit and a gray scale update condition determination unit.
The normal update condition determining unit is used for determining that the update condition is a valid identifier as the server update identifier in the data update request under the condition that the server function identifier is determined to be a normal operation identifier.
The gray scale update condition determining unit is used for determining that the update frequency of the update condition in the data update request is larger than the preset frequency under the condition that the server function identifier is determined to be the gray scale test identifier.
According to an embodiment of the present disclosure, the data updating apparatus 500 further includes an update message generation module and an update message transmission module.
The update message generation module is used for generating an update message based on the data update request and the target server identification.
The update message sending module is used for sending the update message to the data update system by utilizing the data loading interface so that the data update system sends the update data corresponding to the update message to the data management platform by utilizing the data loading interface.
According to an embodiment of the present disclosure, the data update module 540 includes an update data acquisition unit, a data format conversion unit, an update method determination unit, and an update method execution unit.
The update data acquisition unit is used for acquiring the update data of the target service based on the data loading interface.
The data format conversion unit is used for carrying out format conversion on the updated data to obtain converted data.
The updating method determining unit is used for determining an updating method for the conversion data according to the reflection mechanism algorithm.
The updating method executing unit is used for executing the updating method in the data management platform so as to finish updating the target data.
According to an embodiment of the present disclosure, the data updating apparatus 500 further includes a cluster directory generation module including a physical information determination unit, a physical information division unit, a service deployment division unit, and a cluster directory generation unit.
The physical information determining unit is used for determining physical distribution information of each server in the server cluster.
The physical information dividing unit is used for dividing servers in the server cluster based on the plurality of physical distribution information to obtain a plurality of server sub-clusters.
The service deployment dividing unit is used for dividing the server sub-clusters based on the service deployment information of each server in the server sub-clusters to obtain a plurality of server cluster units.
The cluster catalog generation unit is used for generating a service cluster catalog according to the server cluster identifier corresponding to each server cluster unit.
Any of the cluster identity determination module 510, the service identity determination module 520, the update condition determination module 530, and the data update module 540 may be combined in one module to be implemented, or any of the modules may be split into a plurality of modules, according to an embodiment of the present disclosure. Alternatively, at least some of the functionality of one or more of the modules may be combined with at least some of the functionality of other modules and implemented in one module. According to embodiments of the present disclosure, at least one of cluster identity determination module 510, service identity determination module 520, update condition determination module 530, and data update module 540 may be implemented, at least in part, as hardware circuitry, such as a Field Programmable Gate Array (FPGA), programmable Logic Array (PLA), system-on-chip, system-on-substrate, system-on-package, application Specific Integrated Circuit (ASIC), or in hardware or firmware, such as any other reasonable manner of integrating or packaging circuitry, or in any one of or a suitable combination of three of software, hardware, and firmware. Alternatively, at least one of the cluster identity determination module 510, the service identity determination module 520, the update condition determination module 530, and the data update module 540 may be at least partially implemented as a computer program module, which when executed, may perform the corresponding functions.
Fig. 6 schematically illustrates a block diagram of an electronic device adapted to implement a data update method according to an embodiment of the present disclosure.
As shown in fig. 6, an electronic device 600 according to an embodiment of the present disclosure includes a processor 601 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 602 or a program loaded from a storage section 608 into a Random Access Memory (RAM) 603. The processor 601 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or an associated chipset and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), or the like. Processor 601 may also include on-board memory for caching purposes. The processor 601 may comprise a single processing unit or a plurality of processing units for performing different actions of the method flows according to embodiments of the disclosure.
In the RAM 603, various programs and data necessary for the operation of the electronic apparatus 600 are stored. The processor 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. The processor 601 performs various operations of the method flow according to the embodiments of the present disclosure by executing programs in the ROM 602 and/or the RAM 603. Note that the program may be stored in one or more memories other than the ROM 602 and the RAM 603. The processor 601 may also perform various operations of the method flow according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to an embodiment of the present disclosure, the electronic device 600 may also include an input/output (I/O) interface 605, the input/output (I/O) interface 605 also being connected to the bus 604. The electronic device 600 may also include one or more of the following components connected to an input/output (I/O) interface 605: an input portion 606 including a keyboard, mouse, etc.; an output portion 607 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, a speaker, and the like; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The drive 610 is also connected to an input/output (I/O) interface 605 as needed. Removable media 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed as needed on drive 610 so that a computer program read therefrom is installed as needed into storage section 608.
The present disclosure also provides a computer-readable storage medium that may be embodied in the apparatus/device/system described in the above embodiments; or may exist alone without being assembled into the apparatus/device/system. The computer-readable storage medium carries one or more programs which, when executed, implement methods in accordance with embodiments of the present disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example, but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, the computer-readable storage medium may include ROM 602 and/or RAM 603 and/or one or more memories other than ROM 602 and RAM 603 described above.
Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the methods shown in the flowcharts. The program code, when executed in a computer system, causes the computer system to implement the data update methods provided by embodiments of the present disclosure.
The above-described functions defined in the system/apparatus of the embodiments of the present disclosure are performed when the computer program is executed by the processor 601. The systems, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the disclosure.
In one embodiment, the computer program may be based on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted, distributed in the form of signals over a network medium, and downloaded and installed via the communication section 609, and/or installed from the removable medium 611. The computer program may include program code that may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 609, and/or installed from the removable medium 611. The above-described functions defined in the system of the embodiments of the present disclosure are performed when the computer program is executed by the processor 601. The systems, devices, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the disclosure.
According to embodiments of the present disclosure, program code for performing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, such computer programs may be implemented in high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. Programming languages include, but are not limited to, such as Java, c++, python, "C" or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Those skilled in the art will appreciate that the features recited in the various embodiments of the disclosure and/or in the claims may be provided in a variety of combinations and/or combinations, even if such combinations or combinations are not explicitly recited in the disclosure. In particular, the features recited in the various embodiments of the present disclosure and/or the claims may be variously combined and/or combined without departing from the spirit and teachings of the present disclosure. All such combinations and/or combinations fall within the scope of the present disclosure.
The embodiments of the present disclosure are described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the embodiments cannot be used advantageously in combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be made by those skilled in the art without departing from the scope of the disclosure, and such alternatives and modifications are intended to fall within the scope of the disclosure.
Claims (11)
1. A data updating method, comprising:
responding to a data updating request of a target service, and determining a target cluster identifier corresponding to the target service from a service cluster catalog of a data management platform;
Determining a target server identifier corresponding to the data updating request in the data management platform according to the target cluster identifier;
determining an updating condition for updating target data in the data management platform based on a server function identifier in the target server identifier, wherein the target data is a parameter about a target server stored in the data management platform, and the target server corresponds to the target server identifier;
and under the condition that the data updating request meets the updating condition, acquiring the updating data of the target service based on a data loading interface so as to update the target data based on the updating data.
2. The method of claim 1, wherein the service cluster directory includes a plurality of service cluster identifiers, and the determining, from the service cluster directory of the data management platform, the target cluster identifier corresponding to the target service includes:
determining service deployment information corresponding to each server cluster identifier in the data management platform;
matching the target service with a plurality of service deployment information to obtain a matching result;
And determining the target cluster identification from a plurality of server clusters based on the matching result.
3. The method of claim 1, wherein the determining, in the data management platform, a target server identification corresponding to the data update request according to the target cluster identification, comprises:
determining a plurality of server identifications corresponding to the target cluster identifications in the data management platform;
and determining the target server identification from a plurality of server identifications according to the server update identifications in the data update request.
4. The method of claim 1, wherein the determining, based on the server function identification in the target server identification, an update condition for updating target data in the data management platform comprises:
under the condition that the server function identifier is determined to be a normal operation identifier, determining that the update condition is that a server update identifier in the data update request is a valid identifier;
and under the condition that the server function identifier is determined to be a gray test identifier, determining that the update condition is that the update times in the data update request are larger than preset times.
5. The method of claim 1, wherein prior to the data loading interface obtaining the update data for the target service, the method further comprises:
generating an update message based on the data update request and the target server identifier;
and sending the update message to a data update system by utilizing the data loading interface, so that the data update system sends update data corresponding to the update message to the data management platform by utilizing the data loading interface.
6. The method of claim 1, wherein the data loading interface-based obtaining update data of the target service to update the target data based on the update data comprises:
acquiring update data of the target service based on the data loading interface;
performing format conversion on the updated data to obtain converted data;
determining an updating method for the conversion data according to a reflection mechanism algorithm;
and executing the updating method in the data management platform to finish updating the target data.
7. The method of claim 1, wherein the service cluster directory is generated by:
Determining physical distribution information of each server in a server cluster;
dividing servers in the server cluster based on the plurality of physical distribution information to obtain a plurality of server sub-clusters;
dividing the server sub-clusters according to service deployment information of each server in the server sub-clusters aiming at each server sub-cluster to obtain a plurality of server cluster units;
and generating the service cluster catalogue according to the server cluster identification corresponding to each server cluster unit.
8. A data updating apparatus comprising:
the cluster identification determining module is used for responding to the data updating request of the target service and determining a target cluster identification corresponding to the target service from a service cluster catalog of the data management platform;
the service identification determining module is used for determining a target server identification corresponding to the data updating request in the data management platform according to the target cluster identification;
the updating condition determining module is used for determining updating conditions for updating target data in the data management platform based on the server function identification in the target server identification, wherein the target data are parameters about a target server stored in the data management platform, and the target server corresponds to the target server identification;
And the data updating module is used for acquiring the updating data of the target service based on a data loading interface under the condition that the data updating request meets the updating condition so as to update the target data based on the updating data.
9. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs,
wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method of any of claims 1-7.
10. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to perform the method according to any of claims 1-7.
11. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311753739.5A CN117743353A (en) | 2023-12-19 | 2023-12-19 | Data updating method, device, equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311753739.5A CN117743353A (en) | 2023-12-19 | 2023-12-19 | Data updating method, device, equipment and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN117743353A true CN117743353A (en) | 2024-03-22 |
Family
ID=90260333
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202311753739.5A Pending CN117743353A (en) | 2023-12-19 | 2023-12-19 | Data updating method, device, equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN117743353A (en) |
-
2023
- 2023-12-19 CN CN202311753739.5A patent/CN117743353A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10122598B2 (en) | Subscription watch lists for event handling | |
CN109522751B (en) | Access right control method and device, electronic equipment and computer readable medium | |
US10963298B2 (en) | Method, device and computer-readable for managing virtual machines | |
CN107644075B (en) | Method and device for collecting page information | |
CN112463729B (en) | Data file warehousing method and device, electronic equipment and medium | |
CN115587575A (en) | Data table creation method, target data query method, device and equipment | |
CN113535577B (en) | Application testing method and device based on knowledge graph, electronic equipment and medium | |
CN116760640B (en) | Access control method, device, equipment and storage medium | |
CN111783005B (en) | Method, device and system for displaying web page, computer system and medium | |
CN110674426B (en) | Webpage behavior reporting method and device | |
CN115202973A (en) | Application running state determining method and device, electronic equipment and medium | |
CN115033574A (en) | Information generation method, information generation device, electronic device, and storage medium | |
CN117743353A (en) | Data updating method, device, equipment and storage medium | |
CN114780361A (en) | Log generation method, device, computer system and readable storage medium | |
CN114637969A (en) | Target object authentication method and device | |
CN114201508A (en) | Data processing method, data processing apparatus, electronic device, and storage medium | |
CN114363172B (en) | Decoupling management method, device, equipment and medium for container group | |
CN113760835B (en) | Log management method, middle platform system, electronic equipment and storage medium | |
CN114844950B (en) | Service request response method, device, equipment and medium | |
CN114285743B (en) | Method, device, electronic equipment and storage medium for updating configuration information | |
CN113641966B (en) | Application integration method, system, equipment and medium | |
CN113568657A (en) | Icon configuration method, icon configuration system, electronic device, and medium | |
CN114268558B (en) | Method, device, equipment and medium for generating monitoring graph | |
CN117395314A (en) | Request processing method, request processing device, electronic equipment and storage medium | |
CN117176576A (en) | Network resource changing method, device, equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |