CN108112268A - Management and the relevant load balancer of automatic expanded set - Google Patents

Abstract

Computing resource service provider can provide the calculated examples for being organized into logical groups (such as automatic expanded set).The calculated examples for distributing to automatic expanded set can be related to being configured to flow being directed to one or more load balancers of the calculated examples.In addition, the client of the computing resource service provider can be from the automatic expanded set addition or removal load balancer.

Description

Management and the relevant load balancer of automatic expanded set

The cross reference of related application

The application is incorporated by reference into the entitled " BACKGROUND submitted on April 30th, 2016 for all purposes PROCESSES IN UPDATE LOAD BALANCERS OF AN AUTO SCALING GROUP " (attorney dockets Co-pending U.S. Patent Application number 0097749-517US0) on April 30th, 14,701,518,2016 is submitted entitled " MANAGING STATE FOR UPDATES TO LOAD BALANCERS OF AN AUTO SCALING GROUP " (agency People Reference Number 0097749-518US0) Co-pending U.S. Patent Application number 14/701,522 and on April 30th, 2016 submit Entitled " MANAGING LOAD BALANCERS ASSOCIATED WITH AUTO-SCALING GROUPS (attorney dockets The complete disclosure of Co-pending U.S. Patent Application number 14/701,513 0097749-491US0) ".

Background technology

Trustship calculates service and the use of storage has expanded rapidly in recent years.Resource for network calculations and storage is usual By computing resource, provider provides, and the computing resource provider utilizes the large-scale net of computer, server and memory driver Network causes the client (including content supplier, client etc.) trustship and can to perform various application programs and network service.Net The use that network calculates allows content supplier and client etc. effectively and adaptively meets its calculating demand.However, with void Intend the continuous growth that uses of resource, client just running into wherein virtual resource in some situations (for example, unexpected flow spike Or need to make an immediate response to meet increased load) under can not adapt to the situation of its demand.In response to this, net source service carries Automatic extension is introduced into for business.In many cases, client's transmitting request is to create example, for example, being performed on hardware unit Virtual machine instance.In these cases, example can automatically extend, so that service provider can completely adapt to client Demand.Once client has set automatic extension activity, client may be difficult to easily change example and/or load balancer.

Description of the drawings

Various embodiments according to the disclosure will be described with reference to the drawings, wherein：

Fig. 1 shows that request can be provided to automatic expansion service with being included in automatically according to the wherein client of embodiment Example in expanded set and the environment interacted with the relevant load balancer of automatic expanded set；

Fig. 2 shows to be used to be supplied to for the one of automatic expanded set by examples Example and by example according to embodiment Group realizes resource and makes example and the relevant environment of load balancer；

Fig. 3 is shown can be with being operated according to the example for being wherein used for automatic expanded set of embodiment by load balancing services The relevant environment of load balancer；

Fig. 4 shows to be managed for automatic expanded set according to the service of wherein example and automatic expansion service of embodiment Load balancer environment；

Fig. 5 is to be used for the example allocation of automatic expanded set according to embodiment using background process to load balancer Illustrative process；

Fig. 6 is to be called according to embodiment for being based at least partially on application programming interfaces by load balancer information Return to the illustrative process of the client of computing resource service provider；

Fig. 7 is to be added load balancer for being based at least partially on application programming interfaces calling according to embodiment To the illustrative process of automatic expanded set；

Fig. 8 is to call to move load balancer for being based at least partially on application programming interfaces according to embodiment Except the illustrative process to automatic expanded set；

Fig. 9 is the example and load balancer that are used to update automatic expanded set using background process according to embodiment Illustrative message transmission figure；And

Figure 10 shows wherein realize the environment of various embodiments.

Specific embodiment

In the following description, various embodiments will be described.For illustrative purposes, concrete configuration and details are elaborated To provide the thorough understanding to embodiment.However, it will be apparent to those skilled in the art that can not have Implement embodiment in the case of detail.Furthermore, it is possible to well known feature is omitted or simplified, in order to avoid obscure described reality Apply scheme.

Technology that is described herein and suggesting is related to virtual computing example or simply distributes to the example of automatic expanded set With the customer account management with the relevant load balancer of automatic expanded set.Trustship by customer account management computer system computing resource The client of service provider can be called by one or more application Program Interfaces and programmatically create automatic extension Group, to meet in some situations (for example, unexpected flow spike or needs make an immediate response to meet increased load) Resource requirement.Automatic expanded set can be managed for the one or more computer examples created by client (for example, virtual computing Machine system example) resource.Load balancer can be supplied to the client of computing resource service provider contribute to client Automatic expanded set one or more examples request processing.For example, client can use the computing resource of automatic expanded set Operate website, and load balancer can be configured to computing resource (such as one or more meters in automatic expanded set Calculation machine example) among direct traffic.In addition, website can receive the request from other multiple clients by network.Then, count Calculating resource service provider can will be asked to be directed to automatic expanded set or be performed the automatic expansion of website with configuration load balancer The particular instance of exhibition group, so that the load distribution generated by handling request is among the computer example of website is performed.

Automatic expansion service can automatically and dynamically manage automatic expanded set to manage computing resource or can suffer from Any resource of demand fluctuation.For example, automatic expansion service can be determined whether automatically and dynamically using various factors In response to event (such as to be more than threshold value group load) adjustment and/or distribution resource.In addition, client it may also be desirable to respond Resource is adjusted and/or distribute in event and/or the example of automatic expanded set is distributed in management.Client can be by that will ask transmission To interact with automatic expansion service to computing resource service provider.The request can include order, application programming interface (API) call, remote procedure call (RPC) or be configured to the service execution various functions for causing computing resource service provider Other instruction.

Computing resource service provider can disclose API Calls to client, so that client can be in automatic expanded set Modification and automatic expanded set relevant load balancer during operation.These API Calls can eliminate customer demand terminated and/or Automatic expanded set or load balancer are deleted, to change the relevance between load balancer and automatic expanded set.It is for example, objective Family can submit API request to automatic expansion service, and load balancer is added to automatic expanded set.In various embodiments In, load balancer is added to automatic expanded set causes to include the calculated examples in automatic expanded set to distribute to load balance Device, so that network traffics are distributed to the calculated examples for distributing to load balancer by load balancer.Automatic expansion service can To include being configured to maintaining on the status information for the load balancer for being attached to automatic expanded set and/or the number of other information According to storehouse.Database can be configured to track the status information with the relevant load balancer of automatic expanded set, to avoid maintenance The one-to-one mapping of load balancer and example.

Status information can include a variety of different states, such as add state, added state and shifting in state, service Except state.Addition state can indicate background process just by all example allocations in group to load balancer, when completing after Platform process updates state to be added.The state of addition can indicate that all examples in automatic expanded set have been distributed to and previously exist Load balancer under addition state.State can indicate that flow is just directed to automatic expanded set by load balancer in service At least one health example, as described in more detail below.Removal state can indicate the example of automatic expanded set currently just quilt It deallocates to specific load balancer.For being added to any new example of automatic expanded set, due to customer interaction or certainly The configuration of dynamic expanded set, background process can determine to distribute to automatic expanded set load balancer whether in addition state, In addition state or service under state.If under a state of the load balancer in these states, background process can be with New example is registered or distributed to load balancer.

Fig. 1 shows the illustrated examples of environment 100, and wherein load balancer can distribute to specific automatic expanded set 102, to handle request 118 of the guiding in the computer example of the automatic expanded set operated by client 106.Computing resource takes Being engaged in provider 104 can be to the offer computing resource of client 106.Client 106 can utilize to be grasped by computing resource service provider 104 Physical host 142 performs multiple functions in greater detail below work.For example, client 106 can be taken using computing resource The computing resource of provider 104 of being engaged in operates website or log server.It is taken in addition, client 106 can create by computing resource The automatic expanded set that business provider 104 manages.The automatic expanded set 202 being described more fully below can include being grasped by client 106 The one group of computer example made.Automatic expanded set can be configured to be based at least partially on by client 106 and/or computing resource The setting that service provider 104 provides computer example and other computing resources are added or removed to/from automatic expanded set.

In some embodiments, client 106 can include other clients for operating usual computing resource service provider Or the tissue of the addressable computing resource of other entities.For example, client can operate user can by network (such as internet) The website of access.Term " tissue " (unless in addition being pointed out with clearing in context) is intended to be construed as to imply that in a broad sense with certain One group of main body of kind mode tissue.Client 106 can use the computing resource of computing resource service provider 104, with convenient to operate It is configured to will to ask the load balancer 120 of 118 computing resources (such as computer example) for being distributed to client 106 and automatic Expanded set 102.As shown in Figure 1, the computing resource of client 106 can include the object operated by computing resource service provider 104 It manages host 142 and/or is realized by the physical host 142.However, in various embodiments, the calculating utilized by client 106 provides Source includes the computing resource according to the client of the disclosure or other entities.For example, client can use computing resource service to provide The computing resource of business 104 carrys out service load balancer 120, and flow is directed to one or more clothes operated by client 106 Business device.

Asking 118 can be by load balancer 120 or by one or more other of computing resource service provider 104 System (the request monitoring device not shown in such as simplicity Fig. 1) receives, and is directed into load balancer 120.It is negative It can be computer system or virtual computer system to carry balancer 120, the computer system or virtual computer system by with Put 118 will be asked to be distributed to one or more computer examples for being supported by physical host 142 so as to optimize the utilization of resources and/ Or avoid the overload of certain computer example.For example, load balancer 120 can include being connected to server rack or with other Mode includes physical hardware in the data center.In another example, load balancer 120 can include by computing resource One or more virtual machines that the specific physical host 142 that service provider 104 operates is supported, as described in more detail below.

In some embodiments, it is contemplated that be currently assigned to the quantity of the computing resource of load balancer 120, ask 118 quantity is likely larger than the quantity of 120 manageable request of load balancer.Therefore, client 106 can determine add Load balancer 122 be added to automatic expanded set.Client 106 can be configured with transmitting request, such as API Calls, the request To cause computing resource service provider 104 or its component (for example, the automatic expansion service being described more fully below) attached to make The load balancer 122 added is related to automatic expanded set 102.As described herein, load balancer 120 and automatic expanded set are made The 102 related computer examples for including being included in automatic expanded set 202 distribute to load balancer 120, so that load Request and/or other network traffics are directed to the computer example of automatic expanded set by balancer, are described in greater detail below.

Client 106 can be so as to update (for example, addition or removal) and automatic 102 relevant one groups of load balances of expanded set Whether device is currently updating and automatic expanded set 102 relevant one but regardless of computing resource service provider 104 or its component Group load balancer.For example, particular customer, which may be transmitted unexpectedly from automatic expanded set 102, adds and/or removes load balance The request of device 120, and then at some later time point, client can just locate in computing resource service provider 104 The second request that transmission reversion is surprisingly asked when the unexpected addition of reason and/or removal request.Due to the second request, computing resource service Provider 104 can surprisingly be asked with termination and start to process second is asked.In addition, computing resource service provider 104 can Load balancer is being added and removed to the audit information of the operation performed in automatic expanded set to generate to correspond to.Audit letter Breath can cause client 106 to can determine previously addition or remove the result of operation and the progress or shape of existing load balancer State.

As described above, computing resource service provider 104 or its component (all automatic extension clothes as described in more detail below Business) background process can be performed, which is configured to the computer example distribution and releasing point of automatic expanded set 102 Dispensing load balancer 120 and additional load balancer 122.In addition, background process may be configured so that client 106 repaiies Change the capacity (for example, computer example is caused to start or terminate in automatic expanded set 102) of automatic expanded set 102, but regardless of How is the current state of background process.For example, background process can distribute to one group of computer example of automatic expanded set 102 Load balancer 120；Client then may cause to one group of new computer example and be added to automatic expanded set 102, and because This, the new computer example of the group can be added to this group of computer reality to be allocated to load balancer 120 by background process Example.

Background process can be inquired about by combining Fig. 2 load balancers in greater detail below the maintenance of automatic expansion service Database, so as to determine with automatic 102 relevant any load balancer of expanded set whether transition state (for example, addition shape State has added state and/or has removed state) under.If under the transient state there are at least one load balancer, backstage into Journey can be based at least partially on the state of at least one load balancer to determine one group of computer example and corresponding operation. For example, if load balancer, under addition state, background process can determine a collection of computer example to distribute to load Balancer.Background process can be by being transmitted to instruction load balancer 120 and to be allocated to load balancer by API Calls Computer example is distributed to load balancer by the load balancer service of 120 computer example.In various embodiments In, request can be transferred directly to load balancer 120 by background process, so as to which 120 managing boot of load balancer be asked to arrive The flow of computer example.

In some embodiments, adding additional load balancer 122 can be included one or more load balances Device instantiates and the load balancer of instantiation is distributed to automatic expanded set 102.In addition, distribute additional load balancer 122 can include other one or more computer systems of update.Correspond to additional load balancer 122 for example, can use Information update above-mentioned request monitoring device, so as to route requests.In another example, domain name system (DNS) can be updated Entry or other names system service entry are to include and additional resource 122 relevant Internet Protocol (IP) address.

API Calls can be by being submitted to the interface of computing resource service provider 104 (in order to simply rise by client 106 See not shown in Fig. 1) come change automatic expanded set 102 and/or distribute to the group load balancer 120 capacity.For example, Additional computer example can be distributed to automatic expanded set by client 106 by managing console or other applications 102, the management console or other applications are configured such that client can be managed by computing resource service provider 104 The computing resource of offer.Management console can be disclosed to client 106 as webpage, and the executable code of wherein webpage is configured To generate the API Calls to computing resource service provider 104.Client 106 can be corresponded to certainly by managing console and providing The information of dynamic expanded set 102, the computer example of automatic expanded set 102 and the load balancer for distributing to automatic expanded set 102. For example, client, which can be computing resource service provider 104, provides API Calls, and API Calls can be indicated to be added to certainly The load balancer of first quantity of dynamic expanded set and the load balancer for treating the second quantity removed from automatic expanded set 102. Information can include with the IP address of automatic 102 relevant computer example of expanded set, automatic expanded set identifier, distribute to The computing capability of the computing resource of computer example and/or automatic expanded set 102, computer example and/or automatic expanded set 102 With network capacity, routing iinformation, load balancer identifier and be configured such that automatic expansion service can be from automatic Any other information of load balancer is added and/or removed to expanded set.

Fig. 2 show according to embodiment be used for by example 222 instantiate and by example 222 be supplied to for automatically extend One group of realization resource of group 202 simultaneously makes example and the relevant environment of load balancer.As shown in Fig. 2, computing resource service provides Person 204 operates multiple physical hosts 242.Physical host 242 can be configured to perform for perform data calculate, operation or Any device or equipment of the instruction of store tasks, such as computer or server.Physical host 242 can include any of the above described Computer system or virtual machine example.The virtualization layer 244 operated by computing resource service provider 204 is so that physics master Machine 242 can be used in providing the computing resource that one or more examples 222 can be operated on it.It is described more fully below Ground, virtualization layer 244 can be used to any device, software or the firmware that example 222 provides virtual computing platforms.Virtual meter Various virtual computer components, one or more virtual cpus, virtual memory, virtual disk etc. can be included by calculating platform.

Automatic expanded set 202 can include one or more examples 222, and can be based at least partially on a variety of attributes To supply new example 224.A variety of attributes can be included such as by the expected capacity of client's instruction, the entirety to automatic expanded set 202 It load, the load to the particular instance of automatic expanded set 202, the request from client, timetable and is adapted to determine whether Any other attribute of example is added or deleted from automatic expanded set 202.Example 222 can be virtual computer system, the void Intend computer system to be configured to by least performing various operations come to automatic expanded set 202 and computing resource service provider 204 client provides computing resource.In some embodiments, it is that client's execution is various that automatic expanded set 202 and example, which are used as, The single computational entity of operation is operated.

With reference to Fig. 3, load balancing services 236 can provide load balance to automatic expanded set 202 in greater detail Device and other flow distribution services.For example, the DNS entry of load balancer can be included for the various of automatic expanded set 202 The IP address of example 222 is loaded, and the request for being directed to automatic expanded set 202 can be distributed to and distribute to load balancer Example 222.During the extension event to automatic expanded set 202 distribution computing resource is needed, computer example image can be used It is instantiated in by new example 224.When deallocating computing resource to automatic expanded set 202, it can terminate or suspend example 222 One or more of operation.It can determine that example 222 whether will with reference to Fig. 3 expansion services automatic in greater detail It adds or removes from automatic expanded set 202.

As described above, automatic expansion service 230 can also include background process 232, and background process can be by example 222 distribution are deallocated to one or more load balancers.Background process 232 can include logic or other computers Executable code, the logic or other computer-executable codes are in the one or more processors execution by physical host 242 When physical host 242 is caused to perform to correspond to and add and remove the various operations of load balancer from automatic expanded set 202.Each In kind embodiment, automatic expansion service 230 or load balancing services 236 are deallocated from one or more load balancers It will be waited during example 222 until the all-network connection to example 222 to be deallocated is terminated or completes.Once it is not present To the more multi-link of example 222 to be deallocated, load balancing services can remove example 222 from one group of example, one Or flow is directed to this group of example by multiple load balancers.The process can be referred to as connection and exclude, for example, waiting until arriving All current connections of particular instance have terminated while have prevented the new connection established to example.

In addition, when distributing to automatic expanded set 202 or deallocating computing resource, the backstage of automatic expansion service 230 Process 232 can will be transmitted to load balancing services 236 corresponding to the distribution of computing resource or the information deallocated, so that Flow correctly can be directed to automatic expanded set 202 by load balancing services.For example, if new example 224 is added to group, Background process can transmit the API Calls of the identifier including new example 224, which is configured to cause load balance Service distributes to new example 224 and the relevant one or more load balancers of automatic expanded set 202.In addition, background process Can with corresponding to example 222, new example 224 and distribute to automatic expanded set one or more load balancers information come Update load balancer database 210.

Load balancer database 210 can include one group of row and column, and where each row corresponds to and automatic 202 phase of expanded set The load balancer of pass, and each column is included corresponding to automatic expanded set 202, example 222 or suitable for from automatic expanded set 202 The information of the other information of addition or removal load balancer.Load balancer database 210 can include being suitable for tracking spy The information of the state of fixed load balancer.In addition, the information being included in load balancer database 210 can be by background process 232 adapt to determine on-unit, to add or remove load balancer from automatic expanded set 202.For example, backstage into Journey 232 can inquire about database to determine and the associated one or more load balancers of new example 224.In addition, such as this paper institutes It states, load balancer database 210 can include being configured to store corresponding to and automatic expanded set 202 relevant one or more A load balancer information (including with the relevant status information of one or more load balancers) any database or appoint What his data repository.

Load balancer database 210 can be any data repository and/or storage device as described herein.In addition, Data on the operation of automatic expanded set 202, example 222, background process 232 and new example 224 can be by extending clothes automatically Business 230 collects and/or monitor and be stored in load balancer database 210 or other data repositories, to generate day of auditing Will information and metric.Data on the operation of automatic expanded set 202, example 222, background process 232 and new example 224 It is all including any information on the action performed by automatic expanded set 202, example 222, background process 232 and new example 224 As preformed metric data (for example, the memory use of fictitious host computer, file system, on virtual cpu information or on Any other information of automatic expanded set 220 or its component) or action.In some embodiments, data can be converted into It is suitble to the form being used together with audit log or auditing service.In various embodiments, serviced and provided using computing resource The storage service on demand of business 204 constantly stores data, so that client can determine background process 232 using data Operation and the state with automatic 202 relevant load balancer of expanded set.

In some embodiments, expand when particular customer submission is configured to update (for example, addition or removal) with automatic During the API Calls of the relevant one or more load balancers of exhibition group 202, if automatic expansion service 230 can perform dry run To handle the API Calls.First, automatic expansion service 230 can update in load balancer database in API Calls The relevant record of one or more load balancers for automatic expanded set 202 indicated.This may insure extending automatically Any other example (such as new example 224) started in group 202 will be assigned to one or more load balancers.To load The update of balancer database 210 synchronous with receiving request can occur.Then, automatic expansion service 203 can make asynchronous mistake Journey (for example, background process 232) is lined up, which can determine one group of existing example 222 and will be with the existing example of the group 222 relevant load balancers are updated to the one or more load balancers indicated by client in API Calls.Background process 232 can be deterministic with right and wrong, so that identical input (for example, adding or remove same group of load balancer) may not Background process 232 is caused to operate in an identical manner.It is to be allocated to load balancer for example, the order of operation may be different The batch size of example 222 may be different, and any other operation of background process as described herein may be different.

Background process 232 can also create record in the extension history of particular customer, and (it can be used DescribeScalingActivities API are retrieved).Record and/or API can be used for tracking pair and automatic expanded set The newer process of 202 one or more load balancers relevant and for the audit objective such as user's needs.Record and Any corresponding audit information can include the readable expression of people of operation performed by automatic expansion service 230, such as " in response to The request of client 110581 come update the load balancer for automatic expanded set A with：Addition (loadbalancer1, loadbalancer2、loadbalancer3)”.Once automatic expansion service has completed processing request, record can also include Time started, end time and completion status.As described above, the operation of background process 232 will not lock or otherwise Prevent the update to automatic expanded set 202, and background process 232 will not prevent from handling simultaneously pair and automatic 202 phase of expanded set Other updates of one or more load balancers of pass.For example, if particular customer is updated when just handling another update With the relevant one or more load balancers of automatic expanded set 202, then automatic expansion service 230 can terminate previously update, Restarting process, and generate another record in the automatic extension history of client.

That environment such as shown in FIG. 1 may be useful for provider (such as computing resource supplier), wherein The load balancer of automatic expanded set is distributed in request of the computing resource system response from client to manage.It is as discussed above , computing resource system provides mechanism, is born so that client is allowed to add or delete from one group of example relevant with automatic expanded set Carry balancer.Environment in this case can include additional component and/or other arrangements, the networked environment 300 of such as Fig. 3 Shown in those.In this example, network environment 300 includes calculating by network 306 and client terminal device 306 and server Machine 342 is into the computing resource service provider 304 of row data communication.In one embodiment, server computer 342 can be with It is the one or more computer hardware devices for being used to implement example 320.For example, server computer 342 can include being used for Realize the hardware of polytype computing resource, such as above in conjunction with the described storage devices of Fig. 2, virtualized storage device, Network equipment etc..In addition, the computing resource realized can be programmed and remotely by the client of distributed computing resource provider Mode manages.

Server computer 342 includes multiple computer system apparatus, and each computer system apparatus is able to carry out by dividing One or more examples 320 that cloth computing resource service provider 304 creates.In one embodiment, server calculates Each in machine 342 include processor, data repository, input/output bus and/or be known in the art for holding Any other component of row example 320.In addition, example 320 can be virtual machine instance.As known in the art, virtually Machine example is analogous to physical machine and performs the example that the software on the machine (that is, computer) of program is realized.For example, server Each Instance Manager 318 that can be configured to carry out realizing example 320 in computer 342.For example, example pipe Reason device 318 can be management program, virtualization layer or be configured to implement on individual server computer 342 and perform multiple realities The another type of program of example 320.As discussed above, each in example 320 can be configured to carry out application program All or part of.In addition, network 306 can be similar to network as described above.Networked environment 300 can cross over one or Multiple data centers, wherein each data center geographically can be different from each other.In addition, networked environment 300 shown in Fig. 3 can To be one in several embodiments used by computing resource service provider.

In one embodiment, computing resource service provider 304 includes load balancer database 310, example takes Business 312, placement Service 326, automatic expansion service 330, safeguard service 332, measurement service 334, load balancing services 336 and/ Or other component.Load balancer database 310 can include load balancer data 342.For example, as described above, load is flat Weighing apparatus database 310 includes recording with the one or more of automatic 302 relevant load balancer 340 of expanded set.Load balance In the record of device data 346 each correspond to networked environment 300 load balancer 340.

Example service 312 is based at least partially on the one group of preference provided by client and instantiates example 320.At one In embodiment, example service 312 receives request 336 to create one or more examples from the client on client terminal device 306 332, and the example 320 of establishment is optionally distributed into automatic expanded set 302.In addition, from the client on client terminal device 306 Received request 336 can also indicate that the time for starting to perform requested example 320.It is asked in response to receiving, example clothes Business 312 instantiates example 320.In various embodiments, automatic expansion service 330 receives request, and order is transmitted To example service 312 example 320 to be instantiated, so that example is for example by making automatic 302 metadata of expanded set and example 320 is related and related to automatic expanded set.In one embodiment, example service 312 can be in response to coming from client dress Put 306 and/or the request of automatic expansion service 330 example is placed in holding state or separates example from automatic expanded set. For example, automatic expansion service 330, which can transfer a request to example, services 312, to be removed according to request 336 with being extended from automatic 302 separated relevant automatic 302 metadata of expanded set of example 320 of group.In addition, automatic expansion service 330 can will be separated Example is deallocated from load balancer 340.

Client can be interacted with computing resource service provider 304 (via appropriately configured and certification API Calls) for It should, operate and manage the automatic expansion with instantiating on server computer 342 and being operated by computing resource service provider 304 302 relevant example 320 of exhibition group.In addition, client can create one or more automatic expanded sets 302, and automatic expanded set 302 can be the logical collection of example 320.In addition, example 320 can distribute to automatic expanded set 302 or can be automatic The component of expanded set 302.Automatic expansion service 330 can allow client to interact and manage various with various automatic expanded sets 302 Automatic expanded set 302.For example, client can set maximum or minimum appearance by automatic expansion service 330 for automatic expanded set 302 Amount.Then, automatic expanded set 302 can manage the example 320 for distributing to automatic expanded set, to maintain to be set by what client provided It is fixed.In various embodiments, client can be controlled by the management as described above provided by computing resource service provider 304 Platform processed creates and manages automatic expanded set 302.

Management console can be disclosed to client as webpage；By accessing the web page (for example, by browser application journey Sequence), client can generate API Calls.The API Calls of generation may cause to computing resource service provider 304 or its component Perform the various operations indicated by client.Once client has created automatic expanded set 302, client can be asked by submitting One or more load balancers are distributed to automatic expanded set 302 by 336.In this case, request 336 can be by expanding automatically Exhibition service 330 or the other component processing of computing resource service provider 304.The example 320 of automatic expanded set 302 can be used for Various purposes, such as server as support website are operated, operation service application or generally act as the calculating of client Ability.For the other application of example 320 can be support database application, E-business applications, service application and/or other Using.In addition, flow distribution to the various examples 320 of automatic expanded set 302 can be used for by load balancer 340 with realizing The operation of the example of above-mentioned various purposes, and prevent the example 320 of automatic expanded set 302 from overloading.Although example service 312 exists It is shown in Fig. 3, computing resource service provider 302 can utilize any other computer system or computer system service, all If do not used virtualization or instantiation and supplying special or Sharing computer/server and/or other physics dress as substituting The computer system for the computing resource put or computer system service.

Example 320 is fed to one or more of server computer 342 by placement Service 326.In an embodiment party In case, placement Service 326 is based at least partially on the automatic expanded set 302 of indicated new example 320 to determine server meter Calculation machine 342 is to supply new example 320.For example, placement Service 326 can identify one or more server meters with appropriate capacity Calculation machine 342 is to perform example 320.For this purpose, will such as describe, placement Service 326 is from the number of resources being stored in data repository The capacity for determining each server computer 342 according to 310, and therefore supply example 230.The automatic at least portion of expansion service 330 Divide the capacity that ground makes the set of the example 320 of previous Request based on the environment limited by the client for requesting example 320 automatically It extends up or down.For example, automatic expansion service 330 can distribute to the example 320 of client in the reduction of demand tempus intercalare Quantity, and during demand peaks increase distribute to client example 320 quantity.

In one embodiment, automatic expansion service 330 in one section of low use and/or is removed and asked in free time Example 320 a subset.For example, automatic expansion service 330 can determine that the quantity of the example 320 by client's request is superfluous It is remaining and/or excessive.In response, automatic expansion service 330 can terminate a certain number of examples for distributing to client 320, so that the volume residual for distributing to the example 320 of client is not redundancy and/or excessive.In another embodiment In, if utilization rate is no more than predetermined threshold value, automatic expansion service 330 can remove requested example 330 Subset.Similarly, automatic expansion service 330 increases the quantity of example 320 in one section of high usage time.In an embodiment In, if utilization rate is more than predetermined threshold value, automatic expansion service 330 can increase the quantity of example 320.

It can include updating as described above from 306 received request 326 of client terminal device or modification is expanded with automatic The API Calls of 302 relevant load balancer 340 of exhibition group.It can be carried including API Calls in the request in computing resource service It is received for the interface of business 304.In addition, API Calls and/or request can be by 304 certifications of computing resource service provider.Interface API Calls can be directed to handle the appropriate service of request.For example, for load balancer to be added to automatic expansion The API Calls of exhibition group 302 may be directed to the automatic expansion service 330 that can handle request 326.Then, automatic extension clothes Business 330 can will synchronously be stored with receiving request 326 corresponding to the information including the load balancer 340 in request 326 To load balancer database 310.

Above in conjunction with Fig. 2, background process can periodically or non-periodically query load balancer number in greater detail According to storehouse 310 to determine whether any load balancer 340 under the transient state and creates the workflow that performs in the background, the work It is configured to update automatic expanded set 302 by least adding and/or removing to example 322 by load balancer 340 as stream Example 322 at least a portion.In various embodiments, automatic expansion service 330 may be configured so that for every A automatic expanded set 302 can only perform a background process.For example, if client is attempted via client terminal device 306 just When handling another update, update and the relevant load balancer of automatic expanded set, then can signal existing backstage Process background process should recalculate the operation needed for update load balancer 340 and again launching process.

Background process can generate the batch size of the dynamic and configurable for both load balancer 340 and example 322 To perform operation.For example, background process can determine with automatic 302 relevant whole group load balancer 340 of expanded set and The whole group example 322 being included in automatic expanded set 302.Then, background process can perform updates load balancer in batches Operation (for example, adding and/or remove load balancer 340 to/from the example 322 in automatic expanded set 302) needed for 340. Background process can carry out priority ranking based on a variety of different factors to batch.For example, background process can appoint performing What performs all addition operations before removing operation.In another example, background process can be indicated in request 326 Any other load balancer perform operation before complete for single load balancer operation.Background process can be with one Other a or multiple communication for services, to complete the update load balancer being included in request 326 operation.For example, backstage into Journey can generate API request, which is configured to that the execution of load balancing services 336 is caused to be included in particular batch It operates (for example, adding and/or remove load balancer 340 to/from the example 322 in automatic expanded set 302).

Safeguard that service 332 arranges maintenance, software upgrading and/or firmware update for server computer 342.In an implementation In scheme, safeguard that service 332 is based at least partially on the active volume of server computer 342, tieed up in reasonable time arrangement Shield and software upgrading.For example, safeguard that service 332 can be pacified when corresponding server computer 342 has estimated availability Row safeguards and software upgrading.In one embodiment, when maintenance service 332 determines server computers 342 not just in trustship During any example 320, safeguard that service 332 can repair and restart server computer 342.In addition, safeguard that service 332 can If necessary will then repaired and 342 relevant void of example before new images instantiation relevant with corresponding virtual machine Plan machine.For example, safeguard that service 332 can be based at least partially on the health status of example 320 to arrange the repairing of machine image. In one embodiment, it is impossible to additional example is supplied on server computer 342 until periodic maintenance is completed.

Safeguard service 332 can also periodically or aperiodically test case 320 (including distributing to automatic expanded set 302 And/or the example of load balancer 340) health status.Health examination can include determining that the various parts of example 320 are (all Such as the other component of central processing unit, memory, networking interface, operating system, application program and example 320) load, profit With and operation.In various embodiments, determine that example 320 is not when maintenance service 332 is based at least partially on health examination Health when, safeguard that service 332 or the other component (such as automatic expansion service 230) of service provider 304 can start work It flows to remove unsound example from automatic expanded set 302.In addition, if safeguard that service 332 determines previously unsound reality Example 320 has returned to health status, then safeguards service 332 or other component (such as automatic expansion service of service provider 304 230) example 320 can be made to be moved in service or example 320 is made to be attached to automatic expanded set 302.In addition, as described above, such as Fruit distributes to the example 322 of load balancer 340 back to health status, then automatic expanded set 302 can be by load balancer 340 state is updated in service.In various embodiments, health examination can be described by Fig. 2 above in conjunction The second different background process of background process performs.

Measurement service 334 can be responsible for collecting the resource data corresponding to example 320.The money obtained by measurement service 334 Source data can indicate example 320 various parts (such as central processing unit, memory, networking interface, operating system, should With program and the other component of example 320) use.The information can be used for a variety of different purposes, for example, it is determined whether to Resource is distributed or deallocated to automatic expanded set 302.In addition, information can be by safeguarding service 332 using determining example 320 And/or the health of server computer 342.Measurement service 334 can be all examples 320 for distributing to automatic expanded set 302 It obtains and polymerize and utilize information.In addition, when adding from automatic expanded set 320 or removing load balancer 340, measurement service 334 can receive that add or remove measurement service 332 from one group of load balancer 340 be its collection and/or polymerization using information Load balancer 340 order.

Load balancer service 336 can be provided to the client of computing resource service provider 304, to contribute to client Example 320 request processing.In various embodiments, example 320 can distribute to automatic expanded set 302, and load Balancer service 336 can be by flow distribution to the example 322 for distributing to automatic expanded set 302.For example, client can use meter The resource of resource service provider 304 is calculated to operate with the website for the example 320 for distributing to automatic expanded set 302.In addition, net The request from other multiple clients can be received by network 206 by standing.Computing resource service provider 304 can be with configuration load The load balancer of balancer service 336 will ask to be directed to the example 320 for the automatic expanded set 302 for performing website, so that The load distribution that must be generated by handling request is among the example 320 of automatic expanded set 302 of website is performed.Load balance Device service 336 can be computer system or virtual computer system, and the computer system or virtual computer system are configured Request is distributed to and distributes to the example 320 of load balancer to optimize the utilization of resources and/or to avoid particular server meter The overload of calculation machine 342.For example, load balancer can include being connected to server rack or being otherwise contained in data Physical hardware in the heart.In another example, load balancer can include one supported by server computer 342 or Multiple virtual machines.

Fig. 4 shows to service 412 according to the example of at least one embodiment.The example service that can be realized by physical hardware 412 by service provider 404 using for client 406 providing computing resource.Physical hardware can include server computer 442.Server computer 442 can be configured to perform to perform data calculating, operation or the instruction of store tasks Any device or equipment, such as computer or server.Server computer 442 can be equipped with any desired processing energy Power, including one or more processors, such as central processing unit (CPU), graphics processing unit (GPU) or Digital Signal Processing Device (DSP), memory (including static and dynamic memory), bus and meet any handshake, communication or data transmission association The input and output port of view.Physical hardware can also include storage device, storage dish and tape, the network equipment etc..

Virtualization layer 444 can include bare metal management program or trustship management program.It is performed on service computer 442 Virtualization layer 444 physical hardware is allowd to can be used in providing one or more computer examples 420 and grasped on it The computing resource of work.For example, virtualization layer can enable virtual machine 420 to be driven by the virtual bench on virtual machine 420 Physical hardware on routine access server computer 442.Virtualization layer 444 can include management program or virtualization software And/or hardware.Virtualization layer can also include being exclusively used in the computer example 420 that management is run on server computer 442 Operating system example.Each virtualization layer 444 can include the networking software storehouse of its own, be responsible for and other virtualizations The communication of layer 444, and be at least also responsible for realizing the computer run on server computer 442 in some embodiments Network connectivity between example 420 and other computer examples 420 run on other server computers 442.In addition, Server computer 442 can on identical server computer 442 the identical or different type of trustship multiple virtualization layers 444.Virtualization layer 444 can be used to computer example 420 and provide any device of virtual computing platforms, software or solid Part.Virtual computing platforms can include various virtual computer components, a or multiple virtual cpus, virtual memory etc..It can To provide computer example 420 to the client 406 of service provider 404, and client 406 can be in computer example 420 Run operating system or application program.In addition, service provider 404 can use one in the computer example 420 of its own It is a or multiple perform its application program.At least a portion of computer example 420 can perform for it is one or more other The kernel level component of computer example 420.For example, certain computer example, which can perform, is configured to management by other computers The parent partition for one or more child partitions that example performs, wherein certain computer example and other computer examples are by identical Virtualization layer 444 is supported.

Order and other information can be included in from Virtual Machine Management Service 412 or automatic expansion service 430 to virtualization In the API Calls of layer 444.Virtual Machine Management Service 412 can enable client 406 to manage and operate computer example 420. For example, client 406 can transfer a request to Virtual Machine Management Service 412 to terminate all computers operated by client 406 Example 420.Request can be the API Calls for including corresponding to the information of client 406 and computer example 420.Virtual Machine Manager Service 412 can be that the computer example 420 being included in request determines corresponding virtualization layer 444, and be passed order is terminated It is sent to virtualization layer 444.Virtual Machine Management Service 412 can be realized at least some embodiments, so that a variety of visitors Family end application program can be run on the virtual computer service device of the instantiation of client 406 or computer example 420 is represented.Meter Calculation machine example 420 can each include virtual machine, and the wherein operating system of its own includes networking software storehouse, and it is multiple this Class example can the trustship on the given server computer 442 at service provider network data center.

In addition, above in conjunction with Fig. 3 load balancing services 436 in greater detail.The life that can be included in API Calls Order and other information are transmitted to example service 412.Example service can determine appropriate virtualization layer, and cause example 420 It is operated according to API Calls.For example, as described above, load balancer service 436 that API Calls can be transmitted to realization is negative The particular instance 420 of balancer is carried, and API Calls can be configured to cause load balancer management flow and draw flow Lead one group of example of automatic expanded set.In various embodiments, load balancing services 436 and automatic expansion service can incite somebody to action Order is transferred directly to virtualization layer 444.

Fig. 5 shows to be used for background process by the example allocation of automatic expanded set to load according to embodiment The illustrative process 500 of balancer.Process 500 (can such as be described by any suitable system above in conjunction with Fig. 2 and Fig. 3 Automatic expansion service) or multiple systems or any combinations of its component (all background process described above) perform.Back to Fig. 5, In a embodiment, process 500 includes receiving the request 502 for starting asynchronous workflows.Asynchronous workflows can be treated by taking The one group of operation or task that the computer system of business provider performs, such as automatic expansion service, wherein the sequence or suitable operated Sequence need not be to be done before next operation is started prior operation.For example, as described above, automatic expansion service can connect Load balancer is added to the request for the automatic expanded set for needing asynchronous workflows to handle the request by receipts.Then, automatically Expansion service can perform background process 504.In multiple modifications of process 500, if current positive execution background process, from Dynamic expansion service may cause background process to restart or may cause background process at the specified point in process 500 Restarting.

Then, background process can determine one group of load balancer 506 under transition state.For example, background process can be with In addition state as described above, add under state or removal state as load balancer query load balancer database. Then, background process can determine and the relevant one group of computer system example of load balancer under transition state.This can be with All examples including automatic expanded set only include the specific load balancing for still treating the load balancer group under transition state The example that device is distributed or deallocated.Then, background process can be determined for the example to be updated under transition state and born Carry the operation order and batch size of balancer.

Many factors can be based on, including multiple examples, multiple load balancers, the amount to the loads of load balancing services Or the other factors of the batch size suitable for determining to update example and load balancer are determined.In addition, backstage into Journey can be based at least partially on the load to load balancing services and/or stay in the quantity of the operation performed on load balancer Or type carrys out query load balanced service to determine appropriate batch size (for example, wherein will distribute or solve to load balancer Except allocation example).In various embodiments, if background process receives mistake from load balancing services, if for example, negative Request cannot be handled by carrying balanced service, then background process can reduce transmission and the relevant API of batch in interval of time The batch size of calling and/or delay.

Then, background process can perform and the relevant operation 512 of identified batch.For example, background process can incite somebody to action API Calls are transmitted to load balancing services, the load balancing services be configured to by 10 example allocations of automatic expanded set to Indicated specific load balancing device in API Calls.Then, automatic expansion service and/or background process can generate audit day Will information 514.As described above, audit log information can enable the customer to obtain corresponding to relevant negative with automatic expanded set Balancer and the operation performed when adding and/or removing load balancer are carried (for example, the knot of batch operation determined by performing Fruit) information.Automatic expansion service can generate at least a portion of audit log information after asynchronous workflows is made to join the team, And additional audit log information can be generated after asynchronous workflows are completed.For example, automatic expansion service generation audit Log information, including the operation performed according to request and time started.After asynchronous workflows are completed, automatic expansion service can To generate audit log information, whether the time and operation completed including operation succeed.

If receiving additional request 516, background process can be under restarting procedure and definite transition state Load balancer.If not receiving additional request 516, background process can continue to execute relevant with identified batch Operation, until all operations are completed.Once it is all operation complete, background process can with the load balance under transition state Device relevant information updates load balancer database 518.For example, as described above, once all examples have been added to it is specific Load balancer, background process can update the status information included in load balancer database to be added.

Fig. 6 is to show to be used to enable the customer to acquisition corresponding to the automatic extension with client according to various embodiments The exemplary block diagram of the process 600 of the information of the relevant one or more load balancers of group.Process 600 can be by any suitable System (server in such as data center, multiple computing devices in the distributed system of computing resource service provider, Or any service (the automatic expansion service such as described above in conjunction with Fig. 2 and Fig. 3) operated by computing resource service provider) It performs.Process 600 includes sequence of operations, wherein receiving DescribeLoadBalancers application programmings from requestor Interface calls, certification request person, if be then certified, for requested information inquiry load balancer database and incites somebody to action The load balancer database inquired about is supplied to requestor.In some embodiments, can be requestor format or with The information that other modes modification is obtained from load balancer database.

In 602, computing resource ISP receives application programming interface from client or other entities and calls, with Description and the relevant load balancer of automatic expanded set.As described above, the automatic expanded set of computing resource service provider or its He can safeguard load balancer database by component.Load balancer database can be included corresponding to related to automatic expanded set Load balancer information, such as the identification information of load balancer, with the relevant specific automatic expanded set of load balancer, At the beginning of particular state is assigned in the state of load balancer, load balancer or end time and suitable for client Any other information of load balancer is described.In addition, request can indicate the automatic extension corresponding to client's solicited message The subset of the relevant one group of load balancer of group.It is used for such as example, client can indicate specific load balancer to obtain The information for all load balancers for adding or removing from automatic expanded set in interval when nearest 24 is small or client can refer to Show one or more attributes of load balancer to obtain the information.

In 604, computing resource ISP determines whether requestor allows request to be carried out with enough permissions Row.It is answered for example, requestor may have been provided for identity with the proof for possessing voucher as with DescribeLoadBalancers The parameter called with Program Interfaces.For example, requestor can supply the information conduct pair for sufficing to show that the access to voucher It should be added in the proof for possessing voucher of identity, encryption hash/summary of such as password, password by what encrypted signature key generated Other keys of close digital signature or the identity for authorization requests person that can be verified by computing resource service provider.Calculate money Source service provider can provide the identity and proof to authentication service, which then can be with the identity of checking request person With the proof of voucher.Once demonstrate the identity of requestor, computing resource service provider or authentication service be assured that with It identifies relevant security strategy and/or whether role authorizes enough permissions to allow fulfillment request.

If computing resource service provider not can determine that identity (for example, being not present in safety database), with The proof of card is not enough to prove that identity (for example, password of mistake) or the identity of requestor cannot otherwise confirm, holds The system of row process 600 may not further be advanced in process 600.The system of implementation procedure 600 can be to give requestor Error message respond to authentification failure and/or in security log authentication registration failure 610.Otherwise, if requestor It is certified and is confirmed as with enough permissions DescribeLoadBalancers being allowed to ask to be fulfiled, then performed The system of journey 600 can enter 606.

Once computing resource service provider determines requestor with enough permissions request to be allowed to be fulfiled, money is calculated Source service provider or its component (such as automatic expansion service) can be directed to requested information inquiry load balancer number According to storehouse 606.Load balancer database can maintain the data storage service of computing resource service provider or database clothes In business.In response to the inquiry, automatic expansion service information indicated in being asked.For example, automatic expansion service can With the state for obtaining the list with the relevant load balancer of automatic expanded set and including load balancer in the list. Then, automatic expansion service can provide the list 608 of load balancer in response to the request to requestor.

Fig. 7 is the process 700 for being used to load balancer being added to automatic expanded set shown according to various embodiments Exemplary block diagram.Process 700 can be by any suitable system (server, computing resource service in such as data center Any service of multiple computing devices or computing resource service provider in the distributed system of provider (is such as tied above Close the automatic expansion service of Fig. 2 and Fig. 3 descriptions)) it performs.Process 700 includes sequence of operations, wherein being received from requestor AddLoadBalancer application programming interfaces are called, and certification request person if be then certified, uses load balance Device information updates load balancer database, and load balancer is added to automatic expanded set.

At 702, computing resource ISP receives application programming interface from client or other entities and calls, with One or more load balancers are added to automatic expanded set.One or more load balancers are added to automatic expanded set It may cause one or more load balancer managing network flows and the network traffics are directed to included in automatic expanded set In one group of example.In addition, one or more load balancers are added to automatic expanded set can include being taken by computing resource The operation of various other service executions of business provider.For example, client can be by that will ask to be submitted to describe in more detail above Load balancing services be created load balancer.In addition, automatic expansion service or its component (such as background process) can One or more load balancers are added to automatic extension by the way that more batches of API Calls are submitted to load balancing services Group.For example, background process can determine a batch 10 examples to be allocated to specific load balancer, generation is configured to cause Make API Calls of the load balancing services by 10 example allocations to specific load balancer, and provided to load balancing services API Calls.

In 704, computing resource ISP determines whether requestor allows request to be carried out with enough permissions Row.For example, requestor may have been provided for identity and possess the proof of voucher as with AddLoadBalancer application programs The parameter of program interface call.For example, requestor, which can supply, suffices to show that the information of the access to voucher is used as corresponding to body The proof for possessing voucher of part, encryption hash/summary of such as password, password, the encryption number generated by encrypted signature key Other keys of signature or the identity for authorization requests person that can be verified by computing resource service provider.Computing resource service Provider can provide the identity and proof to authentication service, which then can be with the identity and voucher of checking request person Proof.Once demonstrating the identity of requestor, computing resource service provider or authentication service are assured that and identity phase Whether the security strategy of pass and/or role authorize enough permissions to allow to complete to ask.

If computing resource service provider not can determine that identity (for example, being not present in safety database), with The proof of card is not enough to prove that identity (for example, password of mistake) or the identity of requestor cannot otherwise confirm, holds The system of row process 700 may not further advance in process 700.The system of implementation procedure 700 can be to give requestor Error message respond to authentification failure and/or in security log authentication registration failure 712.Otherwise, if requestor It is certified and is confirmed as with enough permissions AddLoadBalancer being allowed to ask to be completed, then implementation procedure 700 System can enter 706.

In 706, the system of implementation procedure 700 can use the information for corresponding to load balancer indicated in request To update load balancer database.For example, request can include the identifier and load balance of load balancer to be added The relevant client of device, computing resource service provider or service relevant with its load balancer are adapted so that automatic expansion Load balancer can be added to the other information of automatic expanded set by exhibition service.For example, update load balancer database can To include generating the row of the state of the identifier comprising load balancer and load balancer in the database.The state can be by Automatic expansion service determines.For example, if load balancer is previously not yet added to automatic expanded set, automatic expansion service can State assignment will be added to the row for corresponding to the load balancer in load balancer database.

Then, the automatic expansion service of implementation procedure 700 or other systems can make asynchronous workflows be lined up 708.It is asynchronous Workflow can be the process of the process 500 such as above in conjunction with Fig. 5 descriptions, which is configured to the reality of automatic expanded set Example distributes to load balancer indicated in request.Asynchronous workflows can be completed by above-mentioned background process.Then, automatically Expansion service can generate audit log information 710.As described above, audit log information can enable the customer to be corresponded to In load balancer relevant with automatic expanded set and the information of the operation performed in addition and/or removal load balancer. Automatic expansion service can generate at least a portion of audit log information after asynchronous workflows is made to join the team, and can be It completes to generate additional audit log information after asynchronous workflows.For example, automatic expansion service generation audit log information, bag The operation performed according to request and time started are included, after asynchronous workflows are completed, automatic expansion service can generate audit Whether log information, the time completed including operation and operation succeed.

Fig. 8 is the process 800 for being used to remove to load balancer automatic expanded set shown according to various embodiments Exemplary block diagram.Process 800 can be by any suitable system (server, computing resource service in such as data center Any service of multiple computing devices or computing resource service provider in the distributed system of provider (is such as tied above Close the automatic expansion service of Fig. 2 and Fig. 3 descriptions)) it performs.Process 800 includes sequence of operations, wherein being received from requestor RemoveLoadBalancer application programming interfaces are called, certification request person, flat using load if be then certified Weighing apparatus information updates load balancer database, and load balancer is removed to automatic expanded set.

In 802, computing resource ISP receives application programming interface from client or other entities and calls, with One or more load balancers are removed into automatic expanded set.One or more load balancers are removed into automatic expanded set It may cause one or more load balancer managing network flows and the network traffics are directed to included in automatic expanded set In one group of example.In addition, one or more load balancers are removed to automatic expanded set can include being taken by computing resource The operation of various other service executions of business provider.For example, client can be by that will ask to be submitted to describe in more detail above Load balancing services be created load balancer.In addition, automatic expansion service or its component (such as background process) can One or more load balancers are removed to automatic extension by the way that more batches of API Calls are submitted to load balancing services Group.For example, background process can determine a batch 10 examples to be allocated to specific load balancer, generation is configured to cause Make API Calls of the load balancing services by 10 example allocations to specific load balancer, and provided to load balancing services API Calls.

In 804, computing resource ISP determines whether requestor allows request to have obtained with enough permissions Into.For example, requestor may have been provided for identity and possess the proof of voucher as with RemoveLoadBalancer applications The parameter that Program Interfaces call.For example, requestor can supply the information for sufficing to show that the access to voucher as correspondence In the proof for possessing voucher of identity, encryption hash/summary of such as password, password, the encryption generated by encrypted signature key Other keys of digital signature or the identity for authorization requests person that can be verified by computing resource service provider.Computing resource Service provider can provide the identity and proof to authentication service, the authentication service then can with the identity of checking request person and The proof of voucher.Once the identity of requestor is demonstrated, computing resource service provider or authentication service is assured that and body Whether the relevant security strategy of part and/or role authorize enough permissions to allow to complete to ask.

If computing resource service provider not can determine that identity (for example, being not present in safety database), with The proof of card is not enough to prove that identity (for example, password of mistake) or the identity of requestor cannot otherwise confirm, holds The system of row process 800 may not further be advanced in process 800.The system of implementation procedure 800 is to give the mistake of requestor Mistake message responds to authentification failure and/or the authentication registration failure 812 in security log.Otherwise, if requestor is recognized It demonstrate,proves and is confirmed as with enough permissions RemoveLoadBalancer being allowed to ask to be completed, then implementation procedure 800 System can enter 806.

In 806, the system of implementation procedure 800 can use the information for corresponding to load balancer indicated in request To update load balancer database.For example, request can include the identifier and load balance of load balancer to be removed The relevant client of device, computing resource service provider or service relevant with its load balancer are adapted so that automatic expansion Load balancer can be removed to the other information of automatic expanded set by exhibition service.For example, update load balancer database can To include generating the row of the state of the identifier comprising load balancer and load balancer in the database.The state can be by Automatic expansion service determines.For example, if load balancer previously not yet removes to automatic expanded set, automatic expansion service can State assignment will be removed to the row for corresponding to the load balancer in load balancer database.

Then, the automatic expansion service of implementation procedure 800 or other systems can make asynchronous workflows be lined up 808.It is asynchronous Workflow can be the process of the process 500 such as above in conjunction with Fig. 5 descriptions, which is configured to the reality of automatic expanded set Example distributes to load balancer indicated in request.Asynchronous workflows can be completed by above-mentioned background process.Then, automatically Expansion service can generate audit log information 810.As described above, audit log information can enable the customer to be corresponded to In load balancer relevant with automatic expanded set and the information of the operation performed in addition and/or removal load balancer. Automatic expansion service can generate at least a portion of audit log information after asynchronous workflows is made to join the team, and can be It completes to generate additional audit log information after asynchronous workflows.For example, automatic expansion service generation audit log information, bag The operation performed according to request and time started are included, after asynchronous workflows are completed, automatic expansion service can generate audit Whether log information, the time completed including operation and operation succeed.

Fig. 9 show according to the explanation of embodiment using background process 932 to the load balancer of automatic expanded set more New 902 messaging diagram.The update 902 of load balancer can be responded from client API Calls (such as above in conjunction with The API Calls of Fig. 7 and Fig. 8 descriptions) with update (for example, addition or removal) and the relevant load balancer of automatic expanded set.From Dynamic expansion service can perform update using background process 932, and can communicate with load balancing services 936, will With the related update of the example of automatic expanded set to one or more load balancers by load balancing services management.Backstage into Journey can perform the asynchronous workflows as described in above in conjunction with Fig. 5.For example, as described above, automatic expansion service can receive by Load balancer is added to the request for the automatic expanded set for needing asynchronous workflows to handle the request.Then, automatic extension Service can perform background process 932 by starting background process 904.In various embodiments, if current positive execution Background process, then automatic expansion service background process may be caused to restart or background process may be caused negative in update It carries and is restarted at the operation during balancer 902API is called or step.

Then, background process can be born in response to one group that asks determine under transition state from automatic expansion service Balancer is carried to describe load balancer 926.Therefore, background process can in addition state as described above, added state Or under removal state be load balancer query load balancer database.In various embodiments, regardless of load balancer State how, automatic expansion service can ask to correspond to information with the relevant all load balancers of automatic expanded set. Then, background process can be returned with the list of the relevant load balancer of automatic expanded set and corresponding to load balancer Additional information, such as status information or condition information.Although describing list, it is ordered into or unordered any data structure can For load balancer information is returned to automatic expansion service.As indicated in fig. 9, which can hold in the circulating cycle Row, until automatic expansion service receives the order for the next step that instruction is continued to during update load balancer 902 operates Board.The cycling can be included in from the optional parameter in the API Calls that client is received.

Then, background process can determine and the load under transition state in response to the request from automatic expansion service The relevant one group of computer system example of balancer is to describe example 908.This can include automatic expanded set all examples or Only include the specific load balancing device distribution for still treating the load balancer group under transition state or the example deallocated.With Afterwards, background process 932 can determine the list of the example of automatic expanded set, and the list of the example is provided to automatic expansion service 910.Background process can the information with query load balancer database or comprising the example corresponding to automatic expanded set other Database.Although describing list, it is ordered into or unordered any data structure can be used for returning load balancer information Return to automatic expansion service.As indicated in fig. 9, which can perform in the circulating cycle, until the reception of automatic expansion service refers to Show the token for continuing to the next step during update load balancer 902 operates.For example, it describes load balancer and retouches Stating example can perform in the circulating cycle, until background process 932 determines to have obtained corresponding to all of load balancer and example Information.The cycling can be included in from the optional parameter in the API Calls that client is received.

Then, automatic expansion service can be determined for the example to be updated under transition state and the behaviour of load balancer Work order and batch size (912).Many factors can be based on, including multiple examples, multiple load balancers, to load balance The other factors of the amount of the load of service or the batch size suitable for determining to update example and load balancer carry out true It is fixed.It is held in addition, background process can be based at least partially on the load to load balancing services and/or stay on load balancer The quantity or type of capable operation carry out query load balanced service to determine appropriate batch size (for example, wherein will be to load Balancer distributes or deallocates example).In various embodiments, if background process receives mistake from load balancing services By mistake, if for example, load balancing services cannot handle request, background process can reduce in interval of time transmission and The batch size of the relevant API Calls of batch and/or delay.

Then, automatic expansion service can perform and the relevant operation of identified batch.For example, background process can incite somebody to action API Calls are transmitted to load balancing services, which is configured to give the example allocation of automatic expanded set to API tune The indicated specific load balancing device (914) in.Load balancing services 936 can send confirmation (916).The confirmation can wrap It includes to correspond to and successfully distributes to the example of load balancer in batch and not yet successfully distribute to the example of load balancer Information.The confirmation can cause automatic expansion service to can determine the example for being already allocated to load balancer.For example, the confirmation It can indicate that particular instance distributes to load balancer not successfully, this can indicate that the example has previously distributed to load balance Device.

If update include treat from automatic expanded set remove load balancer, automatic expansion service can wait just from The example that load balancer deallocates excludes operation to complete connection as described above.When example excluding it is all current When during connection, automatic expansion service can regularly or aperiodically determine example health (918).Load balancing services 936 can return to confirmation (920) of the instruction to the remaining connection of example.Once all examples have been distributed or deallocated, from Dynamic expansion service can complete load balancer by the way that the load balancer update of completion is transmitted to load balancing services 936 Update.This can indicate that all batch operations have been completed to load balancing services 936.Then, automatic expansion service can update Complete the background process (924) of update load balancer.In various embodiments, update background process completion cause backstage into Journey terminates operation.

Then, automatic expansion service and/or background process can generate audit log information.As described above, audit log Information can be enabled the customer to obtain corresponding to load balancer relevant with automatic expanded set and born adding and/or removing Carry the information of the operation (for example, result of batch operation determined by performing) performed during balancer.Automatic expansion service can be with Make asynchronous workflows join the team after generate audit log information at least a portion, and can complete asynchronous workflows it After generate additional audit log information.For example, automatic expansion service generation audit log information, including what is performed according to request Operation and time started, after asynchronous workflows are completed, automatic expansion service can generate audit log information, including operation Whether the time of completion and operation succeed.

If receiving additional request, background process can be with the load under restarting procedure and definite transition state Balancer.If not receiving additional request, background process can continue to execute with the relevant operation of identified batch, directly It is completed to all operations.Once all operations are completed, background process can be with related to the load balancer under transition state Information update load balancer database.For example, as described above, once all examples have been added to specific load balancing Device, background process can update the status information included in load balancer database to be added.

In addition, the embodiment of the disclosure can be described according to following clause：

1. a method of computer implementation, including：

In the case where being configured with the control of one or more computer systems of executable instruction,

Update and the request of the relevant load balancer of automatic expanded set are received, wherein the automatic expanded set includes one group Computer example, one or more of computer systems are configured to according to the one or more attribute managements determined by client The size of the computer example；

Load balancer database is updated using the identifier of the load balancer indicated in the request, and And give state assignment to the load balancer in the load balancer database；

Perform background process, the background process be configured to by least change one group of computer example with it is described At least a portion for associating to complete the request between load balancer；

Update the state of the load balancer in the load balancer database；And

Determine to distribute at least one computer example in one group of computer example of the load balancer Pass through health examination.

2. the computer implemented method according to clause 1, wherein the request bag of the update load balancer Include the addition request that the load balancer is added to the automatic expanded set.

3. the computer implemented method according to clause 1 or 2, wherein the request of the update load balancer Removal request including removing the load balancer from the automatic expanded set.

4. the computer implemented method according to any one of clause 1 to 3, wherein computer implemented method is also wrapped It includes and is based at least partially on the execution of the background process to generate log information.

5. a kind of system, including：

One or more processors；

Memory including instruction, described instruction cause the system when being performed by one or more of processors：

Receive the request that load balancer is added to one group of computer example for being organized as computer example group；

It is relevant with the load balancer indicated in the request to determine that load balancer data repository lacks Entry；

Identifier of the generation comprising the load balancer and the load in the load balancer data repository The entry of the state of balancer；And

The background process for being configured to distribute to one group of computer example the load balancer is performed, wherein will One group of computer example distributes to the load balancer, and that the load balancer is caused to be directed to network traffics is described Computer example.

6. according to the system described in clause 5, wherein the memory further includes instruction, described instruction by one or Multiple processors cause the system when performing：

Determine to distribute at least one computer example in one group of computer example of the load balancer Pass through health examination；And

The state of the load balancer is updated in service in the load balancer data repository.

7. the system according to clause 5 or 6, wherein the memory further includes instruction, described instruction is by described one A or multiple processors cause the system when performing：

Receive the second request that the load balancer is removed from the computer example group；And

The background process is caused to deallocate one group of computer example to the load balancer, wherein by institute Stating one group of computer example and deallocating causes the load balancer no longer to guide network traffics to the load balancer To the computer example.

8. according to the system described in clause 7, the load balancer is removed wherein receiving from the computer example group Second request, which is additionally included in the load balancer data repository, updates the state of the load balancer To remove state, wherein background process described in the removal state instruction is deallocated by one group of computer example to institute During stating load balancer.

9. the system according to clause 7 or 8, wherein the memory further includes instruction, described instruction is by described one A or multiple processors cause the system since the background process deallocates one group of computer example when performing To the load balancer, remove and the relevant load balancer data repository entry of the load balancer.

10. the system according to any one of clause 5 to 9, wherein the memory further includes instruction, described instruction exists Cause the system when being performed by one or more of processors：

Receive update and the second request of relevant second load balancer of the computer example group；

Determine that the background process is just handling the request at present；And

The background process is restarted, so that the background process is caused to complete the request and the described second request.

11. the system according to any one of clause 5 to 10, wherein the memory further includes instruction, described instruction Cause the system when being performed by one or more of processors：

Receive obtain with and the relevant information of the relevant one group of load balancer of the computer example group request, wherein The load balancer is the member of one group of load balancer；

The load balancer data repository is inquired about for described information relevant with one group of load balancer；And And

The result of the inquiry is provided in response to the request of the acquisition information.

12. the system according to any one of clause 5 to 11, wherein raw in the load balancer data repository It further includes to change into the entry and is included in the state of the load balancer in the request to indicate opening for addition It is dynamic.

13. a kind of non-transitory computer-readable storage media, stores executable instruction thereon, the executable instruction exists Cause the computer system at least when being performed by the one or more processors of computer system：

Receive update and the request of the relevant one or more load balancers of computer example group；

It is flat to update load to be based at least partially on one or more of load balancers indicated in the request Weighing apparatus data repository, the update are distributed to one in the load balancer data repository including at least modification Or the state of each load balancer in multiple load balancers；And

Background process is caused to complete the request.

14. according to the non-transitory computer-readable storage media described in clause 13, wherein causing the computer system The described instruction for receiving the update and the request of the relevant one or more load balancers of the computer example group is also wrapped Including causes the computer system to perform following instruction：

Determine that the update to one or more of load balancers indicated in the request is included by described in At least one load balancer in one or more load balancers is added to the computer example group；And

One group of computer example in the computer example group is distributed at least one load balancer.

15. the non-transitory computer-readable storage media according to clause 13 or 14, wherein described instruction further include Cause request of the computer system generation instruction in response to the reception when being performed by one or more of processors The instruction of the audit log of the one group of operation performed.

16. the non-transitory computer-readable storage media according to any one of clause 13 to 15, wherein the finger Order further include instruction, cause when being performed by one or more of processors the computer system determine the backstage into Journey has completed at least one load balancer asked and be more newly assigned in one or more of load balancers The state.

17. the non-transitory computer-readable storage media according to any one of clause 13 to 16, wherein causing institute State computer system receive it is described update with computer example group it is relevant one or more load balancers request it is described Instruction, which further includes, causes the computer system to perform following instruction：

Determine that the update to one or more of load balancers indicated in the request is included by described in At least one load balancer in one or more load balancers removes to the computer example group；And

One group of computer example in the computer example group is deallocated at least one load balancer.

18. the non-transitory computer-readable storage media according to any one of clause 13 to 17, wherein the finger Order, which is additionally included in, causes the computer system to perform following instruction when being performed by one or more of processors：

It receives application programming interfaces (API) to call, the API Calls are configured to obtain and the computer example group phase The list of the load balancer of pass；And

It is provided in response to the API Calls to the inquiry as a result, described look into of the load balancer data repository It askes and is configured to obtain the list with the relevant load balancer of the computer example group.

19. the non-transitory computer-readable storage media according to any one of clause 13 to 18, wherein the finger Order, which is additionally included in when being performed by one or more of processors, causes the computer system to recognize before the request is completed Demonstrate,prove the instruction of the request.

20. the non-transitory computer-readable storage media according to any one of clause 13 to 19, wherein the finger Order, which is additionally included in when being performed by one or more of processors, causes the computer system in the computer example group At least one computer example perform health examination instruction, wherein at least one computer example with it is one or At least one load balancer in multiple load balancers is related.

21. a method of computer implementation, including：

In the case where being configured with the control of one or more computer systems of executable instruction,

Detection pair and the update of the relevant load balancer of automatic expanded set including one group of computer example operate, described One or more computer systems are configured to the computer example according to the one or more attribute managements determined as client Size, wherein the update operation is configured to change one group of meter of the load balancer and the automatic expanded set Association between calculation machine example；

For the information inquiry load balancer database corresponding to the load balancer；

It is based at least partially on the load balancer and the update of the load balancer is operated to change Load balancer database is stated, wherein changing the load balancer database includes changing the instruction institute of the load balancer State the state of the situation of update operation；

It is updated storage described in the load balancer database；And

Due to detecting the completion of the update operation, the state of the load balancer is updated.

22. the computer implemented method according to clause 21, wherein the state of the load balancer includes At least one of following state：Addition state, added state, removal state and service in state.

23. the computer implemented method according to clause 21 or 22, wherein the computer implemented method is also wrapped The client being based at least partially on from the automatic expanded set removal load balancer is included to ask the load balance The status modifier of the load balancer in device database is removal state.

24. the computer implemented method according to any one of clause 21 to 23, wherein described computer implemented Method further include be based at least partially on client's request that the load balancer is added from the automatic expanded set will be described The status modifier of the load balancer in load balancer database is addition state.

25. the computer implemented method according to any one of clause 21 to 24, wherein described computer implemented Method is further included since the inquiry lacks the information corresponding to the load balancer, in the load balancer database Generation is used for the entry of the information corresponding to the load balancer.

26. a kind of system, including：

One or more processors；And

Memory including instruction, described instruction cause the system when being performed by one or more of processors：

Detect and distribute to the relevant operation of one or more load balancers of computer example group；

For the information corresponding to one or more of load balancers, inquiry is relevant with the computer example group Data repository；

Store the update to the data repository for corresponding to the load balancer and the operation, the update bag Include the state of the one or more of load balancers for the type for indicating the operation；And

For data repository described in the status inquiry of the load balancer, to determine to perform and to distribute to institute State the relevant operation of the load balancer of computer example group.

27. according to the system described in clause 26, wherein the operation further includes load balancer being added to the calculating Machine example set, and at least one in computer example group described in the state instruction of one or more of load balancers A example is just distributing to the load balancer.

28. according to the system described in clause 27, wherein the memory further includes instruction, described instruction is by one Or multiple processors cause the system to determine that at least one example has distributed to the load balancer when performing, and One or more of examples in computer example group described in the state instruction of one or more of load balancers The load balancer is distributed to.

29. according to the system described in clause 28, wherein the memory further includes instruction, described instruction is by one Or multiple processors cause the system to determine that at least one example in the computer example group has passed through health when performing It checks, and at least one load in load balancer described in the state instruction of one or more of load balancers Balancer is in service.

30. the system according to any one of clause 26 to 29, wherein the memory further includes instruction, described instruction The system is caused to receive when being performed by one or more of processors one from computer example group removal Or the request of at least one load balancer in multiple load balancers, and at least one load balancer is described At least one example in computer example group described in state instruction is just deallocated from the load balancer.

31. according to the system described in clause 30, wherein the memory further includes instruction, described instruction is by one Or multiple processors cause the system when performing：

Determine that one or more of examples deallocate from the load balancer；And

The entry corresponding to the load balancer from the data repository is marked to be deleted.

32. the system according to any one of clause 26 to 31, wherein the memory further includes instruction, described instruction Cause the system flat corresponding to the load since the inquiry does not return when being performed by one or more of processors The information of weighing apparatus generates the entry for being used for the information corresponding to the load balancer in the data repository.

33. according to the system described in clause 32, wherein the entry in the data repository is deposited including the data The relevant row of identifier with the load balancer in storage cavern.

34. a kind of non-transitory computer-readable storage media, stores executable instruction thereon, the executable instruction exists Cause the computer system at least when being performed by the one or more processors of computer system：

Receive update and the request of the relevant at least one load balancer of computer example group；

Data repository is changed to include the identifier of at least one load balancer and at least one load The state of balancer, wherein the state of at least one load balancer is based at least partially on the request of the reception And it determines；And

Perform one or more operations be based at least partially in the data repository it is indicated described at least one The state of a load balancer completes the request.

35. according to the non-transitory computer-readable storage media described in clause 34, wherein causing the computer system The described instruction for changing the data repository further includes the modification data repository to include corresponding to described in the update The instruction of the audit information of the request of at least one load balancer.

36. the non-transitory computer-readable storage media according to clause 34 or 35, wherein causing the computer The described instruction of data repository described in system modification is further included by least inquiring about institute before the data repository is changed Data repository is stated to determine to be stored in the precedence record of at least one load balancer in the data repository The instruction of state.

37. the non-transitory computer-readable storage media according to any one of clause 34 to 36, wherein causing institute Stating the described instruction for the request that computer system receives update at least one load balancer also causes the calculating Machine system：

Receive the request that at least one load balancer is removed from the computer example group；And

It is removal state by the status modifier of at least one load balancer in the data repository.

38. the non-transitory computer-readable storage media according to any one of clause 34 to 37, wherein the finger Order also causes the computer system：

The second request to the load balancer under transition state is received from background process；

It is based at least partially on the shape for being included at least one load balancer in the data repository State obtains the load balancer under a kind of transition state in one or more transition states from the data repository；And

The load balancer of the acquisition is provided in response to the described second request.

39. the non-transitory computer-readable storage media according to any one of clause 34 to 38, wherein the finger Order also causes the computer system：

Receive the request that at least one load balancer is added to the computer example group；And

The entry of the identifier including at least one load balancer is generated to the data repository, and And the state of at least one load balancer is set as addition state.

40. the non-transitory computer-readable storage media according to any one of clause 34 to 39, wherein the finger Order also causes the computer system to be based at least partially at least one load balancer received from background process The modification of more newly arriving of the state be included in the shape of at least one load balancer in the data repository State.

41. the non-transitory computer-readable storage media according to any one of clause 34 to 40, wherein the finger Order also causes the computer system to detect the newer completion at least one load balancer, and therefore repaiies Change the state of at least one load balancer in the data repository.

42. a method of computer implementation, including：

In the case where being configured with the control of one or more computer systems of executable instruction,

One or more of one group of load balancer under transition state load balancer is detected, wherein the transition shape State indicates to need to update with the relevant one or more load balancers of automatic expanded set, and wherein described automatic expanded set bag Include at least one computer example；

The request for starting asynchronous workflows is received from automatic expansion service, the asynchronous workflows are configured to by least Make at least one load balancer in one group of load balancer of the computer example with distributing to the automatic expanded set Correlation updates the computer example of the automatic expanded set by the automatic expansion service management；

Definite one or more load balancers under the transition state are based at least partially on to determine to treat One or more of one group of computer example of newer automatic expanded set computer example；

It determines a component batch operation, is configured to update definite one or more computer examples and the mistake Cross the association between definite one or more load balancers under state；

The component batch operation is caused to be performed；And

Due to the execution of the component batch operation, load balancer database is updated.

43. the computer implemented method according to clause 42, wherein determining to be configured to update described definite one It is described between definite one or more load balancers under a or multiple computer examples and the transition state The associated component batch operation further includes one group of application programming interfaces and calls, one group of application programming interfaces call by with It puts that definite one or more computer examples is caused to distribute to definite one or more load balancers, with So that network traffics are distributed to definite one or more computers by definite one or more load balancers Example.

44. the computer implemented method according to clause 42 or 43, wherein determining to be configured to update described determine One or more computer examples and the transition state under definite one or more load balancers between The associated component batch operation further includes one group of application programming interfaces and calls, and one group of application programming interfaces call It is configured to that definite one or more computer examples is caused to move from definite one or more load balancers It removes, so that network traffics are no longer distributed to described definite one or more by definite one or more load balancers A computer example.

45. the computer implemented method according to any one of clause 42 to 44, wherein described computer implemented Method, which further includes, to be received newer second request started to the computer example of automatic expanded set and restarts described different Walk workflow.

46. a kind of system, including：

One or more processors；And

Memory including instruction, described instruction cause the system when being performed by one or more of processors：

Receive the request for starting workflow；

The request is completed by least performing the following：

Determine at least one load balancer in one group of load balancer under transition state；

In the computer example group for determining at least one load balancer to be allocated under the transition state At least one computer example；

Described in determining to be configured to distribute to definite at least one computer example under the transition state The operation of definite at least one load balancer；And

The definite operation is caused to be performed.

47. according to the system described in clause 46, wherein the system is caused to determine described one group under the transition state The described instruction of at least one load balancer in load balancer is additionally included in by one or more of processors The system is caused to perform following instruction during execution：

For load balancer state information searching data repository；And

The result of the inquiry is based at least partially on to determine at least one load balancer that is in the mistake It crosses under state.

48. according to the system described in clause 47, wherein the memory further includes instruction, described instruction is by one Or multiple processors cause the system to be based at least partially on the result of the definite operation to update the number when performing According to the load balancer status information in repository.

49. the system according to any one of clause 46 to 48, wherein the memory further includes instruction, described instruction Cause the system when being performed by one or more of processors：

Receive the second request for starting the second workflow；

Second requirement is completed by least performing the following：

Second at least one load balancer in one group of load balancer is determined, wherein described second is at least one Load balancer is under removal state；And

It determines to treat at least one from second in the computer example group that at least one load balancer removes Example；And

Additional operations is caused to be performed, wherein the additional operations are configured to from described definite under the transition state The second at least one load balancer remove second definite at least one computer example.

50. according to the system described in clause 49, wherein the memory further includes instruction, described instruction is by one Or multiple processors cause the system to determine that the request and the described second request will occur simultaneously when performing, and restart It is configured to carry out the background process of second workflow.

51. according to the system of any one of clause 46 to 50, wherein causing the system to make the definite operation quilt The described instruction of execution, which is additionally included in when being performed from one or more of processors, causes the system to load balancing services The instruction of the definite operation is provided.

52. according to the system described in clause 51, further include application program wherein the definite operation is caused to be performed and connect Mouth calls, and at least one computer example is distributed at least one load balancer.

53. the system according to any one of clause 46 to 53, wherein at least it is based in part on spy from client Fixed load balancer is added to the application requests of the computer example group to generate the startup workflow Request.

54. a kind of non-transitory computer-readable storage media, stores executable instruction thereon, the executable instruction exists Cause the computer system at least when being performed by the one or more processors of computer system：

By at least for corresponding to the information inquiry data repository with the relevant load balancer of computer example group Each load balancer to be based at least partially in one group of load balancer under transition state determines one group of load Balancer is to be updated；

The definite and relevant one group of computer example of the computer example group, wherein one group of definite computer is real Example is to be updated with associating between one group of definite load balancer；

Determine to be configured to update one group of definite computer example and one group of definite load balancer it Between associated operation；

Operation is caused to be performed；And

Due to the execution of one group of operation, the data repository is updated.

55. according to the non-transitory computer-readable storage media described in clause 54, wherein the transition state indicates institute At least one computer example stated in computer example group is needed to one or more of loads under the transition state Balancer is updated.

56. the non-transitory computer-readable storage media according to clause 54 or 55, wherein the transition state bag Include at least one of following state：Addition state has added state and has removed state.

57. the non-transitory computer-readable storage media according to any one of clause 54 to 56, wherein causing institute Computer system generation is stated to be configured to update one group of definite computer example and one group of definite load balance The described instruction of the associated operation between device further includes the finger that the computer system is caused to generate the operation Order, so that the operation causes one group of definite computer example to be put down from one group of definite load when executed Weighing apparatus deallocates.

58. the non-transitory computer-readable storage media according to any one of clause 54 to 57, wherein causing institute Computer system generation is stated to be configured to update one group of definite computer example and one group of definite load balance The described instruction of the associated operation between device further includes the finger that the computer system is caused to generate the operation Order, so that the operation causes one group of definite computer example to be put down from one group of definite load when executed Weighing apparatus distributes.

59. the non-transitory computer-readable storage media according to any one of clause 54 to 58, wherein the finger Order, which is additionally included in, causes the computer system to perform following instruction when being performed by one or more of processors：

It is based at least partially on update and the request of the relevant load balancer of computer example group terminates to receive The request of background process, wherein the background process is configured to generate the operation；And

The background process is restarted to handle the request.

60. the non-transitory computer-readable storage media according to any one of clause 54 to 59, wherein the finger Order further includes instruction, when being performed by one or more of processors the computer system is caused to be based at least partially on The computing capability of load balancing services determines the quantity of the computer example of the computer example group to be updated to include In the specific operation of the operation.

61. the non-transitory computer-readable storage media according to any one of clause 54 to 60, wherein the finger Order, which is additionally included in when being performed by one or more of processors, causes the computer system to be based at least partially on from load The information that balanced service obtains determines the instruction of operation order.

Figure 10 shows each side of the example context 1000 for being used to implement each side according to various embodiments.Such as should Understand, although for illustrative purposes using network-based environment, different environment can be suitably used for realizing Various embodiments.Environment include electronic client device 1002, the electronic client device 1002 can include it is operable with Any appropriate device of request, message or information is sent and/or received by appropriate network 1004, and in some implementations In scheme, by the user of information transmission return device.The example of such client terminal device includes personal computer, mobile phone, hand Hold messaging units, laptop computer, tablet computer, set-top box, personal digital assistant, embedded computer system, electricity Philosophical works reader etc..Network can include any appropriate network, including Intranet, internet, cellular network, LAN, defend StarNet's network or any other such network and/or its combination.Institute can be depended, at least partially, on for the component of this system The network of selection and/or the type of environment.Agreement and component for communicating via this network are well known, and will It is not discussed in detail herein.By communication on network can by wired or wireless connection with and combinations thereof realize.Originally showing In example, since environment includes asking in response to this reception and serves the web server 1006 of content, so network includes Although internet for other networks, can use the replacement device for reaching similar purpose, this is for the ordinary skill of this field Personnel will be apparent

Illustrative environment includes at least one application server 1008 and data repository 1010.It should be appreciated that it may deposit In several application servers, layer or other elements, process or the component that can be linked or otherwise configure, can hand over Mutually to perform task, such as data are obtained from appropriate data repository.Server as used herein can be in various ways (such as hardware unit or virtual computer system) is realized.In some cases, server can refer to just in computer system The programming module of upper execution.As used herein, unless in addition illustrating or pointing out with clearing in context, term " data repository " It is to refer to store, access and retrieve any equipment of data or the combination of device, it can be in any standard, distribution, void Intend or assemble any combinations sum number that environment includes data server, database, data storage device and data storage medium Amount.Application server can include integrating to perform as needed with data repository for one of client terminal device or The various aspects of multiple applications, processing for application data access and service logic it is some or all of any appropriate hard Part, software and firmware.Application server can cooperate with data repository provide access control service, and can generate including But be not limited to text, figure, audio, video and/or cannot be supplied to user other content content, can be taken by web Device be engaged in hypertext markup language (" HTML "), extensible markup language (" XML "), JavaScript, cascading style sheets The form of (" CSS ") or other appropriate client terminal structure language is supplied to user.The content for being transmitted to client terminal device can To be handled by client terminal device, (include but not limited to user audibly, visually and/or pass through in one or more forms Other feel (including tactile, product are felt and/or smell) appreciable form) content is provided.It is all request and response processing with And the transmission of the content between client terminal device 1002 and application server 1008 can be used by web server in this example PHP is handled：HyperText Preprocessor (" PHP "), Python, Ruby, Perl, Java, HTML, XML or other applicable clothes Business device end structure language.It should be appreciated that web server and application server are not required, and only exemplary components, It is such as discussed elsewhere herein because the structured code being discussed herein can perform on any appropriate device or host 's.In addition, the operations described herein (unless in addition being pointed out with clearing in context) such as performed by single device can be by can Distributed and/or virtual system multiple devices can be formed to perform jointly.

Data repository 1010 can include several individual tables of data, database, data file, dynamic data storage side Case and/or for storing other data storage mechanisms and medium with the relevant data of particular aspects of the disclosure.It is for example, shown Data repository can include for store generation data 1012 and user information 1016 mechanism, can be used for for generation End provides content.It also illustrates that data repository includes the mechanism for storing daily record data 1014, can be used for reporting, analyze Or other such purposes.It should be appreciated that there may be possibility needs to be stored in many other aspects in data repository, such as Page image information and access authority information, the information can be appropriately stored in any one in mechanism listed above or In additional mechanism providing additional operation in data repository 1010.Data repository 1010 can be operated by relative logic, with It receives and instructs from application server 1008, and handle in response to this acquisition, update or otherwise data.Application server 1008 can provide the combination of static data, dynamic data or static data and dynamic data in response to the instruction received.It is dynamic State data (data such as used in web daily records (blog), shopping application program, press service and such other application) can With by server end structured language as described herein generation or can be by the application server or in the application service The Content Management System (" CMS ") operated under the control of device provides.In one example, user passes through the device by user's operation Some type of project can be directed to and submit searching request.In this case, data repository can access user information to test The identity of user is demonstrate,proved, and catalog detail information can be accessed to obtain the information of the project on the type.Then, information can To return to user, the results list on webpage that can be such as checked in user via the browser on user apparatus 1002 In.The information of interested specific project can check in the private pages of browser or window.It should be noted, however, that this Disclosed embodiment is not necessarily limited to the content of webpage, but can usually be more generally applicable to processing request, wherein please Ask the request being not necessarily to content.

Each server is typically included the executable program instructions for providing general management and operation for the server Operating system, and be typically included be stored in by server processor execution when allow server perform its expectation function Instruction computer readable storage medium (for example, hard disk, random access memory, read-only memory etc.).For server Operating system and general utility functions it is suitable be achieved in that it is known or commercially available, and by the common of this field Technical staff easily realizes specifically according to this disclosure.

In one embodiment, environment is to utilize to use one or more computer networks or direct by communication link Connect several computer systems of interconnection and the distribution and/or virtual computation environmental of component.However, the ordinary skill of this field Personnel will be understood that this system can be similary good in the system of the component with than less or more quantity shown in Fig. 10 Ground operates.Therefore, the description of the system 1000 in Figure 10 should be considered as substantially being illustrative, the model without limiting the disclosure It encloses.

Various embodiments can also realize that the operating environment in some cases may be used in various operating environments To include can be used for operating any one one or more subscriber computers, computing device or processing in multiple application programs Device.User or client terminal device can include any one in multiple general purpose personal computers, such as operation standard operation system Desktop computer, laptop computer or the tablet computer of system and the mobile software of operation can simultaneously support multiple network and Cellular devices, wireless device and the hand-held device of messaging protocol.This system can also be included for such as exploitation and database The purpose of management and run the multiple work stations of any one in multiple commercially available operating systems and other known applications.This A little devices can also include other electronic devices, such as virtual terminal, thin-client, games system and can be carried out via network Other devices of communication.These devices can also include virtual bench, such as virtual machine, management program and can via network into Other virtual bench of row communication.

The various embodiments of the disclosure utilize appreciated by those skilled in the art be used for using a variety of commercially available Agreement in any one support communication at least one network, such as transmission control protocol/Internet Protocol (" TCP/IP "), User Datagram Protocol (" UDP "), the agreement operated in each layer of open system interconnection (" OSI ") model, file transmission association Discuss (" FTP "), Universal Plug and Play (" UpnP "), Network File System (" NFS "), common Internet file system (" CIFS ") With a routable protocol group.Network can be for example LAN, wide area network, Virtual Private Network, internet, Intranet, extranet, Public switch telephone network, infrared network, wireless network, satellite network and any combination thereof.

In the embodiment using web server, web server can run multiple servers or middle-tier application journey Sequence is (including hypertext transfer protocol (" HTTP ") server, ftp server, common gateway interface (" CGI ") server, data Server, java server, Apache Server and service application service device) in any one.Server can be can ring Requests of the Ying Yu from user apparatus such as can be implemented as with any programming language (such as by performingC, C# or C++) or any script (such as Ruby, PHP, Perl, Python or TCL) with and combinations thereof one or more feet for writing One or more weblications of this or program perform program or script.Server can also include database server, Including without limitation can be fromWithIt those commercially available and increases income Server, such as MySQL, Postgres, SQLite, MongoDB and can store, retrieve and access structure or unstructured Other any servers of data.Database server can include the server based on table, the server based on file, non-knot The combination of structure server, relationship server, non-relationship server or these and/or other database server.

Environment can include a variety of data repositories and other memories as discussed above and storage medium.These can To reside in a variety of positions, such as locally to one or more of computer (and/or resident in a computer one Or it is multiple in) or across a network away from any one in computer or all storage mediums.In one group of particular embodiment In, information may reside in storage area network appreciated by those skilled in the art (" SAN ").Similarly, for holding Any necessary file that row is attributed to the function of computer, server or other network equipments can be suitably local and/or remote Journey stores.In the case where system includes computerized device, each this device can include being electrically coupled via bus Hardware element, the element include for example, at least central processing unit (" CPU " or " processor "), an at least one input Device (for example, mouse, keyboard, controller, touch-screen or keyboard) and at least one output device are (for example, display device, printing Machine or loud speaker).Such system can also include one or more storage devices, such as disc driver, light storage device and Solid-state storage device (such as random access memory (" RAM ") or read-only memory (" ROM ")) and removable medium dress It puts, storage card, flash card etc.

Such device can also include computer-readable storage media reader, communicator (for example, modem, Network interface card (wirelessly or non-wirelessly), infrared communications set etc.) and working storage as described above.Computer readable storage medium is read Take device can with represent long-range, local, fixation and/or mobile storage means and for it is interim and/or more permanently include, It stores, transmit and retrieve the computer readable storage medium connection of the storage medium of computer-readable information or be configured to receive The computer readable storage medium.System and various devices usually will also be including being located at least one working storage device Multiple software applications, module, service or other elements, including operating system and application program, such as client application or Web browser.It should be appreciated that alternate embodiment can have many variations unlike those described above.For example, it is also possible to it uses Custom hardware and/or particular element can be in hardware, softwares (including portable software, such as applet) or two It is realized in person.Furthermore, it is possible to use the connection of other computing devices (such as network inputs/output device).

It can include to contain the storage medium and computer-readable medium of code or the part of code in this field Any appropriate medium known or used, including storage medium and communication media, such as, but not limited to for storing and/or pass Defeated information (such as computer-readable instruction, data structure, program module or other data) any method or technique (including RAM, ROM, Electrically Erasable Programmable Read-Only Memory (" EEPROM "), flash memory or other memory technologies) in realize volatibility and Non-volatile, removable and nonremovable medium, compact disc read-only memory (" CD-ROM "), digital versatile disc (DVD) or its His optical memory, cassette, tape, magnetic disk storage or other magnetic memory apparatus or any other medium, can be used for depositing It stores up desired information and can be accessed by system and device.Based on disclosure provided herein and introduction, this field it is common Technical staff will recognize the other modes and/or method for realizing various embodiments.

Therefore, specification and drawings are considered to be illustrative and not restrictive meaning.However, it will become apparent to It is that in the case of the wider spirit and scope of the present invention illustrated in not departing from such as claim, can carry out each Kind modifications and changes.

Other modifications are in the spirit of the disclosure.Therefore, although disclosed technology is easy to carry out various modifications and substitute Construction, but the embodiment of its some illustration is shown in the drawings, and described in detail above.However, it should manage Solution, it is not intended to limit the invention to disclosed concrete form or diversified forms, but on the contrary, its object is to cover All modifications, alternative constructions and equivalent within the spirit and scope of the present invention (as defined in appended claims).

In the case of the disclosed embodiment of description term is used (particularly in the case of appended claims) " one (a) " should be interpreted to cover odd number and plural number with " one (an) " and " (the) " and similar indicant, unless In addition illustrate or be apparently contradicted in the context herein.Term "comprising", " having ", " comprising " and " containing " are to be interpreted as opening Formula term (i.e., it is intended that " including but not limited to "), unless otherwise indicated.Term " connection " is unmodified and with reference to physical connection When should be interpreted partly or entirely to be included in, be attached to or be bonded together, even if there are something interventions.This paper intermediate values The statement of scope be merely intended to serve as individually with reference to the stenography method for falling each individual value in the range of, unless otherwise herein Illustrate, and each individual value is incorporated into this specification, as individually illustrating herein.Term " group " (for example, " one group of project ") or " subset " use (unless otherwise specified herein or and contradicted by context) should be interpreted as including one or The nonempty set of multiple components.In addition, unless otherwise indicated or and contradicted by context, otherwise the term " subset " of corresponding group is no Centainly represent the appropriate subset of the correspondence group, but subset and corresponding group can be equal.

Connect language (such as phrase of form " at least one in A, B and C " or " at least one in A, B and C ") (being apparently contradicted in the context unless otherwise specified or otherwise) can by being such as generally used for presentation project, term etc. Otherwise understood with the context of any nonvoid subset for being A or B or C or A and B and C groups.For example, there are three the tools In the illustrated examples of the group of component, loigature phrase " at least one in A, B and C " and " at least one in A, B and C " are Refer to any one in the following group：{A}、{B}、{C}、{A、B}、{A、C}、{B、C}、{A、B、C}.Therefore, such connection language leads to Often being not intended to imply that the requirement of some embodiments, there are at least one at least one and C at least one, B in A In each.

The operation of process as described herein can perform in any suitable order, unless otherwise specified herein or with it is upper and lower Text is clearly contradicted.Process (or its modification and/or combination) described in text can be configured with the one or more of executable instruction It is performed under the control of computer system, and can be realized by its hardware or combination and held jointly on the one or more processors Capable code (for example, executable instruction, one or more computer programs or one or more application program).Code can example It is such as stored in the form of the computer program for the multiple instruction for including to be performed by one or more processors computer-readable On storage medium.Computer readable storage medium can be temporary with right and wrong.

Provided herein is any and all example or the use of exemplary language (for example, " such as ") be only intended to preferably say Bright embodiment of the present invention, and the scope of the present invention is not construed as limiting, unless otherwise stated.Language in specification is not It should be understood to indicate that any element being not claimed is necessary for the practice of the present invention.

The embodiment of the disclosure is described herein, the best mode embodiment of the present invention is used for including known for inventor. After the description for reading front, the modifications of these embodiments may become for those of ordinary skill in the art it is aobvious and It is clear to.The present inventor it is expected technical staff suitably using such modification, and inventor is intended to be different from specifically to retouch herein The mode embodiment of the disclosure stated.Therefore, the scope of the present disclosure includes such as permitted appended by applicable law The all modifications and equivalent of the theme illustrated in claim.In addition, said elements in its all possible modification Any combinations are covered by the scope of the present disclosure, unless otherwise specified herein or are apparently contradicted in the context.

All references cited herein is incorporated by reference text (including publications, patent applications and patents), Its degree as each bibliography by individually and specifically indicate be incorporated by reference and entire contents herein by It illustrates.

Claims (15)

1. a method of computer implementation, including：

In the case where being configured with the control of one or more computer systems of executable instruction,

Update and the request of the relevant load balancer of automatic expanded set are received, wherein the automatic expanded set includes one group of calculating Machine example, one or more of computer systems are configured to according to the one or more attribute managements determined as client The size of computer example；

Load balancer database is updated using the identifier of the load balancer indicated in the request, and State assignment is given to the load balancer in the load balancer database；

Background process is performed, the background process is configured to by least changing one group of computer example and the load At least a portion for associating to complete the request between balancer；

Update the state of the load balancer in the load balancer database；And

It determines to distribute at least one computer example in one group of computer example of the load balancer to have passed through Health examination.

2. computer implemented method according to claim 1, wherein the request bag of the update load balancer Include the addition request that the load balancer is added to the automatic expanded set.

3. computer implemented method according to claim 1, wherein the request bag of the update load balancer Include the removal request that the load balancer is removed from the automatic expanded set.

4. a kind of system, including：

One or more processors；

Memory including instruction, described instruction cause the system when being performed by one or more of processors：

Receive the request that load balancer is added to one group of computer example for being organized as computer example group；

Determine that load balancer data repository lacks and the relevant entry of the load balancer indicated in the request；

Identifier of the generation comprising the load balancer and the load balance in the load balancer data repository The entry of the state of device；And

The background process for being configured to distribute to one group of computer example the load balancer is performed, wherein by described in One group of computer example, which distributes to the load balancer, causes the load balancer that network traffics are directed to the calculating Machine example.

5. system according to claim 4, wherein the memory further includes instruction, described instruction by one or Multiple processors cause the system when performing：

It determines to distribute at least one computer example in one group of computer example of the load balancer to have passed through Health examination；And

The state of the load balancer is updated in service in the load balancer data repository.

6. system according to claim 4, wherein the memory further includes instruction, described instruction by one or Multiple processors cause the system when performing：

Receive the second request that the load balancer is removed from the computer example group；And

The background process is caused to deallocate one group of computer example to the load balancer, wherein by described one Group computer example is deallocated causes the load balancer that network traffics no longer are directed to institute to the load balancer State computer example.

7. system according to claim 6 removes the load balancer wherein receiving from the computer example group Second request, which is additionally included in the load balancer data repository, updates the state of the load balancer To remove state, wherein background process described in the removal state instruction is deallocated by one group of computer example to institute During stating load balancer.

8. system according to claim 6, wherein the memory further includes instruction, described instruction by one or Multiple processors cause the system since the background process deallocates one group of computer example to institute when performing Load balancer is stated, is removed and the relevant load balancer data repository entry of the load balancer.

9. system according to claim 4, wherein the memory further includes instruction, described instruction by one or Multiple processors cause the system when performing：

Receive update and the second request of relevant second load balancer of the computer example group；

Determine that the background process is just handling the request at present；And

The background process is restarted, so that the background process is caused to complete the request and the described second request.

10. a kind of non-transitory computer-readable storage media stores executable instruction thereon, the executable instruction is by counting The one or more processors of calculation machine system cause the computer system at least when performing：

Receive update and the request of the relevant one or more load balancers of computer example group；

One or more of load balancers indicated in the request are based at least partially on to update load balancer Data repository, the update are distributed to one or more in the load balancer data repository including at least modification The state of each load balancer in a load balancer；And

Background process is caused to complete the request.

11. non-transitory computer-readable storage media according to claim 10, wherein causing the computer system The described instruction for receiving the update and the request of the relevant one or more load balancers of the computer example group is also wrapped Including causes the computer system to perform following instruction：

The definite update to one or more of load balancers indicated in the request includes will be one Or at least one load balancer in multiple load balancers is added to the computer example group；And

One group of computer example in the computer example group is distributed at least one load balancer.

12. non-transitory computer-readable storage media according to claim 10, wherein described instruction be additionally included in by One or more of processors cause the computer system generation instruction to be performed in response to the request of the reception when performing One group of operation audit log instruction.

13. non-transitory computer-readable storage media according to claim 10, wherein causing the computer system The described instruction for receiving the update and the request of the relevant one or more load balancers of computer example group further includes cause The computer system is made to perform following instruction：

The definite update to one or more of load balancers indicated in the request includes will be one Or at least one load balancer in multiple load balancers removes to the computer example group；And

One group of computer example in the computer example group is deallocated at least one load balancer.

14. non-transitory computer-readable storage media according to claim 10, wherein described instruction be additionally included in by One or more of processors cause the computer system to perform following instruction when performing：

It receives application programming interfaces (API) to call, the API Calls are configured to obtain relevant with the computer example group The list of load balancer；And

It is provided in response to the API Calls to the inquiry as a result, the inquiry quilt of the load balancer data repository It configures to obtain the list with the relevant load balancer of the computer example group.

15. non-transitory computer-readable storage media according to claim 10, wherein described instruction be additionally included in by One or more of processors cause the computer system at least one meter in the computer example group when performing Calculation machine example performs the instruction of health examination, wherein at least one computer example and one or more of load balances At least one load balancer in device is related.