CN106656552A - Extension method, system and electronic device for data platform system - Google Patents
Extension method, system and electronic device for data platform system Download PDFInfo
- Publication number
- CN106656552A CN106656552A CN201610874285.0A CN201610874285A CN106656552A CN 106656552 A CN106656552 A CN 106656552A CN 201610874285 A CN201610874285 A CN 201610874285A CN 106656552 A CN106656552 A CN 106656552A
- Authority
- CN
- China
- Prior art keywords
- added
- back end
- data platform
- platform system
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/02—Standardisation; Integration
- H04L41/0246—Exchanging or transporting network management information using the Internet; Embedding network management web servers in network elements; Web-services-based protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/34—Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters
Abstract
The invention provides an extension method, system and electronic device for data platform system wherein the data platform system comprises the management nodes and at least one data node in communicative connection with the management nodes. The management nodes transmit to the to-be-added data node the script file for configuring a system environment so that the to-be-added node could complete the corresponding system environment configuration after executing the script file. The management nodes install corresponding applications for the to-be-added data node. In this manner, the adding of the to-be-added data node into the data platform system is completed. Compared with the traditional graphically node adding method, the method of the invention could cut two thirds of the time while the error rate is down by 99%. With only one script file executed, it is possible to realize the adding of a plurality of data nodes. Therefore, labor and material devotion as well as resource cost can be reduced substantially.
Description
Technical field
The present invention relates to compunication and internet, software management backstage technical field, more particularly to a kind of data
The extended method of plateform system, system and electronic equipment.
Background technology
In recent years, with the fast development and popularization and application of computer and information technology, the scale of sector application system
Rapid to expand, the data produced by sector application are in explosive increase, easily hundreds of TB even row of tens of to hundreds of PB scales
Industry/enterprise's big data far beyond existing traditional computing technique and the disposal ability of information system, therefore, seek effectively
Big data treatment technology, ways and means have become the active demand of real world.
In view of the urgency and importance of big data process demand, in recent years big data technology Global Academy,
Industrial quarters and national governments are paid high attention to and are paid attention to, and the whole world has started one can be public with the high speed information of the nineties in 20th century
The research boom that road is mentioned in the same breath.Some governments of developed country of US and European all propose one and are from national science and technology strategic level
The big data technical research plan of row, to promote the spy of government organs, great industry, academia and industrial quarters to big data technology
Rope is studied and applied.
The process of big data needs substantial amounts of hardware support, without the hardware support just various data analyses without big data
Management.When data volume is presented the growth of geometry magnitude, if hardware can not quickly dispose the node for being changed into big data, just cannot
Meet the service condition of daily system.How rapid deployment big data system, easily increases the nodes of big data server
Amount, is an important topic urgently to be resolved hurrily.
The content of the invention
The shortcoming of prior art in view of the above, it is an object of the invention to provide a kind of extension of data platform system
Method, system and electronic equipment, for rapidly hardware device being deployed as into the calculate node in big data processing system, so as to
Analysis and management for big data provides hardware support.
For achieving the above object and other related purposes, the present invention provides a kind of extended method of data platform system, should
For the data platform system, wherein, the data platform system includes：The management node and with the management node
At least one back end of communication connection, methods described includes：The management node sends to back end to be added to be used for
The script file of configuration system environments, complete corresponding system after the script file so that the back end to be added is performed
Ambient As；The management node installs related application for the back end to be added, so as to complete the data to be added
Addition of the node to the data platform system.
In one embodiment of the invention, the type of the data platform system includes：CDH systems.
In one embodiment of the invention, the content of the script file includes：The order for performing the script file is installed
Instrument compiling bag, edit the back end to be added title, closed safe arrange, install popular software bag, open ntp
Time Service simultaneously adds automatic item, modification swappiness to reduce use, installation CDH system operations to swap cachings
One or more combination that environment and language environment, pressure refresh and restart in the back end to be added.
It is described that related application is installed for back end to be added in one embodiment of the invention, including：Addition CDH management
Member's account, unlatching CDH client services, the function mounting for carrying out the back end to be added and the unlatching number to be added
Combine according to one or more in the computing function of node.
In one embodiment of the invention, at least one back end be respectively associated with its one-to-one at least one
Individual default load value, described to before back end transmission script file to be added, methods described also includes：Obtain described
The actual negative charge values of at least one back end, and compare with corresponding default load value respectively；If detecting the presence of actual negative
Charge values then start to extend the data platform system not less than the back end of default load value.
For achieving the above object and other related purposes, the present invention provides a kind of extension system of data platform system, should
For the data platform system, wherein, the data platform system includes：The management node and with the management node
At least one back end of communication connection, the system includes：Script sending module, for the management node to be added
Back end sends the script file for configuring system environments, so that the back end to be added performs the script file
After complete corresponding system environments and arrange；It is the back end peace to be added for the management node using module is installed
Dress related application, so as to complete addition of the back end to be added to the data platform system.
In one embodiment of the invention, the type of the data platform system includes：CDH systems.
In one embodiment of the invention, the content of the script file includes：The order for performing the script file is installed
Instrument compiling bag, edit the back end to be added title, closed safe arrange, install popular software bag, open ntp
Time Service simultaneously adds automatic item, modification swappiness to reduce use, installation CDH system operations to swap cachings
One or more combination that environment and language environment, pressure refresh and restart in the back end to be added.
It is described that related application is installed for back end to be added in one embodiment of the invention, including：Addition CDH management
Member's account, unlatching CDH client services, the function mounting for carrying out the back end to be added and the unlatching number to be added
Combine according to one or more in the computing function of node.
In one embodiment of the invention, at least one back end be respectively associated with its one-to-one at least one
Individual default load value, the system also includes：Comparing module, for sending script file to back end to be added described
Before：Obtain the actual negative charge values of at least one back end, and compare with corresponding default load value respectively；If detection
To there is back end of the actual negative charge values not less than default load value, then send to the script sending module and start to extend institute
State the instruction of data platform system.
For achieving the above object and other related purposes, the present invention provides a kind of electronic equipment, including as above arbitrary described
Data platform system extension system.
As described above, the extended method of the data platform system of the present invention, system and electronic equipment, with following beneficial effect
Really：
1) it is time-consuming：Traditional node server addition is needed in graphical interfaces addition, complex steps, when installing wait
Between it is long, error information is few, if once running into mistake, this node needs to reinstall system and could be added again；The present invention
Using script mode rapid expansion node calculation server, save time and cost, meet increasingly huge mass data processing
Demand；
2) data reliability：Add node server using order line, empirical tests can almost exclude all mistakes,
Addition node up is stablized, and can quickly be incorporated to CDH systems and provide calculating；
3) system failure rate is low：Ripe order line script, adds node server, and the foundation ring of system is defined in advance
Border, variable has evaded the aspect that graphic interface addition is not considered, the probability that calculate node occurs the system failure is dropped significantly
It is low.
Description of the drawings
Fig. 1 is shown as the CDH system structure diagrams of one embodiment of the invention.
Fig. 2 is shown as the extended method flow chart of the data platform system of one embodiment of the invention.
Fig. 3 is shown as the content for script schematic diagram of one embodiment of the invention.
Fig. 4 is shown as the extension system module figure of the data platform system of one embodiment of the invention.
Fig. 5 is shown as the electronic equipment schematic diagram including extension system of one embodiment of the invention.
Component label instructions
The extension system of 4 data platform systems
400 comparing modules
401 script sending modules
Module is installed in 402 applications
5 electronic equipments
S201～S202 steps
Specific embodiment
Embodiments of the present invention are illustrated below by way of specific instantiation, those skilled in the art can be by this specification
Disclosed content understands easily other advantages and effect of the present invention.The present invention can also pass through concrete realities different in addition
The mode of applying is carried out or applies, the every details in this specification can also based on different viewpoints with application, without departing from
Various modifications and changes are carried out under the spirit of the present invention.It should be noted that, in the case where not conflicting, following examples and enforcement
Feature in example can be mutually combined.
It should be noted that the diagram provided in following examples only illustrates in a schematic way the basic structure of the present invention
Think, only show in schema then with relevant component in the present invention rather than according to component count during actual enforcement, shape and size
Draw, it is actual when the implementing kenel of each component, quantity and ratio can be a kind of random change, and its assembly layout kenel
It is likely more complexity.
The present invention provides a kind of extended method of data platform system, the data platform system include management node and and its
The back end of communication connection.For example, the data platform system is CDH (Cloudera ' the s Distribution shown in Fig. 1
Including Apache Hadoop) system, the CDH systems are based on Apache agreements, based on Apache Hadoop and correlation
Project is developed, and 100% increases income, and can do batch processing, in time interactive SQL query and inquiry, the authority control of based role
System etc., is Hadoop distribution versions most wide used in enterprise.In the CDH systems, NameNode is management node, for connecing
The data processing needs of HDFS Client are received, and the data processing task is distributed to each DataNode back end, each
DataNode back end parallel computations, and result of calculation is fed back to HDFS Client from the Disk disks of write.Additionally,
The CDH systems can also include the Secondary NameNode, the Secondary with the communication connection of NameNode management nodes
NameNode is mainly used in periodically backing up the data in NameNode management nodes, in case NameNode management nodes
Loss of data can occur after collapse.Hereinafter will be described in detail the several critical function modules in the CDH systems：
1)HDFS：Distributed storage system main in CDH application programs, HDFS clusters contain a NameNode
(management host node), this node is responsible for the metadata of All Files system and stores the DataNode of True Data
(back end can have a lot).HDFS is designed for mass data, and traditional file systemses are realized to the excellent of high-volume small documents
Change, HDFS then realizes the optimization of access and storage to small lot mass file.
2)Hive：Apache Hive are a data warehouses of Hadoop, promote the summary of data (by structure
The data file of change is mapped as a database table), extemporaneous inquiry and the large data that is stored in Hadoop compatible systems
Set analysis.Hive provides complete SQL query function --- HiveQL language, meanwhile, when using this language performance, one is patrolled
When volume becoming poorly efficient and loaded down with trivial details, HiveQL also allow traditional Map/Reduce programmers use the Mapper of oneself customization with
Reducer is expressed.Hive is similar to CloudBase, based on the offer data on hadoop Distributed Computing Platforms
A set of software of the SQL functions of warehouse so that the collecting of the mass data being stored in inside hadoop, extemporaneous inquiry letter
Dan Hua.
3)Zookeeper：One of Chubby increases income realization in Google, be one for large-scale distributed system can
By coordinate system, there is provided function include：Configuring maintenance, name Service, distributed synchronization, group service etc..The mesh of ZooKeeper
Mark is exactly the error-prone key service of packaged complexity, and the system of interface and performance efficiency easy to use, function-stable is carried
Supply user.
4) CDH main frames item：That is each data computational node in Fig. 1.The number of main frame, configuration, quality decide this set
The quality of CDH systems, quality is higher, and the ability of processing data is stronger.1 master 3 from CDH frameworks in, include a management
Node, 3 back end being managed, all of log analysis, data processing all can distribute to this 3 data by host node
Node.
Below will be by taking CDH systems as an example, elaborate the present invention realizes process.Preferably, the management in the CDH systems
Node adopts linux servers, because linux increases income, can not only almost all of system on compatible market, will not also produce
Cost in any system of life, compared to system the servers such as high windows are taken, and greatly reduce expense cost.Additionally,
The CDH systems carry out mass data storage using HDFS distributed file systems, using the teaching of the invention it is possible to provide the data access of high-throughput, make
Can be just to realize original 6 times of performance with 1/6 cost, to meet the daily operation of the mass users for carrying out millions daily
Data analysis and user behavior are excavated.Further, the CDH systems are using the interconnected system technology for interconnecting networking completely, i.e. system is complete
C/S Technical Architectures are based on entirely, and CDH systems are divided into Server with Agent two parts and database, and Agent is responsible for holding for client
The order that row service end is sent, executive mode generally calls corresponding service shell scripts using python, is conducive to reality
It is existing：The operations such as management and monitoring cluster system, unified management configuration, management service Hadoop platform system.As shown in Fig. 2 this
Bright extended method is applied to the CDH systems, mainly includes the following steps that：
Step S201：The management node sends the script file for configuring system environments to back end to be added,
Corresponding system environments setting is completed after the script file so that the back end to be added is performed.As shown in figure 3, the pin
The content of presents can include：The instrument compiling bag of the order for performing the script file is installed, the number to be added is edited
Automatic item, modification are arranged, popular software bag is installed, opened ntp Time Services and add according to the title of node, closed safe
Swappiness is refreshed, is restarted with use, installation CDH system running environments and the language environment, pressure for reducing caching swap
Described back end to be added etc., its particular content can need to write in advance, add according to actual functional capability.
It should be noted that the server hardware of the back end to be added is suitable for what CDH systems were used, and
And, the back end to be added is provided with Linux server operating system.After due to operating system installation, at system
In space state, basically can not use, generally require manual installation foundation software environment to support the rapid deployment of CDH.Phase
Than performing order one by one under installation environment in conventional, the present invention is only needed by the way of script (such as shell scripts)
The repertoire of needs can be just automatically obtained by performing this script, so as to realize the quick setting of system-based environment.
Step S202：The management node installs related application for the back end to be added, so as to complete described treating
Addition of the interpolation data node to the data platform system.That is, specific, server basis environment is held by script
It is necessary to the operation for starting to be added CDH nodes after row installation, below will be by step a)～d) as a example by, describe in detail
The detailed content of related application is installed on the back end server of new addition：
Step a)：Useradd--system--home=/opt/cm-5.5.1/run/cloudera-scm-
Server/--no-create-home--shell=/bin/false--comment " Cloudera SCM User "
Cloudera-scm# adds cdh keeper's accounts；
Step b)：/ opt/cm-5.5.1/etc/init.d/cloudera-scm-agent start# open cdh client
End service；
Step c)：./hdfs dfsadmin-refreshNodes# performs order and carries out new node server capability installation；
Step d)：./hadoop-daemon.sh start datanode# new nodes install unlatching node and calculate work(
Energy.
So far, the process of quick addition calculate node server terminates in hadoop CDH big data systems.
Particularly, in one embodiment, ensure CDH systems do not delay machine, allow the base that data can normally, safely run
On plinth, it is also contemplated that the expense of resources costs, the method for the present invention also includes：Before step S201 is performed, in CDH systems
Existing back end is respectively provided with default load value, and its actual load value is monitored.Here, the content of load can be with
Including：Loading condition, disk service condition, physical memory service condition etc..For example, load is disk service condition, then correspond to
Load value can include：Disk I/O utilization, disk stand-by period, disk average queue length, Disk service time, disk
Etc. concrete numerical values such as to be read/wait write time, disk read/write handling capacities.When the reality for detecting back end
When load value is than or equal to corresponding default load value, start execution step S201, that is, start to add new in CDH systems
Back end, so as to meet the needs of real data process.
Fig. 4 is referred to, with said method embodiment principle similarly, the present invention provides a kind of expansion of data platform system
Exhibition system 4, realizes as a set of software, is equipped on including management node and communicates with least one back end of connection
Data platform system, for example：CDH systems, so as to realize the expanded function of the interpolation data node in the data platform system.
Because the technical characteristic in previous embodiment can apply to the system embodiment, thus it is no longer repeated.
The system 4 includes：Module 402 is installed in script sending module 401, application.
The function of script sending module 401 is to make the management node send for configuring system to back end to be added
The script file of system environment, completes corresponding system environments and sets so that the back end to be added is performed after the script file
Put, wherein, the content of the script file can include：The instrument compiling bag of the order for performing the script file is installed, is compiled
Collect the title of the back end to be added, closed safe to arrange, popular software bag is installed, opens ntp Time Services and add
Automatic item, modification swappiness are reducing use to swap cachings, install CDH system running environments and language ring
One or more combination that border, pressure refresh and restart in the back end to be added.
It is to make the management node related answering is installed for the back end to be added using the function of installing module 402
With, it is detailed, can include：Add CDH keeper's accounts, open CDH client services, carry out the back end to be added
Function mounting, one or more combination opened in the computing function of the back end to be added, so as to complete described treating
Addition of the interpolation data node to the data platform system.
In one embodiment, the system 4 also includes：Comparing module 400, at least one back end is respectively associated
Have and its one-to-one at least one default load value, pin is sent to back end to be added in the script sending module
Before presents, the comparing module obtains the actual negative charge values of at least one back end, and pre- with corresponding respectively
If load value is compared；If detecting the presence of back end of the actual negative charge values not less than default load value, send out to the script
Send module 401 to send to start to extend the instruction of the data platform system.
Fig. 5 is referred to, with said method, system embodiment principle similarly, the present invention provides one kind to be included as taken up an official post
The electronic equipment 5 of the extension system 4 of the data platform system described in, it may for example comprise communication unit (wireless communication module, has
Line communication module etc.), the server of the part such as processing unit (cpu chip etc.), because the technical characteristic in previous embodiment can
To be applied to the system embodiment, thus it is no longer repeated.
To sum up, the present invention uses order line script mode quick interpolation data node in data platform system, can be than passing
The mode of the graphical addition node of system saves for more than 2/3rds time, and error rate can reduce by 99%, no matter will be many
Few platform server is added to the calculate node of CDH systems, it is only necessary to which a script of seeking unity of action just can be completed, so as to quickly support
The computation capability of big data, and do not delay other librarian uses of team CDH systems, effectively overcome of the prior art
Various shortcoming and have high industrial utilization.
The principle and its effect of above-described embodiment only illustrative present invention, it is of the invention not for limiting.It is any ripe
Know the personage of this technology all can carry out modifications and changes under the spirit and the scope without prejudice to the present invention to above-described embodiment.Cause
This, such as those of ordinary skill in the art is complete with institute under technological thought without departing from disclosed spirit
Into all equivalent modifications or change, should by the present invention claim be covered.
Claims (11)
1. a kind of extended method of data platform system, it is characterised in that be applied to the data platform system, wherein, it is described
Data platform system includes：The management node and at least one back end with management node communication connection, it is described
Method includes：
The management node sends the script file for configuring system environments to back end to be added, for described to be added
Back end performs and corresponding system environments setting is completed after the script file；
The management node installs related application for the back end to be added, so as to complete the back end to be added to
The addition of the data platform system.
2. the extended method of data platform system according to claim 1, it is characterised in that the data platform system
Type includes：CDH systems.
3. the extended method of data platform system according to claim 2, it is characterised in that the content of the script file
Including：The instrument compiling bag of the order for performing the script file is installed, is edited the title of the back end to be added, closed
Security setting, installation popular software bag, unlatching ntp Time Services simultaneously add automatic item, modification swappiness to reduce
Use, installation CDH system running environments and language environment, pressure to swap cachings refreshes and restarts the data to be added
One or more combination in node.
4. the extended method of data platform system according to claim 2, it is characterised in that described for data section to be added
Point installs related application, including：Add CDH keeper's accounts, open CDH client services, carry out the data section to be added
One or more combination in the function mounting of point and the computing function of the unlatching back end to be added.
5. the extended method of data platform system according to claim 1, it is characterised in that at least one data section
Point has been respectively associated and its one-to-one at least one default load value, and script is sent to back end to be added described
Before file, methods described also includes：
Obtain the actual negative charge values of at least one back end, and compare with corresponding default load value respectively；
If detecting the presence of back end of the actual negative charge values not less than default load value, start to extend the data platform system
System.
6. the extension system of a kind of data platform system, it is characterised in that be applied to the data platform system, wherein, it is described
Data platform system includes：The management node and at least one back end with management node communication connection, it is described
System includes：
Script sending module, for the management node script text for configuring system environments is sent to back end to be added
Part, so that the back end to be added is performed corresponding system environments setting is completed after the script file；
Using module is installed, related application is installed for the back end to be added for the management node, so as to complete
Back end to be added is stated to the addition of the data platform system.
7. the extension system of data platform system according to claim 6, it is characterised in that the data platform system
Type includes：CDH systems.
8. the extension system of data platform system according to claim 7, it is characterised in that the content of the script file
Including：The instrument compiling bag of the order for performing the script file is installed, is edited the title of the back end to be added, closed
Security setting, installation popular software bag, unlatching ntp Time Services simultaneously add automatic item, modification swappiness to reduce
Use, installation CDH system running environments and language environment, pressure to swap cachings refreshes and restarts the data to be added
One or more combination in node.
9. the extension system of data platform system according to claim 7, it is characterised in that described for data section to be added
Point installs related application, including：Add CDH keeper's accounts, open CDH client services, carry out the data section to be added
One or more combination in the function mounting of point and the computing function of the unlatching back end to be added.
10. the extension system of data platform system according to claim 6, it is characterised in that at least one data
Node has been respectively associated and its one-to-one at least one default load value, and the system also includes：Comparing module, for
It is described to send before script file to back end to be added：
Obtain the actual negative charge values of at least one back end, and compare with corresponding default load value respectively；
If detecting the presence of back end of the actual negative charge values not less than default load value, send to the script sending module
Start the instruction for extending the data platform system.
11. a kind of electronic equipment, it is characterised in that include：Data platform system as described in arbitrary in claim 6 to 10
Extension system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610874285.0A CN106656552A (en) | 2016-09-30 | 2016-09-30 | Extension method, system and electronic device for data platform system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610874285.0A CN106656552A (en) | 2016-09-30 | 2016-09-30 | Extension method, system and electronic device for data platform system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106656552A true CN106656552A (en) | 2017-05-10 |
Family
ID=58853585
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610874285.0A Pending CN106656552A (en) | 2016-09-30 | 2016-09-30 | Extension method, system and electronic device for data platform system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106656552A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108809993A (en) * | 2018-06-15 | 2018-11-13 | 北京信安世纪科技股份有限公司 | The dispositions method and certificate authentication method of certificate authentication system, certificate authentication system |
| CN108989113A (en) * | 2018-07-24 | 2018-12-11 | 网宿科技股份有限公司 | A kind of dispositions method and management server of server |
| CN109587221A (en) * | 2018-11-09 | 2019-04-05 | 平安科技（深圳）有限公司 | Large data sets group managing means, device, storage medium and computer equipment |
| CN111708614A (en) * | 2020-08-19 | 2020-09-25 | 鹏城实验室 | Method, system and related equipment for dynamically adjusting resource parameters of virtual machine |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101442469A (en) * | 2007-11-22 | 2009-05-27 | ***通信集团公司 | Method, system and apparatus for down distributing configuration data |
| CN102736946A (en) * | 2011-04-11 | 2012-10-17 | 阿里巴巴集团控股有限公司 | Batch application node deploying method and device |
| CN104317610A (en) * | 2014-10-11 | 2015-01-28 | 福建新大陆软件工程有限公司 | Method and device for automatic installation and deployment of hadoop platform |
| CN105144093A (en) * | 2012-12-12 | 2015-12-09 | 微软技术许可有限责任公司 | Workload deployment with infrastructure management agent provisioning |
-
2016
- 2016-09-30 CN CN201610874285.0A patent/CN106656552A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101442469A (en) * | 2007-11-22 | 2009-05-27 | ***通信集团公司 | Method, system and apparatus for down distributing configuration data |
| CN102736946A (en) * | 2011-04-11 | 2012-10-17 | 阿里巴巴集团控股有限公司 | Batch application node deploying method and device |
| CN105144093A (en) * | 2012-12-12 | 2015-12-09 | 微软技术许可有限责任公司 | Workload deployment with infrastructure management agent provisioning |
| CN104317610A (en) * | 2014-10-11 | 2015-01-28 | 福建新大陆软件工程有限公司 | Method and device for automatic installation and deployment of hadoop platform |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108809993A (en) * | 2018-06-15 | 2018-11-13 | 北京信安世纪科技股份有限公司 | The dispositions method and certificate authentication method of certificate authentication system, certificate authentication system |
| CN108989113A (en) * | 2018-07-24 | 2018-12-11 | 网宿科技股份有限公司 | A kind of dispositions method and management server of server |
| CN109587221A (en) * | 2018-11-09 | 2019-04-05 | 平安科技（深圳）有限公司 | Large data sets group managing means, device, storage medium and computer equipment |
| CN111708614A (en) * | 2020-08-19 | 2020-09-25 | 鹏城实验室 | Method, system and related equipment for dynamically adjusting resource parameters of virtual machine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Viennot et al. | Synapse: a microservices architecture for heterogeneous-database web applications | |
| Yuan et al. | A data placement strategy in scientific cloud workflows | |
| CN103338135B (en) | A kind of method for real-time monitoring of cluster storage capacity | |
| Firouzi et al. | Architecting iot cloud | |
| CN106656552A (en) | Extension method, system and electronic device for data platform system | |
| US10949218B2 (en) | Generating an execution script for configuration of a system | |
| CN112148718A (en) | Big data support management system for city-level data middling station | |
| CN105138765A (en) | Large-scale computational experiment method based on Docker of artificial transportation system | |
| CN106569896A (en) | Data distribution and parallel processing method and system | |
| US10198537B2 (en) | Method and system for implementing intelligent system diagrams | |
| Miller et al. | Open source big data analytics frameworks written in scala | |
| CN103646134A (en) | Service-oriented networked simulation system dynamic generation method | |
| CN109783194A (en) | Processing method, device, equipment and the storage medium of defence mobilization platform | |
| CN113177088B (en) | Multi-scale simulation big data management system for material irradiation damage | |
| Singh et al. | Big data: technologies, trends and applications | |
| Taneja et al. | AirBits: a web application development using microsoft azure | |
| Yang et al. | On construction of the air pollution monitoring service with a hybrid database converter | |
| Cai et al. | Deployment and verification of machine learning tool-chain based on kubernetes distributed clusters: This paper is submitted for possible publication in the special issue on high performance distributed computing | |
| Chullipparambil | Big data analytics using Hadoop tools | |
| CN112799742B (en) | Machine learning practical training system and method based on micro-service | |
| CN115543543A (en) | Application service processing method, device, equipment and medium | |
| KR20150089693A (en) | Apparatus and Method for Extending Data Store System Based on Big Data Platform | |
| CN103246962A (en) | Enterprise comprehensive information management system | |
| de Sousa Reis et al. | Archadia: An architecture for big data as a service in private cloud | |
| Zhang et al. | The research and design of SQL processing in a data-mining system based on MapReduce |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170510 |