CN117032712A - Pipeline compiling and constructing method and device, electronic equipment and storage medium - Google Patents
Pipeline compiling and constructing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117032712A CN117032712A CN202310442569.2A CN202310442569A CN117032712A CN 117032712 A CN117032712 A CN 117032712A CN 202310442569 A CN202310442569 A CN 202310442569A CN 117032712 A CN117032712 A CN 117032712A
- Authority
- CN
- China
- Prior art keywords
- compiling
- pipeline
- container
- construction
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000010276 construction Methods 0.000 claims abstract description 65
- 230000008569 process Effects 0.000 claims abstract description 26
- 238000004590 computer program Methods 0.000 claims description 17
- 230000001419 dependent effect Effects 0.000 claims description 15
- 238000004891 communication Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000003139 buffering effect Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002085 persistent effect Effects 0.000 description 2
- 238000000275 quality assurance Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
- G06F8/44—Encoding
- G06F8/445—Exploiting fine grain parallelism, i.e. parallelism at instruction level
- G06F8/4452—Software pipelining
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/31—Programming languages or programming paradigms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/31—Programming languages or programming paradigms
- G06F8/315—Object-oriented languages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
- G06F8/43—Checking; Contextual analysis
- G06F8/433—Dependency analysis; Data or control flow analysis
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a pipeline compiling and constructing method, a device, electronic equipment and a storage medium. The method comprises the following steps: acquiring compiling language data according to a current pipeline construction instruction; determining a compiling container required in the current pipeline construction process according to compiling language data; judging whether the compiling container exists in the current pipeline or not; if so, carrying out pipeline compiling and constructing according to the compiling container. According to the technical scheme, the compiling container required in the current pipeline construction process is accurately determined according to the compiling language data, so that whether the compiling container exists in the current pipeline is judged, compiling is carried out by utilizing the compiling container existing in the pipeline, the compiling construction speed of the pipeline is greatly improved, and meanwhile consumption of cluster resources is reduced.
Description
Technical Field
The present application relates to the field of computers, and in particular, to a pipeline compiling and constructing method, apparatus, electronic device, and storage medium.
Background
Currently, cloud native technology is widely applied, yun Yuansheng is a set of cloud technology product system established based on technologies such as containers, micro services, devOps (Development Operations, software development and operation and maintenance) and the like, wherein DevOps is a set of general terms of processes, methods and systems for promoting communication, collaboration and integration among development (application/software engineering), technical operation and Quality Assurance (QA) departments.
In the prior art, when a devOps product based on a cloud protozoon system is compiled and constructed in a pipeline, a container construction pipeline is usually adopted, and then after construction is completed, a destroyed container technology is used, so that each construction is carried out again and completely, and the conditions of long time consumption, broadband occupation and large host resources are caused. Therefore, how to solve the problem of occupying more bandwidth and host resources in the pipeline compiling and constructing process is very important.
Disclosure of Invention
The application provides a pipeline compiling and constructing method, a device, electronic equipment and a storage medium, which are used for improving the speed of pipeline compiling and constructing and reducing the consumption of cluster resources.
According to an aspect of the present application, there is provided a pipeline compilation construction method, the method comprising:
acquiring compiling language data according to a current pipeline construction instruction;
determining a compiling container required in the current pipeline construction process according to compiling language data;
judging whether the compiling container exists in the current pipeline or not;
if so, carrying out pipeline compiling and constructing according to the compiling container.
According to another aspect of the present application, there is provided a pipeline compilation construction device comprising:
the data acquisition module is used for acquiring compiling language data according to the current pipeline construction instruction;
the container determining module is used for determining a compiling container required in the current pipeline construction process according to compiling language data;
the judging module is used for judging whether the compiling container exists in the current pipeline or not;
and the construction module is used for carrying out pipeline compiling construction according to the compiling container if the compiling container exists.
According to another aspect of the present application, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the pipeline compilation construction method of any of the embodiments of the present application.
According to another aspect of the present application, there is provided a computer readable storage medium storing computer instructions for causing a processor to implement a pipeline compilation construction method according to any embodiment of the present application when executed.
According to the technical scheme, compiling language data is obtained by constructing instructions according to a current pipeline; determining a compiling container required in the current pipeline construction process according to compiling language data; judging whether the compiling container exists in the current pipeline or not; if so, carrying out pipeline compiling and constructing according to the compiling container. According to the technical scheme, the compiling container required in the current pipeline construction process is accurately determined according to the compiling language data, so that whether the compiling container exists in the current pipeline is judged, compiling is carried out by utilizing the compiling container existing in the pipeline, the compiling construction speed of the pipeline is greatly improved, and meanwhile consumption of cluster resources is reduced.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the application or to delineate the scope of the application. Other features of the present application will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a pipeline compilation construction method provided in accordance with an embodiment of the present application;
FIG. 2 is a flow chart of a pipeline compilation construction method provided in accordance with an embodiment of the present application;
FIG. 3 is a flow chart of a pipeline compilation construction method provided in accordance with an embodiment of the present application;
FIG. 4 is a schematic structural diagram of a pipeline compiling and constructing device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device implementing a pipeline compilation construction method according to an embodiment of the present application.
Detailed Description
In order that those skilled in the art will better understand the present application, a technical solution in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, shall fall within the scope of the present application.
It should be noted that the term "present" and the like in the description of the present application and the claims and the above-described drawings are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
Fig. 1 is a flowchart of a pipeline compiling and constructing method according to an embodiment of the present application, where the method may be performed by a pipeline compiling and constructing device, which may be implemented in hardware and/or software, and may be configured in an electronic device having the pipeline compiling and constructing method, in the use and processing of a compiling container in the pipeline compiling and constructing process. As shown in fig. 1, the method includes:
s110, constructing an instruction according to the current pipeline, and acquiring compiled language data.
The pipeline construction instruction refers to a pipeline construction instruction sent by a user, and the pipeline is a group of automatic flows. In this embodiment, the pipeline may be a Kubernetes-based persistent integrated pipeline CI or a persistent delivery pipeline CD. Kubernetes is currently the most mainstream cloud primary container orchestration system. The pipeline compiling language can be java, go, c, c ++ or js, and the compiling language data is data composed of the pipeline compiling language.
Specifically, after the user configures the current pipeline, a current pipeline construction instruction is sent, and after the server receives the current pipeline construction instruction, the compiling language used by the current pipeline is determined, namely the compiling language data is obtained, and the same compiling language corresponds to a compiling container.
S120, determining a compiling container required in the current pipeline construction process according to compiling language data.
The compiling container is a container in a program, and refers to a software package formed by binding together codes, related configuration files, libraries and dependency items required by running a pipeline.
Specifically, after the compiling language data is determined, by analyzing the compiling language data, the type of the compiling language can be determined, so that a compiling container required in the current pipeline construction process can be accurately determined according to the compiling language type, and whether the compiling is easy or not can be accurately judged in the current pipeline.
S130, judging whether the compiling container exists in the current pipeline or not.
Specifically, different compiling containers correspond to different identification information, namely, the identification information and the compiling containers have a one-to-one correspondence relationship, so that whether the compiling containers exist in the current pipeline or not can be determined by detecting whether the identification information of the compiling containers required by the current pipeline exists in the current pipeline, namely, whether the identification information of the compiling containers exists in the current pipeline or not is determined; if so, determining that the compiling container exists in the current pipeline, and if not, determining that the compiling container does not exist in the current pipeline.
And S140, if the compiling container exists, carrying out pipeline compiling construction according to the compiling container.
Specifically, the compiling container is determined to exist in the current streamline according to the identification information, and is reserved in the last execution pipeline compiling and constructing process, so that the building of the compiling container can be omitted when the same language is executed in the later pipeline compiling and constructing process, namely, the current pipeline compiling and constructing process is carried out according to the compiling container, meanwhile, whether the compiling container can be reserved or not is judged, if the compiling container can be reserved, deletion is not carried out, and if the compiling container can not be reserved, the compiling container is deleted, so that frequent building and deleting of the compiling container are avoided, and because the compiling container reserved before can be directly used, the speed of the pipeline compiling and constructing process is greatly shortened, and the occupation of broadband resources is reduced.
Optionally, if not, the compiling container is created to perform pipeline compiling construction according to the compiling container.
Optionally, the pipeline compiling and constructing are performed according to the compiling container, and the method further comprises the following steps:
according to the compiling language data, determining the dependency data corresponding to the compiling container; judging whether the dependency data exists in the compiling container or not; if so, directly using the dependent data; if not, acquiring the dependent data, and storing the dependent data into the compiling container.
The dependency data refer to dependency items required by an operation pipeline, and because different compiling languages correspond to different dependency data, the dependency data corresponding to a compiling container can be accurately determined according to the compiling language data, when the dependency data does not exist in the compiling container, the dependency data is acquired and stored in the compiling container, if only a part of the dependency data exists in the compiling container, only the dependency data which does not exist in the compiling container is acquired, and the dependency data which does not exist in the compiling container is stored in the compiling container, so that the cache of the dependency data is reduced, and the occupation of resources is reduced; when the dependent data exists in the compiling container, the dependent data is directly compiled by using the dependent data in the compiling container without buffering the dependent data.
According to the technical scheme, each time of buffering of dependent data is avoided, the time of compiling and constructing the assembly line is greatly shortened, the loss of resources is also avoided, and meanwhile, the failure of compiling and constructing the assembly line caused by the failure of buffering the resources is avoided.
According to the technical scheme, compiling language data is obtained by constructing instructions according to a current pipeline; determining a compiling container required in the current pipeline construction process according to compiling language data; judging whether the compiling container exists in the current pipeline or not; if so, carrying out pipeline compiling and constructing according to the compiling container. According to the technical scheme, the compiling container required in the current pipeline construction process is accurately determined according to the compiling language data, so that whether the compiling container exists in the current pipeline is judged, compiling is carried out by utilizing the compiling container existing in the pipeline, the compiling construction speed of the pipeline is greatly improved, and meanwhile consumption of cluster resources is reduced.
Example two
Fig. 2 is a flowchart of a pipeline compiling and constructing method according to an embodiment of the present application, and the embodiment is described in further detail in S140 of the above embodiment. As shown in fig. 2, the method includes:
s210, constructing an instruction according to a current pipeline to acquire compiling language data; and determining a compiling container required in the current pipeline construction process according to the compiling language data.
S220, judging whether the compiling container exists in the current pipeline or not.
As shown in FIG. 3, after executing the checkout, i.e., after pulling a process of compiling the language, it is determined whether there is a previously reserved compilation container in the current pipeline.
S230, if the data exists, carrying out pipeline compiling and constructing according to the compiling container.
As shown in fig. 3, if present, the compilation is performed according to the compilation container, and if not present, the compilation container is created and then compiled according to the compilation container.
S240, acquiring historical operation data and historical value flow statistical information.
The running data includes the execution condition of the pipeline, including but not limited to the execution time of the pipeline, the language used for executing the compiling step, and the compiling command and parameters used for executing the compiling. The value stream statistics include information of the code repository (e.g., links of the code repository, information of the primary language, etc.), the commit record (including commit time).
Specifically, as shown in fig. 3, after the pipeline is compiled according to the compiling container, whether the compiling container needs to be reserved or not needs to be judged, so that the compiling container is convenient to use when the pipeline with the same language is executed next time; at this time, the historical operation data and the historical value stream statistics of the pipelines in the same language are important, so that the historical operation data and the historical value stream statistics of the current previous period of time are acquired, and whether the compiling container is reserved or not can be accurately determined by analyzing the historical operation data and the historical value stream statistics.
S250, determining whether to reserve the compiling container according to the historical operation data and the historical value flow statistical information.
Specifically, whether a compiling container is reserved after the current pipeline is finished is judged according to historical operation data and historical value flow statistical information of the current pipeline in the same time period before so as to multiplex the compiling container in the same time period in the future.
Optionally, the historical operating data at least comprises a starting frequency of the pipeline, and the historical value stream statistical information at least comprises the number of times of submission of the item in the pipeline; in a specified time period of the pipeline, when the starting frequency is greater than a preset starting frequency and/or the number of times of submission is greater than a preset number of times of submission, determining to reserve the compiling container so as to use the compiling container to carry out next pipeline compiling construction; otherwise, deleting the compiling container.
By way of example, determining whether to reserve a compilation container is not limited to the following three scenarios:
first kind: when the starting frequency of the current pipeline is larger than the preset starting frequency and the number of submissions is larger than the preset number of submissions at a certain time of each day, determining to reserve the compiling container so as to use the compiling container to carry out next pipeline compiling construction; otherwise, deleting the compiling container;
second kind: when the starting frequency of the current pipeline is larger than the preset starting frequency at a certain time of each day, determining to reserve the compiling container so as to use the compiling container to carry out next pipeline compiling construction; otherwise, deleting the compiling container;
third kind: when the number of times of submission is larger than the preset number of times of submission at a certain time of each day, determining to reserve the compiling container so as to use the compiling container to carry out next pipeline compiling construction; otherwise, deleting the compiling container;
according to the scheme, through analyzing the historical operation data and the historical value flow statistical information, whether the compiling container used by the current assembly line is reserved or not is accurately determined, and therefore reasonable utilization of the compiling container is achieved.
According to the technical scheme, compiling language data is obtained according to the current pipeline construction instruction; according to the compiling language data, determining a compiling container required in the current pipeline construction process, further judging whether the compiling container exists in the current pipeline, if so, carrying out pipeline compiling construction according to the compiling container, if not, creating the compiling container, compiling according to the compiling container, and determining whether to keep the compiling container after compiling, then acquiring historical operation data and historical value flow statistical information, and determining whether to keep the compiling container according to the historical operation data and the historical value flow statistical information, thereby realizing reasonable utilization of the compiling container, avoiding frequent creating and deleting of the compiling container, greatly improving the compiling construction speed of the pipeline, and reducing consumption of cluster resources.
Example III
Fig. 4 is a schematic structural diagram of a pipeline compiling and constructing device according to an embodiment of the present application. As shown in fig. 4, the apparatus includes:
a data acquisition module 310, configured to acquire compiled language data according to a current pipeline construction instruction;
a container determining module 320, configured to determine a compiling container required in the current pipeline construction process according to compiling language data;
a determining module 330, configured to determine whether the compilation container exists in the current pipeline;
a construction module 340, configured to perform pipeline compilation construction according to the compilation container, if any.
Optionally, the judging module is further configured to:
determining whether the identification information of the compiling container exists in the current pipeline;
if so, determining that the compiling container exists in the current pipeline.
Optionally, the building module includes a compilation container creating unit, specifically configured to:
if not, the compiling container is created to carry out pipeline compiling construction according to the compiling container.
Optionally, the construction module includes a dependent data determining unit, specifically configured to:
according to the compiling language data, determining the dependency data corresponding to the compiling container;
judging whether the dependency data exists in the compiling container or not;
if so, directly using the dependent data;
if not, acquiring the dependent data, and storing the dependent data into the compiling container.
Optionally, the building module includes:
the information acquisition unit is used for acquiring historical operation data and historical value flow statistical information;
and the judging unit is used for determining whether to keep the compiling container according to the historical operation data and the historical value stream statistical information.
Optionally, the historical operation data at least comprises the starting frequency of the pipeline, and the historical value flow statistical information at least comprises the number of times of submission of the item in the pipeline; the judging unit is specifically configured to:
when the starting frequency is greater than a preset starting frequency and/or the number of submissions is greater than a preset number of submissions, determining to reserve the compiling container so as to use the compiling container to carry out next pipeline compiling construction;
otherwise, deleting the compiling container.
The assembly line compiling and constructing device provided by the embodiment of the application can execute the assembly line compiling and constructing method provided by any embodiment of the application, and has the corresponding functional modules and beneficial effects of the executing method.
The technical scheme of the application is used for acquiring, storing, using and processing the data, and the like, which accords with the relevant regulations of national laws and regulations and does not violate the popular public order.
Example IV
According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.
Fig. 5 shows a schematic diagram of the structure of an electronic device 10 that may be used to implement an embodiment of the application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the applications described and/or claimed herein.
As shown in fig. 5, the electronic device 10 includes at least one processor 11, and a memory, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., communicatively connected to the at least one processor 11, in which the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as a pipeline compilation build method.
In some embodiments, the pipeline compilation construction method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the pipeline compilation construction method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the pipelined compilation build method in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above can be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present application, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present application may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present application are achieved, and the present application is not limited herein.
The above embodiments do not limit the scope of the present application. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the scope of the present application.
Claims (10)
1. A pipeline compilation construction method, comprising:
acquiring compiling language data according to a current pipeline construction instruction;
determining a compiling container required in the current pipeline construction process according to compiling language data;
judging whether the compiling container exists in the current pipeline or not;
if so, carrying out pipeline compiling and constructing according to the compiling container.
2. The method of claim 1, wherein determining whether the compilation container is present in a current pipeline comprises:
determining whether the identification information of the compiling container exists in the current pipeline;
if so, determining that the compiling container exists in the current pipeline.
3. The method of claim 1, wherein after determining whether the compilation container is present in a current pipeline, the method further comprises:
if not, the compiling container is created to carry out pipeline compiling construction according to the compiling container.
4. The method of claim 1, wherein performing pipeline compilation build from the compilation container comprises:
according to the compiling language data, determining the dependency data corresponding to the compiling container;
judging whether the dependency data exists in the compiling container or not;
if so, directly using the dependent data;
if not, acquiring the dependent data, and storing the dependent data into the compiling container.
5. A method according to claim 1 or 3, wherein after pipelined compilation build-up from the compilation container, the method comprises:
acquiring historical operation data and historical value flow statistical information;
and determining whether to reserve the compiling container according to the historical operation data and the historical value flow statistical information.
6. The method of claim 5, wherein the historical operating data includes at least a start-up frequency of the pipeline, and the historical value stream statistics include at least a number of submissions of items in the pipeline; determining whether to retain the compilation container according to the historical operating data and the historical value flow statistics comprises:
when the starting frequency is greater than a preset starting frequency and/or the number of submissions is greater than a preset number of submissions, determining to reserve the compiling container so as to use the compiling container to carry out next pipeline compiling construction;
otherwise, deleting the compiling container.
7. A pipeline compilation construction device, comprising:
the data acquisition module is used for acquiring compiling language data according to the current pipeline construction instruction;
the container determining module is used for determining a compiling container required in the current pipeline construction process according to compiling language data;
the judging module is used for judging whether the compiling container exists in the current pipeline or not;
and the construction module is used for carrying out pipeline compiling construction according to the compiling container if the compiling container exists.
8. The method of claim 7, wherein the determining module is further configured to:
determining whether the identification information of the compiling container exists in the current pipeline;
if so, determining that the compiling container exists in the current pipeline.
9. An electronic device, the electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the pipeline compilation construction method of any of claims 1-6.
10. A computer readable storage medium storing computer instructions for causing a processor to implement the pipeline compilation construction method of any of claims 1-6 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310442569.2A CN117032712A (en) | 2023-04-23 | 2023-04-23 | Pipeline compiling and constructing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310442569.2A CN117032712A (en) | 2023-04-23 | 2023-04-23 | Pipeline compiling and constructing method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117032712A true CN117032712A (en) | 2023-11-10 |
Family
ID=88634207
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310442569.2A Pending CN117032712A (en) | 2023-04-23 | 2023-04-23 | Pipeline compiling and constructing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117032712A (en) |
-
2023
- 2023-04-23 CN CN202310442569.2A patent/CN117032712A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112540806B (en) | Method and device for rendering small program page, electronic equipment and storage medium | |
| CN115373861A (en) | GPU resource scheduling method and device, electronic equipment and storage medium | |
| CN116303013A (en) | Source code analysis method, device, electronic equipment and storage medium | |
| CN114697398B (en) | Data processing method, device, electronic equipment, storage medium and product | |
| CN115454971A (en) | Data migration method and device, electronic equipment and storage medium | |
| CN117032712A (en) | Pipeline compiling and constructing method and device, electronic equipment and storage medium | |
| CN115186738A (en) | Model training method, device and storage medium | |
| CN115983222A (en) | EasyExcel-based file data reading method, device, equipment and medium | |
| CN115098520A (en) | Device data updating method and device, electronic device and storage medium | |
| CN118093048A (en) | Multi-module starting management method, device, equipment and medium | |
| CN115757275A (en) | Asset information management method and device, electronic equipment and storage medium | |
| CN115481090A (en) | File processing method and device, electronic equipment and storage medium | |
| CN117453358A (en) | Optimization method and device for offline scheduling task, electronic equipment and storage medium | |
| CN115630245A (en) | Page loading method and device, electronic equipment and storage medium | |
| CN117668114A (en) | Data synchronization method, device, equipment and medium | |
| CN115934101A (en) | Interface document generation method, device, medium and electronic equipment | |
| CN117608779A (en) | Scheduling period determining method, device, equipment and medium | |
| CN117608798A (en) | Workflow scheduling method, device, equipment and medium | |
| CN115859300A (en) | Vulnerability detection method and device, electronic equipment and storage medium | |
| CN118200405A (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN115576713A (en) | GRPC service application method and device based on class library | |
| CN115934178A (en) | Code running method and device, electronic equipment and storage medium | |
| CN117596141A (en) | Message assembling method, device, equipment and storage medium | |
| CN117707643A (en) | Plug-in building method and device and plug-in running method and device | |
| CN115098074A (en) | Interface creating method, device, equipment, storage medium and computer program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |