WO2019223171A1 - Workflow management method and system, computer device and storage medium - Google Patents

Workflow management method and system, computer device and storage medium Download PDF

Info

Publication number
WO2019223171A1
WO2019223171A1 PCT/CN2018/104339 CN2018104339W WO2019223171A1 WO 2019223171 A1 WO2019223171 A1 WO 2019223171A1 CN 2018104339 W CN2018104339 W CN 2018104339W WO 2019223171 A1 WO2019223171 A1 WO 2019223171A1
Authority
WO
WIPO (PCT)
Prior art keywords
job
time
running
jobs
average
Prior art date
Application number
PCT/CN2018/104339
Other languages
French (fr)
Chinese (zh)
Inventor
刘斌
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2019223171A1 publication Critical patent/WO2019223171A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/103Workflow collaboration or project management

Definitions

  • the present application relates to the field of computer information processing, and in particular, to a workflow management method, system, computer equipment, and storage medium.
  • IBM DataStage is an ETL tool developed by IBM and part of the IBM Information Platform Solution Suite and IBM InfoSphere. It is an integration tool that provides a data integration solution in a graphical interface.
  • ETL is the abbreviation of English Extract-Transform-Load, which is used to describe the process of extracting, transposing, and loading data from the source to the destination.
  • Extract-Transform-Load the abbreviation of English Extract-Transform-Load, which is used to describe the process of extracting, transposing, and loading data from the source to the destination.
  • the daily operation and maintenance of platforms such as DATASTAGE need to frequently perform abnormal tasks or stop when necessary.
  • platforms with a distributed deployment architecture For example, these daily operations require manual login to different servers and different clients for operations. In the case of a large number of engineering tasks, you can open the client and enter the user password to operate one by one.
  • a workflow management method, system, computer equipment and storage medium are provided.
  • a workflow management method for web job monitoring and scheduling applications including:
  • the runtime monitoring agent Periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table , Including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
  • a workflow management system includes:
  • a scheduling unit configured to schedule a plurality of jobs resident and running on a platform and a scheduled job tracking table, wherein the platform includes a runtime monitoring agent;
  • the monitoring unit is configured to periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, and the runtime monitoring agent monitors each of the multiple jobs on the platform and Stored in the job statistics table, including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
  • the inspection unit is configured to determine and save whether a given running job in the running time monitoring table is excluded by an alarm by checking a job scheduling exclusion list stored in the job statistics table;
  • Save unit set to save the alarm to the running time monitoring table when the current running time of a given running job exceeds the sum of the average running time and the predetermined tolerance value of the given running job and when the given running job is not excluded by the alert in;
  • a display unit configured to display a running time monitoring table for a plurality of jobs that are run, including a list of alerts associated with jobs that have exceeded an acceptable completion time.
  • a computer device includes a memory and a processor.
  • the memory stores computer-readable instructions.
  • the processor causes the processor to perform the following steps:
  • the runtime monitoring agent Periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table , Including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
  • a storage medium storing computer-readable instructions.
  • the one or more processors execute the following steps:
  • the runtime monitoring agent Periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table , Including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
  • the above workflow management method, device, computer equipment, and storage medium schedule multiple jobs that are resident and running on the platform and a scheduled job tracking table by scheduling, where the platform includes a runtime monitoring agent, which periodically monitors and resides in Multiple jobs running on the platform with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table, including start time, end Time, and current running time, and the job tracking table stores and tracks job data for each job.
  • FIG. 1 is a flowchart of a workflow management method according to an embodiment
  • FIG. 2 is a flowchart of a method for scheduling and monitoring multiple jobs in an embodiment
  • FIG. 3 is a structural block diagram of a workflow management system in an embodiment
  • FIG. 4 is a structural block diagram of a monitoring unit in an embodiment.
  • a workflow management method includes the following steps:
  • Step S101 scheduling multiple jobs resident and running on the platform and a scheduled job tracking table, where the platform includes a runtime monitoring agent;
  • DataStage can extract data from data sources of multiple platforms from multiple different business systems, complete conversion and cleaning, and load it into other systems. Each of these steps can be completed in a graphical tool, and can also be flexibly scheduled by external systems. Special design tools are provided to design conversion rules and cleaning rules, etc., and implement a variety of complex and practical tasks such as incremental extraction and task scheduling. Features. Among them, simple data conversion can be achieved by dragging operations on the interface and calling predefined conversion functions. Complex conversions can be achieved by writing code or combining extensions with other programs. DataStage provides a debugging environment that can greatly improve development and debugging extraction. Efficiency of the conversion process.
  • the platform contains runtime monitoring agents. Jobs are jobs that can be a single task or can be defined as batch jobs that contain many aspects.
  • the monitoring agent can be a time monitoring routine or a time monitor stored in the computer.
  • Step S102 Periodically monitor multiple jobs running on the platform together with the runtime monitoring agent, and the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in the job statistics table. , Including start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
  • the user can enter the following parameters to schedule the job, job name, start time and date of the job, future plans, can be weekly or monthly, optional alerts, user name, scheduled job, job priority, etc. All this initial job information is stored in a database of job tracking tables that reside on the computer.
  • the runtime monitoring agent For each running job on the platform, the runtime monitoring agent periodically monitors and saves the start time and date of the job, the end time and date of the job determined after the job is completed, and the current running time, which can be in minutes, Save for hours, days or any time.
  • the current running time is the difference between the start time and the current time. For example, starting work at 10 am today, and now it is 10:45 am, the current running time is 45 minutes.
  • Step S103 Determine and save whether a given running job in the running time monitoring table is excluded by an alarm by checking the job reservation exclusion list stored in the job statistics table;
  • Step S104 when the current running time of the given running job exceeds the sum of the average running time and the predetermined tolerance value of the given running job and when the given running job is not excluded by the alarm, save the alarm to the running time monitoring table;
  • a list of currently running jobs is displayed to the user, and options can be used to display all scheduled and completed jobs for a given time period, such as the current workday or work week.
  • a given time period such as the current workday or work week.
  • the monitoring process of the runtime monitoring agent continues to update the status of the job for system administrators to review.
  • Step S105 Display a running time monitoring table of a plurality of running jobs, including a list of alarms associated with jobs that have exceeded an acceptable completion time.
  • the status of all currently running jobs is also displayed together in a single list on the display.
  • the system administrator can choose to display monitoring and saving information for any past, present, or future job.
  • the user can extract and display historical job data from the job statistics table, job scheduling data from the job tracking table, and status data of currently running jobs from the run-time monitoring table, regardless of whether these jobs are already running and are about to run, Can be scheduled separately, real-time monitoring and maintenance, reducing manual misoperations, saving operation and maintenance time, and improving efficiency.
  • the scheduling and monitoring of multiple jobs further includes:
  • Step S201 The running time monitoring agent receives a statistical file, a tolerance file, and an exclusion file.
  • the statistical file contains an average running time for completing each job in the plurality of jobs, and the tolerance file contains each job in the plurality of jobs.
  • Three data files marked as statistics or statistical files, tolerance files and exclusion files are stored in the job statistics table and are received and used by the runtime monitoring agent.
  • the runtime monitoring agent runs the commands passed to it and inserts job initialization records into the log, such as a log graph located in the database layer.
  • job initialization records such as a log graph located in the database layer.
  • the runtime monitor process tracks this log and monitors records.
  • the above process relies on the existence of runtime statistics files, tolerance files, and exclusion files.
  • Statistics files are the average time to complete each job.
  • the tolerance file contains a time range in which each job can be completed. This time range can be entered by the system administrator or a value determined based on job data obtained over time.
  • the average time to complete each job is calculated based on historical data for a particular job.
  • the average job completion time for batch job generation and printout of insurance bill analysis may be one hour, so the statistics file will contain entries for the job, and the average job completion time is 1 hour or 60 minutes.
  • step S202 a runtime monitoring table composed of a list of multiple jobs is populated by the runtime monitoring agent
  • Three data files marked as statistics or statistical files, tolerance files and exclusion files are stored in the job statistics table and used by the runtime monitoring agent.
  • Step S203 Determine and save the average running time of each of the multiple jobs that have completed running in the job statistics table based on the historical data stored in the job statistics table.
  • the job statistics table further stores statistics files and tolerance files. Run-time monitoring agents are used to process excluded files for jobs that reside and run on the platform;
  • Statistics files are the average time to complete each job.
  • the average time to complete each job is calculated based on historical data for a particular job. For example, the average job completion time for bill payment and printout batch jobs may be 30 minutes, so the statistics file will contain entries for the job, and the average job completion time is 30 minutes.
  • the runtime monitoring agent also uses exclude files, which contains the names of all files that are excluded from alert notifications. For example, if task A has a tolerance value of 15 minutes and its running time exceeds its average running time by 5 minutes, an alert will be issued for the task unless the exclusion file lists exclude task A.
  • Step S204 Determine the acceptable completion time of each of the multiple jobs that are running and save them in the job statistics table.
  • the acceptable completion time is defined as the time period that is the sum of the average running time and the predetermined tolerance value.
  • the complete runtime data for that job is transferred from the runtime monitoring table to the job statistics table, which serves as a historical database of all jobs running on the platform.
  • the acceptable completion time is defined as the time period where the average running time and the predetermined tolerance value sum.
  • the average run time of the same job completed in the past and stored in the job statistics table determines the average run time of each job.
  • the average run time for a given job is stored in the job statistics table and updated when new data is available. If needed, different types of averages can be calculated and saved in the job statistics table. For example, instead of using a mean mean, you can calculate the mean as a median or pattern mean.
  • alerts include email notifications, pop-up screens, highlighted text, and colored text.
  • Alerts include push email notifications, pop-up screens, highlighted text, and colored text to make text stand out on the screen and can present multiple message formats.
  • the job statistics table includes parameters for each job in the plurality of jobs, including job name, start time, end time, run time, run date, platform name, average run time, tolerance range, and alarm.
  • Job data is stored in the storage device and usually includes job name, start time, end time, run time, run date, platform name, average run time, tolerance range and alarms, parameters are monitored in real time by the run time monitoring agent and will be updated Save to storage device.
  • the average run time is the average average time that previous jobs have completed; each job on the exclusion list has a due date, after which the due alert is excluded; each of the multiple jobs has a
  • the current running time is the time elapsed from the start time to the current time.
  • the average run time is the average average time that previous jobs have completed; each job on the exclusion list has an expiration date, after which the expiration alert is excluded; the current run time of each job in multiple jobs is from the start The time elapsed between the time and the current time.
  • job name task one
  • running system 8
  • running percentage 80
  • the current running time is the difference between the start time and the current time. For example, starting work at 3 pm today, and now it is 3:30 pm that day, then the current running time is 30 minutes.
  • batch jobs may be excluded from alerts based on their respective start and stop times.
  • a job can be a single task, or it can be defined as a batch job that contains many aspects. The same job will be defined by many tasks. You can search various databases, retrieve data, organize data, print out data, and so on. Batch jobs are based on Their respective start and stop times can be set to be excluded from the alarm.
  • a workflow management system is provided, and the management device includes:
  • a scheduling unit configured to schedule a plurality of jobs resident and running on a platform and a scheduled job tracking table, wherein the platform includes a runtime monitoring agent;
  • the monitoring unit is configured to periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, and the runtime monitoring agent monitors each of the multiple jobs on the platform and Stored in the job statistics table, including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
  • the inspection unit is configured to determine and save whether a given running job in the running time monitoring table is excluded by an alarm by checking a job reservation exclusion list stored in the job statistics table;
  • Save unit set to save the alarm to the running time monitoring table when the current running time of a given running job exceeds the sum of the average running time and the predetermined tolerance value of the given running job and when the given running job is not excluded by the alert in;
  • a display unit configured to display a running time monitoring table for a plurality of jobs that are run, including a list of alerts associated with jobs that have exceeded an acceptable completion time.
  • the monitoring unit includes:
  • a receiving module configured to receive a statistical file, a tolerance file, and an exclusion file by the runtime monitoring agent, the statistical file including an average running time configured to complete each of the plurality of jobs, the tolerance
  • the file contains an acceptable completion time for each of the plurality of jobs, the completion time being based on the respective average completion time of each job and if the current running time of each job is within the tolerance range of the given job time
  • exclusion files that include the names of files that were excluded from alert notifications
  • a filling module which is configured to fill a running time monitoring table composed of a list of multiple jobs through a running time monitoring agent
  • a determination module configured to determine and save an average running time of each of a plurality of jobs that have completed running in the job statistics table based on historical data stored in the job statistics table, wherein the job statistics table further Storing the statistical file and the tolerance file, and the runtime monitoring agent is set to process the excluded files of the jobs resident and running on the platform;
  • a saving module configured to determine an acceptable completion time at which each of the plurality of jobs is running and save it in the job statistics table, and the acceptable completion time is defined as the average running time and a predetermined capacity The period during which the limit sums.
  • the alerts include email notifications, pop-up screens, highlighted text, and colored text.
  • the job statistics table includes parameters for each job in the plurality of jobs, including job name, start time, end time, run time, run date, platform name, average run time, tolerance Scope and alerts.
  • the average run time is the average average time that previous jobs have completed; each job on the exclusion list has a due date, after which the due alert is excluded; the multiple jobs
  • the current running time of each job in is the time elapsed between the start time and the current time.
  • batch jobs are excluded from alerts based on their respective start and stop times.
  • a computer device in one embodiment, includes a memory and a processor.
  • the memory stores computer-readable instructions.
  • the processor causes the processor to execute the computer program. The steps in the workflow management method in the above embodiments are implemented at all times.
  • a storage medium storing computer-readable instructions.
  • the one or more processors execute the workflow in the foregoing embodiments. Steps in a management approach.
  • the storage medium may be a non-volatile storage medium.
  • the program may be stored in a computer-readable storage medium.
  • the storage medium may include: Read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks, etc.

Landscapes

  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Strategic Management (AREA)
  • Engineering & Computer Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Operations Research (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Debugging And Monitoring (AREA)

Abstract

A workflow management method and system, a computer device and a storage medium. The method comprises: scheduling multiple tasks residing and running on a platform, and a pre-set task tracking table, wherein the platform includes a running time monitoring agent (S101); periodically monitoring the multiple tasks residing on the platform and running together with the running time monitoring agent, wherein the running time monitoring agent monitors each task from among the multiple tasks on the platform and stores same in a task statistics table, comprising the start time, the end time and the current running time; and the task tracking table stores and tracks task data of each task (S102); determining, by means of checking a pre-set task exclusion list stored in the task statistics table, whether a given running task in a running time monitoring table is subjected to alarm exclusion, and storing same (S103); and when the current running time of the given running task exceeds the sum of the average running time of the given running task and a pre-set tolerance value and when the given running task is not subjected to alarm exclusion, storing the alarm in the running time monitoring table (S104). Manual erroneous operations are reduced, operating and maintenance time is saved on, and efficiency is improved.

Description

工作流管理方法、***、计算机设备和存储介质Workflow management method, system, computer equipment and storage medium
本申请要求于2018年05月21日提交中国专利局、申请号为201810487233.7、发明名称为“工作流管理方法、***、计算机设备和存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority from a Chinese patent application filed with the Chinese Patent Office on May 21, 2018, with application number 201810487233.7, and the invention name is "Workflow Management Method, System, Computer Equipment, and Storage Medium", the entire contents of which are incorporated by reference Incorporated in this application.
技术领域Technical field
本申请涉及计算机信息处理领域,尤其涉及一种工作流管理方法、***、计算机设备和存储介质。The present application relates to the field of computer information processing, and in particular, to a workflow management method, system, computer equipment, and storage medium.
背景技术Background technique
随着信息化建设的深入,IT***日趋复杂,各总各样的网络设备、服务器、中间件、数据库、业务***等让运维人员难以从容应对,即使加班加点地维护、部署、管理也经常会因设备出现故障而导致业务的中断,严重影响业务的正常运转。出现这些问题部分原因是缺乏事件监控和诊断工具等自动化运维技术工具,因为在没有高效的技术工具的支持下,使到问题出现后很难快速、准确地找到根本原因,也很难得到主动、快速处理。With the deepening of informatization construction, IT systems are becoming more and more complex. Various network equipment, servers, middleware, databases, business systems, etc. make it difficult for operation and maintenance personnel to cope with them. It will cause business interruption due to equipment failure, which will seriously affect the normal operation of the business. Part of the reason for these problems is the lack of automated operation and maintenance technical tools such as event monitoring and diagnostic tools, because without the support of efficient technical tools, it is difficult to quickly and accurately find the root cause after the problem occurs, and it is difficult to get the initiative Fast processing.
IBM DataStage是IBM开发的一种ETL工具,也是IBM信息平台解决方案套件和IBM InfoSphere的其中一部分,它是一个以图形界面方式来提供数据整合解决方案的集成工具。ETL,是英文Extract-Transform-Load的缩写,用来描述将数据从来源端经过萃取、转置、加载至目的端的过程。目前对DATASTAGE等平台的日常运维,需经常对异常任务或者在有必要的情况下停止进行,另外,需要经常查看平台的详细日志,导入导出文件等操作,然而,对于分布式部署架构的平台来说,这些日常运维需要人工登录不同的服务器和不同的客户端进行操作,在工程任务量较多的情况下,通过打开客户端,输入用户密码,逐一操作。IBM DataStage is an ETL tool developed by IBM and part of the IBM Information Platform Solution Suite and IBM InfoSphere. It is an integration tool that provides a data integration solution in a graphical interface. ETL is the abbreviation of English Extract-Transform-Load, which is used to describe the process of extracting, transposing, and loading data from the source to the destination. At present, the daily operation and maintenance of platforms such as DATASTAGE need to frequently perform abnormal tasks or stop when necessary. In addition, it is necessary to frequently check the detailed logs of the platform, import and export files, etc. However, for platforms with a distributed deployment architecture For example, these daily operations require manual login to different servers and different clients for operations. In the case of a large number of engineering tasks, you can open the client and enter the user password to operate one by one.
因而,现有DATASTAGE等平台的运维使用人力操作的缺陷主要有监控维护多个应用程序是非常耗时、困难和复杂,人工操作误差大,运维场景的自动化 程序不够,需要进行大量的脚本配置,效率不高。Therefore, the shortcomings of the manual operation of the existing DATASTAGE and other platforms using human operations are mainly the time-consuming, difficult and complicated monitoring and maintenance of multiple applications, large manual operation errors, insufficient automation procedures for operation and maintenance scenarios, and the need for a large number of scripts Configuration is not efficient.
发明内容Summary of the Invention
基于此,有必要针对现有DATASTAGE等平台的运维使用人力操作的缺陷监控维护多个应用程序是非常耗时、困难和复杂,提供一种工作流管理方法、***、计算机设备和存储介质。Based on this, it is necessary to use human-operated defect monitoring for the operation and maintenance of existing platforms such as DATASTAGE to maintain multiple applications, which is very time-consuming, difficult and complicated. A workflow management method, system, computer equipment and storage medium are provided.
一种工作流管理方法,用于网页作业监控和调度应用,包括:A workflow management method for web job monitoring and scheduling applications, including:
调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理;Schedule multiple jobs that reside and run on a platform and a scheduled job tracking table, where the platform includes a runtime monitoring agent;
周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据;Periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table , Including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除;Determine and save whether a given running job in the runtime monitoring table is excluded by an alert by checking the job scheduling exclusion list stored in the job statistics table;
当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;When the current running time of a given running job exceeds the sum of the average running time and a predetermined tolerance value of the given running job and when the given running job is not excluded by the alarm, save the alarm to the running time monitoring table;
显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。Displays a run-time monitoring table for multiple jobs running, including a list of alerts associated with jobs that have exceeded their acceptable completion time.
一种工作流管理***,包括:A workflow management system includes:
调度单元,设置为调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理;A scheduling unit configured to schedule a plurality of jobs resident and running on a platform and a scheduled job tracking table, wherein the platform includes a runtime monitoring agent;
监控单元,设置为周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据;The monitoring unit is configured to periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, and the runtime monitoring agent monitors each of the multiple jobs on the platform and Stored in the job statistics table, including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
检察单元,设置为通过检查存储在作业统计表内的作业预定排除列表来确 定并保存运行时间监控表内的给定运行作业是否受到警报排除;The inspection unit is configured to determine and save whether a given running job in the running time monitoring table is excluded by an alarm by checking a job scheduling exclusion list stored in the job statistics table;
保存单元,设置为当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;Save unit, set to save the alarm to the running time monitoring table when the current running time of a given running job exceeds the sum of the average running time and the predetermined tolerance value of the given running job and when the given running job is not excluded by the alert in;
显示单元,设置为显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。A display unit configured to display a running time monitoring table for a plurality of jobs that are run, including a list of alerts associated with jobs that have exceeded an acceptable completion time.
一种计算机设备,包括存储器和处理器,所述存储器中存储有计算机可读指令,所述计算机可读指令被所述处理器执行时,使得所述处理器执行以下步骤:A computer device includes a memory and a processor. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor causes the processor to perform the following steps:
调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理;Schedule multiple jobs that reside and run on a platform and a scheduled job tracking table, where the platform includes a runtime monitoring agent;
周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据;Periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table , Including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除;Determine and save whether a given running job in the runtime monitoring table is excluded by an alert by checking the job scheduling exclusion list stored in the job statistics table;
当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;When the current running time of a given running job exceeds the sum of the average running time and a predetermined tolerance value of the given running job and when the given running job is not excluded by the alarm, save the alarm to the running time monitoring table;
显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。Displays a run-time monitoring table for multiple jobs running, including a list of alerts associated with jobs that have exceeded their acceptable completion time.
一种存储有计算机可读指令的存储介质,所述计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器执行以下步骤:A storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the following steps:
调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理;Schedule multiple jobs that reside and run on a platform and a scheduled job tracking table, where the platform includes a runtime monitoring agent;
周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在 作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据;Periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table , Including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除;Determine and save whether a given running job in the runtime monitoring table is excluded by an alert by checking the job scheduling exclusion list stored in the job statistics table;
当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;When the current running time of a given running job exceeds the sum of the average running time and a predetermined tolerance value of the given running job and when the given running job is not excluded by the alarm, save the alarm to the running time monitoring table;
显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。Displays a run-time monitoring table for multiple jobs running, including a list of alerts associated with jobs that have exceeded their acceptable completion time.
上述工作流管理方法、装置、计算机设备和存储介质,通过调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理,周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据。通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除,当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中,显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表,减少了人工误操作,节省了运维时间,提高了效率。The above workflow management method, device, computer equipment, and storage medium schedule multiple jobs that are resident and running on the platform and a scheduled job tracking table by scheduling, where the platform includes a runtime monitoring agent, which periodically monitors and resides in Multiple jobs running on the platform with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table, including start time, end Time, and current running time, and the job tracking table stores and tracks job data for each job. Determine and save whether a given running job in the running time monitoring table is excluded by an alarm by checking the job scheduling exclusion list stored in the job statistics table, when the current running time of a given running job exceeds the average running time of the given running job And a predetermined tolerance limit and when a given run job is not excluded by an alert, save the alert to a run time monitoring table that displays the run time monitoring table for multiple jobs running, including those that have exceeded acceptable completion times The alarm list associated with the job reduces manual error operations, saves operation and maintenance time, and improves efficiency.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本申请的限制。Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the detailed description of the preferred embodiments below. The drawings are only for the purpose of illustrating preferred embodiments and are not to be considered as limiting the present application.
图1为一个实施例中工作流管理方法的流程图;FIG. 1 is a flowchart of a workflow management method according to an embodiment; FIG.
图2为一个实施例中多个作业的调度和监控方法的流程图;2 is a flowchart of a method for scheduling and monitoring multiple jobs in an embodiment;
图3为一个实施例中工作流管理***的结构框图;3 is a structural block diagram of a workflow management system in an embodiment;
图4为一个实施例中监控单元的结构框图。FIG. 4 is a structural block diagram of a monitoring unit in an embodiment.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the purpose, technical solution, and advantages of the present application clearer, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the application, and are not used to limit the application.
本技术领域技术人员可以理解,除非特意声明,这里使用的单数形式“一”、“一个”、“所述”和“该”也可包括复数形式。应该进一步理解的是,本申请的说明书中使用的措辞“包括”是指存在所述特征、整数、步骤、操作、元件和/或组件,但是并不排除存在或添加一个或多个其他特征、整数、步骤、操作、元件、组件和/或它们的组。Those skilled in the art will understand that, unless specifically stated otherwise, the singular forms "a", "an", "the" and "the" may include plural forms. It should be further understood that the word "comprising" used in the specification of the present application refers to the presence of the described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components, and / or groups thereof.
作为一个较好的实施例,如图1所示,一种工作流管理方法,该工作流管理方法包括以下步骤:As a better embodiment, as shown in FIG. 1, a workflow management method includes the following steps:
步骤S101,调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中平台包含运行时间监控代理;Step S101, scheduling multiple jobs resident and running on the platform and a scheduled job tracking table, where the platform includes a runtime monitoring agent;
提供了一种方法来监视DataStage平台上运行的作业,但不限于DataStage平台。DataStage可以从多个不同的业务***,从多个平台的数据源中抽取数据,完成转换和清洗,装载到其它***里面。其中每步都可以在图形化工具里完成,同样可以灵活地被外部***调度,提供专门的设计工具来设计转换规则和清洗规则等,实现了增量抽取、任务调度等多种复杂而实用的功能。其中简单的数据转换可以通过在界面上拖拉操作和调用预定义转换函数来实现,复杂转换可以通过编写代码或结合其他程序的扩展来实现,并且DataStage提供调试环境,可以极大提高开发和调试抽取、转换程序的效率。调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中平台包含运行时间监控代理,作业即工作,可以是一项单一任务,也可以被定义为包含许多方面的批量工作,时间监控代理可以是存储在计算机内的时间监控子程序或时间监控器。Provides a method to monitor jobs running on the DataStage platform, but is not limited to the DataStage platform. DataStage can extract data from data sources of multiple platforms from multiple different business systems, complete conversion and cleaning, and load it into other systems. Each of these steps can be completed in a graphical tool, and can also be flexibly scheduled by external systems. Special design tools are provided to design conversion rules and cleaning rules, etc., and implement a variety of complex and practical tasks such as incremental extraction and task scheduling. Features. Among them, simple data conversion can be achieved by dragging operations on the interface and calling predefined conversion functions. Complex conversions can be achieved by writing code or combining extensions with other programs. DataStage provides a debugging environment that can greatly improve development and debugging extraction. Efficiency of the conversion process. Schedule multiple jobs that reside and run on the platform, as well as scheduled job tracking tables. The platform contains runtime monitoring agents. Jobs are jobs that can be a single task or can be defined as batch jobs that contain many aspects. The monitoring agent can be a time monitoring routine or a time monitor stored in the computer.
步骤S102,周期性的监控驻留在平台上与运行时间监控代理一并运行的多 个作业,运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且作业跟踪表存储并跟踪每个作业的作业数据;Step S102: Periodically monitor multiple jobs running on the platform together with the runtime monitoring agent, and the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in the job statistics table. , Including start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
可以将监控设置为任意的间隔,例如每30秒监控一次或每一分钟监控一次。用户可以输入以下参数来安排作业,作业名称,作业的开始时间和日期,未来计划,可以每周一次或每月一次,可选的警报,用户的姓名,调度作业,作业优先级等。所有这些初始作业信息被存储在计算机上驻留的作业跟踪表的数据库中。对于平台上的每个正在运行的作业,运行时间监控代理程序会定期监控并保存作业的开始时间和日期,作业完成后确定的作业的结束时间和日期,以及当前运行时间,可以在几分钟,几小时,几天或任何时间之内保存。当前运行时间是开始时间和当前时间之差,例如今天上午10点开始工作,现在是当天上午10点45分,那么当前运行时间是45分钟。You can set the monitoring to any interval, such as every 30 seconds or every minute. The user can enter the following parameters to schedule the job, job name, start time and date of the job, future plans, can be weekly or monthly, optional alerts, user name, scheduled job, job priority, etc. All this initial job information is stored in a database of job tracking tables that reside on the computer. For each running job on the platform, the runtime monitoring agent periodically monitors and saves the start time and date of the job, the end time and date of the job determined after the job is completed, and the current running time, which can be in minutes, Save for hours, days or any time. The current running time is the difference between the start time and the current time. For example, starting work at 10 am today, and now it is 10:45 am, the current running time is 45 minutes.
步骤S103,通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除;Step S103: Determine and save whether a given running job in the running time monitoring table is excluded by an alarm by checking the job reservation exclusion list stored in the job statistics table;
通过将给定的作业,比如订单生成,与位于作业统计表中的排除列表或排除文件进行比较来确定完成的作业是否受到警报排除。如果完成的作业订单生成从警报通知中排除,则更新运行时间监控表列出排除,如果没有排除订单生成,则显示警报。Determine whether a completed job is excluded by an alert by comparing a given job, such as order generation, with an exclusion list or exclusion file located in the job statistics table. If the completed job order generation is excluded from the alert notification, the update runtime monitoring table lists the exclusions, and if the order generation is not excluded, an alert is displayed.
步骤S104,当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;Step S104, when the current running time of the given running job exceeds the sum of the average running time and the predetermined tolerance value of the given running job and when the given running job is not excluded by the alarm, save the alarm to the running time monitoring table;
当前运行的作业列表显示给用户,选项可用于显示给定时间段,例如当前工作日或工作周的所有计划和完成的作业。当然,如果给定的作业还没有完成,则运行时间监控代理的监控过程继续更新作业的状态以供***管理员查看。A list of currently running jobs is displayed to the user, and options can be used to display all scheduled and completed jobs for a given time period, such as the current workday or work week. Of course, if a given job has not been completed, the monitoring process of the runtime monitoring agent continues to update the status of the job for system administrators to review.
步骤S105,显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。Step S105: Display a running time monitoring table of a plurality of running jobs, including a list of alarms associated with jobs that have exceeded an acceptable completion time.
当前运行的所有作业的状态也会一起显示在显示器上的单个列表中。此外,***管理员可以选择显示任何过去,现在或将来的任何工作的监控和保存信息。 换句话说,用户可以从作业统计表中提取并显示历史作业数据,来自作业跟踪表的作业调度数据以及来自运行时间监控表的当前正在运行的作业的状态数据不管这些作业已经运行,即将运行,可以单独的调度,实时监控和维护,减少了人工误操作,节省了运维时间,提高了效率。The status of all currently running jobs is also displayed together in a single list on the display. In addition, the system administrator can choose to display monitoring and saving information for any past, present, or future job. In other words, the user can extract and display historical job data from the job statistics table, job scheduling data from the job tracking table, and status data of currently running jobs from the run-time monitoring table, regardless of whether these jobs are already running and are about to run, Can be scheduled separately, real-time monitoring and maintenance, reducing manual misoperations, saving operation and maintenance time, and improving efficiency.
如图2所示,在一个实施例中,多个作业的调度和监控还包括:As shown in FIG. 2, in one embodiment, the scheduling and monitoring of multiple jobs further includes:
步骤S201,由运行时间监控代理接收统计文件,容差文件和排除文件,统计文件包含用于完成多个作业中的每个作业的平均运行时间,容差文件包含多个作业中的每个作业的可接受完成时间,完成时间基于每个作业各自的平均完成时间以及如果每个作业的当前运行时间在给定作业时间的容限范围之外,则包含排除文件,排除文件包含从警报通知中被排除的文件名称;Step S201: The running time monitoring agent receives a statistical file, a tolerance file, and an exclusion file. The statistical file contains an average running time for completing each job in the plurality of jobs, and the tolerance file contains each job in the plurality of jobs. Acceptable completion time based on each job ’s average completion time and if the current run time of each job is outside the tolerance for a given job time, include exclusion files that are included from the alert notification Excluded file names;
标记为统计或统计文件,容差文件和排除文件的三个数据文件存储在作业统计表中,并由运行时间监控代理接收使用。运行时间监控代理运行传递给它的命令,并将作业初始化记录***到日志中,例如位于数据库层中的日志图。当作业完成时,运行时间监控代理被通知并且作业终止记录被***到作业统计表中。运行时监视器进程会跟踪此日志并监视记录。上述过程依赖于运行时统计文件,容差文件和排除文件的存在。统计文件是完成每项工作的平均时间文件。容差文件包含可完成每项作业的时间范围,此时间范围可以由***管理员输入,也可以是根据随时间获取的作业数据确定的值。每项工作完成的平均时间,例如平均时间,是根据特定工作的历史数据计算的。例如,保险账单分析生成和打印输出批次作业的平均作业完成时间可能为一个小时,因此统计文件将包含作业的条目,平均作业完成时间为1小时或60分钟。Three data files marked as statistics or statistical files, tolerance files and exclusion files are stored in the job statistics table and are received and used by the runtime monitoring agent. The runtime monitoring agent runs the commands passed to it and inserts job initialization records into the log, such as a log graph located in the database layer. When the job is completed, the runtime monitoring agent is notified and the job termination record is inserted into the job statistics table. The runtime monitor process tracks this log and monitors records. The above process relies on the existence of runtime statistics files, tolerance files, and exclusion files. Statistics files are the average time to complete each job. The tolerance file contains a time range in which each job can be completed. This time range can be entered by the system administrator or a value determined based on job data obtained over time. The average time to complete each job, such as the average time, is calculated based on historical data for a particular job. For example, the average job completion time for batch job generation and printout of insurance bill analysis may be one hour, so the statistics file will contain entries for the job, and the average job completion time is 1 hour or 60 minutes.
步骤S202,通过运行时间监控代理填充由多个作业的列表组成的运行时间监控表;In step S202, a runtime monitoring table composed of a list of multiple jobs is populated by the runtime monitoring agent;
标记为统计或统计文件,容差文件和排除文件的三个数据文件存储在作业统计表中,并由运行时间监控代理使用。Three data files marked as statistics or statistical files, tolerance files and exclusion files are stored in the job statistics table and used by the runtime monitoring agent.
步骤S203,基于存储在作业统计表内的历史数据,确定并保存作业统计表中已经完成运行的多个作业中的每一个的平均运行时间,其中作业统计表进一步存储统计文件和容差文件,运行时间监控代理用于处理驻留并运行在平台上 作业的排除文件;Step S203: Determine and save the average running time of each of the multiple jobs that have completed running in the job statistics table based on the historical data stored in the job statistics table. The job statistics table further stores statistics files and tolerance files. Run-time monitoring agents are used to process excluded files for jobs that reside and run on the platform;
统计文件是完成每项工作的平均时间文件。每项工作完成的平均时间,例如平均时间,是根据特定工作的历史数据计算的。例如,账单支付和打印输出批次作业的平均作业完成时间可能为30分钟,因此统计文件将包含作业的条目,平均作业完成时间为30分钟。运行时间监控代理程序还使用排除文件,其中包含从警报通知中排除的所有文件的名称。例如,如果任务A的公差值为15分钟,且运行时间超过其平均运行时间5分钟,则会为任务发出警报,除非排除文件列出排除任务A。Statistics files are the average time to complete each job. The average time to complete each job, such as the average time, is calculated based on historical data for a particular job. For example, the average job completion time for bill payment and printout batch jobs may be 30 minutes, so the statistics file will contain entries for the job, and the average job completion time is 30 minutes. The runtime monitoring agent also uses exclude files, which contains the names of all files that are excluded from alert notifications. For example, if task A has a tolerance value of 15 minutes and its running time exceeds its average running time by 5 minutes, an alert will be issued for the task unless the exclusion file lists exclude task A.
步骤S204,确定多个作业中的每一个正在运行的可接受完成时间并将其保存在作业统计表中,可接受完成时间定义为平均运行时间与预定容限值总和的时间段。Step S204: Determine the acceptable completion time of each of the multiple jobs that are running and save them in the job statistics table. The acceptable completion time is defined as the time period that is the sum of the average running time and the predetermined tolerance value.
一旦给定作业完成,该作业的完整运行时数据从运行时间监控表传送到作业统计表,其作为在平台上运行的所有作业的历史数据库。可接受完成时间定义为平均运行时间与预定容限值总和的时间段。过去完成并存储在作业统计表中的相同作业的平均运行时间确定每个作业的平均运行时间。给定作业的平均运行时间存储在作业统计表中,并在新数据可用时更新。如果需要,可以计算不同类型的平均值并将其保存在作业统计表中。例如,不是使用均值平均值,可以将平均值计算为中值平均值或模式平均值。可以在不兼容的计算机平台、服务器和客户端对这些作业进行实时监控和维护,无论这些作业是否已经运行还是即将运行。Once a given job is completed, the complete runtime data for that job is transferred from the runtime monitoring table to the job statistics table, which serves as a historical database of all jobs running on the platform. The acceptable completion time is defined as the time period where the average running time and the predetermined tolerance value sum. The average run time of the same job completed in the past and stored in the job statistics table determines the average run time of each job. The average run time for a given job is stored in the job statistics table and updated when new data is available. If needed, different types of averages can be calculated and saved in the job statistics table. For example, instead of using a mean mean, you can calculate the mean as a median or pattern mean. These jobs can be monitored and maintained in real-time on incompatible computer platforms, servers, and clients, regardless of whether these jobs are already running or are about to run.
在一个实施例中,警报包括电子邮件通知,弹出屏幕,突出显示的文本和彩色文本。In one embodiment, alerts include email notifications, pop-up screens, highlighted text, and colored text.
警报包括推送式电子邮件通知,弹出屏幕,突出显示的文本,和彩色文本,使文本在屏幕上突出显示,可以呈现多种消息格式。Alerts include push email notifications, pop-up screens, highlighted text, and colored text to make text stand out on the screen and can present multiple message formats.
在一个实施例中,作业统计表包括用于多个作业中的每一个作业的参数,包括作业名称,开始时间,结束时间,运行时间,运行日期,平台名称,平均运行时间,容差范围和警报。In one embodiment, the job statistics table includes parameters for each job in the plurality of jobs, including job name, start time, end time, run time, run date, platform name, average run time, tolerance range, and alarm.
作业数据存储在存储设备中,通常包括作业名称,开始时间,结束时间, 运行时间,运行日期,平台名称,平均运行时间,容差范围和警报,参数由运行时间监控代理实时监控,并将更新保存到存储设备。Job data is stored in the storage device and usually includes job name, start time, end time, run time, run date, platform name, average run time, tolerance range and alarms, parameters are monitored in real time by the run time monitoring agent and will be updated Save to storage device.
在一个实施例中,平均运行时间是先前作业已经完成的平均平均时间;排除列表上的每个作业都具有到期日,在此之后排除该到期警报;多个作业中的每一个作业的当前运行时间是从开始时间到当前时间之间耗费的时间。In one embodiment, the average run time is the average average time that previous jobs have completed; each job on the exclusion list has a due date, after which the due alert is excluded; each of the multiple jobs has a The current running time is the time elapsed from the start time to the current time.
平均运行时间是先前作业已经完成的平均平均时间;排除列表上的每个作业都具有到期日,在此之后排除该到期警报;多个作业中的每一个作业的当前运行时间是从开始时间到当前时间之间耗费的时间。举例说明,作业名称:任务一,运行***:8,运行百分比:80,这表示任务一在预定的时间段内平均运行了8分钟,在过去10个月中运行了8个月。当前运行时间是开始时间和当前时间之差,例如今天下午3点开始工作,现在是当天下午3点30分,那么当前运行时间是30分钟。The average run time is the average average time that previous jobs have completed; each job on the exclusion list has an expiration date, after which the expiration alert is excluded; the current run time of each job in multiple jobs is from the start The time elapsed between the time and the current time. For example, job name: task one, running system: 8, running percentage: 80, which means that task one has run an average of 8 minutes in a predetermined period of time, and has run for 8 months in the past 10 months. The current running time is the difference between the start time and the current time. For example, starting work at 3 pm today, and now it is 3:30 pm that day, then the current running time is 30 minutes.
在一个实施例中,批量作业基于其各自的开始和停止时间可被排除在警报之外。In one embodiment, batch jobs may be excluded from alerts based on their respective start and stop times.
工作可以是一项单一任务,也可以被定义为包含许多方面的批量工作,相同工作将由许多任务来定义,可以搜索各种数据库,检索数据,组织数据,最后打印出数据等等,批量作业基于其各自的开始和停止时间可被设置排除在警报之外。A job can be a single task, or it can be defined as a batch job that contains many aspects. The same job will be defined by many tasks. You can search various databases, retrieve data, organize data, print out data, and so on. Batch jobs are based on Their respective start and stop times can be set to be excluded from the alarm.
如图3所示,在一个实施例中,提供一种工作流管理***,该管理装置包括:As shown in FIG. 3, in one embodiment, a workflow management system is provided, and the management device includes:
调度单元,设置为调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理;A scheduling unit configured to schedule a plurality of jobs resident and running on a platform and a scheduled job tracking table, wherein the platform includes a runtime monitoring agent;
监控单元,设置为周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据;The monitoring unit is configured to periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, and the runtime monitoring agent monitors each of the multiple jobs on the platform and Stored in the job statistics table, including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
检察单元,设置为通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除;The inspection unit is configured to determine and save whether a given running job in the running time monitoring table is excluded by an alarm by checking a job reservation exclusion list stored in the job statistics table;
保存单元,设置为当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;Save unit, set to save the alarm to the running time monitoring table when the current running time of a given running job exceeds the sum of the average running time and the predetermined tolerance value of the given running job and when the given running job is not excluded by the alert in;
显示单元,设置为显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。A display unit configured to display a running time monitoring table for a plurality of jobs that are run, including a list of alerts associated with jobs that have exceeded an acceptable completion time.
如图4所示,在一个实施例中,所述监控单元包括:As shown in FIG. 4, in an embodiment, the monitoring unit includes:
接收模块,设置为由所述运行时间监控代理接收统计文件,容差文件和排除文件,所述统计文件包含设置为完成所述多个作业中的每个作业的平均运行时间,所述容差文件包含所述多个作业中的每个作业的可接受完成时间,所述完成时间基于每个作业各自的平均完成时间以及如果每个作业的当前运行时间在给定作业时间的容限范围之外,则包含排除文件,所述排除文件包含从警报通知中被排除的文件名称;A receiving module configured to receive a statistical file, a tolerance file, and an exclusion file by the runtime monitoring agent, the statistical file including an average running time configured to complete each of the plurality of jobs, the tolerance The file contains an acceptable completion time for each of the plurality of jobs, the completion time being based on the respective average completion time of each job and if the current running time of each job is within the tolerance range of the given job time In addition, it includes exclusion files that include the names of files that were excluded from alert notifications;
填充模块,设置为通过运行时间监控代理填充由多个作业的列表组成的运行时间监控表;A filling module, which is configured to fill a running time monitoring table composed of a list of multiple jobs through a running time monitoring agent;
确定模块,设置为基于存储在所述作业统计表内的历史数据,确定并保存所述作业统计表中已经完成运行的多个作业中的每一个的平均运行时间,其中所述作业统计表进一步存储所述统计文件和容差文件,运行时间监控代理设置为处理驻留并运行在平台上作业的排除文件;A determination module configured to determine and save an average running time of each of a plurality of jobs that have completed running in the job statistics table based on historical data stored in the job statistics table, wherein the job statistics table further Storing the statistical file and the tolerance file, and the runtime monitoring agent is set to process the excluded files of the jobs resident and running on the platform;
保存模块,设置为确定所述多个作业中的每一个正在运行的可接受完成时间并将其保存在所述作业统计表中,所述可接受完成时间定义为所述平均运行时间与预定容限值总和的时间段。A saving module configured to determine an acceptable completion time at which each of the plurality of jobs is running and save it in the job statistics table, and the acceptable completion time is defined as the average running time and a predetermined capacity The period during which the limit sums.
在一个实施例中,所述警报包括电子邮件通知,弹出屏幕,突出显示的文本和彩色文本。In one embodiment, the alerts include email notifications, pop-up screens, highlighted text, and colored text.
在一个实施例中,所述作业统计表包括用于多个作业中的每一个作业的参数,包括作业名称,开始时间,结束时间,运行时间,运行日期,平台名称,平均运行时间,容差范围和警报。In one embodiment, the job statistics table includes parameters for each job in the plurality of jobs, including job name, start time, end time, run time, run date, platform name, average run time, tolerance Scope and alerts.
在一个实施例中,所述平均运行时间是先前作业已经完成的平均平均时间;所述排除列表上的每个作业都具有到期日,在此之后排除该到期警报;所述多 个作业中的每一个作业的当前运行时间是从所述开始时间到所述当前时间之间耗费的时间。In one embodiment, the average run time is the average average time that previous jobs have completed; each job on the exclusion list has a due date, after which the due alert is excluded; the multiple jobs The current running time of each job in is the time elapsed between the start time and the current time.
在一个实施例中,批量作业基于其各自的开始和停止时间被排除在警报之外。In one embodiment, batch jobs are excluded from alerts based on their respective start and stop times.
在一个实施例中,提出了一种计算机设备,所述计算机设备包括存储器和处理器,存储器中存储有计算机可读指令,计算机可读指令被处理器执行时,使得处理器执行所述计算机程序时实现上述各实施例里工作流管理方法中的步骤。In one embodiment, a computer device is provided. The computer device includes a memory and a processor. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor causes the processor to execute the computer program. The steps in the workflow management method in the above embodiments are implemented at all times.
在一个实施例中,提出了一种存储有计算机可读指令的存储介质,该计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器执行上述各实施例里工作流管理方法中的步骤。其中,存储介质可以为非易失性存储介质。In one embodiment, a storage medium storing computer-readable instructions is provided. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the workflow in the foregoing embodiments. Steps in a management approach. The storage medium may be a non-volatile storage medium.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:只读存储器(ROM,Read Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁盘或光盘等。A person of ordinary skill in the art may understand that all or part of the steps in the various methods of the foregoing embodiments may be implemented by a program instructing related hardware. The program may be stored in a computer-readable storage medium. The storage medium may include: Read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks, etc.
以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the embodiments described above can be arbitrarily combined. In order to simplify the description, all possible combinations of the technical features in the above embodiments have not been described. However, as long as there is no contradiction in the combination of these technical features, It should be considered as the scope described in this specification.
以上所述实施例仅表达了本申请一些示例性实施例,其描述较为具体和详细,但并不能因此而理解为对本申请专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only express some exemplary embodiments of the present application, and their descriptions are more specific and detailed, but cannot be understood as a limitation on the scope of the patent of the present application. It should be noted that, for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of this application patent shall be subject to the appended claims.

Claims (20)

  1. 一种工作流管理方法,用于网页作业监控和调度应用,包括:A workflow management method for web job monitoring and scheduling applications, including:
    调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理;Schedule multiple jobs that reside and run on a platform and a scheduled job tracking table, where the platform includes a runtime monitoring agent;
    周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据;Periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table , Including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
    通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除;Determine and save whether a given running job in the runtime monitoring table is excluded by an alert by checking the job scheduling exclusion list stored in the job statistics table;
    当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;When the current running time of a given running job exceeds the sum of the average running time and a predetermined tolerance value of the given running job and when the given running job is not excluded by the alarm, save the alarm to the running time monitoring table;
    显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。Displays a run-time monitoring table for multiple jobs running, including a list of alerts associated with jobs that have exceeded their acceptable completion time.
  2. 根据权利要求1所述的工作流管理方法,其中,所述多个作业的调度和监控还包括:The workflow management method according to claim 1, wherein the scheduling and monitoring of the plurality of jobs further comprises:
    由所述运行时间监控代理接收统计文件,容差文件和排除文件,所述统计文件包含用于完成所述多个作业中的每个作业的平均运行时间,所述容差文件包含所述多个作业中的每个作业的可接受完成时间,所述完成时间基于每个作业各自的平均完成时间以及如果每个作业的当前运行时间在给定作业时间的容限范围之外,则包含排除文件,所述排除文件包含从警报通知中被排除的文件名称;Receiving statistics files, tolerance files, and exclusion files by the runtime monitoring agent, the statistics files containing an average running time for completing each of the plurality of jobs, and the tolerance files containing the multiple Acceptable completion time for each of the jobs, based on the average completion time of each job and including exclusions if the current run time of each job is outside the tolerance for a given job time A file that includes the name of the file that was excluded from the alert notification;
    通过运行时间监控代理填充由多个作业的列表组成的运行时间监控表;Populate a runtime monitoring table consisting of a list of multiple jobs through the runtime monitoring agent;
    基于存储在所述作业统计表内的历史数据,确定并保存所述作业统计表中已经完成运行的多个作业中的每一个的平均运行时间,其中所述作业统计表进一步存储所述统计文件和容差文件,运行时间监控代理用于处理驻留并运行在平台上作业的排除文件;Determine and save an average running time of each of a plurality of jobs that have completed running in the job statistics table based on historical data stored in the job statistics table, wherein the job statistics table further stores the statistics file And tolerance files, the runtime monitoring agent is used to process excluded files for jobs that reside and run on the platform;
    确定所述多个作业中的每一个正在运行的可接受完成时间并将其保存在所 述作业统计表中,所述可接受完成时间定义为所述平均运行时间与预定容限值总和的时间段。Determine an acceptable completion time at which each of the plurality of jobs is running and save it in the job statistics table, and the acceptable completion time is defined as a time when the average operation time and a predetermined tolerance value sum segment.
  3. 根据权利要求1所述的工作流管理方法,其中,所述警报包括电子邮件通知,弹出屏幕,突出显示的文本和彩色文本。The workflow management method of claim 1, wherein the alerts include email notifications, pop-up screens, highlighted text, and color text.
  4. 根据权利要求1所述的工作流管理方法,其中,所述作业统计表包括用于多个作业中的每一个作业的参数,包括作业名称,开始时间,结束时间,运行时间,运行日期,平台名称,平均运行时间,容差范围和警报。The workflow management method according to claim 1, wherein the job statistics table includes parameters for each of a plurality of jobs, including job name, start time, end time, run time, run date, platform Name, average run time, tolerance range and alerts.
  5. 根据权利要求1所述的工作流管理方法,其中,所述平均运行时间是先前作业已经完成的平均平均时间;所述排除列表上的每个作业都具有到期日,在此之后排除该到期警报;所述多个作业中的每一个作业的当前运行时间是从所述开始时间到所述当前时间之间耗费的时间。The workflow management method according to claim 1, wherein the average running time is an average average time that a previous job has completed; each job on the exclusion list has a due date, after which the job is excluded Periodic alert; the current running time of each of the plurality of jobs is the time spent between the start time and the current time.
  6. 根据权利要求1所述的工作流管理方法,其中,批量作业基于其各自的开始和停止时间可被排除在警报之外。The workflow management method according to claim 1, wherein the batch jobs can be excluded from the alert based on their respective start and stop times.
  7. 一种工作流管理***,包括:A workflow management system includes:
    调度单元,设置为调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理;A scheduling unit configured to schedule a plurality of jobs resident and running on a platform and a scheduled job tracking table, wherein the platform includes a runtime monitoring agent;
    监控单元,设置为周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据;The monitoring unit is configured to periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, and the runtime monitoring agent monitors each of the multiple jobs on the platform and Stored in the job statistics table, including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
    检察单元,设置为通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除;The inspection unit is configured to determine and save whether a given running job in the running time monitoring table is excluded by an alarm by checking a job reservation exclusion list stored in the job statistics table;
    保存单元,设置为当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;Save unit, set to save the alarm to the running time monitoring table when the current running time of a given running job exceeds the sum of the average running time of the given running job and a predetermined tolerance value in;
    显示单元,设置为显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。A display unit configured to display a running time monitoring table for a plurality of jobs that are run, including a list of alerts associated with jobs that have exceeded an acceptable completion time.
  8. 根据权利要求7所述的工作流管理***,其中,所述监控单元包括:The workflow management system according to claim 7, wherein the monitoring unit comprises:
    接收模块,设置为由所述运行时间监控代理接收统计文件,容差文件和排除文件,所述统计文件包含设置为完成所述多个作业中的每个作业的平均运行时间,所述容差文件包含所述多个作业中的每个作业的可接受完成时间,所述完成时间基于每个作业各自的平均完成时间以及如果每个作业的当前运行时间在给定作业时间的容限范围之外,则包含排除文件,所述排除文件包含从警报通知中被排除的文件名称;A receiving module configured to receive a statistical file, a tolerance file, and an exclusion file by the runtime monitoring agent, the statistical file including an average running time configured to complete each of the plurality of jobs, the tolerance The file contains an acceptable completion time for each of the plurality of jobs, the completion time being based on the respective average completion time of each job and if the current running time of each job is within the tolerance range of the given job time In addition, it includes exclusion files that include the names of files that were excluded from alert notifications;
    填充模块,设置为通过运行时间监控代理填充由多个作业的列表组成的运行时间监控表;A filling module, which is configured to fill a running time monitoring table composed of a list of multiple jobs through a running time monitoring agent;
    确定模块,设置为基于存储在所述作业统计表内的历史数据,确定并保存所述作业统计表中已经完成运行的多个作业中的每一个的平均运行时间,其中所述作业统计表进一步存储所述统计文件和容差文件,运行时间监控代理设置为处理驻留并运行在平台上作业的排除文件;A determination module configured to determine and save an average running time of each of a plurality of jobs that have completed running in the job statistics table based on historical data stored in the job statistics table, wherein the job statistics table further Storing the statistical file and the tolerance file, and the runtime monitoring agent is set to process the excluded files of the jobs resident and running on the platform;
    保存模块,设置为确定所述多个作业中的每一个正在运行的可接受完成时间并将其保存在所述作业统计表中,所述可接受完成时间定义为所述平均运行时间与预定容限值总和的时间段。A saving module configured to determine an acceptable completion time at which each of the plurality of jobs is running and save it in the job statistics table, and the acceptable completion time is defined as the average running time and a predetermined capacity The period during which the limit sums.
  9. 根据权利要求7所述的工作流管理***,其中,所述警报包括电子邮件通知,弹出屏幕,突出显示的文本和彩色文本。The workflow management system of claim 7, wherein the alerts include email notifications, pop-up screens, highlighted text, and color text.
  10. 根据权利要求7所述的工作流管理***,其中,所述作业统计表包括用于多个作业中的每一个作业的参数,包括作业名称,开始时间,结束时间,运行时间,运行日期,平台名称,平均运行时间,容差范围和警报。The workflow management system according to claim 7, wherein the job statistics table includes parameters for each of a plurality of jobs, including job name, start time, end time, run time, run date, platform Name, average run time, tolerance range and alerts.
  11. 根据权利要求7所述的工作流管理***,其中,所述平均运行时间是先前作业已经完成的平均平均时间;所述排除列表上的每个作业都具有到期日,在此之后排除该到期警报;所述多个作业中的每一个作业的当前运行时间是从所述开始时间到所述当前时间之间耗费的时间。The workflow management system according to claim 7, wherein the average running time is an average average time that a previous job has completed; each job on the exclusion list has a due date, after which it is excluded Periodic alert; the current running time of each of the plurality of jobs is the time spent between the start time and the current time.
  12. 根据权利要求7所述的工作流管理***,其中,批量作业基于其各自的开始和停止时间被排除在警报之外。The workflow management system of claim 7, wherein the batch jobs are excluded from the alert based on their respective start and stop times.
  13. 一种计算机设备,包括存储器和处理器,所述存储器中存储有计算机可读指令,所述计算机可读指令被所述处理器执行时,使得所述处理器执行以 下步骤:A computer device includes a memory and a processor. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor causes the processor to perform the following steps:
    调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理;Schedule multiple jobs that reside and run on a platform and a scheduled job tracking table, where the platform includes a runtime monitoring agent;
    周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据;Periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table , Including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
    通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除;Determine and save whether a given running job in the runtime monitoring table is excluded by an alert by checking the job scheduling exclusion list stored in the job statistics table;
    当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;When the current running time of a given running job exceeds the sum of the average running time and a predetermined tolerance value of the given running job and when the given running job is not excluded by the alarm, save the alarm to the running time monitoring table;
    显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。Displays a run-time monitoring table for multiple jobs running, including a list of alerts associated with jobs that have exceeded their acceptable completion time.
  14. 根据权利要求13所述的计算机设备,其中,所述多个作业的调度和监控时,还使得所述处理器执行以下步骤:The computer device according to claim 13, wherein the scheduling and monitoring of the plurality of jobs further cause the processor to perform the following steps:
    由所述运行时间监控代理接收统计文件,容差文件和排除文件,所述统计文件包含用于完成所述多个作业中的每个作业的平均运行时间,所述容差文件包含所述多个作业中的每个作业的可接受完成时间,所述完成时间基于每个作业各自的平均完成时间以及如果每个作业的当前运行时间在给定作业时间的容限范围之外,则包含排除文件,所述排除文件包含从警报通知中被排除的文件名称;Receiving statistics files, tolerance files, and exclusion files by the runtime monitoring agent, the statistics files containing an average running time for completing each of the plurality of jobs, and the tolerance files containing the multiple Acceptable completion time for each of the jobs, based on the average completion time of each job and including exclusions if the current run time of each job is outside the tolerance for a given job time A file that includes the name of the file that was excluded from the alert notification;
    通过运行时间监控代理填充由多个作业的列表组成的运行时间监控表;Populate a runtime monitoring table consisting of a list of multiple jobs through the runtime monitoring agent;
    基于存储在所述作业统计表内的历史数据,确定并保存所述作业统计表中已经完成运行的多个作业中的每一个的平均运行时间,其中所述作业统计表进一步存储所述统计文件和容差文件,运行时间监控代理用于处理驻留并运行在平台上作业的排除文件;Determine and save an average running time of each of a plurality of jobs that have completed running in the job statistics table based on historical data stored in the job statistics table, wherein the job statistics table further stores the statistics file And tolerance files, the runtime monitoring agent is used to process excluded files for jobs that reside and run on the platform;
    确定所述多个作业中的每一个正在运行的可接受完成时间并将其保存在所 述作业统计表中,所述可接受完成时间定义为所述平均运行时间与预定容限值总和的时间段。Determine an acceptable completion time at which each of the plurality of jobs is running and save it in the job statistics table, and the acceptable completion time is defined as a time when the average operation time and a predetermined tolerance value sum segment.
  15. 根据权利要求13所述的计算机设备,其中,所述警报包括电子邮件通知,弹出屏幕,突出显示的文本和彩色文本。The computer device of claim 13, wherein the alerts include email notifications, pop-up screens, highlighted text, and color text.
  16. 根据权利要求13所述的计算机设备,其中,所述作业统计表包括用于多个作业中的每一个作业的参数,包括作业名称,开始时间,结束时间,运行时间,运行日期,平台名称,平均运行时间,容差范围和警报。The computer device according to claim 13, wherein the job statistics table includes parameters for each of a plurality of jobs, including a job name, a start time, an end time, a running time, a running date, a platform name, Average run time, tolerance range and alerts.
  17. 一种存储有计算机可读指令的存储介质,所述计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器执行以下步骤:A storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the following steps:
    调度在平台上驻留和运行的多个作业以及预定作业跟踪表,其中所述平台包含运行时间监控代理;Schedule multiple jobs that reside and run on a platform and a scheduled job tracking table, where the platform includes a runtime monitoring agent;
    周期性的监控驻留在平台上与所述运行时间监控代理一并运行的多个作业,所述运行时间监控代理对平台上的多个作业中的每一个作业进行监控并保存在作业统计表中,包括开始时间,结束时间,以及当前运行时间,并且所述作业跟踪表存储并跟踪每个作业的作业数据;Periodically monitor a plurality of jobs running on the platform together with the runtime monitoring agent, the runtime monitoring agent monitors each of the multiple jobs on the platform and saves them in a job statistics table , Including the start time, end time, and current running time, and the job tracking table stores and tracks job data for each job;
    通过检查存储在作业统计表内的作业预定排除列表来确定并保存运行时间监控表内的给定运行作业是否受到警报排除;Determine and save whether a given running job in the runtime monitoring table is excluded by an alert by checking the job scheduling exclusion list stored in the job statistics table;
    当给定运行作业的当前运行时间超过给定运行作业的平均运行时间和预定容限值之和并且当给定运行作业不受警报排除时,将警报保存到运行时间监控表中;When the current running time of a given running job exceeds the sum of the average running time and a predetermined tolerance value of the given running job and when the given running job is not excluded by the alarm, save the alarm to the running time monitoring table;
    显示运行的多个作业的运行时间监控表,包括已超过可接受的完成时间的作业相关联的警报列表。Displays a run-time monitoring table for multiple jobs running, including a list of alerts associated with jobs that have exceeded their acceptable completion time.
  18. 根据权利要求17所述的存储介质,其中,所述多个作业的调度和监控时,还使得一个或多个处理器执行以下步骤:The storage medium according to claim 17, wherein the scheduling and monitoring of the plurality of jobs further cause one or more processors to perform the following steps:
    由所述运行时间监控代理接收统计文件,容差文件和排除文件,所述统计文件包含用于完成所述多个作业中的每个作业的平均运行时间,所述容差文件包含所述多个作业中的每个作业的可接受完成时间,所述完成时间基于每个作业各自的平均完成时间以及如果每个作业的当前运行时间在给定作业时间的容 限范围之外,则包含排除文件,所述排除文件包含从警报通知中被排除的文件名称;Receiving statistics files, tolerance files, and exclusion files by the runtime monitoring agent, the statistics files containing an average running time for completing each of the plurality of jobs, and the tolerance files containing the multiple Acceptable completion time for each of the jobs, based on the average completion time of each job and including exclusions if the current run time of each job is outside the tolerance for a given job time A file that includes the name of the file that was excluded from the alert notification;
    通过运行时间监控代理填充由多个作业的列表组成的运行时间监控表;Populate a runtime monitoring table consisting of a list of multiple jobs through the runtime monitoring agent;
    基于存储在所述作业统计表内的历史数据,确定并保存所述作业统计表中已经完成运行的多个作业中的每一个的平均运行时间,其中所述作业统计表进一步存储所述统计文件和容差文件,运行时间监控代理用于处理驻留并运行在平台上作业的排除文件;Determine and save an average running time of each of a plurality of jobs that have completed running in the job statistics table based on historical data stored in the job statistics table, wherein the job statistics table further stores the statistics file And tolerance files, the runtime monitoring agent is used to process excluded files for jobs that reside and run on the platform;
    确定所述多个作业中的每一个正在运行的可接受完成时间并将其保存在所述作业统计表中,所述可接受完成时间定义为所述平均运行时间与预定容限值总和的时间段。Determine an acceptable completion time at which each of the plurality of jobs is running and save it in the job statistics table, and the acceptable completion time is defined as a time when the average operation time and a predetermined tolerance value sum segment.
  19. 根据权利要求17所述的存储介质,其中,所述警报包括电子邮件通知,弹出屏幕,突出显示的文本和彩色文本。The storage medium of claim 17, wherein the alerts include email notifications, pop-up screens, highlighted text, and color text.
  20. 根据权利要求17所述的存储介质,其中,所述作业统计表包括用于多个作业中的每一个作业的参数,包括作业名称,开始时间,结束时间,运行时间,运行日期,平台名称,平均运行时间,容差范围和警报。The storage medium according to claim 17, wherein the job statistics table includes parameters for each of a plurality of jobs, including a job name, a start time, an end time, a running time, a running date, a platform name, Average run time, tolerance range and alerts.
PCT/CN2018/104339 2018-05-21 2018-09-06 Workflow management method and system, computer device and storage medium WO2019223171A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810487233.7 2018-05-21
CN201810487233.7A CN108694561A (en) 2018-05-21 2018-05-21 Workflow management method, system, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2019223171A1 true WO2019223171A1 (en) 2019-11-28

Family

ID=63847390

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/104339 WO2019223171A1 (en) 2018-05-21 2018-09-06 Workflow management method and system, computer device and storage medium

Country Status (2)

Country Link
CN (1) CN108694561A (en)
WO (1) WO2019223171A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110147292A (en) * 2019-04-15 2019-08-20 平安普惠企业管理有限公司 Monitoring method, device, storage medium and the computer equipment of webpage exception
CN110533383B (en) * 2019-07-24 2023-06-06 平安科技(深圳)有限公司 Item supervision method, device, computer equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101477652A (en) * 2008-12-04 2009-07-08 山东浪潮齐鲁软件产业股份有限公司 Implementing process for timeout mechanism of flow
CN101819659A (en) * 2010-04-16 2010-09-01 浙江工商大学 Method for applying workflow technology to management process control
CN101923683A (en) * 2009-06-09 2010-12-22 埃森哲环球服务有限公司 Technician control system
CN102226890A (en) * 2011-06-10 2011-10-26 中国工商银行股份有限公司 Monitoring method and device for host batch job data
CN107515864A (en) * 2016-06-15 2017-12-26 阿里巴巴集团控股有限公司 The method and apparatus of control work flows

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101477652A (en) * 2008-12-04 2009-07-08 山东浪潮齐鲁软件产业股份有限公司 Implementing process for timeout mechanism of flow
CN101923683A (en) * 2009-06-09 2010-12-22 埃森哲环球服务有限公司 Technician control system
CN101819659A (en) * 2010-04-16 2010-09-01 浙江工商大学 Method for applying workflow technology to management process control
CN102226890A (en) * 2011-06-10 2011-10-26 中国工商银行股份有限公司 Monitoring method and device for host batch job data
CN107515864A (en) * 2016-06-15 2017-12-26 阿里巴巴集团控股有限公司 The method and apparatus of control work flows

Also Published As

Publication number Publication date
CN108694561A (en) 2018-10-23

Similar Documents

Publication Publication Date Title
US20210294716A1 (en) Continuous software deployment
US10067788B2 (en) Automated invalidation of job output data in a job processing system
US7500150B2 (en) Determining the level of availability of a computing resource
US8352867B2 (en) Predictive monitoring dashboard
US7856575B2 (en) Collaborative troubleshooting computer systems using fault tree analysis
US8365185B2 (en) Preventing execution of processes responsive to changes in the environment
US10831910B2 (en) Providing data protection and privacy as a service in a cloud platform
US9372685B1 (en) Impact prediction of software change deployment on customer systems
EP4124956A1 (en) Automated system and method for detection and remediation of anomalies in robotic process automation environment
US8219435B2 (en) Determining task status based upon identifying milestone indicators in project-related files
US10102240B2 (en) Managing event metrics for service management analytics
US11329869B2 (en) Self-monitoring
WO2014110310A1 (en) Cross platform workflow management
CN112101803A (en) Business process monitoring method, device, system, equipment and medium
US11940974B2 (en) Database lock
CN113227978B (en) Automatic anomaly detection in a computer processing pipeline
WO2019223171A1 (en) Workflow management method and system, computer device and storage medium
US9448998B1 (en) Systems and methods for monitoring multiple heterogeneous software applications
US8606762B2 (en) Data quality administration framework
US20050154734A1 (en) Method and system for monitoring and reporting backup results
Yin et al. Availability modeling and analysis for data backup and restore operations
Venegas et al. Monitoring Model for Preventive Incident Identification and Execution of Corrective Measures in Technological Services of Organizations
Miró Blanco Implementing a Kubernetes cluster with IBM Cloud
CN116737464A (en) Backup failure handling method, apparatus, device, medium and program product
CN118036983A (en) Scheduling management method and system based on data quality management

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18919790

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18919790

Country of ref document: EP

Kind code of ref document: A1