WO2020259326A1 - Signal transmission method and apparatus - Google Patents

Signal transmission method and apparatus Download PDF

Info

Publication number
WO2020259326A1
WO2020259326A1 PCT/CN2020/095938 CN2020095938W WO2020259326A1 WO 2020259326 A1 WO2020259326 A1 WO 2020259326A1 CN 2020095938 W CN2020095938 W CN 2020095938W WO 2020259326 A1 WO2020259326 A1 WO 2020259326A1
Authority
WO
WIPO (PCT)
Prior art keywords
host
task scheduling
task
application
scheduling signal
Prior art date
Application number
PCT/CN2020/095938
Other languages
French (fr)
Chinese (zh)
Inventor
罗盛毅
卢道和
周杰
李焕
李慧敏
方镇举
翁玉萍
陈文龙
Original Assignee
深圳前海微众银行股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳前海微众银行股份有限公司 filed Critical 深圳前海微众银行股份有限公司
Publication of WO2020259326A1 publication Critical patent/WO2020259326A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources

Definitions

  • the present invention relates to the field of financial technology (Fintech) and signal transmission, in particular to a signal transmission method and device.
  • the task completion status is registered through the database for interaction.
  • task 2 depends on task 1
  • the task scheduling signal that triggers the execution of task 2 is written to the database, and the task needs to be executed.
  • the data center node of 2 queries whether the task scheduling signal of task 2 has been written to the database according to the preset duration, and if it has been written, then execute task 2 according to the task scheduling signal.
  • This way of frequently accessing the database will cause the transmission delay of the task scheduling signal to be too long.
  • the application host selected by the data center node may change, and the data center node needs to switch the host that accesses the database, causing additional The switching time is too long. This situation will also cause the task scheduling signal transmission delay to be too long.
  • the embodiments of the present application provide a signal transmission method and device, which solve the problem of excessively long task scheduling signal transmission delay in the prior art.
  • the embodiments of the present application provide a signal transmission method: applicable to a processing system including multiple proxy hosts and multiple data center nodes; each data center node has a corresponding proxy host; each data center node includes multiple An application host; the method includes: the first agent host receives a task scheduling signal sent by a second agent host; the task scheduling signal is triggered after the second application host completes the second task; the first agent host is The host of the first data center node; the second proxy host and the second application host are the hosts of the second data center node; the first proxy host determines the corresponding task scheduling signal according to the task processing host information The first application host; the task processing host information is determined by the first agent host according to the tasks processed by the application hosts of the first data center node; the first application host is the first data center The host of the node; the first proxy host sends the task scheduling signal to the first application host, and the task scheduling signal is used to trigger the first application host to perform the first task.
  • the first agent host of the first data center node receives the task scheduling signal sent by the second agent host, and the task scheduling signal is triggered after the second application host performs the second task, so there is no need to frequently access the database ,
  • the task scheduling signal can be transmitted, reducing the delay of the task scheduling signal.
  • the first agent host determines the first application host corresponding to the task scheduling signal according to the task processing host information, and sends the task scheduling signal to the first application host.
  • the application host avoids frequent switching of the application host that accesses the database, so the above method reduces the transmission delay of the task scheduling signal.
  • the method before the first agent host sends the task scheduling signal to the first application host, the method further includes: a first listener of the first agent host according to the task scheduling signal Type, write the task scheduling signal into the corresponding first data structure and add 1 to the first count; when the second listener of the first proxy host determines that the first count is greater than the second count, The task scheduling signal is obtained from the first data structure and written into the second data structure, and then the second count is incremented by 1.
  • the first listener of the first proxy host writes the task scheduling signal into the corresponding first data structure according to the type of the task scheduling signal, and adds 1 to the first count, thereby benefiting
  • the task scheduling signal is classified and stored, and when it is determined that the first count is greater than the second count, the task scheduling signal is obtained from the first data structure and written into the second data structure, so that the first count and the second count
  • the counts are consistent, so that the task scheduling signal can be cyclically and synchronously transmitted according to the first count and the second count.
  • the first proxy host obtains an update request message sent by a third application host; the update request information is used to instruct the first proxy host to add the task processing host information to the The third application host corresponding to the task scheduling signal is updated to the first application host; after the first proxy host confirms that the update request message is legal, the task scheduling signal in the task processing host information corresponds to the The first application host.
  • the first proxy host can update the third application host corresponding to the task scheduling signal to the first application host according to the legal update request message, thereby increasing the flexibility of task scheduling signal transmission.
  • the first proxy host confirms that the update request message is legal, including: if the first proxy host determines that the user name and password in the update request message are preset user names and presets If a password is set, it is determined that the update request message is legal; corresponding to the task scheduling signal in the task processing host information to the first application host includes: corresponding to the task scheduling signal in the task processing host information The Internet Protocol IP address of the first application host and the port of the first application host.
  • the first proxy host determines that the user name and password in the update request message are the preset user name and the preset password, it determines that the update request message is legal, thereby adding a verification to the update request message, which improves Improve the security of signal transmission.
  • the method further includes : The first proxy host determines whether the second proxy host is the proxy host indicated in the preset whitelist, and if not, discards the task scheduling signal.
  • the first agent host verifies that the task scheduling signal is sent, and if the second agent host is not the agent host indicated in the preset white list, the task scheduling signal is discarded.
  • the present application provides a signal transmission device, including: an acquisition module configured to receive a task scheduling signal sent by a second agent host; the task scheduling signal is triggered after the second application host completes the second task;
  • the second proxy host and the second application host are the hosts of the second data center node;
  • the processing module is configured to determine the first application host corresponding to the task scheduling signal according to the task processing host information;
  • the first The application host is the host of the first data center node;
  • the task processing host information is determined according to the tasks processed by each application host of the first data center node;
  • the task scheduling signal is sent to the first application Host, the task scheduling signal is used to trigger the first application host to execute the first task.
  • the processing module is further configured to: according to the type of the task scheduling signal, write the task scheduling signal into the corresponding first data structure and increase the first count by 1; When the first count is greater than the second count, the task scheduling signal is obtained from the first data structure and written into the second data structure, and then the second count is increased by one.
  • the acquisition module is further configured to: acquire an update request message sent by a third application host; the update request information is used to indicate that the task scheduling signal corresponds to the task scheduling signal in the task processing host information
  • the third application host of is updated to the first application host; after confirming that the update request message is legal, the task scheduling signal in the task processing host information corresponds to the first application host.
  • the obtaining module is specifically configured to: if it is determined that the user name and password in the update request message are a preset user name and a preset password, determine that the update request message is legal;
  • the task scheduling signal in the task processing host information corresponds to the Internet Protocol IP address of the first application host and the port of the first application host.
  • the processing module is further configured to determine whether the second proxy host is the proxy host indicated in the preset white list, and if not, discard the task scheduling signal.
  • an embodiment of the present application provides a computer device including a program or instruction, and when the program or instruction is executed, it is used to execute the methods of the first aspect and the embodiments of the first aspect.
  • an embodiment of the present application provides a storage medium including a program or instruction, and when the program or instruction is executed, it is used to execute the method of the foregoing first aspect and each embodiment of the first aspect.
  • FIG. 1 is a schematic flow chart of the steps of a signal transmission method provided by an embodiment of this application;
  • FIG. 2 is a schematic diagram of the data structure of batch tasks in an embodiment of the application
  • 3 is a schematic diagram of the queue structure of batch tasks in an embodiment of the application.
  • FIG. 4 is a schematic diagram of the structure of the batch signal classification monitor and the batch signal monitor in the embodiment
  • 5 is a schematic diagram of the execution sequence of the batch signal listener and subsequent batch subtasks related to the batch signal in an embodiment of the application;
  • FIG. 6 is a schematic diagram of updating the batch signal index, data table, and current data in an embodiment of the application
  • FIG. 7 is a schematic diagram of a system architecture corresponding to the application host update method in an embodiment of the application.
  • FIG. 8 is a schematic diagram of PUBLISHER synchronizing service management data from CMDB in an embodiment of the application.
  • FIG. 10 is a schematic diagram of task scheduling signal transmission between DCNs in an embodiment of the application.
  • FIG. 11 is a schematic structural diagram of a signal transmission device provided by an embodiment of the application.
  • Reliable message bus A cross-DCN message interaction system built around message middleware.
  • DCN Data center node
  • HA High availability
  • PUBLISHER Task scheduling signal distribution module
  • this application provides a signal transmission method, as shown in FIG. 1, which is a flow chart of the steps of a signal transmission method provided in this application.
  • Step 101 The first agent host receives a task scheduling signal sent by the second agent host.
  • the task scheduling signal is triggered after the second application host completes the second task; the first proxy host is the host of the first data center node; the second proxy host and the second application host are second The host of the data center node.
  • Step 102 The first agent host determines the first application host corresponding to the task scheduling signal according to the task processing host information.
  • the task processing host information is determined by the first proxy host according to the tasks processed by the application hosts of the first data center node; the first application host is the host of the first data center node.
  • Step 103 The first agent host sends the task scheduling signal to the first application host.
  • the task scheduling signal is used to trigger the first application host to execute the first task.
  • a signal transmission method shown in Figure 1 is applicable to a processing system including multiple proxy hosts and multiple data center nodes; each data center node has a corresponding proxy host; each data center node includes multiple Application hosts.
  • This processing system can be any task scheduling processing system, and can also be applied in a variety of business scenarios, which is not limited here. In the following, the signal transmission method shown in FIG. 1 will be explained by taking a batch scheduling system in a bank batch scheduling business scenario as an example.
  • step 104 an optional implementation is as follows:
  • the first listener of the first proxy host writes the task scheduling signal into the corresponding first data structure and adds 1 to the first count;
  • the second listener obtains the task scheduling signal from the first data structure and writes it into the second data structure, and then adds 1 to the second count.
  • the batch task can add a dimension of DCN.
  • BATCH1 is named BATCH1_DCNA.
  • the task scheduling signal may be a batch signal in a batch task.
  • Figure 2 it is a schematic diagram of the data structure of the batch task.
  • the batch task is composed of batch name, batch signal name and batch signal data.
  • the batch name is BATCH2_DCNA as an example
  • the batch signal name is EA as an example
  • the batch signal data is DATA_EA1 as an example.
  • Batch tasks have their own queue structure according to their naming.
  • the EA queue is composed of batch signal index EA_index, data table EA_data and current data EA_current_data.
  • the signal index consists of a first count and a second count, where the first count can be represented by max and the second count can be represented by last.
  • EA_index.max represents the total number of EA signals received by the first listener, and EA_index.last is the number of EA signals acquired by the second listener;
  • the batch signal data table is an array structure, and EA_data[1] represents the number of received EA signals.
  • the internal monitoring consists of a batch signal classification monitor and multiple batch signal monitors.
  • the batch signal classification listener receives batch signals from outside the batch, and classifies and maintains the batch signal queue according to the batch signal name; the batch signal listener will try to obtain the batch signal from the corresponding batch signal queue.
  • FIG. 5 is a schematic diagram of the execution sequence of the batch signal monitor and subsequent batch subtasks related to the batch signal in an embodiment of the application
  • FIG. 6 is a schematic diagram of updating the batch signal index, data table and current data in an embodiment of the application.
  • the subtask EA_1 waits for the batch signal EA listener to complete, and the batch signal EA listener waits for EA_index.max>EA_index.last to be true, so the process where the batch signal EA listener is located is blocked.
  • subtask EA_i in Figure 5 represents the i-th task in the task sequence waiting for the batch signal EA; i is a positive integer, for example, the subtask EA_1 represents the first task sequence in the task sequence waiting for the batch signal EA Each task; each time the batch signal EA listener is executed, EA_i in the task sequence waiting for the batch signal EA will be executed in sequence.
  • the first listener of the first proxy host writes the task scheduling signal into the corresponding first data structure according to the type of the task scheduling signal, and adds 1 to the first count, thereby benefiting
  • the task scheduling signal is classified and stored, and when it is determined that the first count is greater than the second count, the task scheduling signal is obtained from the first data structure and written into the second data structure, so that the first count and the second count
  • the counts are consistent, so that the task scheduling signal can be cyclically and synchronously transmitted according to the first count and the second count.
  • PUBLISHER can be deployed in the first proxy host, and the dimension of DCN can be added to each PUBLISHER.
  • PUBLISHER is named PUBLISHER_DCNA.
  • step 102 an optional implementation is as follows:
  • the first agent host obtains an update request message sent by a third application host; the update request information is used to instruct the first agent host to assign the third application corresponding to the task scheduling signal in the task processing host information
  • the host is updated to the first application host; after the first proxy host confirms that the update request message is legal, the task scheduling signal in the task processing host information corresponds to the first application host.
  • the first proxy host can update the third application host corresponding to the task scheduling signal to the first application host according to the legal update request message, thereby increasing the flexibility of task scheduling signal transmission.
  • the first proxy host confirms that the update request message is legal, which may be specifically as follows:
  • the signal corresponding to the first application host includes: corresponding the task scheduling signal in the task processing host information to the internet protocol IP address of the first application host and the port of the first application host.
  • the first proxy host determines that the user name and password in the update request message are the preset user name and the preset password, it determines that the update request message is legal, thereby adding a verification to the update request message, which improves Improve the security of signal transmission.
  • the user name and password in the update request message are the preset user name and the preset password means: the user name in the update request message is the preset user name, and the user name in the update request message is the preset password .
  • the preset user name and preset password are a pair of matching information.
  • the preset user name and preset password can be preset in various ways.
  • the first application host and the third application host belong to the same batch, and the preset user name and the preset password can be determined according to this batch.
  • FIG. 7 a schematic diagram of the system architecture corresponding to the application host update method in this embodiment of the application.
  • Batch tasks are deployed according to the HA scheme, and the zookeeper cluster determines the active and standby application hosts.
  • the application host in BATCH1_DCNA becomes the application host through the zookeeper cluster decision.
  • the IP address is 192.168.0.1 and the port number is 10000.
  • the batch name of the system and the ip used by the batch classification listener of this batch are reported to PUBLISHER_DCNA: port;
  • the schedule serverB2 of BATCH2_DCNA becomes the application host through the zookeeper cluster decision, then the batch name of this system and the ip:port used by the batch classification listener of this batch are reported to PUBLISHER_DCNA.
  • the message also contains the username and password assigned to BATCH1_DCNA.
  • PUBLISHER_DCNA uses the user name and password in the report message to verify the secret. If the verification passes, the ip:port mapping of BATCH1_DCNA will be updated.
  • the interaction scheme is: the configuration management database (CMDB) component maintains the service management data, and the batch signals that need to be sent must be registered in the CMDB for sending relationships.
  • CMDB configuration management database
  • PUBLISHER regularly synchronizes service management data from CMDB. It will be described in detail below with reference to FIG. 9, which is a schematic diagram of task scheduling signal transmission within the DCN in an embodiment of the application.
  • BATCH2DCNA starts the batch signal listener to monitor the batch signal EA.
  • the host schedule of BATCH1_DCNA sends the batch signal EA to PUBLISHER_DCNA.
  • the message contains the username and password assigned to BATCH1_DCNA.
  • PUBLISHER_DCNA uses the user name and password in the message for secret verification. If the secret verification fails, the message is discarded and the current secret verification behavior is recorded. If the verification is passed, the service management authentication of batch signals will be performed. If the calling relationship of BTACH1_DCNA->BATCH2_DCNA.EA does not exist in the service management, it will stop and not send.
  • step 101 After step 101 and before step 104, an optional implementation is as follows:
  • the first proxy host determines whether the second proxy host is the proxy host indicated in the preset whitelist, and if not, discards the task scheduling signal.
  • the first agent host verifies that the task scheduling signal is sent, and if the second agent host is not the agent host indicated in the preset white list, the task scheduling signal is discarded.
  • FIG. 10 is a schematic diagram of task scheduling signal transmission between DCNs in an embodiment of the application. It should be noted that in the architecture shown in FIG. 10, other systems may be batch systems or not.
  • PUBLISHER_DCNB monitors the topic_publisher_DCNB of RMB, and BATCH1_DCNB starts the batch signal listener to monitor the batch signal EB.
  • the host schedule of BATCH1_DCNA serverA1 sends a batch signal to PUBLISHER_DCNA, PUBLISHER_DCNA checks that the DCN indicated by the target batch name is DCNB, not the DCNA of this DCN, so the batch signal is encapsulated into RMB message and sent to RMB, and RMB will be pushed to the monitoring RMB PUBLISHER_DCNB of topic_publisher_DCNB, after passing PUBLISHER_DCNB authentication and service management authentication, PUBLISHER_DCNB sends the message to the host of BATCH1_DCNB, otherwise the message is discarded and recorded.
  • the first agent host of the first data center node receives the task scheduling signal sent by the second agent host, and the task scheduling signal is triggered after the second application host performs the second task, so there is no need to frequently access the database ,
  • the task scheduling signal can be transmitted, reducing the delay of the task scheduling signal.
  • the first agent host determines the first application host corresponding to the task scheduling signal according to the task processing host information, and sends the task scheduling signal to the first application host.
  • the application host avoids frequent switching of the application host that accesses the database, so the above method reduces the transmission delay of the task scheduling signal.
  • the signal transmission method provided in this application has the following advantages:
  • the proxy host uniformly maintains the mapping relationship between batch names and actual hosts, so that batches that need to exchange batch signals can be deployed using the HA solution, and maintain the mapping relationship between batch names and actual hosts.
  • FIG. 11 it is a schematic structural diagram of a signal transmission device provided by an embodiment of this application.
  • the present application provides a signal transmission device, including: an acquisition module 1101, configured to receive a task scheduling signal sent by a second agent host; the task scheduling signal is triggered after the second application host completes the second task; the first The second proxy host and the second application host are the hosts of the second data center node; the processing module 1102 is configured to determine the first application host corresponding to the task scheduling signal according to task processing host information; the first application host Is the host of the first data center node; the task processing host information is determined according to the tasks processed by each application host of the first data center node; sending the task scheduling signal to the first application host, The task scheduling signal is used to trigger the first application host to execute the first task.
  • an acquisition module 1101 configured to receive a task scheduling signal sent by a second agent host
  • the task scheduling signal is triggered after the second application host completes the second task
  • the first The second proxy host and the second application host are the hosts of the second data center node
  • the processing module 1102 is configured to determine the first application host corresponding to the task scheduling
  • the processing module 1102 is further configured to: according to the type of the task scheduling signal, write the task scheduling signal into the corresponding first data structure and increase the first count by 1; When it is determined that the first count is greater than the second count, the task scheduling signal is obtained from the first data structure and written into the second data structure, and then the second count is increased by 1.
  • the obtaining module 1101 is further configured to: obtain an update request message sent by a third application host; the update request information is used to indicate that the task scheduling signal is included in the task processing host information The corresponding third application host is updated to the first application host; after confirming that the update request message is legal, the task scheduling signal in the task processing host information corresponds to the first application host.
  • the obtaining module 1101 is specifically configured to: if it is determined that the user name and password in the update request message are the preset user name and the preset password, determine that the update request message is legal;
  • the task scheduling signal in the task processing host information corresponds to the Internet Protocol IP address of the first application host and the port of the first application host.
  • the processing module 1102 is further configured to determine whether the second proxy host is the proxy host indicated in the preset whitelist, and if not, discard the task scheduling signal.
  • the embodiment of the present application provides a computer device including a program or instruction, and when the program or instruction is executed, it is used to execute a signal transmission method and any optional method provided in the embodiment of the present application.
  • the embodiment of the present application provides a storage medium including a program or instruction.
  • the program or instruction When executed, it is used to execute a signal transmission method and any optional method provided in the embodiment of the present application.
  • the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.
  • a computer-usable storage media including but not limited to disk storage, optical storage, etc.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer And Data Communications (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

Disclosed in the present invention are a signal transmission method and apparatus. The method comprises: a first proxy host receives a task scheduling signal transmitted by a second proxy host; the task scheduling signal is triggered by a second application host subsequent to implementing a second task; the first proxy host is a host of a first data center node; the second proxy host and the second application host are the hosts of a second data center node; the first proxy host determines a first application host corresponding to the task scheduling signal according to task processing host information; the first proxy host transmits the task scheduling signal to the first application host, and the task scheduling signal is used for triggering the first application host to implement a first task. When the method is applied to Fintech, after the second application host has implemented the second task, the second proxy host transmits the task scheduling signal to the first proxy host, without reading the task scheduling signal into or out of a database, thereby reducing the transmission delay of the task scheduling signal.

Description

一种信号传输方法及装置Signal transmission method and device
相关申请的交叉引用Cross references to related applications
本申请要求在2019年06月28日提交中国专利局、申请号为201910580557.X、申请名称为“一种信号传输方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910580557.X, and the application name is "A signal transmission method and device" on June 28, 2019, the entire content of which is incorporated herein by reference Applying.
技术领域Technical field
本发明涉及金融科技(Fintech)领域和信号传输领域，尤其涉及一种信号传输方法及装置。The present invention relates to the field of financial technology (Fintech) and signal transmission, in particular to a signal transmission method and device.
背景技术Background technique
随着计算机技术的发展，越来越多的技术(大数据、分布式、区块链(Blockchain)、人工智能等)应用在金融领域，传统金融业正在逐步向金融科技(Fintech)转变。目前，金融科技领域中，数据中心节点之间进行任务调度时，由于各任务之间可能存在先后依赖关系，因此可以通过任务调度信号来触发任务的执行。With the development of computer technology, more and more technologies (big data, distributed, Blockchain, artificial intelligence, etc.) are applied in the financial field, and the traditional financial industry is gradually transforming to Fintech. At present, in the field of financial technology, when task scheduling is performed between data center nodes, because tasks may have a sequential dependency relationship, task execution signals can be used to trigger task execution.
现有技术中，会通过数据库登记任务完成状态来进行交互，如当任务2依赖任务1时，会约定任务1执行完毕后，将触发任务2执行的任务调度信号写入到数据库，需要执行任务2的数据中心节点，按照预设时长，查询任务2的任务调度信号是否已经写入到数据库，如果已经写入，再根据任务调度信号执行任务2。这种频繁访问数据库的方式会导致任务调度信号的传输延迟过长，另外，在这个查询过程中，数据中心节点选取的应用主机可能会变动，数据中心节点需要切换访问数据库的主机，造成额外的切换时长，这种情况也会导致任务调度信号传输延迟过长。In the prior art, the task completion status is registered through the database for interaction. For example, when task 2 depends on task 1, it is agreed that after task 1 is executed, the task scheduling signal that triggers the execution of task 2 is written to the database, and the task needs to be executed. The data center node of 2 queries whether the task scheduling signal of task 2 has been written to the database according to the preset duration, and if it has been written, then execute task 2 according to the task scheduling signal. This way of frequently accessing the database will cause the transmission delay of the task scheduling signal to be too long. In addition, during this query process, the application host selected by the data center node may change, and the data center node needs to switch the host that accesses the database, causing additional The switching time is too long. This situation will also cause the task scheduling signal transmission delay to be too long.
发明内容Summary of the invention
本申请实施例提供一种信号传输方法及装置，解决了现有技术中任务调度信号传输延迟过长的问题。The embodiments of the present application provide a signal transmission method and device, which solve the problem of excessively long task scheduling signal transmission delay in the prior art.
第一方面，本申请实施例提供一种信号传输方法：适用于包括多个代理主机和多个数据中心节点的处理***；每个数据中心节点具有对应的代理主机；每个数据中心节点包括多个应用主机；所述方法包括：第一代理主机接收第二代理主机发送的任务调度信号；所述任务调度信号是第二应用主机执行完第二任务后触发的；所述第一代理主机为第一数据 中心节点的主机；所述第二代理主机和所述第二应用主机为第二数据中心节点的主机；所述第一代理主机根据任务处理主机信息，确定所述任务调度信号对应的第一应用主机；所述任务处理主机信息是所述第一代理主机根据所述第一数据中心节点的各应用主机处理的各任务确定的；所述第一应用主机为所述第一数据中心节点的主机；所述第一代理主机将所述任务调度信号发送给所述第一应用主机，所述任务调度信号用于触发所述第一应用主机执行第一任务。In the first aspect, the embodiments of the present application provide a signal transmission method: applicable to a processing system including multiple proxy hosts and multiple data center nodes; each data center node has a corresponding proxy host; each data center node includes multiple An application host; the method includes: the first agent host receives a task scheduling signal sent by a second agent host; the task scheduling signal is triggered after the second application host completes the second task; the first agent host is The host of the first data center node; the second proxy host and the second application host are the hosts of the second data center node; the first proxy host determines the corresponding task scheduling signal according to the task processing host information The first application host; the task processing host information is determined by the first agent host according to the tasks processed by the application hosts of the first data center node; the first application host is the first data center The host of the node; the first proxy host sends the task scheduling signal to the first application host, and the task scheduling signal is used to trigger the first application host to perform the first task.
上述方法中，第一数据中心节点的第一代理主机接收第二代理主机发送的任务调度信号，而所述任务调度信号是第二应用主机执行完第二任务后触发的，因此无需频繁访问数据库，即可传输任务调度信号，降低了任务调度信号的延迟，另外，第一代理主机根据任务处理主机信息，确定所述任务调度信号对应的第一应用主机，并将任务调度信号发送给第一应用主机，避免了频繁切换访问数据库的应用主机，因此上述方法降低了任务调度信号的传输延迟。In the above method, the first agent host of the first data center node receives the task scheduling signal sent by the second agent host, and the task scheduling signal is triggered after the second application host performs the second task, so there is no need to frequently access the database , The task scheduling signal can be transmitted, reducing the delay of the task scheduling signal. In addition, the first agent host determines the first application host corresponding to the task scheduling signal according to the task processing host information, and sends the task scheduling signal to the first application host. The application host avoids frequent switching of the application host that accesses the database, so the above method reduces the transmission delay of the task scheduling signal.
一种可选实施方式中，所述第一代理主机将所述任务调度信号发送给所述第一应用主机之前，还包括：所述第一代理主机的第一***根据所述任务调度信号的类型，将所述任务调度信号写入对应的第一数据结构中并将第一计数加1；所述第一代理主机的第二***在确定所述第一计数大于第二计数时，从所述第一数据结构中获取所述任务调度信号并写入第二数据结构，之后将所述第二计数加1。In an optional implementation manner, before the first agent host sends the task scheduling signal to the first application host, the method further includes: a first listener of the first agent host according to the task scheduling signal Type, write the task scheduling signal into the corresponding first data structure and add 1 to the first count; when the second listener of the first proxy host determines that the first count is greater than the second count, The task scheduling signal is obtained from the first data structure and written into the second data structure, and then the second count is incremented by 1.
上述方法中，所述第一代理主机的第一***根据所述任务调度信号的类型，将所述任务调度信号写入对应的第一数据结构中并将第一计数加1，从而有利于任务调度信号归类存储，且在确定所述第一计数大于第二计数时，从所述第一数据结构中获取所述任务调度信号并写入第二数据结构，使得第一计数和第二计数一致，从而可根据第一计数和第二计数，循环同步传输任务调度信号。In the above method, the first listener of the first proxy host writes the task scheduling signal into the corresponding first data structure according to the type of the task scheduling signal, and adds 1 to the first count, thereby benefiting The task scheduling signal is classified and stored, and when it is determined that the first count is greater than the second count, the task scheduling signal is obtained from the first data structure and written into the second data structure, so that the first count and the second count The counts are consistent, so that the task scheduling signal can be cyclically and synchronously transmitted according to the first count and the second count.
一种可选实施方式中，所述第一代理主机获取第三应用主机发送的更新请求消息；所述更新请求信息用于指示所述第一代理主机在所述任务处理主机信息中将所述任务调度信号对应的第三应用主机更新为所述第一应用主机；所述第一代理主机确认所述更新请求消息合法后，将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机。In an optional implementation manner, the first proxy host obtains an update request message sent by a third application host; the update request information is used to instruct the first proxy host to add the task processing host information to the The third application host corresponding to the task scheduling signal is updated to the first application host; after the first proxy host confirms that the update request message is legal, the task scheduling signal in the task processing host information corresponds to the The first application host.
上述方法中，第一代理主机可根据合法的更新请求消息，将任务调度信号对应的第三应用主机更新为所述第一应用主机，从而增加了任务调度信号传输的灵活性。In the above method, the first proxy host can update the third application host corresponding to the task scheduling signal to the first application host according to the legal update request message, thereby increasing the flexibility of task scheduling signal transmission.
一种可选实施方式中，所述第一代理主机确认所述更新请求消息合法，包括：所述第一代理主机若确定所述更新请求消息中的用户名及密码为预设用户名及预设密码，则确定所述更新请求消息合法；将所述任务处理主机信息中所述任务调度信号对应于所述第一应 用主机，包括：将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机的互联网协议IP地址和第一应用主机的端口。In an optional implementation manner, the first proxy host confirms that the update request message is legal, including: if the first proxy host determines that the user name and password in the update request message are preset user names and presets If a password is set, it is determined that the update request message is legal; corresponding to the task scheduling signal in the task processing host information to the first application host includes: corresponding to the task scheduling signal in the task processing host information The Internet Protocol IP address of the first application host and the port of the first application host.
上述方式下，第一代理主机若确定所述更新请求消息中的用户名及密码为预设用户名及预设密码，则确定所述更新请求消息合法，从而为更新请求消息增加一次验证，提升了信号传输的安全性。In the above manner, if the first proxy host determines that the user name and password in the update request message are the preset user name and the preset password, it determines that the update request message is legal, thereby adding a verification to the update request message, which improves Improve the security of signal transmission.
一种可选实施方式中，所述第一代理主机接收第二代理主机发送的任务调度信号之后，所述第一代理主机将所述任务调度信号发送给所述第一应用主机之前，还包括：所述第一代理主机确定所述第二代理主机是否为预设白名单中指示的代理主机，若不是，则将所述任务调度信号丢弃。In an optional implementation manner, after the first agent host receives the task scheduling signal sent by the second agent host, before the first agent host sends the task scheduling signal to the first application host, the method further includes : The first proxy host determines whether the second proxy host is the proxy host indicated in the preset whitelist, and if not, discards the task scheduling signal.
上述方式下，通过预设白名单，第一代理主机对发送任务调度信号进行验证，若第二代理主机不为预设白名单中指示的代理主机，则将任务调度信号丢弃。In the above manner, through the preset white list, the first agent host verifies that the task scheduling signal is sent, and if the second agent host is not the agent host indicated in the preset white list, the task scheduling signal is discarded.
第二方面，本申请提供一种信号传输装置，包括：获取模块，用于接收第二代理主机发送的任务调度信号；所述任务调度信号是第二应用主机执行完第二任务后触发的；所述第二代理主机和所述第二应用主机为第二数据中心节点的主机；处理模块，用于根据任务处理主机信息，确定所述任务调度信号对应的第一应用主机；所述第一应用主机为所述第一数据中心节点的主机；所述任务处理主机信息是根据第一数据中心节点的各应用主机处理的各任务确定的；将所述任务调度信号发送给所述第一应用主机，所述任务调度信号用于触发所述第一应用主机执行第一任务。In a second aspect, the present application provides a signal transmission device, including: an acquisition module configured to receive a task scheduling signal sent by a second agent host; the task scheduling signal is triggered after the second application host completes the second task; The second proxy host and the second application host are the hosts of the second data center node; the processing module is configured to determine the first application host corresponding to the task scheduling signal according to the task processing host information; the first The application host is the host of the first data center node; the task processing host information is determined according to the tasks processed by each application host of the first data center node; the task scheduling signal is sent to the first application Host, the task scheduling signal is used to trigger the first application host to execute the first task.
一种可选实施方式中，所述处理模块还用于：根据所述任务调度信号的类型，将所述任务调度信号写入对应的第一数据结构中并将第一计数加1；在确定所述第一计数大于第二计数时，从所述第一数据结构中获取所述任务调度信号并写入第二数据结构，之后将所述第二计数加1。In an optional implementation manner, the processing module is further configured to: according to the type of the task scheduling signal, write the task scheduling signal into the corresponding first data structure and increase the first count by 1; When the first count is greater than the second count, the task scheduling signal is obtained from the first data structure and written into the second data structure, and then the second count is increased by one.
一种可选实施方式中，所述获取模块还用于：获取第三应用主机发送的更新请求消息；所述更新请求信息用于指示在所述任务处理主机信息中将所述任务调度信号对应的第三应用主机更新为所述第一应用主机；确认所述更新请求消息合法后，将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机。In an optional implementation manner, the acquisition module is further configured to: acquire an update request message sent by a third application host; the update request information is used to indicate that the task scheduling signal corresponds to the task scheduling signal in the task processing host information The third application host of is updated to the first application host; after confirming that the update request message is legal, the task scheduling signal in the task processing host information corresponds to the first application host.
一种可选实施方式中，所述获取模块具体用于：若确定所述更新请求消息中的用户名及密码为预设用户名及预设密码，则确定所述更新请求消息合法；将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机的互联网协议IP地址和第一应用主机的端口。In an optional implementation manner, the obtaining module is specifically configured to: if it is determined that the user name and password in the update request message are a preset user name and a preset password, determine that the update request message is legal; The task scheduling signal in the task processing host information corresponds to the Internet Protocol IP address of the first application host and the port of the first application host.
一种可选实施方式中，所述处理模块还用于：确定所述第二代理主机是否为预设白名 单中指示的代理主机，若不是，则将所述任务调度信号丢弃。In an optional implementation manner, the processing module is further configured to determine whether the second proxy host is the proxy host indicated in the preset white list, and if not, discard the task scheduling signal.
上述第二方面及第二方面各个实施例的有益效果，可以参考上述第一方面及第一方面各个实施例的有益效果，这里不再赘述。For the beneficial effects of the above-mentioned second aspect and the embodiments of the second aspect, reference may be made to the beneficial effects of the above-mentioned first aspect and the embodiments of the first aspect, which will not be repeated here.
第三方面，本申请实施例提供一种计算机设备，包括程序或指令，当所述程序或指令被执行时，用以执行上述第一方面及第一方面各个实施例的方法。In a third aspect, an embodiment of the present application provides a computer device including a program or instruction, and when the program or instruction is executed, it is used to execute the methods of the first aspect and the embodiments of the first aspect.
第四方面，本申请实施例提供一种存储介质，包括程序或指令，当所述程序或指令被执行时，用以执行上述第一方面及第一方面各个实施例的方法。In a fourth aspect, an embodiment of the present application provides a storage medium including a program or instruction, and when the program or instruction is executed, it is used to execute the method of the foregoing first aspect and each embodiment of the first aspect.
附图说明Description of the drawings
图1为本申请实施例提供的一种信号传输方法的步骤流程示意图；FIG. 1 is a schematic flow chart of the steps of a signal transmission method provided by an embodiment of this application;
图2为本申请实施例中批量任务的数据结构示意图；2 is a schematic diagram of the data structure of batch tasks in an embodiment of the application;
图3为本申请实施例中批量任务的队列结构的示意图；3 is a schematic diagram of the queue structure of batch tasks in an embodiment of the application;
图4为本身请实施例中批量信号分类***与批量信号***的结构示意图；FIG. 4 is a schematic diagram of the structure of the batch signal classification monitor and the batch signal monitor in the embodiment;
图5为本申请实施例中批量信号***和该批量信号相关的后续批量子任务的执行顺序示意图；5 is a schematic diagram of the execution sequence of the batch signal listener and subsequent batch subtasks related to the batch signal in an embodiment of the application;
图6为本申请实施例中批量信号索引、数据表和当前数据的更新示意图；6 is a schematic diagram of updating the batch signal index, data table, and current data in an embodiment of the application;
图7为本申请实施例中应用主机更新方法对应的***架构示意图；FIG. 7 is a schematic diagram of a system architecture corresponding to the application host update method in an embodiment of the application;
图8为本申请实施例中PUBLISHER从CMDB同步服务治理数据的示意图；FIG. 8 is a schematic diagram of PUBLISHER synchronizing service management data from CMDB in an embodiment of the application;
图9为本申请实施例中DCN内部的任务调度信号传输示意图；9 is a schematic diagram of task scheduling signal transmission within DCN in an embodiment of the application;
图10为本申请实施例中DCN之间的任务调度信号传输示意图；FIG. 10 is a schematic diagram of task scheduling signal transmission between DCNs in an embodiment of the application;
图11为本申请实施例提供的一种信号传输装置的结构示意图。FIG. 11 is a schematic structural diagram of a signal transmission device provided by an embodiment of the application.
具体实施方式Detailed ways
为了更好的理解上述技术方案，下面将结合说明书附图及具体的实施方式对上述技术方案进行详细的说明，应当理解本申请实施例以及实施例中的具体特征是对本申请技术方案的详细的说明，而不是对本申请技术方案的限定，在不冲突的情况下，本申请实施例以及实施例中的技术特征可以相互结合。In order to better understand the above technical solutions, the above technical solutions will be described in detail below with reference to the drawings and specific implementations of the specification. It should be understood that the embodiments of the application and the specific features in the embodiments are detailed to the technical solutions of the application. Note, rather than limiting the technical solution of the present application, the embodiments of the present application and the technical features in the embodiments can be combined with each other if there is no conflict.
为方便理解，下面首先描述本申请中出现的缩略语和关键术语：To facilitate understanding, the following first describes the abbreviations and key terms appearing in this application:
可靠消息总线(reliable message bus，RMB)：围绕消息中间件搭建的跨DCN消息交互***。数据中心节点(data center node，DCN)：用来存储数据、传输数据的一个计算机***，逻辑上为一个节点，物理上包括多个计算机。高可用性(high available，HA)：指 ***满足高容错性、高可用性。任务调度信号分发模块(PUBLISHER)：用于传输任务调度信号的软件或硬件。Reliable message bus (RMB): A cross-DCN message interaction system built around message middleware. Data center node (DCN): A computer system used to store and transmit data. Logically, it is a node and physically includes multiple computers. High availability (HA): The system meets high fault tolerance and high availability. Task scheduling signal distribution module (PUBLISHER): software or hardware used to transmit task scheduling signals.
在金融机构(银行机构、保险机构或证券机构)在进行业务(如银行的贷款业务、存款业务等)运转过程中，数据中心节点之间进行任务调度时，由于各任务之间可能存在先后依赖关系，因此可以通过任务调度信号来触发任务的执行。现有技术中，会通过数据库登记任务完成状态来进行交互，这种频繁访问数据库的方式会导致任务调度信号的传输延迟过长，另外，在这个查询过程中，数据中心节点中选取的应用主机可能会变动，数据中心节点需要切换访问数据库的主机，造成额外的切换时长，这种情况也会导致任务调度信号传输延迟过长。这种情况不符合银行等金融机构的需求，无法保证金融机构各项业务的高效运转。When a financial institution (banking institution, insurance institution, or securities institution) is in the process of performing business (such as bank loan business, deposit business, etc.), when task scheduling is performed between data center nodes, there may be sequential dependencies between tasks Therefore, the execution of the task can be triggered by the task scheduling signal. In the prior art, interaction is performed by registering the task completion status of the database. This frequent access to the database will cause the transmission delay of the task scheduling signal to be too long. In addition, in the query process, the application host selected in the data center node It may change. The data center node needs to switch the host that accesses the database, causing extra switching time. This situation will also cause the task scheduling signal transmission delay to be too long. This situation does not meet the needs of banks and other financial institutions, and cannot guarantee the efficient operation of various businesses of financial institutions.
为此，本申请提供一种信号传输方法，如图1所示，为本申请提供的一种信号传输方法的步骤流程图。To this end, this application provides a signal transmission method, as shown in FIG. 1, which is a flow chart of the steps of a signal transmission method provided in this application.
步骤101：第一代理主机接收第二代理主机发送的任务调度信号。Step 101: The first agent host receives a task scheduling signal sent by the second agent host.
所述任务调度信号是第二应用主机执行完第二任务后触发的；所述第一代理主机为第一数据中心节点的主机；所述第二代理主机和所述第二应用主机为第二数据中心节点的主机。The task scheduling signal is triggered after the second application host completes the second task; the first proxy host is the host of the first data center node; the second proxy host and the second application host are second The host of the data center node.
步骤102：所述第一代理主机根据任务处理主机信息，确定所述任务调度信号对应的第一应用主机。Step 102: The first agent host determines the first application host corresponding to the task scheduling signal according to the task processing host information.
所述任务处理主机信息是所述第一代理主机根据所述第一数据中心节点的各应用主机处理的各任务确定的；所述第一应用主机为所述第一数据中心节点的主机。The task processing host information is determined by the first proxy host according to the tasks processed by the application hosts of the first data center node; the first application host is the host of the first data center node.
步骤103：所述第一代理主机将所述任务调度信号发送给所述第一应用主机。Step 103: The first agent host sends the task scheduling signal to the first application host.
所述任务调度信号用于触发所述第一应用主机执行第一任务。The task scheduling signal is used to trigger the first application host to execute the first task.
需要说明的是，图1示出的一种信号传输方法适用于包括多个代理主机和多个数据中心节点的处理***；每个数据中心节点具有对应的代理主机；每个数据中心节点包括多个应用主机。这种处理***可以是任何任务调度处理的***，也可以应用在多种业务场景下，在此不做限定。下面以银行批量调度业务场景下，批量调度***为例说明图1示出的信号传输方法。It should be noted that a signal transmission method shown in Figure 1 is applicable to a processing system including multiple proxy hosts and multiple data center nodes; each data center node has a corresponding proxy host; each data center node includes multiple Application hosts. This processing system can be any task scheduling processing system, and can also be applied in a variety of business scenarios, which is not limited here. In the following, the signal transmission method shown in FIG. 1 will be explained by taking a batch scheduling system in a bank batch scheduling business scenario as an example.
步骤104之前，一种可选实施方式如下：Before step 104, an optional implementation is as follows:
所述第一代理主机的第一***根据所述任务调度信号的类型，将所述任务调度信号写入对应的第一数据结构中并将第一计数加1；所述第一代理主机的第二***在确定所述第一计数大于第二计数时，从所述第一数据结构中获取所述任务调度信号并写入第二数 据结构，之后将所述第二计数加1。According to the type of the task scheduling signal, the first listener of the first proxy host writes the task scheduling signal into the corresponding first data structure and adds 1 to the first count; When determining that the first count is greater than the second count, the second listener obtains the task scheduling signal from the first data structure and writes it into the second data structure, and then adds 1 to the second count.
本申请实施例中，批量任务可以增加一个DCN的维度，举例来说，BATCH1命名为BATCH1_DCNA。在批量调度业务场景下，任务调度信号可以为批量任务中批量信号。如图2所示，为批量任务的数据结构示意图，批量任务由批量名称、批量信号名称和批量信号数据组成。其中，批量名称以BATCH2_DCNA为例，批量信号名称以EA为例，批量信号数据以DATA_EA1为例。In the embodiment of the present application, the batch task can add a dimension of DCN. For example, BATCH1 is named BATCH1_DCNA. In the batch scheduling business scenario, the task scheduling signal may be a batch signal in a batch task. As shown in Figure 2, it is a schematic diagram of the data structure of the batch task. The batch task is composed of batch name, batch signal name and batch signal data. Among them, the batch name is BATCH2_DCNA as an example, the batch signal name is EA as an example, and the batch signal data is DATA_EA1 as an example.
批量任务根据命名分别拥有各自的队列结构。如批量信号名称为EA，则EA的队列由批量信号索引EA_index、数据表EA_data和当前数据EA_current_data组成。如图3所示，为本申请实施例中批量任务的队列结构的示意图。信号索引由包括第一计数和第二计数，其中第一计数可用max表示，第二计数可用last表示。EA_index.max表示第一***收到批量信号EA的总次数，EA_index.last为第二***获取的EA信号的次数；批量信号数据表是一个数组结构，EA_data[1]表示收到的第一个EA所携带的批量信号数据；当前数据存储的值为EA_data[EA_index.last]。举例来说，当前数据current_data为D＝100，也就是索引号index为1的数据为D＝100。Batch tasks have their own queue structure according to their naming. If the batch signal name is EA, the EA queue is composed of batch signal index EA_index, data table EA_data and current data EA_current_data. As shown in FIG. 3, it is a schematic diagram of the queue structure of batch tasks in an embodiment of this application. The signal index consists of a first count and a second count, where the first count can be represented by max and the second count can be represented by last. EA_index.max represents the total number of EA signals received by the first listener, and EA_index.last is the number of EA signals acquired by the second listener; the batch signal data table is an array structure, and EA_data[1] represents the number of received EA signals. The batch signal data carried by an EA; the current data storage value is EA_data[EA_index.last]. For example, the current data current_data is D=100, that is, the data whose index number is 1 is D=100.
下面以第一***为批量信号分类***，以及第二***为批量信号***为例说明。如图4所示，为本申请实施例中批量信号分类***与批量信号***的结构示意图。内部监听由一个批量信号分类***和多个批量信号***组成。批量信号分类***接收来自批量外部的批量信号，并根据批量信号名称进行分类和维护批量信号队列；批量信号***会尝试从对应的批量信号队列获取批量信号。同一个批量内，同名批量队列有且仅有一个，监听同一个批量信号的批量信号***数量最多为1个。Take the first monitor as the batch signal classification monitor and the second monitor as the batch signal monitor as an example. As shown in FIG. 4, it is a schematic diagram of the structure of a batch signal classification monitor and a batch signal monitor in an embodiment of the application. The internal monitoring consists of a batch signal classification monitor and multiple batch signal monitors. The batch signal classification listener receives batch signals from outside the batch, and classifies and maintains the batch signal queue according to the batch signal name; the batch signal listener will try to obtain the batch signal from the corresponding batch signal queue. Within the same batch, there is one and only one batch queue with the same name, and the number of batch signal monitors that listen to the same batch signal is at most one.
下面结合图5～图6，详细说明上述可选实施方式中的内部监听机制。其中，图5为本申请实施例中批量信号***和该批量信号相关的后续批量子任务的执行顺序示意图；图6为本申请实施例中批量信号索引、数据表和当前数据的更新示意图。The following describes the internal monitoring mechanism in the above-mentioned optional implementation in detail with reference to FIGS. 5 to 6. 5 is a schematic diagram of the execution sequence of the batch signal monitor and subsequent batch subtasks related to the batch signal in an embodiment of the application; FIG. 6 is a schematic diagram of updating the batch signal index, data table and current data in an embodiment of the application.
初始时EA的批量信号索引的max和last都为0，数据表中无数据，当前数据也无数据。如图5所示，子任务EA_1等待批量信号EA***完成，批量信号EA***等待EA_index.max>EA_index.last为真，因此批量信号EA***所在的流程处于被阻断状态。需要说明的是，图5中子任务EA_i代表等待批量信号EA的任务序列中的第i个任务；i为正整数，举例来说，子任务EA_1代表等待批量信号EA的任务序列中的第1个任务；每次批量信号EA***执行完成，等待批量信号EA的任务序列中的EA_i都会按顺序执行一次。Initially, the max and last of EA's batch signal index are 0, there is no data in the data table, and there is no data in the current data. As shown in Figure 5, the subtask EA_1 waits for the batch signal EA listener to complete, and the batch signal EA listener waits for EA_index.max>EA_index.last to be true, so the process where the batch signal EA listener is located is blocked. It should be noted that the subtask EA_i in Figure 5 represents the i-th task in the task sequence waiting for the batch signal EA; i is a positive integer, for example, the subtask EA_1 represents the first task sequence in the task sequence waiting for the batch signal EA Each task; each time the batch signal EA listener is executed, EA_i in the task sequence waiting for the batch signal EA will be executed in sequence.
批量信号分类***收到第一个批量信号EA后，将data_EA1存入数据表即 EA_data[1]＝data_EA1，更新EA_index.max为1。条件EA_index.max>EA_index.last满足，批量信号EA***将EA_data[EA_index.last+1]存入EA_current_data即EA_current_data＝EA_data[1]，更新EA_index.last为EA_index.last+1即EA_index.last更新为1，然后流程继续执行，子任务EA_1从当前数据EA_current_data获取批量信号数据。After the batch signal classification listener receives the first batch signal EA, it stores data_EA1 in the data table, ie EA_data[1]=data_EA1, and updates EA_index.max to 1. If the condition EA_index.max>EA_index.last is met, the batch signal EA listener will store EA_data[EA_index.last+1] into EA_current_data, ie EA_current_data=EA_data[1], and update EA_index.last to EA_index.last+1, ie EA_index.last update Is 1, and then the process continues, the subtask EA_1 obtains batch signal data from the current data EA_current_data.
批量信号分类***收到第二个批量信号EA后，将data_EA2存入数据表即EA_data[2]＝data_EA2，更新EA_index.max为2。如上图，当批量信号EA***所在流程再次获得调度执行(循环调度)，条件EA_index.max>EA_index.last满足，批量信号EA***将EA_data[EA_index.last+1]存入EA_current_data即EA_current_data＝EA_data[2]，更新EA_index.last为EA_index.last+1即EA_index.last更新为2，流程继续执行，子任务EA_1从当前数据EA_current_data获取批量信号数据。After the batch signal classification listener receives the second batch signal EA, it stores data_EA2 in the data table, ie EA_data[2]=data_EA2, and updates EA_index.max to 2. As shown in the figure above, when the process of the batch signal EA listener is scheduled to be executed again (cyclic scheduling), and the condition EA_index.max>EA_index.last is met, the batch signal EA listener will store EA_data[EA_index.last+1] into EA_current_data, which is EA_current_data= EA_data[2], update EA_index.last to EA_index.last+1, that is, EA_index.last is updated to 2, the process continues, and the subtask EA_1 obtains batch signal data from the current data EA_current_data.
上述方法中，所述第一代理主机的第一***根据所述任务调度信号的类型，将所述任务调度信号写入对应的第一数据结构中并将第一计数加1，从而有利于任务调度信号归类存储，且在确定所述第一计数大于第二计数时，从所述第一数据结构中获取所述任务调度信号并写入第二数据结构，使得第一计数和第二计数一致，从而可根据第一计数和第二计数，循环同步传输任务调度信号。In the above method, the first listener of the first proxy host writes the task scheduling signal into the corresponding first data structure according to the type of the task scheduling signal, and adds 1 to the first count, thereby benefiting The task scheduling signal is classified and stored, and when it is determined that the first count is greater than the second count, the task scheduling signal is obtained from the first data structure and written into the second data structure, so that the first count and the second count The counts are consistent, so that the task scheduling signal can be cyclically and synchronously transmitted according to the first count and the second count.
本申请实施例中，PUBLISHER可以部署在第一代理主机中，且可为每个PUBLISHER增加DCN的维度，举例来说，PUBLISHER命名为PUBLISHER_DCNA。In the embodiment of this application, PUBLISHER can be deployed in the first proxy host, and the dimension of DCN can be added to each PUBLISHER. For example, PUBLISHER is named PUBLISHER_DCNA.
步骤102之前，一种可选实施方式如下：Before step 102, an optional implementation is as follows:
所述第一代理主机获取第三应用主机发送的更新请求消息；所述更新请求信息用于指示所述第一代理主机在所述任务处理主机信息中将所述任务调度信号对应的第三应用主机更新为所述第一应用主机；所述第一代理主机确认所述更新请求消息合法后，将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机。The first agent host obtains an update request message sent by a third application host; the update request information is used to instruct the first agent host to assign the third application corresponding to the task scheduling signal in the task processing host information The host is updated to the first application host; after the first proxy host confirms that the update request message is legal, the task scheduling signal in the task processing host information corresponds to the first application host.
上述方法中，第一代理主机可根据合法的更新请求消息，将任务调度信号对应的第三应用主机更新为所述第一应用主机，从而增加了任务调度信号传输的灵活性。In the above method, the first proxy host can update the third application host corresponding to the task scheduling signal to the first application host according to the legal update request message, thereby increasing the flexibility of task scheduling signal transmission.
在上述可选实施方式中，所述第一代理主机确认所述更新请求消息合法，可以具体如下：In the foregoing optional implementation manner, the first proxy host confirms that the update request message is legal, which may be specifically as follows:
所述第一代理主机若确定所述更新请求消息中的用户名及密码为预设用户名及预设密码，则确定所述更新请求消息合法；将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机，包括：将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机的互联网协议IP地址和第一应用主机的端口。If the first proxy host determines that the user name and password in the update request message are the preset user name and the preset password, it determines that the update request message is legal; schedules the task in the task processing host information The signal corresponding to the first application host includes: corresponding the task scheduling signal in the task processing host information to the internet protocol IP address of the first application host and the port of the first application host.
上述方式下，第一代理主机若确定所述更新请求消息中的用户名及密码为预设用户名 及预设密码，则确定所述更新请求消息合法，从而为更新请求消息增加一次验证，提升了信号传输的安全性。In the above manner, if the first proxy host determines that the user name and password in the update request message are the preset user name and the preset password, it determines that the update request message is legal, thereby adding a verification to the update request message, which improves Improve the security of signal transmission.
其中，所述更新请求消息中的用户名及密码为预设用户名及预设密码含义为：更新请求消息中的用户名为预设用户名，且更新请求消息中的用户名为预设密码。另外，预设用户名及预设密码为一对匹配的信息。Wherein, the user name and password in the update request message are the preset user name and the preset password means: the user name in the update request message is the preset user name, and the user name in the update request message is the preset password . In addition, the preset user name and preset password are a pair of matching information.
需要说明的是，预设用户名和预设密码可根据多种方式预设。举例来说，第一应用主机和第三应用主机归属于同一个批量，可根据这个批量确定预设用户名和预设密码。It should be noted that the preset user name and preset password can be preset in various ways. For example, the first application host and the third application host belong to the same batch, and the preset user name and the preset password can be determined according to this batch.
对于上述可选实施方式，如图7所示，为本申请实施例中应用主机更新方法对应的***架构示意图。For the foregoing optional implementation manners, as shown in FIG. 7, a schematic diagram of the system architecture corresponding to the application host update method in this embodiment of the application.
批量任务按照HA方案部署，由zookeeper集群决定主备应用主机。如图7，BATCH1_DCNA中的应用主机经由zookeeper集群决策成为应用主机，IP地址为192.168.0.1，端口号为10000，则向PUBLISHER_DCNA上报本***的批量名称和本批量的批量分类***使用的ip：port；BATCH2_DCNA的schedule serverB2经由zookeeper集群决策成为应用主机，则向PUBLISHER_DCNA上报本***的批量名称和本批量的批量分类***使用的ip：port，报文中还包含分配给BATCH1_DCNA的用户名和密码。PUBLISHER_DCNA使用上报报文中的用户名和密码进行验密，验密通过则会更新BATCH1_DCNA的ip：port映射。Batch tasks are deployed according to the HA scheme, and the zookeeper cluster determines the active and standby application hosts. As shown in Figure 7, the application host in BATCH1_DCNA becomes the application host through the zookeeper cluster decision. The IP address is 192.168.0.1 and the port number is 10000. Then the batch name of the system and the ip used by the batch classification listener of this batch are reported to PUBLISHER_DCNA: port; The schedule serverB2 of BATCH2_DCNA becomes the application host through the zookeeper cluster decision, then the batch name of this system and the ip:port used by the batch classification listener of this batch are reported to PUBLISHER_DCNA. The message also contains the username and password assigned to BATCH1_DCNA. PUBLISHER_DCNA uses the user name and password in the report message to verify the secret. If the verification passes, the ip:port mapping of BATCH1_DCNA will be updated.
另外，对于DCN内部的任务调度信号，其交互的方案是：配置管理数据库(CMDB)组件维护服务治理数据，需要发送的批量信号都须在CMDB上注册发送关系。如图8所示，PUBLISHER定期从CMDB同步服务治理数据。下面结合图9详细说明，图9为本申请实施例中DCN内部的任务调度信号传输示意图。In addition, for the task scheduling signals inside the DCN, the interaction scheme is: the configuration management database (CMDB) component maintains the service management data, and the batch signals that need to be sent must be registered in the CMDB for sending relationships. As shown in Figure 8, PUBLISHER regularly synchronizes service management data from CMDB. It will be described in detail below with reference to FIG. 9, which is a schematic diagram of task scheduling signal transmission within the DCN in an embodiment of the application.
BATCH2DCNA启动批量信号***监听批量信号EA，BATCH1_DCNA的主机schedule serverA1发送批量信号EA到PUBLISHER_DCNA,报文中包含分配给BATCH1_DCNA的用户名和密码。PUBLISHER_DCNA使用报文中的用户名和密码进行验密。验密不通过则丢弃该报文，并记录本次验密行为。验密通过则进行批量信号的服务治理鉴权。如服务治理中不存在BTACH1_DCNA->BATCH2_DCNA.EA的调用关系，则中止不发送。如果存在BTACH1_DCNA->BATCH2_DCNA.EA的调用关系即鉴权通过，PUBLISHER_DCNA则会根据目标批量名称BATCH2_DCNA查找到记录的ip:port为192.168.0.22：10000，BATCH2_DCNA然后将消息发送到部署在192.168.0.22服务器上的BATCH2_DCNA，BATCH2_DCNA的批量分类***接收并处理该批量信号。BATCH2DCNA starts the batch signal listener to monitor the batch signal EA. The host schedule of BATCH1_DCNA sends the batch signal EA to PUBLISHER_DCNA. The message contains the username and password assigned to BATCH1_DCNA. PUBLISHER_DCNA uses the user name and password in the message for secret verification. If the secret verification fails, the message is discarded and the current secret verification behavior is recorded. If the verification is passed, the service management authentication of batch signals will be performed. If the calling relationship of BTACH1_DCNA->BATCH2_DCNA.EA does not exist in the service management, it will stop and not send. If there is a call relationship of BTACH1_DCNA->BATCH2_DCNA.EA, that is, the authentication is passed, PUBLISHER_DCNA will find the recorded ip:port is 192.168.0.22:10000 according to the target batch name BATCH2_DCNA, and BATCH2_DCNA will send the message to the server deployed on 192.168.0.22 On the BATCH2_DCNA, the batch classification listener of BATCH2_DCNA receives and processes the batch signal.
步骤101之后，步骤104之前，一种可选实施方式如下：After step 101 and before step 104, an optional implementation is as follows:
所述第一代理主机确定所述第二代理主机是否为预设白名单中指示的代理主机，若不是，则将所述任务调度信号丢弃。The first proxy host determines whether the second proxy host is the proxy host indicated in the preset whitelist, and if not, discards the task scheduling signal.
上述方式下，通过预设白名单，第一代理主机对发送任务调度信号进行验证，若第二代理主机不为预设白名单中指示的代理主机，则将任务调度信号丢弃。该方式可应用于图10示出的架构中。下面结合图10详细介绍，图10为本申请实施例中DCN之间的任务调度信号传输示意图。需要说明的是，图10示出的架构中，其他***既可以是批量***，也可以不是批量***。In the above manner, through the preset white list, the first agent host verifies that the task scheduling signal is sent, and if the second agent host is not the agent host indicated in the preset white list, the task scheduling signal is discarded. This approach can be applied to the architecture shown in FIG. 10. The following describes in detail with reference to FIG. 10, which is a schematic diagram of task scheduling signal transmission between DCNs in an embodiment of the application. It should be noted that in the architecture shown in FIG. 10, other systems may be batch systems or not.
PUBLISHER_DCNB监听RMB的topic_publisher_DCNB，BATCH1_DCNB启动批量信号***监听批量信号EB。BATCH1_DCNA的主机schedule serverA1发送批量信号到PUBLISHER_DCNA，PUBLISHER_DCNA检查到目标批量名称标明的DCN为DCNB，而非本DCN的DCNA，于是将该批量信号封装成RMB消息发送至RMB，RMB将推送给监听RMB的topic_publisher_DCNB的PUBLISHER_DCNB，通过PUBLISHER_DCNB验密和服务治理鉴权后，PUBLISHER_DCNB再将消息发送给BATCH1_DCNB的主机，否则该消息被丢弃并记录。PUBLISHER_DCNB monitors the topic_publisher_DCNB of RMB, and BATCH1_DCNB starts the batch signal listener to monitor the batch signal EB. The host schedule of BATCH1_DCNA serverA1 sends a batch signal to PUBLISHER_DCNA, PUBLISHER_DCNA checks that the DCN indicated by the target batch name is DCNB, not the DCNA of this DCN, so the batch signal is encapsulated into RMB message and sent to RMB, and RMB will be pushed to the monitoring RMB PUBLISHER_DCNB of topic_publisher_DCNB, after passing PUBLISHER_DCNB authentication and service management authentication, PUBLISHER_DCNB sends the message to the host of BATCH1_DCNB, otherwise the message is discarded and recorded.
上述方法中，第一数据中心节点的第一代理主机接收第二代理主机发送的任务调度信号，而所述任务调度信号是第二应用主机执行完第二任务后触发的，因此无需频繁访问数据库，即可传输任务调度信号，降低了任务调度信号的延迟，另外，第一代理主机根据任务处理主机信息，确定所述任务调度信号对应的第一应用主机，并将任务调度信号发送给第一应用主机，避免了频繁切换访问数据库的应用主机，因此上述方法降低了任务调度信号的传输延迟。In the above method, the first agent host of the first data center node receives the task scheduling signal sent by the second agent host, and the task scheduling signal is triggered after the second application host performs the second task, so there is no need to frequently access the database , The task scheduling signal can be transmitted, reducing the delay of the task scheduling signal. In addition, the first agent host determines the first application host corresponding to the task scheduling signal according to the task processing host information, and sends the task scheduling signal to the first application host. The application host avoids frequent switching of the application host that accesses the database, so the above method reduces the transmission delay of the task scheduling signal.
基于RMB可靠消息总线，通过统一的批量信号主动分发模块PUBLISHER和内部监听机制，实现批量信号分发的解耦和高拓展性，满足银行对批量调度服务治理和鉴权的风险管理要求。本申请提供的信号传输方法有以下优点：Based on the RMB reliable message bus, through the unified batch signal active distribution module PUBLISHER and internal monitoring mechanism, the decoupling and high scalability of batch signal distribution are realized, and the bank's risk management requirements for batch scheduling service governance and authentication are met. The signal transmission method provided in this application has the following advantages:
第一、通过内部批量信号队列，拓展批量的执行场景，可以支持循环批量。First, through the internal batch signal queue, expand batch execution scenarios, and can support cyclic batches.
第二、通过代理主机统一地维护批量名称和实际主机映射关系，使需要交互批量信号的批量可以使用HA方案部署，并维护批量名称和实际主机的映射关系。Second, the proxy host uniformly maintains the mapping relationship between batch names and actual hosts, so that batches that need to exchange batch signals can be deployed using the HA solution, and maintain the mapping relationship between batch names and actual hosts.
第三、通过将DCN维度加入批量命名，在跨DCN情境下，通过RMB向非本DCN目标批量发送批量信号和接收来自非批量***的信号。Third, by adding the DCN dimension to batch naming, in a cross-DCN context, batch sending and receiving signals from non-batch systems to non-local DCN targets through RMB.
第四、通过批量信号分发模块完成对批量调度的服务治理和鉴权，满足银行的风险管理要求。Fourth, through the batch signal distribution module, complete service management and authentication of batch scheduling to meet the bank's risk management requirements.
如图11所示，为本申请实施例提供的一种信号传输装置的结构示意图。As shown in FIG. 11, it is a schematic structural diagram of a signal transmission device provided by an embodiment of this application.
本申请提供一种信号传输装置，包括：获取模块1101，用于接收第二代理主机发送的任务调度信号；所述任务调度信号是第二应用主机执行完第二任务后触发的；所述第二代理主机和所述第二应用主机为第二数据中心节点的主机；处理模块1102，用于根据任务处理主机信息，确定所述任务调度信号对应的第一应用主机；所述第一应用主机为所述第一数据中心节点的主机；所述任务处理主机信息是根据第一数据中心节点的各应用主机处理的各任务确定的；将所述任务调度信号发送给所述第一应用主机，所述任务调度信号用于触发所述第一应用主机执行第一任务。The present application provides a signal transmission device, including: an acquisition module 1101, configured to receive a task scheduling signal sent by a second agent host; the task scheduling signal is triggered after the second application host completes the second task; the first The second proxy host and the second application host are the hosts of the second data center node; the processing module 1102 is configured to determine the first application host corresponding to the task scheduling signal according to task processing host information; the first application host Is the host of the first data center node; the task processing host information is determined according to the tasks processed by each application host of the first data center node; sending the task scheduling signal to the first application host, The task scheduling signal is used to trigger the first application host to execute the first task.
一种可选实施方式中，所述处理模块1102还用于：根据所述任务调度信号的类型，将所述任务调度信号写入对应的第一数据结构中并将第一计数加1；在确定所述第一计数大于第二计数时，从所述第一数据结构中获取所述任务调度信号并写入第二数据结构，之后将所述第二计数加1。In an optional implementation manner, the processing module 1102 is further configured to: according to the type of the task scheduling signal, write the task scheduling signal into the corresponding first data structure and increase the first count by 1; When it is determined that the first count is greater than the second count, the task scheduling signal is obtained from the first data structure and written into the second data structure, and then the second count is increased by 1.
一种可选实施方式中，所述获取模块1101还用于：获取第三应用主机发送的更新请求消息；所述更新请求信息用于指示在所述任务处理主机信息中将所述任务调度信号对应的第三应用主机更新为所述第一应用主机；确认所述更新请求消息合法后，将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机。In an optional implementation manner, the obtaining module 1101 is further configured to: obtain an update request message sent by a third application host; the update request information is used to indicate that the task scheduling signal is included in the task processing host information The corresponding third application host is updated to the first application host; after confirming that the update request message is legal, the task scheduling signal in the task processing host information corresponds to the first application host.
一种可选实施方式中，所述获取模块1101具体用于：若确定所述更新请求消息中的用户名及密码为预设用户名及预设密码，则确定所述更新请求消息合法；将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机的互联网协议IP地址和第一应用主机的端口。In an optional implementation manner, the obtaining module 1101 is specifically configured to: if it is determined that the user name and password in the update request message are the preset user name and the preset password, determine that the update request message is legal; The task scheduling signal in the task processing host information corresponds to the Internet Protocol IP address of the first application host and the port of the first application host.
一种可选实施方式中，所述处理模块1102还用于：确定所述第二代理主机是否为预设白名单中指示的代理主机，若不是，则将所述任务调度信号丢弃。In an optional implementation manner, the processing module 1102 is further configured to determine whether the second proxy host is the proxy host indicated in the preset whitelist, and if not, discard the task scheduling signal.
本申请实施例提供一种计算机设备，包括程序或指令，当所述程序或指令被执行时，用以执行本申请实施例提供的一种信号传输方法及任一可选方法。The embodiment of the present application provides a computer device including a program or instruction, and when the program or instruction is executed, it is used to execute a signal transmission method and any optional method provided in the embodiment of the present application.
本申请实施例提供一种存储介质，包括程序或指令，当所述程序或指令被执行时，用以执行本申请实施例提供的一种信号传输方法及任一可选方法。The embodiment of the present application provides a storage medium including a program or instruction. When the program or instruction is executed, it is used to execute a signal transmission method and any optional method provided in the embodiment of the present application.
最后应说明的是：本领域内的技术人员应明白，本申请的实施例可提供为方法、***、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、光学存储器等)上实施的计算机程序产品的形式。Finally, it should be noted that those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.
本申请是参照根据本申请的方法、设备(***)、和计算机程序产品的流程图和/或 方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。This application is described with reference to flowcharts and/or block diagrams of methods, equipment (systems), and computer program products according to this application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的范围。这样，倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the application without departing from the scope of the application. In this way, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, this application is also intended to include these modifications and variations.

Claims (12)

  1. 一种信号传输方法，其特征在于，适用于包括多个代理主机和多个数据中心节点的处理***；每个数据中心节点具有对应的代理主机；每个数据中心节点包括多个应用主机；所述方法包括：A signal transmission method, characterized in that it is suitable for a processing system including multiple proxy hosts and multiple data center nodes; each data center node has a corresponding proxy host; each data center node includes multiple application hosts; The methods include:
    第一代理主机接收第二代理主机发送的任务调度信号；所述任务调度信号是第二应用主机执行完第二任务后触发的；所述第一代理主机为第一数据中心节点的主机；所述第二代理主机和所述第二应用主机为第二数据中心节点的主机；The first agent host receives the task scheduling signal sent by the second agent host; the task scheduling signal is triggered after the second application host completes the second task; the first agent host is the host of the first data center node; The second proxy host and the second application host are hosts of a second data center node;
    所述第一代理主机根据任务处理主机信息，确定所述任务调度信号对应的第一应用主机；所述任务处理主机信息是所述第一代理主机根据所述第一数据中心节点的各应用主机处理的各任务确定的；所述第一应用主机为所述第一数据中心节点的主机；The first agent host determines the first application host corresponding to the task scheduling signal according to task processing host information; the task processing host information is that the first agent host determines the first application host corresponding to the first data center node The processing tasks are determined; the first application host is the host of the first data center node;
    所述第一代理主机将所述任务调度信号发送给所述第一应用主机，所述任务调度信号用于触发所述第一应用主机执行第一任务。The first agent host sends the task scheduling signal to the first application host, and the task scheduling signal is used to trigger the first application host to execute the first task.
  2. 如权利要求1所述的方法，其特征在于，所述第一代理主机将所述任务调度信号发送给所述第一应用主机之前，还包括：The method according to claim 1, wherein before the first agent host sends the task scheduling signal to the first application host, the method further comprises:
    所述第一代理主机的第一***根据所述任务调度信号的类型，将所述任务调度信号写入对应的第一数据结构中并将第一计数加1；According to the type of the task scheduling signal, the first listener of the first proxy host writes the task scheduling signal into the corresponding first data structure and adds 1 to the first count;
    所述第一代理主机的第二***在确定所述第一计数大于第二计数时，从所述第一数据结构中获取所述任务调度信号并写入第二数据结构，之后将所述第二计数加1。When determining that the first count is greater than the second count, the second listener of the first proxy host obtains the task scheduling signal from the first data structure and writes it into the second data structure, and then transfers the The second count is incremented by one.
  3. 如权利要求1所述的方法，其特征在于，还包括：The method of claim 1, further comprising:
    所述第一代理主机获取第三应用主机发送的更新请求消息；所述更新请求信息用于指示所述第一代理主机在所述任务处理主机信息中将所述任务调度信号对应的第三应用主机更新为所述第一应用主机；The first agent host obtains an update request message sent by a third application host; the update request information is used to instruct the first agent host to assign the third application corresponding to the task scheduling signal in the task processing host information The host is updated to the first application host;
    所述第一代理主机确认所述更新请求消息合法后，将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机。After confirming that the update request message is legal, the first proxy host corresponds to the task scheduling signal in the task processing host information to the first application host.
  4. 如权利要求3所述的方法，其特征在于，所述第一代理主机确认所述更新请求消息合法，包括：The method according to claim 3, wherein the confirmation by the first proxy host that the update request message is legal includes:
    所述第一代理主机若确定所述更新请求消息中的用户名及密码为预设用户名及预设密码，则确定所述更新请求消息合法；If the first proxy host determines that the user name and password in the update request message are the preset user name and the preset password, then determine that the update request message is legal;
    将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机，包括：The corresponding task scheduling signal in the task processing host information to the first application host includes:
    将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机的互联网协 议IP地址和第一应用主机的端口。The task scheduling signal in the task processing host information corresponds to the Internet Protocol IP address of the first application host and the port of the first application host.
  5. 如权利要求1-4任一所述的方法，其特征在于，所述第一代理主机接收第二代理主机发送的任务调度信号之后，所述第一代理主机将所述任务调度信号发送给所述第一应用主机之前，还包括：The method according to any one of claims 1-4, wherein after the first agent host receives the task scheduling signal sent by the second agent host, the first agent host sends the task scheduling signal to all Before describing the first application host, it also includes:
    所述第一代理主机确定所述第二代理主机是否为预设白名单中指示的代理主机，若不是，则将所述任务调度信号丢弃。The first proxy host determines whether the second proxy host is the proxy host indicated in the preset whitelist, and if not, discards the task scheduling signal.
  6. 一种信号传输装置，其特征在于，所述装置包括：A signal transmission device, characterized in that the device includes:
    获取模块，用于接收第二代理主机发送的任务调度信号；所述任务调度信号是第二应用主机执行完第二任务后触发的；所述第二代理主机和所述第二应用主机为第二数据中心节点的主机；The acquisition module is configured to receive the task scheduling signal sent by the second agent host; the task scheduling signal is triggered after the second application host finishes the second task; the second agent host and the second application host are the first 2. The host of the data center node;
    处理模块，用于根据任务处理主机信息，确定所述任务调度信号对应的第一应用主机；所述第一应用主机为所述第一数据中心节点的主机；所述任务处理主机信息是根据第一数据中心节点的各应用主机处理的各任务确定的；将所述任务调度信号发送给所述第一应用主机，所述任务调度信号用于触发所述第一应用主机执行第一任务。The processing module is configured to determine the first application host corresponding to the task scheduling signal according to the task processing host information; the first application host is the host of the first data center node; the task processing host information is based on the Each task processed by each application host of a data center node is determined; the task scheduling signal is sent to the first application host, and the task scheduling signal is used to trigger the first application host to execute the first task.
  7. 如权利要求6所述的装置，其特征在于，所述处理模块还用于：The device of claim 6, wherein the processing module is further configured to:
    根据所述任务调度信号的类型，将所述任务调度信号写入对应的第一数据结构中并将第一计数加1；According to the type of the task scheduling signal, write the task scheduling signal into the corresponding first data structure and add 1 to the first count;
    在确定所述第一计数大于第二计数时，从所述第一数据结构中获取所述任务调度信号并写入第二数据结构，之后将所述第二计数加1。When it is determined that the first count is greater than the second count, the task scheduling signal is obtained from the first data structure and written into the second data structure, and then the second count is increased by 1.
  8. 如权利要求6所述的装置，其特征在于，所述获取模块还用于：The device according to claim 6, wherein the acquisition module is further used for:
    获取第三应用主机发送的更新请求消息；所述更新请求信息用于指示在所述任务处理主机信息中将所述任务调度信号对应的第三应用主机更新为所述第一应用主机；Acquiring an update request message sent by a third application host; the update request information is used to instruct to update the third application host corresponding to the task scheduling signal to the first application host in the task processing host information;
    确认所述更新请求消息合法后，将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机。After confirming that the update request message is legal, the task scheduling signal in the task processing host information corresponds to the first application host.
  9. 如权利要求8所述的装置，其特征在于，所述获取模块具体用于：The device according to claim 8, wherein the acquiring module is specifically configured to:
    若确定所述更新请求消息中的用户名及密码为预设用户名及预设密码，则确定所述更新请求消息合法；If it is determined that the user name and password in the update request message are the preset user name and the preset password, then it is determined that the update request message is legal;
    将所述任务处理主机信息中所述任务调度信号对应于所述第一应用主机的互联网协议IP地址和第一应用主机的端口。The task scheduling signal in the task processing host information corresponds to the Internet Protocol IP address of the first application host and the port of the first application host.
  10. 如权利要求6-9任一所述的装置，其特征在于，所述处理模块还用于：9. The device according to any one of claims 6-9, wherein the processing module is further configured to:
    确定所述第二代理主机是否为预设白名单中指示的代理主机，若不是，则将所述任务 调度信号丢弃。Determine whether the second proxy host is the proxy host indicated in the preset whitelist, and if not, discard the task scheduling signal.
  11. 一种计算机设备，其特征在于，包括程序或指令，当所述程序或指令被执行时，如权利要求1至5中任意一项所述的方法被执行。A computer device characterized by comprising a program or an instruction, and when the program or an instruction is executed, the method according to any one of claims 1 to 5 is executed.
  12. 一种存储介质，其特征在于，包括程序或指令，当所述程序或指令被执行时，如权利要求1至5中任意一项所述的方法被执行。A storage medium, characterized by comprising a program or instruction, and when the program or instruction is executed, the method according to any one of claims 1 to 5 is executed.
PCT/CN2020/095938 2019-06-28 2020-06-12 Signal transmission method and apparatus WO2020259326A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910580557.XA CN110290215B (en) 2019-06-28 2019-06-28 Signal transmission method and device
CN201910580557.X 2019-06-28

Publications (1)

Publication Number Publication Date
WO2020259326A1 true WO2020259326A1 (en) 2020-12-30

Family

ID=68019811

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/095938 WO2020259326A1 (en) 2019-06-28 2020-06-12 Signal transmission method and apparatus

Country Status (2)

Country Link
CN (1) CN110290215B (en)
WO (1) WO2020259326A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110290215B (en) * 2019-06-28 2021-09-28 深圳前海微众银行股份有限公司 Signal transmission method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1512380A (en) * 2002-12-31 2004-07-14 联想(北京)有限公司 Load weighing method based on systematic grade diagnosis information
CN101719842A (en) * 2009-11-20 2010-06-02 中国科学院软件研究所 Cloud computing environment-based distributed network security pre-warning method
CN103309738A (en) * 2013-05-31 2013-09-18 中国联合网络通信集团有限公司 User job scheduling method and device
US20150334696A1 (en) * 2013-08-15 2015-11-19 Huawei Technologies Co., Ltd. Resource provisioning method
CN106951330A (en) * 2017-04-10 2017-07-14 郑州轻工业学院 A kind of maximized virtual machine distribution method of cloud service center service utility
CN110290215A (en) * 2019-06-28 2019-09-27 深圳前海微众银行股份有限公司 A kind of method for transmitting signals and device

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103164261B (en) * 2011-12-15 2016-04-27 ***通信集团公司 Multicenter data task disposal route, Apparatus and system
US9479382B1 (en) * 2012-03-27 2016-10-25 Amazon Technologies, Inc. Execution plan generation and scheduling for network-accessible resources
CN102982141B (en) * 2012-11-20 2016-01-20 北京搜狐新媒体信息技术有限公司 A kind of method and device realizing distributed data base agency
US9558043B2 (en) * 2013-01-25 2017-01-31 Cisco Technology Inc. System and method for abstracting and orchestrating mobile data networks in a network environment
CN104144183B (en) * 2013-05-08 2018-11-02 株式会社日立制作所 The management method of data center systems and data center systems
CN104572272B (en) * 2013-10-12 2018-02-09 杭州华为数字技术有限公司 A kind of method for scheduling task, apparatus and system
CN105430074B (en) * 2015-11-13 2018-06-29 厦门大学 Optimization method and system based on the distribution storage of the cloud data of data dependency and visit capacity
CN107025131B (en) * 2016-02-01 2020-12-29 腾讯科技（深圳）有限公司 Task scheduling method and device
US20180136979A1 (en) * 2016-06-06 2018-05-17 Sitting Man, Llc Offer-based computing enviroments
CN106980543B (en) * 2017-04-05 2020-02-07 福建智恒软件科技有限公司 Distributed task scheduling method and device based on event triggering
CN109302308A (en) * 2018-08-23 2019-02-01 厦门秦淮科技有限公司 A kind of data center IDC resource management system and management method
CN109547239B (en) * 2018-11-14 2022-03-04 赵显涛 Remote cloud data center management system based on three-layer network architecture
CN109451047B (en) * 2018-12-13 2021-05-18 深圳前海微众银行股份有限公司 Data transmission method, device, equipment and storage medium of monitoring alarm system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1512380A (en) * 2002-12-31 2004-07-14 联想(北京)有限公司 Load weighing method based on systematic grade diagnosis information
CN101719842A (en) * 2009-11-20 2010-06-02 中国科学院软件研究所 Cloud computing environment-based distributed network security pre-warning method
CN103309738A (en) * 2013-05-31 2013-09-18 中国联合网络通信集团有限公司 User job scheduling method and device
US20150334696A1 (en) * 2013-08-15 2015-11-19 Huawei Technologies Co., Ltd. Resource provisioning method
CN106951330A (en) * 2017-04-10 2017-07-14 郑州轻工业学院 A kind of maximized virtual machine distribution method of cloud service center service utility
CN110290215A (en) * 2019-06-28 2019-09-27 深圳前海微众银行股份有限公司 A kind of method for transmitting signals and device

Also Published As

Publication number Publication date
CN110290215B (en) 2021-09-28
CN110290215A (en) 2019-09-27

Similar Documents

Publication Publication Date Title
US20200410461A1 (en) Sharded Permissioned Distributed Ledgers
US11769150B2 (en) Transaction scheduling for block space on a blockchain
US20060059228A1 (en) Capturing and re-creating the state of a queue when migrating a session
US20230052935A1 (en) Asynchronous accounting method and apparatus for blockchain, medium and electronic device
US10817327B2 (en) Network-accessible volume creation and leasing
CN112075062A (en) Automated commit transaction management in blockchain networks
WO2019134402A1 (en) Equipment control method, cluster system, electronic device and readable storage medium
WO2022134797A1 (en) Data fragmentation storage method and apparatus, a computer device, and a storage medium
CN109951546A (en) Transactions requests processing method, device, equipment and medium based on intelligent contract
US20140059152A1 (en) Support server for redirecting task results to a wake-up server
CN112751847A (en) Interface call request processing method and device, electronic equipment and storage medium
US20070061444A1 (en) High availability for distributed non-persistent event propagation
CN112118322B (en) Data synchronization method of network equipment, network equipment and system
TW202301118A (en) Dynamic microservices allocation mechanism
US20210200765A1 (en) Connection pools for parallel processing applications accessing distributed databases
US10545667B1 (en) Dynamic data partitioning for stateless request routing
US11030220B2 (en) Global table management operations for multi-region replicated tables
CN105373563B (en) Database switching method and device
WO2020259326A1 (en) Signal transmission method and apparatus
US20210132993A1 (en) Rate limiting compliance assessments with multi-layer fair share scheduling
CN113965434A (en) API gateway routing implementation method under cross-machine-room scene
WO2018188607A1 (en) Stream processing method and device
JP2022553701A (en) Decentralized network with consensus mechanism
WO2023207529A1 (en) Data processing method and apparatus, device, medium, and product
US20240241981A1 (en) Methods and systems for data synchronization, and computer-readable storage media

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20831334

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 21/04/2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20831334

Country of ref document: EP

Kind code of ref document: A1