CN114666292A - Instant messaging technology method, system and medium - Google Patents
Instant messaging technology method, system and medium Download PDFInfo
- Publication number
- CN114666292A CN114666292A CN202210338230.3A CN202210338230A CN114666292A CN 114666292 A CN114666292 A CN 114666292A CN 202210338230 A CN202210338230 A CN 202210338230A CN 114666292 A CN114666292 A CN 114666292A
- Authority
- CN
- China
- Prior art keywords
- message
- subscriber
- instant messaging
- data
- publisher
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/70—Admission control; Resource allocation
- H04L47/80—Actions related to the user profile or the type of traffic
- H04L47/806—Broadcast or multicast traffic
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to the technical field of artificial intelligence technology processing, and discloses an instant messaging technical method, a system and a medium. By realizing high throughput rate, the invention can realize that a single machine can support the real-time message transmission of more than 10K messages per second in common commercial machines and gigabit communication networks; the low delay rate is realized, and the arrival time of stable data is within a fixed constant value under the condition of limited bandwidth; the data unidirectional flow is realized, namely, the response of an opposite terminal is not needed after the data sending request; in the case of high-frequency data packet communication, allowing a part of data to be lost in a whole packet, and preferentially processing the last transmitted data in the network; supporting a centralized server and client component; horizontal expansion and distributed consumption are supported.
Description
Technical Field
The invention relates to the technical field of artificial intelligence technical processing, in particular to an instant messaging technical method, an instant messaging technical system and an instant messaging technical medium.
Background
With the rise of artificial intelligence technology and the development of 5G technology, the fields of unmanned systems, artificial intelligence, internet of things, simulation and the like also become research hotspots in various countries. Technically, this means that processing such data between unmanned systems and the fields of artificial intelligence, internet of things, simulation, etc. becomes more complex and challenging. Therefore, the distributed communication system based on the publish/subscribe is researched under the industries supporting various unmanned systems and the fields of artificial intelligence, internet of things, simulation and the like, and the real-time data communication system with low delay, high throughput and high concurrency is realized, so that the distributed real-time data communication system has important significance.
Two examples are illustrated:
the unmanned automobile analyzes high-precision map data and massive real-time sensing data of sensors such as a laser radar and a camera, prejudges consequences of different driving behaviors of the automobile and guides automatic driving of the automobile according to the results. An obstacle in front of the unmanned car could not be conducted to the information system after 1 second, even if the information is prepared, it would not be meaningful. Therefore, the information acquired after the obstacle information in front of the unmanned vehicle is 1-3 seconds is considered to be meaningless and worthless.
The electromagnetic wave collection frequency is generally a scanning frequency of 100 hz, which means that electromagnetic wave information is collected 100 times in 1 second, so that the data collection process is required to be stable and stable at high frequency.
For the two examples, the calculation is performed in a single-machine or lightweight communication environment, and information such as target point cloud data acquired by a laser radar sensor on an unmanned system cannot be effectively calculated in a high-performance cluster, a dynamics cluster and a big data cluster in real time. Therefore, an instant data stream communication system needs to be built among the entity unmanned system, the simulator, the high-performance cluster, the dynamics cluster and the big data cluster, namely, the calculated data is more concerned about real-time information and the current state.
Currently, publish/subscribe based message communication queue middleware such as Kafka, rockmq, RabbitMQ, ActiveMQ, gRPC, and the like. Has the following disadvantages:
when the message queue is full, messages cannot be put into the queue, and two processing modes are provided:
1. and recording the message to a local hard disk or a memory, and compensating at a later stage.
2. And when the message is rejected, throwing the tail message of the current message queue to the deadlock queue.
In the above two processing modes, the immediacy of message processing is poor, and expired messages are buffered in queues, memories or hard disks, i.e., the delay time of the process of processing messages from a producer to a messenger is long.
Disclosure of Invention
The invention aims to provide an instant messaging technical method, an instant messaging system and an instant messaging medium, which achieve high throughput rate and can realize that a single machine can support the real-time message transmission of more than 10K messages per second in a common commercial machine and a gigabit communication network; the low delay rate is realized, and the arrival time of stable data is within a fixed constant value under the condition of limited bandwidth; the data unidirectional flow is realized, namely, the opposite end does not need to respond after the data sending request; in the case of high-frequency data packet communication, allowing a part of data to be lost in a whole packet, and preferentially processing the last transmitted data in the network; supporting a centralized server and client component; horizontal expansion and distributed consumption are supported.
In order to achieve the purpose, the invention provides the following technical scheme:
an instant messaging technology system comprises a sender, wherein the sender (called a publisher) of a message does not directly send the message to a specific receiver (called a subscriber) but broadcasts the message through a message channel to enable the subscriber subscribing the topic to consume the message, the publisher and the subscriber have a one-to-many dependency relationship, an execution result is only generated when the subscriber and the publisher are on the same topic, a communication node is a centralized node responsible for mutual communication among a plurality of clients, and a lightweight communication mechanism is adopted among a plurality of application terminals such as a virtual environment simulation node, a heterogeneous unmanned simulation node, a multi-physical field simulation node and a deep reinforcement learning computing node.
Preferably, the subscribers only pay attention to the messages subscribed by themselves, and each subscriber can subscribe to a plurality of publisher objects at the same time.
Preferably, each publisher does not care whether the message has a subscriber when publishing the message, and when the publisher publishes the message subscribed by the subscriber, the subscriber triggers a registration event according to the message details.
Preferably, the communication nodes have the ability to solve the problem of full message queues by means of newly adding nodes, transversely expanding clusters and the like, each communication node runs in an independent process, and the communication nodes are coordinated and matched with each other to realize data interaction and distributed communication.
An instant messaging technology method comprises the following steps:
s1, storing information
The message in the publisher can be persisted to the tail of the memory queue, and the sending flow can actively pull the message at the head of the message queue to send.
S2, message sending
The publisher allows messages to be sent to multiple communication nodes in a round-robin fashion by throwing head-of-line messages to the deadlock queue when a message queue full condition occurs.
S3, pulling cancel information
The message is persisted to the tail of the memory queue in the communication node, the sending flow actively pulls the message, records the time T0 before the message enters the message queue, and then pushes the message to the head of the message queue.
S4, discarding and processing information
The current time Tn is subtracted from the time T0 before the message enters the sending stream, if the message is discarded after timeout (namely Tn-T0> timeout), only the instant message is taken for processing in the subscriber, and if other messages are processed by the time of the message arrival, the expired message is discarded.
Preferably, the same message is unique in the network in step S2, and has no redundant data.
An instant messaging technology medium, the medium comprising 5G technology and artificial intelligence.
The instant messaging technical method, the instant messaging technical system and the instant messaging technical medium have the following beneficial effects that:
(1) the invention can realize high throughput rate, and can realize that a single machine can support the real-time message transmission of more than 10K messages per second in the common commercial machine and the gigabit communication network; the low delay rate is realized, and the arrival time of stable data is within a fixed constant value under the condition of limited bandwidth; the data unidirectional flow is realized, namely, the response of an opposite terminal is not needed after the data sending request; in the case of high-frequency data packet communication, allowing a part of data to be lost in a whole packet, and preferentially processing the last transmitted data in the network; supporting a centralized server and client component; horizontal expansion and distributed consumption are supported.
(2) The invention sets 100 concurrent sending threads and 100 receiving threads under a common gigabit network, wherein each sending thread sends 1024 bytes (1Kb) of data once every 10 milliseconds, the sending threads are simultaneously connected to three communication nodes, the whole case runs for 120 seconds, each receiving thread is responsible for receiving the data and calculating results and generating an average processing time report and a throughput rate report, the ordinate represents the average processing time per second, namely the difference between the data sending time and the time of receiving confirmation, the abscissa represents the duration, the average processing per second is maintained within 1 millisecond, and the throughput rate is on average 11000 times per second.
Drawings
FIG. 1 is a process diagram of information transmission of the present invention;
FIG. 2 is a schematic diagram of the process of information discard of the present invention;
FIG. 3 is a process diagram of timeout information processing of the present invention;
FIG. 4 is a process diagram illustrating expiration information discarding according to the present invention;
FIG. 5 is a schematic diagram of a processing time display table of the present invention;
fig. 6 is a schematic diagram of a throughput rate time display table of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1 to 6, the present invention provides a technical solution:
an instant communication technology system comprises a sender, the sender of the message (called a publisher) does not directly send the message to a specific receiver (called a subscriber) but broadcasts the message through a message channel to be consumed by the subscriber who subscribes the topic, the publisher and the subscriber have a one-to-many dependency relationship, an execution result can be obtained only when the subscriber and the publisher are the same topic, a communication node is a centralized node responsible for mutual communication among a plurality of clients, and a lightweight communication mechanism is adopted among a plurality of application terminals such as a virtual environment simulation node, a heterogeneous unmanned simulation node, a multi-physics field simulation node, a deep reinforcement learning calculation node and the like, the subscriber only pays attention to the message subscribed by the subscriber, each subscriber can subscribe a plurality of publisher objects at the same time, and each publisher does not need to pay attention to whether the message has a subscriber when publishing the message, when a publisher publishes a message subscribed by a subscriber, the subscriber triggers a registration event according to message details, the communication nodes can solve the problem of full message queues in the modes of adding nodes and transversely expanding clusters, each communication node runs in an independent process, and the communication nodes are coordinated and matched with each other to realize data interaction and distributed communication.
An instant messaging technology method comprises the following steps:
s1, storing information
The message in the publisher can be persisted to the tail of the memory queue, and the sending flow can actively pull the message at the head of the message queue to send.
S2, message sending
By throwing the head-of-line message to the deadlock queue when the message queue full status occurs, the publisher allows the message to be sent to multiple communication nodes in a polling manner, and the same message is unique in the network without redundant data in step S2.
S3, pulling cancel information
The message is persisted to the tail of the memory queue in the communication node, the sending flow actively pulls the message, records the time T0 before the message enters the message queue, and then pushes the message to the head of the message queue.
S4, discarding and processing information
The current time Tn is subtracted from the time T0 before the message enters the sending stream, if the message is discarded after the timeout (i.e. Tn-T0> timeout), only the instant message is taken for processing in the subscriber, and if other messages are processed by the time of arrival, the expired message is discarded.
An instant messaging technology medium comprises 5G technology and artificial intelligence.
In conclusion, the invention can realize high throughput rate, and can realize that a single machine can support the real-time message transmission of more than 10K messages per second in the common commercial machine and the gigabit communication network; the low delay rate is realized, and the arrival time of stable data is within a fixed constant value under the condition of limited bandwidth; the data unidirectional flow is realized, namely, the response of an opposite terminal is not needed after the data sending request; in the case of high-frequency data packet communication, allowing a part of data to be lost in a whole packet, and preferentially processing the last transmitted data in the network; supporting a centralized server and client component; horizontal expansion and distributed consumption are supported; under a common gigabit network, 100 concurrent sending threads and 100 receiving threads are set in the method, each sending thread sends 1024 bytes (1Kb) of data once every 10 milliseconds, the sending threads are connected to three communication nodes simultaneously, the whole case runs for 120 seconds, each receiving thread is responsible for receiving the data and calculating results and generating an average processing time report and a throughput rate report, the ordinate represents the average processing time per second, namely the difference between the data sending time and the time of receiving confirmation, the abscissa represents the duration, the average processing per second is maintained within 1 millisecond, and the throughput rate is 11000 times per second on average.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Claims (7)
1. An instant messaging technology system, comprising a sender, characterized in that: the message sender does not directly send the message to a specific receiver, but broadcasts the message through a message channel, so that a subscriber subscribing the topic consumes the message, a publisher and a subscriber have a one-to-many dependency relationship, an execution result is only generated when the subscriber and the publisher are on the same topic, a communication node is a centralized node responsible for mutual communication among a plurality of clients, and a lightweight communication mechanism is adopted among a plurality of application terminals such as a virtual environment simulation node, a heterogeneous unmanned simulation node, a multi-physical field simulation node, a deep reinforcement learning computing node and the like.
2. The instant messaging technology system of claim 1, wherein: the subscribers only pay attention to the messages subscribed by themselves, and each subscriber can subscribe a plurality of publisher objects at the same time.
3. The instant messaging technology system of claim 1, wherein: each publisher does not care whether the message has a subscriber when publishing the message, and when the publisher publishes the message subscribed by the subscriber, the subscriber triggers a registration event according to the message details.
4. The instant messaging technology system of claim 1, wherein: the communication nodes have the capacity of solving the problem of full message queues in the modes of adding nodes, transversely expanding clusters and the like, and each communication node runs in an independent process and is coordinated and matched with each other to realize data interaction and distributed communication.
5. An instant messaging technology method is characterized by comprising the following steps:
s1, storing information
Through the fact that the message in the publisher can be persisted to the tail of the memory queue, the sending flow can actively pull the message at the head of the message queue to send;
s2, message sending
When the message queue is full, the head-of-queue message is thrown to the dead message queue, and the publisher sends the message to a plurality of communication nodes in a polling allowed mode;
s3, pulling cancel information
The message is persisted to the tail of the memory queue in the communication node, the message is actively pulled by the sending flow, the time T0 is recorded before the message enters the message queue, and then the message is pushed to the head of the message queue;
s4, discarding and processing information
The current time Tn is subtracted from the time T0 before the message enters the sending stream, if the message is discarded after timeout, only the instant message is taken for processing in the subscriber, and if other messages are processed by the time of arrival, the expired message is discarded.
6. The instant messaging technology method of claim 5, wherein: the same message is unique in the network in step S2, and there is no redundant data.
7. An instant messaging technology medium, wherein the medium comprises 5G technology and artificial intelligence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210338230.3A CN114666292A (en) | 2022-04-01 | 2022-04-01 | Instant messaging technology method, system and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210338230.3A CN114666292A (en) | 2022-04-01 | 2022-04-01 | Instant messaging technology method, system and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114666292A true CN114666292A (en) | 2022-06-24 |
Family
ID=82033233
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210338230.3A Pending CN114666292A (en) | 2022-04-01 | 2022-04-01 | Instant messaging technology method, system and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114666292A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103532877A (en) * | 2013-10-29 | 2014-01-22 | 华北科技学院 | Scheduling method for guaranteeing real-time transmission of wireless sensor network information |
| CN103856393A (en) * | 2013-07-09 | 2014-06-11 | 携程计算机技术（上海）有限公司 | Distributed message-oriented middleware system based on database and operating method thereof |
| CN104092767A (en) * | 2014-07-21 | 2014-10-08 | 北京邮电大学 | Posting/subscribing system for adding message queue models and working method thereof |
| CN110832875A (en) * | 2018-07-23 | 2020-02-21 | 深圳市大疆创新科技有限公司 | Video processing method, terminal device and machine-readable storage medium |
| CN112965839A (en) * | 2021-03-29 | 2021-06-15 | 远景智能国际私人投资有限公司 | Message transmission method, device, equipment and storage medium |
| CN113542314A (en) * | 2020-04-13 | 2021-10-22 | 烽火通信科技股份有限公司 | Method and system for realizing subscription mode based on keyword filtering |
| CN113905089A (en) * | 2021-09-06 | 2022-01-07 | 浪潮软件股份有限公司 | Multi-user message pushing method and system based on publish-subscribe mode |
-
2022
- 2022-04-01 CN CN202210338230.3A patent/CN114666292A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103856393A (en) * | 2013-07-09 | 2014-06-11 | 携程计算机技术（上海）有限公司 | Distributed message-oriented middleware system based on database and operating method thereof |
| CN103532877A (en) * | 2013-10-29 | 2014-01-22 | 华北科技学院 | Scheduling method for guaranteeing real-time transmission of wireless sensor network information |
| CN104092767A (en) * | 2014-07-21 | 2014-10-08 | 北京邮电大学 | Posting/subscribing system for adding message queue models and working method thereof |
| CN110832875A (en) * | 2018-07-23 | 2020-02-21 | 深圳市大疆创新科技有限公司 | Video processing method, terminal device and machine-readable storage medium |
| CN113542314A (en) * | 2020-04-13 | 2021-10-22 | 烽火通信科技股份有限公司 | Method and system for realizing subscription mode based on keyword filtering |
| CN112965839A (en) * | 2021-03-29 | 2021-06-15 | 远景智能国际私人投资有限公司 | Message transmission method, device, equipment and storage medium |
| CN113905089A (en) * | 2021-09-06 | 2022-01-07 | 浪潮软件股份有限公司 | Multi-user message pushing method and system based on publish-subscribe mode |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108768826B (en) | Message routing method based on MQTT and Kafka high concurrency scene | |
| CN110858850B (en) | Comprehensive network management method, device and system for rail transit system | |
| CN102355413B (en) | A kind of method of extensive unified message space in real time and system thereof | |
| CN113157449A (en) | Real-time stream data analysis processing method based on MQTT | |
| US10206015B2 (en) | System and method for vehicle data communication | |
| US20060233322A1 (en) | Methods and apparatus for switching between data streams | |
| CN110266810A (en) | Message receival method, equipment and storage medium based on MQTT agreement | |
| CN113723840B (en) | Internet of vehicles scene calculation method, device and system | |
| Yumusak et al. | Low-diameter topic-based pub/sub overlay network construction with minimum–maximum node degree | |
| CN114666292A (en) | Instant messaging technology method, system and medium | |
| CN109428745B (en) | JMS message forwarding method, device, electronic equipment and storage medium | |
| CN116800787A (en) | Vehicle-mounted communication method and system based on Ethernet communication protocol | |
| CN116261065A (en) | Communication method, equipment and storage medium based on message queue telemetry transmission protocol | |
| CN111240860A (en) | Message processing method and service system | |
| Rekik et al. | Application of a CAN BUS transport for DDS middleware | |
| Matic et al. | Optimization of MQTT communication between microservices in the IoT cloud | |
| CN114884830A (en) | Distributed parallel simulation deduction system based on wide area network | |
| CN117873758B (en) | Communication method between DCS system stations based on message bus | |
| Rooney et al. | Edge server software architecture for sensor applications | |
| Mastouri et al. | Opportunistic routing in the context of publishsubscribe model for VANET | |
| CN116361038B (en) | Acceleration computing management method, system, equipment and storage medium | |
| CN117560415B (en) | Asynchronous and synchronous communication method and system for smart community micro-service architecture (MQTT) | |
| CN114095404B (en) | Video equipment state calculation output method, device and equipment based on stream calculation | |
| CN116939028A (en) | Message pushing method, system, equipment and storage medium | |
| KR102127652B1 (en) | Publish and subscribe communication system and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |