CN111478900A - Data processing method and system - Google Patents
Data processing method and system Download PDFInfo
- Publication number
- CN111478900A CN111478900A CN202010263905.3A CN202010263905A CN111478900A CN 111478900 A CN111478900 A CN 111478900A CN 202010263905 A CN202010263905 A CN 202010263905A CN 111478900 A CN111478900 A CN 111478900A
- Authority
- CN
- China
- Prior art keywords
- message
- data
- processed
- luggage
- data item
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title abstract description 16
- 238000000034 method Methods 0.000 claims abstract description 39
- 230000003993 interaction Effects 0.000 claims abstract description 36
- 238000012545 processing Methods 0.000 claims description 24
- 238000004458 analytical method Methods 0.000 claims description 11
- 238000013500 data storage Methods 0.000 claims description 7
- 238000007405 data analysis Methods 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000005303 weighing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/03—Protocol definition or specification
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/26—Special purpose or proprietary protocols or architectures
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a data processing method and a system, wherein the method comprises the following steps: acquiring a message to be processed in a message queue; analyzing the message to be processed according to the interaction standard of the luggage message data of the civil aviation to obtain the message type and the message data of the message to be processed; and determining a data table corresponding to the message type in the database, and storing the message data into the data table. According to the scheme, the message to be processed is obtained from the message queue, the message to be processed is analyzed according to the civil aviation luggage message data standard, the message type and the message data of the message to be processed are obtained, and the message data obtained by analyzing the message to be processed is stored in the database. Based on the civil aviation luggage message data specification, a uniform luggage message data analysis standard is provided, so that the processed luggage message data can be shared among all units, and the service quality and the service efficiency can be improved by using the luggage message data.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a data processing method and system.
Background
With the development of science and technology, more and more people choose to travel by plane. Passengers typically involve baggage consignment while riding in an airplane, resulting in corresponding baggage message data.
For the processing of the baggage message data, units such as airports, airlines, customs and the like are usually involved, but different units process the baggage message data according to their respective requirements and standards, and the processed baggage message data cannot be shared among the units, so that the baggage message data cannot be utilized to improve the service quality and the service efficiency.
Disclosure of Invention
In view of this, embodiments of the present invention provide a data processing method and system to solve the problem that the baggage message data cannot be used to improve the service quality and the service efficiency.
In order to achieve the above purpose, the embodiments of the present invention provide the following technical solutions:
the first aspect of the embodiments of the present invention discloses a data processing method, which includes:
acquiring a message to be processed in a message queue;
analyzing the message to be processed according to the interaction standard of the civil aviation luggage message data to obtain the message type and the message data of the message to be processed;
and determining a data table corresponding to the message type in a database, and storing the message data into the data table, wherein the database at least comprises pre-created data tables corresponding to different message types.
Preferably, the format of the message to be processed is a character string format, and the analyzing the message to be processed according to the civil aviation luggage message data interaction specification to obtain the message type and the message data of the message to be processed includes:
reading a first n-bit character corresponding to the message to be processed, wherein n is a positive integer;
determining the message type of the message to be processed indicated by the first n-bit character according to the data interaction specification of the civil aviation luggage message;
analyzing other characters corresponding to the message to be processed according to the data interaction specification of the civil aviation luggage message to obtain a plurality of data items corresponding to the message to be processed;
and acquiring message data contained in each data item in the message to be processed.
Preferably, the determining a data table corresponding to the packet type in the database, and storing the packet data in the data table include:
determining a data table corresponding to the message type in a database, wherein the data table comprises a field corresponding to each data item;
and for each data item in the to-be-processed message, storing the message data contained in the data item into a field corresponding to the data item in the data table.
Preferably, the acquiring the packet data included in each data item in the packet to be processed includes:
for each data item in the message to be processed, if the format of the message data contained in the data item meets the requirement of a preset format, obtaining the message data contained in the data item;
and if the message data contained in the data item does not meet the preset format requirement, not acquiring the message data contained in the data item.
Preferably, the storing the message data included in the data item into a field corresponding to the data item in the data table includes:
if the format of the message data contained in the data item meets the preset format requirement, storing the message data contained in the data item into a field corresponding to the data item in the data table;
and if the message data contained in the data item does not meet the preset format requirement, storing a null value in a field corresponding to the data item in the data table.
Preferably, before acquiring the message to be processed in the message queue, the method further includes:
creating a first sub message queue, a second sub message queue and a third sub message queue corresponding to the message queue;
and respectively receiving a luggage source message, a luggage processing message and a luggage loading message by utilizing the first sub message queue, the second sub message queue and the third sub message queue.
A second aspect of the embodiments of the present invention discloses a data processing system, including:
the message analysis processing module is used for acquiring a message to be processed in a message queue, analyzing the message to be processed according to the civil aviation luggage message data interaction standard, and obtaining the message type and the message data of the message to be processed;
and the data storage module is used for determining a data table corresponding to the message type in a database and storing the message data into the data table, wherein the database at least comprises pre-created data tables corresponding to different message types.
Preferably, the format of the message to be processed is a character string format, and the message parsing and processing module includes:
a reading unit, configured to read a first n-bit character corresponding to the packet to be processed, where n is a positive integer;
the determining unit is used for determining the message type of the message to be processed indicated by the front n-bit character according to the data interaction specification of the civil aviation luggage message;
the analysis unit is used for analyzing other characters corresponding to the message to be processed according to the data interaction specification of the civil aviation luggage message to obtain a plurality of data items corresponding to the message to be processed;
and the acquisition unit is used for acquiring message data contained in each data item in the message to be processed.
Preferably, the data storage module includes:
the determining unit is used for determining a data table corresponding to the message type in a database, and the data table comprises a field corresponding to each data item;
and the storage unit is used for storing the message data contained in the data item into a field corresponding to the data item in the data table aiming at each data item in the message to be processed.
Preferably, the system further comprises:
and the message access engine is used for creating a first sub message queue, a second sub message queue and a third sub message queue corresponding to the message queues, and respectively receiving a luggage source message, a luggage processing message and a luggage loading message by using the first sub message queue, the second sub message queue and the third sub message queue.
Based on the above data processing method and system provided by the embodiments of the present invention, the method includes: acquiring a message to be processed in a message queue; analyzing the message to be processed according to the interaction standard of the luggage message data of the civil aviation to obtain the message type and the message data of the message to be processed; and determining a data table corresponding to the message type in the database, and storing the message data into the data table. According to the scheme, the message to be processed is obtained from the message queue, the message to be processed is analyzed according to the civil aviation luggage message data standard, the message type and the message data of the message to be processed are obtained, and the message data obtained by analyzing the message to be processed is stored in the database. Based on the civil aviation luggage message data specification, a uniform luggage message data analysis standard is provided, so that the processed luggage message data can be shared among all units, and the service quality and the service efficiency can be improved by using the luggage message data.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present invention;
fig. 2 is a flowchart for analyzing a message to be processed according to an embodiment of the present invention;
fig. 3 is a flowchart of storing message data in a data table according to an embodiment of the present invention;
fig. 4 is another flowchart of a data processing method according to an embodiment of the present invention;
fig. 5 is a block diagram of a data processing system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In this application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
As can be seen from the background art, at present, when processing baggage message data, units such as airports, airlines, customs, and the like process the baggage message data according to their respective requirements and standards, and the processed baggage message data cannot be shared among the units, so that the baggage message data cannot be utilized to improve service quality and service efficiency.
Therefore, the embodiment of the invention provides a data processing method and a data processing system, which utilize the standard of civil aviation luggage message data to provide a uniform analysis standard of luggage message data, so that the processed luggage message data can be shared among various units, and the purpose of improving the service quality and the service efficiency by utilizing the luggage message data is realized.
Referring to fig. 1, a flowchart of a data processing method provided by an embodiment of the present invention is shown, where the data processing method includes the following steps:
step S101: and acquiring the message to be processed in the message queue.
Preferably, before step S101 is executed, a first sub Message queue, a second sub Message queue, and a third sub Message queue corresponding to the Message queues are created, and a Bag Source Message (BSM), a Bag Process Message (BPM), and a bag loading Message (BMM) are respectively received by using the first sub Message queue, the second sub Message queue, and the third sub Message queue.
It can be understood that each sub-message queue can receive a corresponding type of baggage message, and different sub-message queues can be created to receive different types of baggage messages according to actual requirements, that is, the number of sub-message queues is created according to actual situations of different types and numbers of baggage messages. The BSM, BPM and BMM mentioned above are only used for illustration, and other types of baggage messages may be received by creating a sub-message queue, and the type of baggage message is not necessarily illustrated.
For example: and respectively creating a first sub message queue, a second sub message queue and a third sub message queue according to actual requirements in a RabbitMQ message queue mode. The system comprises a BSM (base station management) sent by a field terminal airport departure message channel of a first sub message queue receiver, a BPM sent by a field terminal airport departure message channel of a second sub message queue receiver and a BMM sent by a field terminal airport departure message channel of a third sub message queue receiver.
In the process of implementing step S101, the baggage message is continuously read from the message queue, and the read baggage message is the message to be processed.
It should be noted that the format of the baggage message read from the message queue is a preset format, for example, the format of the baggage message is a character string format.
Step S102: and analyzing the message to be processed according to the interaction standard of the luggage message data of the civil aviation to obtain the message type and the message data of the message to be processed.
In the process of implementing step S102 specifically, when the message to be processed is analyzed, the message to be processed is analyzed according to the civil aviation luggage message data interaction specification, so as to obtain the message type and the message data of the message to be processed.
Step S103: and determining a data table corresponding to the message type in the database, and storing the message data into the data table.
It should be noted that, according to different message types, a data table corresponding to each message type is created in the database, that is, the database at least includes pre-created data tables corresponding to different message types.
In the process of implementing step S103 specifically, a data table corresponding to the type in the database is determined by using the packet type of the packet to be processed, and the packet data of the packet to be processed is stored in the data table.
It should be noted that the database may be an Oracle database, and the type of the database is not specifically limited in the embodiment of the present invention.
In the embodiment of the invention, the message to be processed is continuously read from the message queue, the message to be processed is analyzed by using the civil aviation luggage message data standard to obtain the message type and the message data of the message to be processed, and the message data is stored in a data table corresponding to the message type in the database. Based on the civil aviation luggage message data specification, a uniform luggage message data analysis standard is provided, so that the processed luggage message data can be shared among all units, and the service quality and the service efficiency can be improved by using the luggage message data.
In the above-mentioned process of analyzing a message to be processed related to step S102 in fig. 1 of the present invention, a format of the message to be processed is a string format, and referring to fig. 2, a flowchart for analyzing the message to be processed provided in the embodiment of the present invention is shown, which includes the following steps:
step S201: and reading the first n-bit characters corresponding to the message to be processed.
It should be noted that n is a positive integer, the format of the message to be processed is a character string format, and the characters in the message to be processed indicate information corresponding to the message to be processed, where the first n-bit characters in the message to be processed are used to indicate the message type of the message to be processed.
For example: the first 3-bit character in the message to be processed is used for indicating the message type of the message to be processed.
Step S202: and determining the message type of the message to be processed indicated by the front n-bit character according to the data interaction specification of the civil aviation luggage message.
In the process of implementing step S202 specifically, the message type of the to-be-processed message indicated by the first n-bit character in the to-be-processed message is determined by using the civil aviation baggage message data interaction specification.
For example: and judging the message type of the message to be processed indicated by the first 3-bit character in the message to be processed by utilizing the interaction specification of the civil aviation luggage message data, wherein if the message type indicated by the first 3-bit character is BSM, the message to be processed is BSM, if the message type indicated by the first 3-bit character is BPM, the message to be processed is BPM, and if the message type indicated by the first 3-bit character is BMM, the message to be processed is BMM.
Step S203: and analyzing other characters corresponding to the message to be processed according to the data interaction specification of the civil aviation luggage message to obtain a plurality of data items corresponding to the message to be processed.
In the process of implementing step S203 specifically, according to the data items included in different types of messages specified in the civil aviation baggage message data interaction specification and the content definition in each data item, the other characters of the message to be processed are segmented and matched, and a plurality of data items corresponding to the message to be processed and the message data included in each data item are obtained through analysis.
It is understood that the other characters of the message to be processed referred to above are: characters except the first n-bit characters of the message to be processed.
Step S204: and acquiring message data contained in each data item in the message to be processed.
It should be noted that, when the message data included in each data item in the message to be processed is acquired, a situation that the format of the message data included in a certain data item is incorrect may occur.
In the process of implementing step S204 specifically, for each data item in the message to be processed, if the format of the message data included in the data item meets the requirement of the preset format, the message data included in the data item is acquired. And if the message data contained in the data item does not meet the preset format requirement, the message data contained in the data item is not acquired, namely the data item containing the message data with the wrong format is skipped over, and the following characters are continuously analyzed.
It can be understood that, in the process of analyzing the baggage message, if the format of the baggage message is wrong, the baggage message is not discarded, and the baggage message is continuously analyzed in the above manner.
Through the content of each step, the problem that each unit only analyzes and stores some data items or partial content of some data items according to respective business requirements is avoided, and therefore the defect that the content cannot be acquired when other units need the content of the data items which are not stored in one unit is avoided.
In the embodiment of the invention, the front n-bit character of the message to be processed is analyzed to determine the message type of the message to be processed by utilizing the interaction standard of the luggage message data of civil aviation, and other characters of the message to be processed are analyzed to obtain the message data of the message to be processed. Unified analysis standards of the luggage message data are provided through the civil aviation luggage message data specification, so that the processed luggage message data can be mutually shared among all units, and the service quality and the service efficiency can be improved by using the luggage message data.
In the above-described embodiment of the present invention, referring to fig. 3, a process of storing message data into a data table in step S103 in fig. 1 shows a flowchart of storing message data into a data table according to an embodiment of the present invention, which includes the following steps:
step S301: and determining a data table corresponding to the message type in the database.
It should be noted that, according to different message types, a data table corresponding to each message type is created in the database, and a field (also referred to as a content field) of each data item is defined in the data table corresponding to each message type, that is, the data table includes a field corresponding to each data item.
In the process of implementing step S301 specifically, according to the packet type of the packet to be processed, a data table corresponding to the packet type in the database is determined.
Step S302: and storing the message data contained in the data item into a field corresponding to the data item in the data table for each data item in the message to be processed.
As can be seen from the foregoing, the fields of the data items are predefined, and the message data included in each data item in the message to be processed is obtained.
It can be understood that the fields of the data items are predefined, and when the message data included in each data item is obtained, all the fields included in each data item are analyzed according to the civil aviation luggage message data interaction specification, so that the message content field corresponding to each data item is obtained.
As can be seen from the foregoing, in the process of analyzing the baggage message, if the format of the baggage message is incorrect, the baggage message is not discarded, and the baggage message is continuously analyzed.
In the process of implementing step S302 specifically, for each data item in the message to be processed, the message content field corresponding to the data item is stored in the field corresponding to the data item in the data table, if the format of the message data included in the data item meets the preset format requirement, the message data included in the data item is stored in the field corresponding to the data item in the data table, and if the message data included in the data item does not meet the preset format requirement, the field corresponding to the data item in the data table is stored with a null value.
In the embodiment of the invention, the source tracing of the message data which does not meet the requirement of the preset format can be realized, so that a wrong message source unit can be updated and adjusted in time, and the report accuracy of the luggage message is improved.
To better explain the contents of fig. 1 to fig. 3 in the above embodiments of the present invention, the contents of fig. 1 to fig. 3 in the above embodiments of the present invention are illustrated by taking a BSM message of baggage consigned by a local shoplifter airport as an example, and refer to processes a1 to A3.
The BSM message content is as follows:
BSM
.V/1LHRB
.F/XX1640/08APR/PEK/Y
.N/3666149457002
.S/Y/34L/C/017/Y
.W/K/2/30
.P/1AIJIAMEI
ENDBSM
a1, a piece of luggage locally consigned at the Harbin airport, generates a BSM message as shown above, and the local departure system of the airport sends the BSM message to the message queue through the communication departure message channel.
A2, after obtaining the BSM message in the character string format in the message queue, circularly traversing the character string of the BSM message. And judging the type of the BSM message to be BSM according to the data interaction specification of the civil aviation luggage message and the first 3-bit characters of the BSM message.
A3, traversing contents contained in each data item of V, F, N, S, W and P in the BSM message in sequence according to meanings and formats of each data item defined in the interaction specification of the luggage message data of civil aviation, completing analysis of the BSM message after the message ending identification of EDNBSM is matched in a circulating traversal manner, obtaining message data of the BSM message, and storing the message data of the BSM message into a data table corresponding to the BSM type.
In the process of executing the process A3, according to the V data item format in the civil aviation baggage message data interaction specification, the BSM message can be analyzed to obtain the V/1L HRB, that is, the BSM message has the data dictionary version number of 1 and is a message from the local hardback airport (HRB), according to the V data item format, the V/data dictionary version number, the baggage source identifier, the source airport code, the PartNumber, the related information number, the confirmation request (a)/the encryption information.
Similarly, according to the F data item format: F/XX1640/08APR/PEK/Y, namely, the BSM message is a consignment message of a Y-cabin passenger with the flight number XX1640 flying from Harbin airport (HRB) to Beijing capital airport (PEK) in 8 months and 8 days.
According to the N data item format: n/baggage type identification (1 digit) + airline digital three-character code (3 digits) + baggage tag number (6 digits) + number of consecutive baggage (3 digits), BSM message may be parsed to obtain N/3666149457002, i.e., the BSM message indicates that the traveler has shipped 2 pieces of baggage, with baggage number 3666149457.
According to the S data item format, S/whether the loading/seat number/passenger state/boarding number/security check number/passenger data state/transportable/luggage state can be obtained by analyzing the BSM message, namely the BSM message indicates that the luggage can be loaded and transported, the passenger state is boarding, the seat number is 34L, and the registration number is 017.
According to the W data item format: w/piece count weight identification/number of bags/weight of bags/unit of size (CM/IN)/length/width/height/type of bags code + extrinsic signature, the BSM message can be parsed to obtain W/K/2/30, i.e., the BSM message indicates that the passenger has shipped 2 bags weighing 30 kg.
According to the P data item format: p/1AIJIAMEI, i.e., the BSM message indicates a passenger with a first last name AIJIAMEI.
It should be noted that the above processes a1 to A3 are shown for illustration only.
To better explain the contents of fig. 1 to fig. 3 in the above-mentioned embodiments of the present invention, fig. 4 is used for illustration, and it should be noted that fig. 4 is used for illustration only.
Referring to fig. 4, another flowchart of a data processing method provided by an embodiment of the present invention is shown, where the data processing method includes the following steps:
step S401: and acquiring the message to be processed from the message queue.
Step S402: and judging the message type of the message to be processed according to the data interaction specification of the civil aviation luggage message, if the message type is BSM, executing the step S403, and if the message type is BPM, executing the step S405.
Step S403: and analyzing the message to be processed to obtain message data according to the interaction standard of the luggage message data of civil aviation.
Step S404: and storing the message data into a passenger information table in a database.
Step S405: and analyzing the message to be processed to obtain message data according to the interaction standard of the luggage message data of civil aviation.
Step S406: and storing the message data into a luggage processing node table in a database.
It should be noted that the execution principle of steps S401 to S406 can refer to the content in fig. 1 to fig. 3 of the above embodiments of the present invention, and will not be described again here.
In the embodiment of the invention, the message to be processed is continuously read from the message queue, the message to be processed is analyzed by using the civil aviation luggage message data standard to obtain the message type and the message data of the message to be processed, and the message data is stored in a data table corresponding to the message type in the database. Based on the civil aviation luggage message data specification, a uniform luggage message data analysis standard is provided, so that the processed luggage message data can be shared among all units, and the service quality and the service efficiency can be improved by using the luggage message data.
Corresponding to the data processing method provided by the embodiment of the present invention, referring to fig. 5, an embodiment of the present invention further provides a structural block diagram of a data processing system, where the data processing system includes: a message analysis processing module 501 and a data storage module 502;
the message analyzing and processing module 501 is configured to obtain a to-be-processed message in the message queue, and analyze the to-be-processed message according to the civil aviation luggage message data interaction specification to obtain a message type and message data of the to-be-processed message.
The data storage module 502 is configured to determine a data table corresponding to a packet type in a database, and store packet data in the data table, where the database at least includes pre-created data tables corresponding to different packet types.
In the embodiment of the invention, the message to be processed is continuously read from the message queue, the message to be processed is analyzed by using the civil aviation luggage message data standard to obtain the message type and the message data of the message to be processed, and the message data is stored in a data table corresponding to the message type in the database. Based on the civil aviation luggage message data specification, a uniform luggage message data analysis standard is provided, so that the processed luggage message data can be shared among all units, and the service quality and the service efficiency can be improved by using the luggage message data.
Preferably, in combination with the content shown in fig. 5, the format of the message to be processed is a character string format, and the message parsing and processing module 501 includes: the device comprises a reading unit, a determining unit, an analyzing unit and an acquiring unit, wherein the execution principle of each unit is as follows:
and the reading unit is used for reading the first n-bit character corresponding to the message to be processed, wherein n is a positive integer.
And the determining unit is used for determining the message type of the message to be processed indicated by the front n-bit character according to the civil aviation luggage message data interaction specification.
And the analysis unit is used for analyzing other characters corresponding to the message to be processed according to the data interaction specification of the civil aviation luggage message to obtain a plurality of data items corresponding to the message to be processed.
And the acquisition unit is used for acquiring the message data contained in each data item in the message to be processed.
In a specific implementation, the obtaining unit is specifically configured to: and for each data item in the message to be processed, if the format of the message data contained in the data item meets the requirement of a preset format, obtaining the message data contained in the data item, and if the message data contained in the data item does not meet the requirement of the preset format, not obtaining the message data contained in the data item.
In the embodiment of the invention, the front n-bit character of the message to be processed is analyzed to determine the message type of the message to be processed by utilizing the interaction standard of the luggage message data of civil aviation, and other characters of the message to be processed are analyzed to obtain the message data of the message to be processed. Unified analysis standards of the luggage message data are provided through the civil aviation luggage message data specification, so that the processed luggage message data can be mutually shared among all units, and the service quality and the service efficiency can be improved by using the luggage message data.
Preferably, in connection with the illustration of fig. 5, the data storage module 502 includes: determining units and storage units, wherein the execution principle of each unit is as follows:
and the determining unit is used for determining a data table corresponding to the message type in the database, and the data table comprises a field corresponding to each data item.
And the storage unit is used for storing the message data contained in the data item into a field corresponding to the data item in the data table for each data item in the message to be processed.
In a specific implementation, the storage unit is specifically configured to: and if the format of the message data contained in the data item meets the preset format requirement, storing the message data contained in the data item into a field corresponding to the data item in the data table, and if the format of the message data contained in the data item does not meet the preset format requirement, storing a null value in the field corresponding to the data item in the data table.
In the embodiment of the invention, the source tracing of the message data which does not meet the requirement of the preset format can be realized, so that a wrong message source unit can be updated and adjusted in time, and the report accuracy of the luggage message is improved.
Preferably, in conjunction with the description shown in fig. 5, the data processing system further includes:
and the message access engine is used for creating a first sub message queue, a second sub message queue and a third sub message queue corresponding to the message queues, and respectively receiving a luggage source message, a luggage processing message and a luggage loading message by using the first sub message queue, the second sub message queue and the third sub message queue.
To sum up, the embodiments of the present invention provide a data processing method and system, where the method includes: acquiring a message to be processed in a message queue; analyzing the message to be processed according to the interaction standard of the luggage message data of the civil aviation to obtain the message type and the message data of the message to be processed; and determining a data table corresponding to the message type in the database, and storing the message data into the data table. According to the scheme, the message to be processed is obtained from the message queue, the message to be processed is analyzed according to the civil aviation luggage message data standard, the message type and the message data of the message to be processed are obtained, and the message data obtained by analyzing the message to be processed is stored in the database. Based on the civil aviation luggage message data specification, a uniform luggage message data analysis standard is provided, so that the processed luggage message data can be shared among all units, and the service quality and the service efficiency can be improved by using the luggage message data.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system or system embodiments are substantially similar to the method embodiments and therefore are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described system and system embodiments are only illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method of data processing, the method comprising:
acquiring a message to be processed in a message queue;
analyzing the message to be processed according to the interaction standard of the civil aviation luggage message data to obtain the message type and the message data of the message to be processed;
and determining a data table corresponding to the message type in a database, and storing the message data into the data table, wherein the database at least comprises pre-created data tables corresponding to different message types.
2. The method according to claim 1, wherein the format of the message to be processed is a character string format, and the parsing the message to be processed according to the civil aviation baggage message data interaction specification to obtain the message type and the message data of the message to be processed comprises:
reading a first n-bit character corresponding to the message to be processed, wherein n is a positive integer;
determining the message type of the message to be processed indicated by the first n-bit character according to the data interaction specification of the civil aviation luggage message;
analyzing other characters corresponding to the message to be processed according to the data interaction specification of the civil aviation luggage message to obtain a plurality of data items corresponding to the message to be processed;
and acquiring message data contained in each data item in the message to be processed.
3. The method of claim 2, wherein the determining a data table in a database corresponding to the packet type and storing the packet data in the data table comprises:
determining a data table corresponding to the message type in a database, wherein the data table comprises a field corresponding to each data item;
and for each data item in the to-be-processed message, storing the message data contained in the data item into a field corresponding to the data item in the data table.
4. The method according to claim 2, wherein the obtaining the packet data included in each data item in the packet to be processed comprises:
for each data item in the message to be processed, if the format of the message data contained in the data item meets the requirement of a preset format, obtaining the message data contained in the data item;
and if the message data contained in the data item does not meet the preset format requirement, not acquiring the message data contained in the data item.
5. The method according to claim 3, wherein the storing the message data included in the data item into a field corresponding to the data item in the data table comprises:
if the format of the message data contained in the data item meets the preset format requirement, storing the message data contained in the data item into a field corresponding to the data item in the data table;
and if the message data contained in the data item does not meet the preset format requirement, storing a null value in a field corresponding to the data item in the data table.
6. The method according to any one of claims 1 to 5, wherein before acquiring the message to be processed in the message queue, the method further comprises:
creating a first sub message queue, a second sub message queue and a third sub message queue corresponding to the message queue;
and respectively receiving a luggage source message, a luggage processing message and a luggage loading message by utilizing the first sub message queue, the second sub message queue and the third sub message queue.
7. A data processing system, characterized in that the system comprises:
the message analysis processing module is used for acquiring a message to be processed in a message queue, analyzing the message to be processed according to the civil aviation luggage message data interaction standard, and obtaining the message type and the message data of the message to be processed;
and the data storage module is used for determining a data table corresponding to the message type in a database and storing the message data into the data table, wherein the database at least comprises pre-created data tables corresponding to different message types.
8. The system according to claim 7, wherein the format of the message to be processed is a character string format, and the message parsing and processing module comprises:
a reading unit, configured to read a first n-bit character corresponding to the packet to be processed, where n is a positive integer;
the determining unit is used for determining the message type of the message to be processed indicated by the front n-bit character according to the data interaction specification of the civil aviation luggage message;
the analysis unit is used for analyzing other characters corresponding to the message to be processed according to the data interaction specification of the civil aviation luggage message to obtain a plurality of data items corresponding to the message to be processed;
and the acquisition unit is used for acquiring message data contained in each data item in the message to be processed.
9. The system of claim 8, wherein the data storage module comprises:
the determining unit is used for determining a data table corresponding to the message type in a database, and the data table comprises a field corresponding to each data item;
and the storage unit is used for storing the message data contained in the data item into a field corresponding to the data item in the data table aiming at each data item in the message to be processed.
10. The system of claim 8, further comprising:
and the message access engine is used for creating a first sub message queue, a second sub message queue and a third sub message queue corresponding to the message queues, and respectively receiving a luggage source message, a luggage processing message and a luggage loading message by using the first sub message queue, the second sub message queue and the third sub message queue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010263905.3A CN111478900A (en) | 2020-04-07 | 2020-04-07 | Data processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010263905.3A CN111478900A (en) | 2020-04-07 | 2020-04-07 | Data processing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111478900A true CN111478900A (en) | 2020-07-31 |
Family
ID=71749968
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010263905.3A Pending CN111478900A (en) | 2020-04-07 | 2020-04-07 | Data processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111478900A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113721577A (en) * | 2021-11-02 | 2021-11-30 | 西安热工研究院有限公司 | Data interaction method and system, equipment and storage medium for multitask cycle |
| CN113852635A (en) * | 2021-09-26 | 2021-12-28 | 招商银行股份有限公司 | Task processing method and device, terminal equipment and storage medium |
| CN114710422A (en) * | 2022-04-02 | 2022-07-05 | 中国民航信息网络股份有限公司 | Luggage message format checking method and related device |
| CN115118686A (en) * | 2022-06-23 | 2022-09-27 | 中国民航信息网络股份有限公司 | System, method, equipment, medium and product for processing passenger message |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015169604A1 (en) * | 2014-05-08 | 2015-11-12 | Fraport Ag Frankfurt Airport Services Worldwide | Method and device arrangement for registering luggage |
| CN107403018A (en) * | 2017-08-10 | 2017-11-28 | 中国民航信息网络股份有限公司 | The processing method and processing device of flight data and passenger data |
| CN108074061A (en) * | 2016-11-17 | 2018-05-25 | 上海民航华东凯亚***集成有限公司 | Luggage tracking and system |
| CN110599093A (en) * | 2019-09-09 | 2019-12-20 | 覃文明 | Airport luggage full-flow tracking method and system |
-
2020
- 2020-04-07 CN CN202010263905.3A patent/CN111478900A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015169604A1 (en) * | 2014-05-08 | 2015-11-12 | Fraport Ag Frankfurt Airport Services Worldwide | Method and device arrangement for registering luggage |
| CN108074061A (en) * | 2016-11-17 | 2018-05-25 | 上海民航华东凯亚***集成有限公司 | Luggage tracking and system |
| CN107403018A (en) * | 2017-08-10 | 2017-11-28 | 中国民航信息网络股份有限公司 | The processing method and processing device of flight data and passenger data |
| CN110599093A (en) * | 2019-09-09 | 2019-12-20 | 覃文明 | Airport luggage full-flow tracking method and system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113852635A (en) * | 2021-09-26 | 2021-12-28 | 招商银行股份有限公司 | Task processing method and device, terminal equipment and storage medium |
| CN113852635B (en) * | 2021-09-26 | 2024-05-28 | 招商银行股份有限公司 | Task processing method, device, terminal equipment and storage medium |
| CN113721577A (en) * | 2021-11-02 | 2021-11-30 | 西安热工研究院有限公司 | Data interaction method and system, equipment and storage medium for multitask cycle |
| CN114710422A (en) * | 2022-04-02 | 2022-07-05 | 中国民航信息网络股份有限公司 | Luggage message format checking method and related device |
| CN115118686A (en) * | 2022-06-23 | 2022-09-27 | 中国民航信息网络股份有限公司 | System, method, equipment, medium and product for processing passenger message |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111478900A (en) | Data processing method and system | |
| US20190378225A1 (en) | Federated System for Centralized Management and Distribution of Content Media | |
| CN111506614B (en) | Method and device for identifying civil aviation transfer baggage and storage medium | |
| US20110267192A1 (en) | Individualized Baggage Tracking And Notification System | |
| US20090015398A1 (en) | System and method of providing location information of checked baggage | |
| CN110322233B (en) | Method and system for prohibiting ticket sales based on flight cancellation message | |
| US20220227500A1 (en) | Managed connecting service for mass transit baggage | |
| US20230336553A1 (en) | System, device and method for providing passenger or user information | |
| US20200387861A1 (en) | Article tracking system and method | |
| US20220292273A1 (en) | Article handling system and method | |
| WO2013078897A1 (en) | Packet decoding method and device for aircraft communication addressing and reporting system | |
| CN106936689A (en) | Customer service method and apparatus based on instant messaging public number | |
| US20120213354A1 (en) | Method and system for partitioning data files for efficient processing | |
| CN111461270B (en) | Processing system and method for fast running plums | |
| AU2013211481B2 (en) | Smart parsing of data | |
| CN111510440B (en) | Data exchange method and system | |
| US10360084B1 (en) | System and methods for logging and searching history events such as airline flight or crew history | |
| CN111461613A (en) | Method and device for luggage tracking | |
| US20210264445A1 (en) | System, device and method for token generation and use | |
| CN113312420B (en) | Flight data processing method, device, equipment and storage medium | |
| US20150049351A1 (en) | Formatting data | |
| CN114710422A (en) | Luggage message format checking method and related device | |
| CN118013984A (en) | Method and device for analyzing international freight rate rule data | |
| CN118036596A (en) | Travel state identification method, system, equipment and readable storage medium | |
| CN115344591A (en) | Luggage message correction forwarding method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200731 |