CN107169854A - A kind of method and device of data processing - Google Patents
A kind of method and device of data processing Download PDFInfo
- Publication number
- CN107169854A CN107169854A CN201610128412.2A CN201610128412A CN107169854A CN 107169854 A CN107169854 A CN 107169854A CN 201610128412 A CN201610128412 A CN 201610128412A CN 107169854 A CN107169854 A CN 107169854A
- Authority
- CN
- China
- Prior art keywords
- source file
- data flow
- file data
- data
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Finance (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Technology Law (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the present application discloses a kind of method and device of data processing.This method includes：Receive source file data flow；The source file data flow is inputted into main memory access, the source file data flow is handled using data processing model corresponding with the source file data flow in main memory access, obtain file destination data flow, the main memory access includes at least one data processing model, and the data processing model is the model set up according to the predetermined mapping ruler between the content of source file data flow and the content of file destination data flow.The method of the data processing provided using the embodiment of the present application, when receiving source file data flow, without the storage of database, it will directly be handled in the source file data input internal memory, the time that database is wasted in read-write data has been saved, the efficiency of server process source file data is improved.
Description
Technical field
The application is related to technical field of data processing, more particularly to a kind of method and device of data processing.
Background technology
At present, data processing technique occupies important position in Internet technical field, and with data class
With the continuous increase of quantity, Internet technology is for the selection of data source, the classification of data and the processing of data
Requirement in terms of speed is also improved constantly.
Prior art is typically for the method for data processing：First, first server receives second server
The source file data of transmission, then, first server are periodically parsed to the source file data, and are led to
The read-write capability for crossing database writes the source file data after parsing in the database, i.e.,：After parsing
Source file data are stored, finally, and first server is handled the source file data in internal memory,
Obtain file destination data.
Although above-mentioned prior art can cause user to be effectively obtained file destination data, in some realities
, it is necessary to which server is handled source file data in real time in the application scenarios of border, and prior art is in processing
During data, first source file data are stored by the read-write capability of database, it is therefore desirable to expend phase
To longer time, the efficiency of server process data is have impact on, i.e.,：Using prior art processing data
Method is unable to reach the effect of real-time processing data.
The content of the invention
In view of the above problems, the embodiment of the present application provides a kind of method of data processing, for solving existing skill
Art in processing data, due to database needs to preserve data and the problem of lead to not processing data in real time.
A kind of method of data processing, this method includes：
Receive source file data flow；
By the source file data flow input main memory access, using in main memory access with the source file data flow
Corresponding data processing model is handled the source file data flow, obtains file destination data flow, institute
State main memory access and include at least one data processing model, the data processing model is according to source file data
The model that predetermined mapping ruler between the content of stream and the content of file destination data flow is set up.
Preferably, before source file data flow is received, methods described also includes：
Monitor whether source file data flow reaches, if it has been reached, receiving the source file data flow；Such as
Fruit is not reached, and continuation is monitored source file data flow.
Preferably, the predetermined mapping ruler includes：
Obtain default source file data flow and file destination data flow；
Using the default source file data flow as the input in data processing model, and will be described default
File destination data flow is trained to the data processing model, obtained as the output of data processing model
To the data processing model.
Preferably, the reception source file data flow includes：
Receive the source file data flow that given server is sent in configuration file.
Preferably, after file destination data flow is obtained, methods described also includes：
The source file data flow and/or file destination data flow are stored.
Preferably, the source file data flow is the data flow of binary coded form.
A kind of exchange quotation method, this method includes：
Third-party payment platform server is received from the financial system that the Third-party payment platform is connected
Exchange quotation source file stream；
The exchange quotation source file stream is input to main memory access by Third-party payment platform server, using interior
Data processing model corresponding with the exchange quotation source file stream is deposited in passage to the exchange quotation source document
Part stream is handled, and obtains target exchange quotation file stream, the main memory access is comprising at least one data
Model is managed, the data processing model is the content and target exchange quotation text according to exchange quotation source file stream
The model that predetermined mapping ruler between the content of part stream is set up.
A kind of device of data processing, the device includes：
Receiving unit and processing unit, wherein：
The receiving unit, for receiving source file data flow；
The processing unit, for the source file data flow to be inputted into main memory access, using in main memory access
Data processing model corresponding with the source file data flow is handled the source file data flow, is obtained
File destination data flow, the main memory access includes at least one data processing model, the data processing mould
Type is according to the predetermined mapping ruler between the content of source file data flow and the content of file destination data flow
The model of foundation.
Preferably, described device also includes monitoring unit, and the monitoring unit is used for：
Monitor whether source file data flow reaches, if it has been reached, receiving the source file data flow；Such as
Fruit is not reached, and continuation is monitored source file data flow.
Preferably, the receiving unit specifically for：
Receive the source file data flow that given server is sent in configuration file.
Preferably, described device includes memory cell, and the memory cell is used for：
The source file data flow and/or file destination data flow are stored.
The source file data flow is inputted main memory access by the embodiment of the present application by receiving source file data flow,
And using data processing model corresponding with the source file data flow in main memory access to the source file data flow
Handled, obtain file destination data flow；Here main memory access includes at least one data processing model,
And the data processing model is according between the content of source file data flow and the content of file destination data flow
Predetermined mapping ruler set up model.The beneficial effect obtained using the embodiment of the present application is：Compared to
Prior art obtain file destination data method, the embodiment of the present application after source file data flow is received,
Directly the source file data flow is handled in internal memory, it is to avoid prior art before processing data,
The step of data input to database need to being stored, improves the efficiency of server process data.
Brief description of the drawings
Accompanying drawing described herein is used for providing further understanding of the present application, constitutes the part of the application,
The schematic description and description of the application is used to explain the application, does not constitute the improper limit to the application
It is fixed.In the accompanying drawings：
Fig. 1 is a kind of schematic flow sheet of the method for data processing that the embodiment of the present application 1 is provided；
Fig. 2 is a kind of schematic diagram of the method for data processing that the embodiment of the present application 1 is provided；
Fig. 3 is a kind of schematic flow sheet of the method for data processing that the embodiment of the present application 1 is provided；
Fig. 4 is a kind of schematic flow sheet for exchange quotation method that the embodiment of the present application 2 is provided；
Fig. 5 is a kind of structural representation of the device for data processing that the embodiment of the present application 3 is provided.
Embodiment
In the introduction it has been noted that in current many Internet, applications scenes, it will usually use number
First source file data are stored according to the read-write capability in storehouse, after storage, then to the source document number of packages in internal memory
According to being handled, so as to obtain file destination data；Because database is present in hard disk, using
When the read-write capability of database is to source file data storage, the relatively long time can be consumed.And in reality
In many application scenarios, it is desirable to which data are handled in real time, for example, being performed in Third-party payment platform
During exchange quotation, it is desirable to which Third-party payment platform carries out exchange quotation to user in real time as far as possible, at this moment the
Tripartite's payment platform is needed after the exchange rate file that bank or other financial institutions send is received, right in real time
Exchange rate data in exchange rate file is handled；And prior art is when to source file data processing, server
In database first the source file data of reception are stored, therefore can not accomplish to handle source document in real time
Number of packages evidence.The embodiment of the present application is in view of the above-mentioned problems, there is provided a kind of method and device of data processing, use
Source file data are handled in real time in the server for implementing processing source file data.
It is specifically real below in conjunction with the application to make the purpose, technical scheme and advantage of the application clearer
Apply example and technical scheme is clearly and completely described corresponding accompanying drawing.Obviously, it is described
Embodiment is only some embodiments of the present application, rather than whole embodiments.Based on the implementation in the application
Example, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example, belongs to the scope of the application protection.
Below in conjunction with accompanying drawing, the technical scheme that each embodiment of the application is provided is described in detail.
Embodiment 1
A kind of method for data processing that the embodiment of the present application is provided, this method is used to improve server process source
The efficiency of file data.The idiographic flow schematic diagram of this method as shown in figure 1, this method specifically include it is following
Step：
Step 101：Receive source file data flow.
In this step, first server receives the source file data flow that second server is sent, for example, the 3rd
Square payment platform perform exchange quotation when, the corresponding server of Third-party payment platform first receive bank or
The exchange rate document data flow that other financial institution servers are sent, then further according to preset rules to exchange rate text
The data of part are handled, and finally obtain the data for exchange quotation.
Alternatively, first server is before the source file data flow that second server is sent is received, the first clothes
Business device can open message monitor function, specifically, when the source file data for listening to second server transmission
In have arrived at, then first server receives the source file data flow, if listening to source file data does not have
Reach, then continue on monitor function.
First server open message monitor function purpose be：First server can be received in time
The source file data flow that second server is sent, and after the source file data flow is received, timely to this
Source file data flow is handled, and improves the efficiency of first server processing data.
It should be noted that in " first server " and " second server " that the embodiment of the present application is recorded
" first " and " second " without particular meaning, it is only for distinguish different servers.
First server receives the source file data flow that second server is sent, the source document in the embodiment of the present application
Part data flow can use binary coding or other coding forms.
Specifically, first server is before the source file data flow that second server is sent is received, and this second
Server by source file data conversion into binary coding or the data flow of other coding forms, and the first clothes
Business device and second server need to arrange the compiling form of source file data flow, i.e.,：Second server needs to press
Data format as agreed writes source file data flow, so, and first server is receiving the source document number of packages
During according to stream, more accurately, rapidly the source file data could be parsed.
In addition, first server is when receiving the source file data that second server is sent, generally for guarantee
The security of data transfer, only receives the source file data that given server is sent.
Alternatively, first server is before the source file data that second server is sent are received, first service
Device needs to be arranged between second server, specifically can behave as：Configuration file in first server
In, the identification information containing second server similarly, in the configuration file in second server, contains
The identity of one server.
Specifically, when receiving the source file data that a certain server is sent in first server, according to this
The identification information of server, it is the mark letter of corresponding second server in configuration file to find the identification information
Breath, then first server receives the source file data.
Specifically, when receiving the source file data that a certain server is sent in first server, according to this
The mark information of server, it is not the mark letter of corresponding second server in configuration file to find the identification information
Breath, then first server rejects the exchange rate file, or first server is rejecting exchange rate text
While part, protected mode is opened, it is therefore an objective to prevent hacker or other servers etc. from illegally obtaining the source file
Data flow, or illegal operation is carried out to first server.
Step 102：By the source file data flow input main memory access, using in main memory access with the source
The corresponding data processing model of document data flow is handled the source file data flow, obtains file destination
Data flow.
The main memory access includes at least one data processing model, and the data processing model is according to source document
The model that predetermined mapping ruler between the content of part data flow and the content of file destination data flow is set up.
Data processing model in this step is the content and file destination data flow according to source file data flow
Content between default mapping ruler set up model.
Alternatively, above-mentioned default mapping ruler can be：First, default source file data flow and phase are obtained
The target data stream answered, then, using the default source file data flow as data processing model input number
According to, and using the default file destination data flow as data processing model output data, to the data mould
Type is trained, and finally obtains the data processing model.For example：The content of default source file data flow is
" a=20 ", the content of default target data stream is " b=15 ", then corresponding data processing model can be with
It is " b=a-5 "；Merely just exemplary explanation obtains the process of data processing model, is obtained actual
During model, the default source file data flow and target data stream for training pattern are more complicated, phase
Ying Di, the process of training pattern also can be more complicated.
And the quantity of the data processing model in the first server in this step is one or more, such as scheme
2 first servers for showing the embodiment of the present application offer handle the schematic diagram of source file data flow, wherein,
It is at data to have many data processing model, i.e. A1, A2 ... An in the internal memory of the first server
Manage model.
After the source file data flow that first server receives second server transmission, first server should
Source file data flow is input in the main memory access in first server, and according to the source file data flow, choosing
Select data processing model corresponding with the source file data flow.
It is alternatively possible to according to the corresponding business information of source file data flow, select corresponding data processing mould
Type, if for example, the source file data flow is the exchange rate data stream for " outlet ", can select pre-
If the exchange rate for " outlet " handle model, if the source file data flow is the remittance for " import "
Rate data flow, then can select the default exchange rate for " import " to handle model.
It is alternatively possible to according to the corresponding concrete numerical value of source traffic, corresponding data processing model is selected,
For example, this source file data flow received of first server is " a=20 ", if last time server
It is " b=15 " to calculate the file destination data flow obtained, and by calculating acquisition, this is received the first server
To source file data than the file destination data of last time add 5, it is assumed that regulation is when the source document of this reception
Number of packages according to scope more increased than file destination data for " when 0~5 ", the model of processing data is " b=b+0.3a ",
Then this file destination data obtained is " b=b+0.3a=15+0.3 × 20=21 ".
Above-mentioned source file data content, file destination data content and data processing model are exemplary say
Bright, in actual applications, source file data content, file destination data content can be more complicated, accordingly
Data processing model also can be more complicated, here not to source file data content, file destination data
Content and data processing model constitute specific limit.
Alternatively, after first server obtains file destination data flow, target data stream can be deposited
Storage, can also be stored the source file data flow of acquisition.Compared with prior art, the embodiment of the present application
After first server obtains target data, just source file data flow and file destination data flow are deposited
Storage, so both stores data, and the efficiency that first server handles source file data is improved again.
For more clear explanation the embodiment of the present application, below the complete number provided the embodiment of the present application
Illustrated according to the method for processing, specific workflow is as shown in Figure 3：
Step S301：Source file data flow is received, specifically, first server receives second server and sent
Source file data flow.
Step S302：Message pickup feature is opened, i.e.,：First server is monitored the message of reception.
Step S303：New information is determined whether, i.e., first server is received according to step S302
Message is monitored, if the source file data flow for listening to second server transmission is not reached, is performed
Step S304：Continue on message monitor function；If listening to the source file data of second server transmission
When stream is reached, then step S305 is performed：Data processing model is performed, i.e.,：Source file to receiving immediately
Stream is received to be handled.
Step S306：Obtain target resource data.
The source file data flow is inputted main memory access by the embodiment of the present application by receiving source file data flow,
And using data processing model corresponding with the source file data flow in main memory access to the source file data flow
Handled, obtain file destination data flow；Here main memory access includes at least one data processing model,
And the data processing model is according between the content of source file data flow and the content of file destination data flow
Predetermined mapping ruler set up model.The beneficial effect obtained using the embodiment of the present application is：Compared to existing
There is the method for technical limit spacing file destination data, the embodiment of the present application is after source file data flow is received, directly
It is connected in internal memory the source file data flow is handled, it is to avoid prior art is needed before processing data
The step of data input is stored into database, i.e.,：The time of data base read-write data is eliminated,
Improve the efficiency of server process data.
Embodiment 2
Embodiment 1 provides a kind of method of data processing, and based on identical inventive concept, embodiment 3 is carried
A kind of exchange quotation method has been supplied, exchange quotation is carried out specifically for Third-party payment platform.
For clearer explanation application embodiment, it is necessary to first to Third-party payment platform and prior art
The method of Third-party payment platform exchange quotation is illustrated, specific as follows：
At present when user carries out related consumer in online major application platforms, generally first dealing money is paid
To Third-party payment platform, until user receives tradable commodity or completes other related consumers, first the 3rd
Confirmed on square payment platform, Third-party payment platform just turns dealing money to pay corresponding transaction merchant.
During user is traded using Third-party payment platform, the circulation of foreign currency is had sometimes, is
The accuracy merchandised between user is ensured, Third-party payment platform needs to perform exchange quotation.Prior art
Middle Third-party payment platform performs the usual step of exchange quotation：The first step：The clothes of Third-party payment platform
Business device receives exchange quotation source file, remittance here from the financial system that the Third-party payment platform is connected
Rate quotation source file can be growth or the fall for certain foreign exchange rate, or directly be current time
Exchange rate of certain foreign currency etc.；Second step：The Third-party payment platform is by the exchange quotation source file in database
Stored, wherein, the exchange quotation source file is write into database by the read-write capability in main maintenance data storehouse
In；3rd step：After the exchange quotation source file is stored, then to the exchange quotation source in main memory access
Data in file are handled, so as to obtain the data of exchange quotation.
Prior art Third-party payment platform performs between exchange quotation can ensure user and carries out Foreign Currency Transaction
When accuracy, but processing exchange quotation source file in data before, need the read-write work(in maintenance data storehouse
The exchange quotation source file can be stored, usual database to file when being written and read, each step
Need to consume the relatively long time, therefore can not be accomplished in real time using prior art Third-party payment platform
Perform exchange quotation.
The method for Third-party payment platform exchange quotation that the embodiment of the present application is provided is carried out below detailed
Describe in detail bright, this method is treated specifically for the server of Third-party payment platform in the internal memory of the server
The exchange rate data of processing is handled, and obtains the data of exchange quotation.The idiographic flow schematic diagram of this method
As shown in figure 4, this method is comprised the following steps that：
Step 401：Third-party payment platform server is from the Faculty of Finance being connected with the Third-party payment platform
Exchange quotation source file stream is received in system；
In this step, the server of Third-party payment platform receives associated bank or financial institution (with the 3rd
Payment platform connection financial system) send exchange quotation source file stream, exchange quotation source file here
Content can include the exchange rate of current time foreign currency, for example, it is assumed that current time dollar and RMB it
Between the exchange rate be 6.771, i.e. 6.771 yuans of a U.S. dollar exchange, exchange quotation source file at this moment can
To include the exchange rate between current time dollar and RMB；Either compared to last time, the Third-party payment is put down
The amplitude of variation of the exchange rate in the exchange quotation source file that platform is received between dollar and RMB, if last time
The exchange rate in exchange quotation source file between dollar and RMB is 6.689, current time dollar and RMB
Between the exchange rate be 6.771, i.e., add 0.082 compared to the exchange rate before, exchange quotation source document at this moment
Part can just be added comprising the exchange rate between current time dollar and RMB compared to the exchange rate before
0.082, or increase 1.211% etc. compared to the exchange rate before.
Alternatively, the remittance that associated bank or financial institution send is received in the server of the Third-party payment platform
Before rate quotation source file, the server of the 3rd payment platform can open message monitor function, i.e. work as prison
When hearing that exchange quotation source file is reached, the exchange quotation source file is received immediately, when listening to exchange quotation
When source file is not reached, the 3rd payment platform continues on message monitor function.
Associated bank or financial institution when sending exchange quotation source file stream to Third-party payment platform, it is necessary to
Related data in the exchange quotation source file is write according to fixed data format, and the form is needed
Will the bank or financial institution arranged with Third-party payment platform, it is therefore an objective to facilitate Third-party payment platform
Corresponding server is parsed to the exchange quotation source file stream received.For example, exchange quotation source file
The form required in stream is " what a=1, b=6.689, a=b ", i.e. a represented is dollar, and that b is represented is the people
Coin, what whole formula was represented be 1 dollar be equal to 6.689 RMB, the data of the form are sent to the 3rd
In the corresponding server of square payment platform, because the bank or financial institution that send exchange quotation source file stream carry
Preceding server commitment corresponding with the Third-party payment platform crosses the compiling form of data, so the server exists
Receive after exchange quotation source file stream, it is possible to the parsing to the data flow is completed, so as to obtain exchange rate report
The data of valency；It is above-mentioned that " a=1, b=6.689, a=b " data format are exemplary explanation exchange quotation
Data format in source file, does not constitute to the data format in exchange quotation source file and limits.
In this step, the server of Third-party payment platform obtains the data of exchange quotation source file stream, this
In data can be using binary code or other representations by the content representation of exchange quotation source file
Out；And be used to receive the server of associated bank and the Third-party payment platform of financial institution here, equally
It is also the server that Third-party payment platform is appointed in advance with the associated bank and financial institution, purpose guarantee
The security of data transfer.
It should be noted that in actual applications, bank and finance that each Third-party payment platform is cooperated
Mechanism is differed, therefore in order to ensure the security of data, Third-party payment platform can be only literary with configuration
Include and have with the 3rd payment platform in bank or financial institution's transmission data in part, configuration file here
There are the bank of cooperative relationship or the identification information of financial institution, the Third-party payment platform is according in configuration file
Identification information and corresponding bank or financial institution carry out data transmission.
In the embodiment of the present application, the exchange quotation source file stream that the server of Third-party payment platform is received
Comprising the content that can be included with exchange quotation file stream of the prior art of content it is same or similar；And
The particular content that above-mentioned exchange quotation source file stream is included is exemplary explanation, in actual application,
Related data included in exchange quotation source file stream is more complicated, merely just in order to more clearly
Bright this programme, is simply illustrated, but the content included in exchange quotation source file stream is not carried out
Limit.
Step 402：The exchange quotation source file stream is input to internal memory and led to by Third-party payment platform server
Road, using data processing model corresponding with the exchange quotation source file stream in main memory access to the exchange rate
Quotation source file stream is handled, and obtains target exchange quotation file stream.
The main memory access includes at least one data processing model, and the data processing model is according to the exchange rate
The predetermined mapping ruler offered between the content of source file stream and the content of target exchange quotation file stream is set up
Model.
When the server of Third-party payment platform receives the exchange quotation that associated bank or financial institution send
, it is necessary to select the model of suitable exchange quotation according to the exchange quotation source file during source file.
It is alternatively possible to according to the type of service of the exchange quotation source file, select corresponding data processing mould
Type.For example, the source file stream that the server of Third-party payment platform is received is for " outlet ", then may be used
To select the default exchange rate for " outlet " to handle model, if the exchange quotation source file data flow is
For the exchange rate data stream of " import ", then the default exchange rate for " import " can be selected to handle model.
It is alternatively possible to according to the specific data of the exchange quotation source file, select corresponding data processing mould
Type.For example, the exchange quotation data that receive of the server last time of some Third-party payment platform represent it is interior
Appearance is that " a=1, b=6.689, a=b ", the i.e. data are represented：Received in last time represented by the exchange rate data
Particular content is:1 dollar can exchange 6.689 yuans, if the Third-party payment is put down at current time
The content that the data that the server of platform is received are represented for " a=1, b=6.771, a=b ", at this moment according to it is current when
The data obtained are carved, the exchange quotation model that can be selected is " w=b+0.013b ", i.e. third party here
The server of payment platform receive " " b=6.689 " in a=1, b=6.689, a=b " is as pending
Exchange rate data, and by " b=6.689 " as choose exchange quotation model input data, worked as
The exchange rate in the Third-party payment platform of preceding moment between dollar and RMB is 6.775.
Exchange quotation model " w=b+0.013b " is exemplary explanation in examples detailed above, in practical application
In, Third-party payment platform, can be according to the number after the exchange rate data that bank or financial institution send is received
Pending data are handled according to other factors, that is, the exchange quotation model used can be more complicated.
Using the embodiment of the present application, the server of the 3rd payment platform with the Third-party payment platform from being connected
Exchange quotation source file stream is received in financial system, the exchange quotation source file stream is input to main memory access,
Using data processing model corresponding with the exchange quotation source file stream in main memory access to the exchange quotation source
File stream is handled, and obtains target exchange quotation file stream, the main memory access is comprising at least one data
Model is managed, the data processing model is the content and target exchange quotation file according to exchange quotation source file stream
The model that predetermined mapping ruler between the content of stream is set up.The beneficial effect obtained using the embodiment of the present application
It is：Compared to the method for prior art Third-party payment platform exchange quotation, the embodiment of the present application is being received
After exchange quotation source file stream, the exchange quotation source file stream is handled directly in internal memory, it is to avoid
Prior art Third-party payment platform need to arrive the data input before processing exchange quotation source file data
The step of being stored in database, i.e.,：The time of data base read-write data is eliminated, third party is improved
The server of payment platform performs the efficiency of exchange quotation.
Embodiment 3
Embodiment 1 provides a kind of method of data processing, and correspondingly, the present embodiment accordingly provides one
The device of data processing is planted, described device is present in the server of processing source file data, the tool of the device
Body structural representation is as shown in Figure 5.The device is specifically included：Receiving unit 501 and processing unit 502,
Wherein：
The receiving unit 501, can be used for receiving source file data flow；
The processing unit 502, can be used for the source file data flow inputting main memory access, using interior
Data processing model corresponding with the source file data flow in passage is deposited to carry out the source file data flow
Processing, obtains file destination data flow, the main memory access includes at least one data processing model, described
Data processing model is according to pre- between the content of source file data flow and the content of file destination data flow
Determine the model of mapping ruler foundation.
The specific workflow of the device embodiment is as follows：First, in the server of processing source file data
Receiving unit 501 receives the source file data flow that other servers are sent, then, the basis of processing unit 502
The source file data flow received, and utilize data processing corresponding with the source file data flow in main memory access
Model is handled the source file data flow, obtains file destination data flow.
The embodiment of device embodiment processing source file data flow has many kinds, in one embodiment,
The device also includes monitoring unit 503, and the monitoring unit 503 can be used for：
Monitor whether source file data flow reaches, if it has been reached, receiving the source file data flow；Such as
Fruit is not reached, and continuation is monitored source file data flow.
The monitoring unit 503 can remind server source file data flow to have arrived in real time, and cause
The server is handled the source file data flow in time, improves the efficiency of processing source file data flow.
In another embodiment, the receiving unit 501 specifically for：
Receive the source file data flow that given server is sent in configuration file.
The receiving unit 501 receives the source file data flow that given server is sent, it is ensured that data transfer
Security, and prevent other servers from carrying out illegal operation to the server for handling the source file data.
In another embodiment, described device includes memory cell 504, and the memory cell 504 is used
In：
The source file data flow and/or file destination data flow are stored.
The memory cell 504 is after server is to the source file Data Stream Processing that receives, then to source document
Number of packages evidence and/or file destination data flow are stored, it is to avoid when handling source file data, due to database
Relatively long time is consumed when to the source file data storage.
The beneficial effect obtained using present apparatus embodiment is beneficial with the embodiment of the method acquisition in embodiment 1
Effect is same or like, to avoid repeating, repeats no more here.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or meter
Calculation machine program product.Therefore, the application can be using complete hardware embodiment, complete software embodiment or knot
The form of embodiment in terms of conjunction software and hardware.Wherein wrapped one or more moreover, the application can be used
Containing computer usable program code computer-usable storage medium (include but is not limited to magnetic disk storage,
CD-ROM, optical memory etc.) on the form of computer program product implemented.
The application is produced with reference to according to the method, equipment (system) and computer program of the embodiment of the present application
The flow chart and/or block diagram of product is described.It should be understood that can by computer program instructions implementation process figure and
/ or each flow and/or square frame in block diagram and the flow in flow chart and/or block diagram and/
Or the combination of square frame.These computer program instructions can be provided to all-purpose computer, special-purpose computer, insertion
Formula processor or the processor of other programmable data processing devices are to produce a machine so that pass through and calculate
The instruction of the computing device of machine or other programmable data processing devices is produced for realizing in flow chart one
The device for the function of being specified in individual flow or multiple flows and/or one square frame of block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or the processing of other programmable datas to set
In the standby computer-readable memory worked in a specific way so that be stored in the computer-readable memory
Instruction produce include the manufacture of command device, the command device realization in one flow or multiple of flow chart
The function of being specified in one square frame of flow and/or block diagram or multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices, made
Obtain and perform series of operation steps on computer or other programmable devices to produce computer implemented place
Reason, so that the instruction performed on computer or other programmable devices is provided for realizing in flow chart one
The step of function of being specified in flow or multiple flows and/or one square frame of block diagram or multiple square frames.
In a typical configuration, computing device includes one or more processors (CPU), input/defeated
Outgoing interface, network interface and internal memory.
Internal memory potentially includes the volatile memory in computer-readable medium, random access memory
And/or the form, such as read-only storage (ROM) or flash memory (flash RAM) such as Nonvolatile memory (RAM).
Internal memory is the example of computer-readable medium.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by appointing
What method or technique realizes that information is stored.Information can be computer-readable instruction, data structure, program
Module or other data.The example of the storage medium of computer includes, but are not limited to phase transition internal memory
(PRAM), static RAM (SRAM), dynamic random access memory (DRAM), its
Random access memory (RAM), read-only storage (ROM), the electrically erasable of his type are read-only
Memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage
(CD-ROM), digital versatile disc (DVD) or other optical storages, magnetic cassette tape, tape magnetic
Disk storage or other magnetic storage apparatus or any other non-transmission medium, can be calculated available for storage
The information that equipment is accessed.Defined according to herein, computer-readable medium does not include temporary computer-readable matchmaker
The data-signal and carrier wave of body (transitory media), such as modulation.
It should also be noted that, term " comprising ", "comprising" or its any other variant be intended to it is non-
It is exclusive to include, so that process, method, commodity or equipment including a series of key elements are not only wrapped
Include those key elements, but also other key elements including being not expressly set out, or also include for this process,
Method, commodity or the intrinsic key element of equipment.In the absence of more restrictions, by sentence " including
One ... " limit key element, it is not excluded that in the process including key element, method, commodity or equipment
Also there is other identical element.
It will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer journey
Sequence product.Therefore, the application can using complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the application can be used wherein includes calculating one or more
Machine usable program code computer-usable storage medium (include but is not limited to magnetic disk storage, CD-ROM,
Optical memory etc.) on the form of computer program product implemented.
Embodiments herein is these are only, the application is not limited to.For people in the art
For member, the application can have various modifications and variations.It is all to be made within spirit herein and principle
Any modification, equivalent substitution and improvements etc., should be included within the scope of claims hereof.
Claims (11)
1. a kind of method of data processing, it is characterised in that this method includes：
Receive source file data flow；
By the source file data flow input main memory access, using in main memory access with the source file data flow
Corresponding data processing model is handled the source file data flow, obtains file destination data flow, institute
State main memory access and include at least one data processing model, the data processing model is according to source file data
The model that predetermined mapping ruler between the content of stream and the content of file destination data flow is set up.
2. according to the method described in claim 1, it is characterised in that before source file data flow is received,
Methods described also includes：
Monitor whether source file data flow reaches, if it has been reached, receiving the source file data flow；Such as
Fruit is not reached, and continuation is monitored source file data flow.
3. according to the method described in claim 1, it is characterised in that the predetermined mapping ruler includes：
Obtain default source file data flow and file destination data flow；
Using the default source file data flow as the input in data processing model, and will be described default
File destination data flow is trained to the data processing model, obtained as the output of data processing model
To the data processing model.
4. according to the method described in claim 1, it is characterised in that the reception source file data stream packets
Include：
Receive the source file data flow that given server is sent in configuration file.
5. according to the method described in claim 1, it is characterised in that obtain file destination data flow it
Afterwards, methods described also includes：
The source file data flow and/or file destination data flow are stored.
6. according to the method described in claim 1, it is characterised in that the source file data flow is entered for two
The data flow of coding form processed.
7. a kind of exchange quotation method, it is characterised in that this method includes：
Third-party payment platform server is received from the financial system that the Third-party payment platform is connected
Exchange quotation source file stream；
The exchange quotation source file stream is input to main memory access by Third-party payment platform server, using interior
Data processing model corresponding with the exchange quotation source file stream is deposited in passage to the exchange quotation source document
Part stream is handled, and obtains target exchange quotation file stream, the main memory access is comprising at least one data
Model is managed, the data processing model is the content and target exchange quotation text according to exchange quotation source file stream
The model that predetermined mapping ruler between the content of part stream is set up.
8. a kind of device of data processing, it is characterised in that the device includes：
Receiving unit and processing unit, wherein：
The receiving unit, for receiving source file data flow；
The processing unit, for the source file data flow to be inputted into main memory access, using in main memory access
Data processing model corresponding with the source file data flow is handled the source file data flow, is obtained
File destination data flow, the main memory access includes at least one data processing model, the data processing mould
Type is according to the predetermined mapping ruler between the content of source file data flow and the content of file destination data flow
The model of foundation.
9. device according to claim 8, it is characterised in that described device also includes monitoring unit,
The monitoring unit is used for：
Monitor whether source file data flow reaches, if it has been reached, receiving the source file data flow；Such as
Fruit is not reached, and continuation is monitored source file data flow.
10. device according to claim 8, it is characterised in that the receiving unit specifically for：
Receive the source file data flow that given server is sent in configuration file.
11. device according to claim 8, it is characterised in that described device includes memory cell,
The memory cell is used for：
The source file data flow and/or file destination data flow are stored.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610128412.2A CN107169854B (en) | 2016-03-07 | 2016-03-07 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610128412.2A CN107169854B (en) | 2016-03-07 | 2016-03-07 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107169854A true CN107169854A (en) | 2017-09-15 |
| CN107169854B CN107169854B (en) | 2021-04-02 |
Family
ID=59849807
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610128412.2A Active CN107169854B (en) | 2016-03-07 | 2016-03-07 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107169854B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110162333A (en) * | 2019-05-10 | 2019-08-23 | 中信银行股份有限公司 | Multi-service scene tactical management platform based on Drools regulation engine |
| CN110704480A (en) * | 2018-06-21 | 2020-01-17 | 马上消费金融股份有限公司 | Streaming data processing method and system, electronic equipment and storage medium |
| CN111767129A (en) * | 2020-06-30 | 2020-10-13 | 深圳职业技术学院 | Data flow task processing device and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101399672A (en) * | 2008-10-17 | 2009-04-01 | 章毅 | Intrusion detection method for fusion of multiple neutral networks |
| CN101562539A (en) * | 2009-05-18 | 2009-10-21 | 重庆大学 | Self-adapting network intrusion detection system |
| CN102646332A (en) * | 2011-02-21 | 2012-08-22 | 日电（中国）有限公司 | Traffic state estimation device and method based on data fusion |
| US20130041793A1 (en) * | 2010-04-21 | 2013-02-14 | Fujitsu Limited | Financial data processing device, financial data processing method, and computer-readable recording medium |
| US20130159351A1 (en) * | 2011-12-14 | 2013-06-20 | International Business Machines Corporation | Asset Identity Resolution Via Automatic Model Mapping Between Systems With Spatial Data |
| CN103731298A (en) * | 2013-11-15 | 2014-04-16 | 中国航天科工集团第二研究院七〇六所 | Large-scale distributed network safety data acquisition method and system |
| CN105989179A (en) * | 2015-03-06 | 2016-10-05 | 北京邮电大学 | Financial data processing method and system |
-
2016
- 2016-03-07 CN CN201610128412.2A patent/CN107169854B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101399672A (en) * | 2008-10-17 | 2009-04-01 | 章毅 | Intrusion detection method for fusion of multiple neutral networks |
| CN101562539A (en) * | 2009-05-18 | 2009-10-21 | 重庆大学 | Self-adapting network intrusion detection system |
| US20130041793A1 (en) * | 2010-04-21 | 2013-02-14 | Fujitsu Limited | Financial data processing device, financial data processing method, and computer-readable recording medium |
| CN102646332A (en) * | 2011-02-21 | 2012-08-22 | 日电（中国）有限公司 | Traffic state estimation device and method based on data fusion |
| US20130159351A1 (en) * | 2011-12-14 | 2013-06-20 | International Business Machines Corporation | Asset Identity Resolution Via Automatic Model Mapping Between Systems With Spatial Data |
| CN103731298A (en) * | 2013-11-15 | 2014-04-16 | 中国航天科工集团第二研究院七〇六所 | Large-scale distributed network safety data acquisition method and system |
| CN105989179A (en) * | 2015-03-06 | 2016-10-05 | 北京邮电大学 | Financial data processing method and system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110704480A (en) * | 2018-06-21 | 2020-01-17 | 马上消费金融股份有限公司 | Streaming data processing method and system, electronic equipment and storage medium |
| CN110162333A (en) * | 2019-05-10 | 2019-08-23 | 中信银行股份有限公司 | Multi-service scene tactical management platform based on Drools regulation engine |
| CN110162333B (en) * | 2019-05-10 | 2023-05-05 | 中信银行股份有限公司 | Multi-service scene policy management platform based on Drools rule engine |
| CN111767129A (en) * | 2020-06-30 | 2020-10-13 | 深圳职业技术学院 | Data flow task processing device and method |
| CN111767129B (en) * | 2020-06-30 | 2021-10-29 | 深圳职业技术学院 | Data flow task processing device and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107169854B (en) | 2021-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109246188A (en) | A method of supporting the system traded by all kinds of means and by all kinds of means trading processing | |
| CN109711983A (en) | Current assets mortgage financing appraisal procedure and device based on block chain framework | |
| CN105630590B (en) | A kind of business information processing method and processing device | |
| CN109285071A (en) | A kind of data processing platform (DPP) and data processing method based on block chain | |
| CN108492177A (en) | Domestic assets cross-border transaction method, server and storage medium | |
| CN110349009A (en) | A kind of bull debt-credit violation correction method, apparatus and electronic equipment | |
| CN110188112A (en) | A kind of retroactive method and device of the change record of block chain intelligence contract | |
| CN106651463A (en) | Financial institution service access system and access method | |
| CN107480854A (en) | A kind of method and device of risk identification | |
| CN110135701A (en) | Control automatic generation method, device, electronic equipment and the readable medium of rule | |
| Kshetri et al. | Big data and cloud computing for development: Lessons from key industries and economies in the global south | |
| CN107169854A (en) | A kind of method and device of data processing | |
| CN110443624A (en) | Shou Dan trade company checking method and node apparatus based on block chain | |
| CN109711986A (en) | A kind of token application and award method based on cloud storage plateform system | |
| CN109426894A (en) | User information is shared, price competing method, device, system and electronic equipment | |
| CN107203883A (en) | A kind of risk control method and equipment | |
| CN115545709A (en) | Abnormal fund allocation transaction identification method and device | |
| CN106157066A (en) | Mapping relations processing method, system and information processing platform equipment | |
| CN108629543A (en) | Logistic information systems based on block chain and Internet of Things | |
| CN107845031A (en) | The method and apparatus for assessing the trading activity of user | |
| Broughton et al. | Where next for neighbourhood regeneration in England? | |
| Chivunga et al. | Digital disruption in Africa: Mapping innovations for the AfCFTA in post-COVID times | |
| CN108984606A (en) | A kind of company information classified display system and method | |
| CN108681969A (en) | Terminal, the determination method of investment project and its device and readable storage medium storing program for executing | |
| CN109816529A (en) | A kind of digital cash unifies method of commerce |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1244093 Country of ref document: HK |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200923 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200923 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |