CN107067325A - Filter method, filter and the supplying system of stock market data - Google Patents
Filter method, filter and the supplying system of stock market data Download PDFInfo
- Publication number
- CN107067325A CN107067325A CN201710253446.9A CN201710253446A CN107067325A CN 107067325 A CN107067325 A CN 107067325A CN 201710253446 A CN201710253446 A CN 201710253446A CN 107067325 A CN107067325 A CN 107067325A
- Authority
- CN
- China
- Prior art keywords
- stock
- module
- data
- market data
- stock market
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2216/00—Indexing scheme relating to additional aspects of information retrieval not explicitly covered by G06F16/00 and subgroups
- G06F2216/03—Data mining
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Probability & Statistics with Applications (AREA)
- Development Economics (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Fuzzy Systems (AREA)
- General Engineering & Computer Science (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Technology Law (AREA)
- General Business, Economics & Management (AREA)
- Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
Abstract
The invention provides a kind of filter method, filter and the supplying system of stock market data, the filter method is applied to the supplying system of stock market data, the supplying system at least includes the second module of the first module and distribution stock market data for providing stock market data, and the filter method includes：Obtain the real-time stock quotes data from first module；Obtain all stock informations for all subscription terminals subscription that second module is sent；According to the real-time stock quotes data and all stock informations got, filtration treatment, the stock market data after being filtered are carried out to the real-time stock quotes data；Stock market data after the filtering are sent to second module, so that the stock market data distribution after the filtering is subscribed to terminal by second module to corresponding.Technical scheme can effectively filter out invalid data, so as to be conducive to improving data transmission efficiency, reduce data transfer delay.
Description
Technical field
The present invention relates to stock certificate data technical field, in particular to a kind of filter method of stock market data, mistake
Filter device and supplying system.
Background technology
As intelligent operating system is widely applied in smart mobile phone, tablet personal computer and intelligent television, existing stock
More PC epoch, the i.e. modes mainly by the manual refreshing page of remaining in of market data acquiring mode are pulled.Also have few
Number softwares by the way of push using updating stock market data, but under high concurrent, the scene of magnanimity terminal, generally existing
The problem of high delay and loss of data.
It should be noted that information is only used for strengthening the reason of the background to the present invention disclosed in above-mentioned background section
Solution, therefore can include not constituting the information to prior art known to persons of ordinary skill in the art.
The content of the invention
It is an object of the invention to provide a kind of filter method, filter and the supplying system of stock market data, enter
And one or more problem caused by limitation and the defect due to correlation technique is at least overcome to a certain extent.
Other characteristics and advantage of the present invention will be apparent from by following detailed description, or partially by the present invention
Practice and acquistion.
According to the first aspect of the invention there is provided a kind of filter method of stock market data, the filter method should
For the supplying system of stock market data, the supplying system at least includes providing the first module of stock market data and divided
The second module of stock market data is sent out, the filter method includes：Obtain the real-time stock quotes from first module
Data；Obtain all stock informations for all subscription terminals subscription that second module is sent；According to the reality got
When stock market data and all stock informations, filtration treatment is carried out to the real-time stock quotes data, filtered
Stock market data afterwards；Stock market data after the filtering are sent to second module, so that second mould
Stock market data distribution after the filtering is subscribed to terminal by block to corresponding.
In some embodiments of the invention, based on aforementioned schemes, the real-time stock quotes data are carried out at filtering
The step of reason, including：Detect the generation time of the real-time stock quotes data whether in scheduled duration；Filter out the reality
When stock market data in generation time exceed the scheduled duration stock market data.
In some embodiments of the invention, based on aforementioned schemes, the real-time stock quotes data are carried out at filtering
The step of reason, in addition to：According to all stock informations, judge in the real-time stock quotes data whether there is with not by
The related stock market data of the stock information of subscription；Filter out the stock with not being subscribed in the real-time stock quotes data
The related stock market data of information.
In some embodiments of the invention, based on aforementioned schemes, the real-time stock quotes data are carried out at filtering
The step of reason, in addition to：Detect the indices of the real-time stock quotes data compared to previous stock market data
Indices whether change；Filter out in the real-time stock quotes data compared to previous stock market data
The stock market data that do not change of indices.
In some embodiments of the invention, based on aforementioned schemes, in addition to：Getting from first module
After real-time stock quotes data, by the real-time stock quotes data storage into memory queue.
In some embodiments of the invention, based on aforementioned schemes, obtain described from first module incessantly
Real-time stock quotes data.
In some embodiments of the invention, based on aforementioned schemes, the second module described in periodicity poll, to get
State all stock informations of the second module transmission.
According to the second aspect of the invention there is provided a kind of filter of stock market data, the filter should
For the supplying system of stock market data, the supplying system at least includes providing the first module of stock market data and divided
The second module of stock market data is sent out, the filter includes：First acquisition unit, first mould is come from for obtaining
The real-time stock quotes data of block；Second acquisition unit, is subscribed to for obtaining all subscription terminals that second module is sent
All stock informations；Processing unit, for according to the real-time stock quotes data and all stock letters got
The real-time stock quotes data are carried out filtration treatment, the stock market data after being filtered by breath；Transmitting element, is used for
Stock market data after the filtering are sent to second module, so that second module is by the stock after the filtering
Ticket market data distribution subscribes to terminal to corresponding.
According to the third aspect of the invention we there is provided a kind of supplying system of stock market data, including：First module,
Second module and the 3rd module, the 3rd module include the filtering dress of the stock market data as described in above-mentioned second aspect
Put；Wherein, first module is used to provide real-time stock quotes data；Second module is used to obtain all subscription terminals
All stock informations subscribed to, and for receiving the stock market data after the filtering that the 3rd module is sent, by the mistake
Stock market data distribution after filter subscribes to terminal to corresponding.
In some embodiments of the invention, based on aforementioned schemes, number and first module of the 3rd module
In real-time stock quotes data data volume into positive correlation；The number of second module and the 3rd modular filtration
The data volume of stock market data afterwards into positive correlation, second module number for it is multiple when, multiple described the
Two modules are interconnected to constitute group system.
In the technical scheme that some embodiments of the present invention are provided, by obtaining the real time stock from the first module
Market data, and all stock informations for all subscription terminals subscription that the second module is sent are obtained, and then based on above-mentioned real-time
Stock market data and above-mentioned all stock informations carry out filtration treatment to real-time stock quotes data so that (above-mentioned 3rd mould
Block) it need not pay close attention to which terminal have subscribed which stock information, according to the real-time stock quotes data got and need to only own
Subscribe to all stock informations that terminal subscribes to carry out filtration treatment to real-time stock quotes data, and then can effectively improve pair
The filter efficiency of real-time stock quotes data, it is to avoid hash is pushed into the second module and causes transmission delay and loss to have
The problem of using data.
In addition, by the generation time to real-time stock quotes data, whether have terminal subscribe to, whether be that repeated data is entered
Row judge, stale data, invalid data and repeated data can be effectively filtered out, so can reduce push to the second module or even
The data volume of terminal is subscribed to, so as to be conducive to improving data transmission efficiency, data transfer delay is reduced, and can also avoid
The problem of using loss of data.
It should be appreciated that the general description of the above and detailed description hereinafter are only exemplary and explanatory, not
Can the limitation present invention.
Brief description of the drawings
Accompanying drawing herein is merged in specification and constitutes the part of this specification, shows the implementation for meeting the present invention
Example, and for explaining principle of the invention together with specification.It should be evident that drawings in the following description are only the present invention
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
These accompanying drawings obtain other accompanying drawings.In the accompanying drawings：
Fig. 1 diagrammatically illustrates the flow chart of the filter method of stock market data according to an embodiment of the invention；
Fig. 2 diagrammatically illustrates the block diagram of the filter of stock market data according to an embodiment of the invention；
Fig. 3 diagrammatically illustrates the structural representation of the supplying system of stock market data according to an embodiment of the invention
Figure；
Fig. 4 diagrammatically illustrates a kind of communication frame of the supplying system of stock market data according to an embodiment of the invention
Structure schematic diagram；
Fig. 5 diagrammatically illustrates the distributed extension of the supplying system of stock market data according to an embodiment of the invention
Schematic diagram.
Embodiment
Example embodiment is described more fully with referring now to accompanying drawing.However, example embodiment can be with a variety of shapes
Formula is implemented, and is not understood as limited to example set forth herein；On the contrary, thesing embodiments are provided so that the present invention will more
Fully and completely, and by the design of example embodiment those skilled in the art is comprehensively conveyed to.
Implement in addition, described feature, structure or characteristic can be combined in any suitable manner one or more
In example.Embodiments of the invention are fully understood so as to provide there is provided many details in the following description.However,
It will be appreciated by persons skilled in the art that technical scheme can be put into practice without one or more in specific detail,
Or can be using other methods, constituent element, device, step etc..In other cases, it is not shown in detail or describes known side
Method, device, realization operate to avoid fuzzy each aspect of the present invention.
Block diagram shown in accompanying drawing is only functional entity, not necessarily must be corresponding with physically separate entity.
I.e., it is possible to realize these functional entitys using software form, or realized in one or more hardware modules or integrated circuit
These functional entitys, or realize in heterogeneous networks and/or processor device and/or microcontroller device these functional entitys.
Flow chart shown in accompanying drawing is merely illustrative, it is not necessary to including all contents and operation/step,
It is not required to perform by described order.For example, some operation/steps can also be decomposed, and some operation/steps can be closed
And or part merge, therefore the actual order performed is possible to be changed according to actual conditions.
Fig. 1 diagrammatically illustrates the flow chart of the filter method of stock market data according to an embodiment of the invention, its
In, the filter method is applied to the supplying system of stock market data, and the supplying system at least includes providing stock market number
According to the first module and distribution stock market data the second module.
The filter method of reference picture 1, according to an embodiment of the invention stock market data, including：
Step S102, obtains the real-time stock quotes data from first module.
According to the exemplary embodiment of the present invention, the real-time stock quotes can be obtained from the first module incessantly
Data, so ensure that to the second module or even subscribe to the newest stock market data of terminal push.
In an embodiment of the present invention, can after the real-time stock quotes data from first module are got
With by the real-time stock quotes data storage into memory queue.
By the real-time stock quotes data storage that will get into memory queue, it is ensured that data rate memory,
And then the data in the first module can be avoided due to that can not send out and overstock the performance of the first module of excessive influence in time.
Step S104, obtains all stock informations for all subscription terminals subscription that second module is sent.
According to the present invention exemplary embodiment, can the second module described in periodicity poll, to get described second
All stock informations that module is sent.Subscribed to it is of course also possible to obtain all subscription terminals from the second module in real time
All stock informations.Embodiments of the present invention are not limited to this.
Step S106, according to the real-time stock quotes data and all stock informations got, to the reality
When stock market data carry out filtration treatment, the stock market data after being filtered.
For step S106, the filtering scheme that the present invention is proposed be mainly used for filtering stale data, invalid data and
Repeated data.It is specific as follows：
Filter stale data：
According to the exemplary embodiment of the present invention, step S106 includes：Detect the generation of the real-time stock quotes data
Whether the time is in scheduled duration；Filter out the stock that generation time in the real-time stock quotes data exceedes the scheduled duration
Ticket market data.
Filter invalid data：
According to the exemplary embodiment of the present invention, step S106 includes：According to all stock informations, the reality is judged
When stock market data in whether there is the stock market data related to not subscribed stock information；Filter out described real-time
The stock market data related to not subscribed stock information in stock market data.
Filter repeated data：
According to the exemplary embodiment of the present invention, step S106 includes：Detect the items of the real-time stock quotes data
Whether index changes compared to the indices of previous stock market data；Filter out the real-time stock quotes number
The stock market data not changed compared to the indices of previous stock market data in.
Step S108, the stock market data after the filtering are sent to second module, so that second mould
Stock market data distribution after the filtering is subscribed to terminal by block to corresponding.
Correspondingly, embodiments of the invention also proposed a kind of filter of stock market data, similarly, the filtering
Device is applied to the supplying system of stock market data, and the supplying system at least includes the first mould for providing stock market data
Second module of block and distribution stock market data, it is specific as shown in Figure 2.
The filter 200 of reference picture 2, according to an embodiment of the invention stock market data, including：First obtains single
Member 202, second acquisition unit 204, processing unit 206 and transmitting element 208.
Specifically, first acquisition unit 202 is used to obtain the real-time stock quotes data from first module；Second
Acquiring unit 204 is used for all stock informations for obtaining all subscription terminals subscription that second module is sent；Processing unit
206 are used for according to the real-time stock quotes data and all stock informations got, to the real-time stock quotes
Data carry out filtration treatment, the stock market data after being filtered；Transmitting element 208 is used for the stock row after the filtering
Feelings data are sent to second module so that second module by the stock market data distribution after the filtering to corresponding
Subscription terminal.
It should be noted that the detail of each module/unit has been in the filter 200 of above-mentioned stock market data
It is described in detail in the filter method of corresponding stock market data, therefore here is omitted.
Further, embodiments of the invention also proposed a kind of supplying system of stock market data, including：First mould
Block, the second module and the 3rd module, the 3rd module include the filter 200 of stock market data as shown in Figure 2；
Wherein, first module is used to provide real-time stock quotes data；Second module is ordered for obtaining all subscription terminals
All stock informations read, and for receiving the stock market data after the filtering that the 3rd module is sent, by the filtering
Stock market data distribution afterwards subscribes to terminal to corresponding.
In some embodiments of the invention, based on aforementioned schemes, number and first module of the 3rd module
In real-time stock quotes data data volume into positive correlation；The number of second module and the 3rd modular filtration
The data volume of stock market data afterwards into positive correlation, second module number for it is multiple when, multiple described the
Two modules are interconnected to constitute group system.
It should be noted that：Each module in the first module and the second module in the above embodiment of the present invention can be only
It is made up of, can also be made up of multiple modular units individual module unit.
As the present invention exemplary embodiment, below by Queue module of above-mentioned first module, above-mentioned second module be
Exemplified by distribution module and AM access module, above-mentioned 3rd module are pushing module, with reference to Fig. 3 to Fig. 5 to technical scheme
It is described in detail：
As shown in figure 3, the supplying system of stock market data according to an embodiment of the invention, including：Queue module
M100, pushing module M200, distribution module M300 and AM access module M400.Hierarchical structure is used between modules, mould is pushed
Block M200, distribution module M300 and AM access module M400 can be carried out not according to the terminal M500 quantity and stock exchange frequency of access
Shut down extending transversely.Wherein terminal M500 can be in smart mobile phone, tablet personal computer, intelligent television and PC etc., but not limited to this,
It can be any terminal device with stock exchange function.
Specifically, the supplying system of the stock market data, which includes at least one, is used to receiving and storing the real-time row of stock
The Queue module M100 of feelings data, at least one be used for sorted out from the Queue module with terminal M500 subscribe to stock believe
Cease matching present quotation data pushing module M200, at least one be used for terminal set up be connected and store terminal subscribe to
The AM access module M400 of stock information；And at least one is used to control pushing module M200 and AM access module M400 stream compressions
Distribution module M300.
In an exemplary embodiment of the present invention, terminal M500 and AM access module M400 can set up TCP
(Transmission Control Protocol, transmission control protocol) long connection, and register subscription to AM access module M400
Stock information；Distribution module M300 collects the stock that all terminal M500 are subscribed to by way of poll, and is buffered in the module
It is interior；The subscription stock set all from distribution module M300 acquisitions of the same timings of pushing module M200；While pushing module
M200 is uninterrupted to obtain stock present quotation from Queue module M100；Pushing module M200 is according to the present quotation data of acquisition
Set is subscribed to stock to be matched, by the present quotation data-pushing matched with the stock information that terminal is subscribed to distribution module
M300；Distribution module M300 will receive market data-pushing to other distribution module M300 and AM access module M400；Market number
According to finally directly pushing terminal M500 by AM access module M400.
In an embodiment of the present invention, AM access module M400 is only responsible for the stock subscription that storage is connected to the terminal of the module
Information, and give terminal M500 by corresponding stock market data-pushing.Wherein, AM access module M400 quantity can be according to terminal
M500 quantity is extended.
Distribution module M300 divides administered AM access module M400 by configuring., can be according to user institute in actual use
In region, across the multiple distribution module M300 of the deployment of computer room.By being mutually arranged composition cluster between distribution module M300, carry out
Data forwarding, is realized unlimited extending transversely.
Meanwhile, distribution module M300 collects all stock subscription information of the convergences of the AM access module M400 in administering, and
By forwarding mutually, final all distribution module M300 hold whole terminal M500 stock subscription information.
Pushing module M200 automatic regular polling distribution modules M300 is collected into all stock subscription information, at the same it is continual from
Present quotation data are obtained in Queue module M100 high-speed queue, and stock market data are filtered, are then pushed to
Distribution module 300.Wherein, when being necessary, can be same by multiple pushing module M200 as shown in the cross arrows in Fig. 3
When to same distribution module 300 push market data (different piece) to improve pushing efficiency, otherwise can also be by same
Individual pushing module M200 pushes (identical or different) market data to multiple distribution modules 300 simultaneously, specifically can be according to need
Will be with depending on efficiency, there is no particular restriction.
The stock market data that pushing module M200 only subscribes to terminal are pushed, and maximum does not have using resource is pushed
The transmission of redundant data, also greatlys save flow bandwidth.
In an exemplary embodiment of the present invention, pushing module M200 and Queue module M100 quantity ratio is N:1, wherein
N is the integer more than or equal to 1, and as a rule N is more than 2.
Distributed extension under being connected below to magnanimity terminal, and congestion control is carried out in detail under frequent stock exchange
Explanation：
Stock market, which is pushed, has two major features：1st, the stock sum that can subscribe to concern is to limit, and is handed over by real world
Easily existing stock sum is determined；2nd, the stock that magnanimity terminal user synchronization is subscribed to is concentrated in some fancy stocks.
Based on These characteristics, embodiments of the invention use the supplying system of layer architecture.Specifically, magnanimity terminal M500
Only communicated with without configuration, high performance AM access module M400, the stock of concern subscription is being attached thereto by terminal M500
In AM access module M400.Its characteristic is that AM access module M400 can set up stock in real time according to terminal M500 subscription information
Terminal M500 set is subscribed to, the terminal M500 for paying close attention to identical stock is polymerize, one is used as using such terminal M500 set
Individual push unit carries out market distribution.The each stock that each AM access module M400 can pay close attention to for its access terminal M500
Ticket all safeguards such terminal M500 set, and terminal M500 will be offline, send specified communication protocol to be removed from set.It is existing
The total order of magnitude of real world's stock is constant, and the set can be completely stored among AM access module M400 internal memory, used
LinkedHashMap data structures are stored, can quick response magnanimity terminal M500 frequently access, it is offline same
When, it can provide quick COLLECTION TRAVERSALSThe efficiency in distribution again.Distribution module M300 has isolated terminal M500, pushing module M200
Need to only communicate with distribution module M300 can obtain the quantity of terminal M500 subscription stocks, and pushing module M200 and need not close
Subscription terminal M500 set in heart stock.
Distribution module M300 and AM access module M400 uses communication construction as shown in Figure 4, distribution module M300 and access
Module M400 can set up two ports simultaneously on startup.By using separated port, security can be improved, while can
With bring in higher flexibility, actual deployment can also by two port snoops to different network interface cards, realize in external flux every
From.Distribution module M300 is to external port M301 can (HyperText Transfer Protocol Hyper text transfers be assisted using http
View) agreement is easy to docking, and AM access module M400 can use MQTT (Message Queuing Telemetry to external port M401
Transport, message queue remote measurement transmission) agreement, save bandwidth and improve efficiency simultaneously.Distribution module M300 is to inner port M302
Identical communication protocol is used to inner port M402 with AM access module M400, Binary Serialization agreement can be such as used, calling makes
With the long connection pool modes of TCP, throttling.
The extension of module is similar to the mode that building blocks are built, and a distribution module need to be only disposed when terminal M500 is less
M300 and AM access module M400 can suitably increase AM access module when user increases for the terminal M500 in the whole world
M400, when to other regions, overseas expansion business, can respectively dispose in global each hot spot areas, pass through distribution module
M300 intercommunication ports-Extending constitutes distributed structure/architecture as shown in Figure 5.
It should be noted that the annexation between distribution module M300 is not limited to the annular connection shown in Fig. 5, also may be used
To be chain connection, interconnection etc., the implementation of the present invention is not limited to this.
Pushing module M200 is immediately placed in the queue in pushing module M200 after Queue module M100 acquirement data,
Queue in pushing module M200 is a memory queue, it is ensured that Queue module M100 will not cause number more slowly due to data transfer
Performance is influenceed according to overstocking.
Pushing module M200 can open three circulations on startup, and first is used for being obtained from distribution module M300 for circulation
The stock collection for taking current time access terminal M500 to pay close attention to, which merges, to be buffered in internal memory, and second for circulating from Queue module
M100 obtains real time data deposit internal queues, and the 3rd is used to circulate the filtering present quotation data from internal queues and is pushed away
Send.
Pushing module M200 first starts the stock collection that circulation obtains all concerns of terminal M500 from distribution module M300
Close, its characteristic specifically subscribes to terminal M500 without every stock is got, need to only obtain all connection terminal M500 and close
Which stock noted.
Pushing module M200 the 3rd starts circulation and obtains market data from internal queues, detects that market data are produced first
Whether the time within t1 seconds (such as 3 seconds), was considered as more than t1 seconds and expired abandons this market data-pushing.If market data do not have
There is the expired stock set for further detecting whether this stock there are terminal M500 concerns, obtaining first circulation foundation, if
Not in the set, being considered as this stock does not have terminal M500 concerns, abandons this market data-pushing.Market data if
Terminal M500 is paid close attention to, and also needs to judge whether this market data change compared to each index of last market data, such as
Fruit does not change, and is considered as repeated data and abandons this time pushing.Filtered layer by layer by above-mentioned, stale data, invalid data, repeat number
According to being all filtered out, being flowed into distribution module M300 present quotation data will greatly reduce, and mitigate downstream pressure.
Distribution module M300 can open two circulations on startup, and first for circulating from other distribution module M300
And the stock collection merging of the AM access module M400 acquisition current time access terminal M500 concerns in administration is buffered in internal memory,
It is the same with pushing module M200, terminal M500 is specifically subscribed to without getting every stock, all connection terminals need to be only obtained
Which stock M500 has paid close attention to, and distribution module M300 can also count the concern terminal M500 sums of every stock currently in addition, use
In data analysis and statistics.
Distribution module M300 can be on startup preset according to current total number of modules in the number of distribution market data per second
Limit, when receiving pushing module M200 propelling data, first judges whether the data received were reached in the unit interval (such as per second)
The data upper limit that can be sent, reaches that the upper limit abandons this market data distribution automatically, and records in daily record the miscue.
If being not reaching to the processing upper limit, deposit distribution module M300 memory queue.
Second circulation when distribution module M300 starts can obtain from M300 memory queue and cross filter data again,
Detection market data are taken out first time and the time difference of deposit queue, think that system is produced if more than t2 seconds (such as 1 second)
Congestion abandons this market data distribution, and the miscue is recorded in daily record.Operation maintenance personnel can monitor above-mentioned daily record judgement
It is no to carry out module extension.Last distribution module M300 starts multiple threads and this market data is pushed into connecing in administration simultaneously
The distribution module M300 for entering module M400 and mutually extending.
AM access module M400 is stored in internal queues first when receiving distribution module M300 distribution data.AM access module
M400 on startup can ON cycle, the market data in acquisition queue.When taking out market data, first search this stock and working as
Whether preceding AM access module M400 gathers about injection terminal M500, gathers in the absence of terminal M500, without any operation, otherwise opens
Thread traverses terminal M500 set is opened, market data are pushed to terminal M500 successively.
In the technical scheme of the above embodiment of the present invention, stock market data all employ interior in the circulation of links
Army's row are decoupled, quick response upstream requests；Meanwhile, expired, repetition, invalid data can be filtered in upstream link,
Reduce the circulation of hash；In addition, each layer module can set the disposal ability of itself, it can be carried during beyond the ability upper limit
Show that operation maintenance personnel is extended.
Detailed description more than, those skilled in the art are it can be readily appreciated that the technical scheme tool of the embodiment of the present invention
One or more of have the advantage that：
First, according to certain embodiments of the present invention, the access of millions terminal is supported, terminal can be greatly reduced and connect
Enter cost, in the case of the access of magnanimity terminal and high frequently stock exchange, stock market can be also pushed in time；It will close simultaneously
The terminal for noting identical stock is polymerize, and is gathered using this as push unit, greatly promotes the pushing efficiency of stock market.
Secondly, data forwarding is carried out by being mutually arranged composition cluster between distribution module, realization is unlimited extending transversely,
Meet the demand of high concurrent scene.
Although it should be noted that being referred to some modules or list of the equipment for action executing in above-detailed
Member, but this division is not enforceable.In fact, according to the embodiment of the present invention, it is above-described two or more
Module or the feature and function of unit can embody in a module or unit.Conversely, an above-described mould
The feature and function of block or unit can be further divided into being embodied by multiple modules or unit.
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented
Mode can be realized by software, can also be realized by way of software combines necessary hardware.Therefore, according to the present invention
The technical scheme of embodiment can be embodied in the form of software product, the software product can be stored in one it is non-volatile
Property storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in or network on, including some instructions are to cause a calculating
Equipment (can be personal computer, server, touch control terminal or network equipment etc.) is performed according to embodiment of the present invention
Method.
Those skilled in the art will readily occur to its of the present invention after considering specification and putting into practice invention disclosed herein
Its embodiment.The application be intended to the present invention any modification, purposes or adaptations, these modifications, purposes or
Person's adaptations follow the general principle of the present invention and including undocumented common knowledge in the art of the invention
Or conventional techniques.Description and embodiments are considered only as exemplary, and true scope and spirit of the invention are by following
Claim is pointed out.
It should be appreciated that the invention is not limited in the precision architecture for being described above and being shown in the drawings, and
And various modifications and changes can be being carried out without departing from the scope.The scope of the present invention is only limited by appended claim.
Claims (10)
1. a kind of filter method of stock market data, it is characterised in that the filter method is applied to stock market data
Supplying system, the supplying system at least includes the of the first module and distribution stock market data for providing stock market data
Two modules, the filter method includes：
Obtain the real-time stock quotes data from first module；
Obtain all stock informations for all subscription terminals subscription that second module is sent；
According to the real-time stock quotes data and all stock informations got, to the real-time stock quotes data
Carry out filtration treatment, the stock market data after being filtered；
Stock market data after the filtering are sent to second module, so that second module is by after the filtering
Stock market data distribution subscribe to terminal to corresponding.
2. the filter method of stock market data according to claim 1, it is characterised in that to the real-time stock quotes
The step of data carry out filtration treatment, including：
Detect the generation time of the real-time stock quotes data whether in scheduled duration；
Filter out the stock market data that generation time in the real-time stock quotes data exceedes the scheduled duration.
3. the filter method of stock market data according to claim 2, it is characterised in that to the real-time stock quotes
The step of data carry out filtration treatment, in addition to：
According to all stock informations, judge to whether there is in the real-time stock quotes data and believe with not subscribed stock
The stock market data that manner of breathing is closed；
Filter out stock market data related to not subscribed stock information in the real-time stock quotes data.
4. the filter method of stock market data according to claim 3, it is characterised in that to the real-time stock quotes
The step of data carry out filtration treatment, in addition to：
Detect the indices of the real-time stock quotes data is compared to the indices of previous stock market data
It is no to change；
The indices in the real-time stock quotes data compared to previous stock market data are filtered out not occur
The stock market data of change.
5. the filter method of stock market data according to claim 1, it is characterised in that also include：
After the real-time stock quotes data from first module are got, by the real-time stock quotes data storage
Into memory queue.
6. the filter method of stock market data according to claim 1, it is characterised in that incessantly from described first
The real-time stock quotes data are obtained in module.
7. the filter method of stock market data according to claim 1, it is characterised in that second described in periodicity poll
Module, to get all stock informations that second module is sent.
8. a kind of filter of stock market data, it is characterised in that the filter is applied to stock market data
Supplying system, the supplying system at least includes the of the first module and distribution stock market data for providing stock market data
Two modules, the filter includes：
First acquisition unit, for obtaining the real-time stock quotes data from first module；
Second acquisition unit, for obtaining all stock informations that all subscription terminals that second module is sent are subscribed to；
Processing unit, for according to the real-time stock quotes data and all stock informations got, to the reality
When stock market data carry out filtration treatment, the stock market data after being filtered；
Transmitting element, for the stock market data after the filtering to be sent to second module, so that second mould
Stock market data distribution after the filtering is subscribed to terminal by block to corresponding.
9. a kind of supplying system of stock market data, it is characterised in that including：First module, the second module and the 3rd module,
3rd module includes the filter of stock market data as described in claim 8；
Wherein, first module is used to provide real-time stock quotes data；
Second module is used to obtain all stock informations that all subscription terminals are subscribed to, and for receiving the 3rd module
Stock market data after the filtering of transmission, terminal is subscribed to by the stock market data distribution after the filtering to corresponding.
10. the supplying system of stock market data according to claim 9, it is characterised in that of the 3rd module
The data volume of number and the real-time stock quotes data in first module is into positive correlation；The number of second module with
The data volume of stock market data after 3rd modular filtration, into positive correlation, is many in the number of second module
When individual, multiple second modules are interconnected to constitute group system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710253446.9A CN107067325A (en) | 2017-04-18 | 2017-04-18 | Filter method, filter and the supplying system of stock market data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710253446.9A CN107067325A (en) | 2017-04-18 | 2017-04-18 | Filter method, filter and the supplying system of stock market data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107067325A true CN107067325A (en) | 2017-08-18 |
Family
ID=59599856
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710253446.9A Pending CN107067325A (en) | 2017-04-18 | 2017-04-18 | Filter method, filter and the supplying system of stock market data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107067325A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769141A (en) * | 2018-05-09 | 2018-11-06 | 深圳市深弈科技有限公司 | A kind of method of multi-source real-time deal market data receiver and merger processing |
| CN110113362A (en) * | 2019-05-29 | 2019-08-09 | 杭州海兴泽科信息技术有限公司 | A kind of real-time method for pushing of message based on MQTT agreement |
| CN111104594A (en) * | 2019-12-12 | 2020-05-05 | 上海金纳信息科技有限公司 | Market quotation pushing method and device |
| CN112333119A (en) * | 2020-11-27 | 2021-02-05 | 深圳华云信息***有限公司 | Data transmission system and method |
| CN113193974A (en) * | 2021-07-02 | 2021-07-30 | 深圳华云信息***有限公司 | Multicast-based market information pushing method, system, equipment and medium |
| CN115186198A (en) * | 2022-09-09 | 2022-10-14 | 中国中金财富证券有限公司 | Stock market quotation pushing method and related device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105303443A (en) * | 2015-10-10 | 2016-02-03 | 苏州工业园区凌志软件股份有限公司 | Stock investment method and stock investment system |
| CN105430060A (en) * | 2015-11-04 | 2016-03-23 | 中国人民解放军63680部队 | Spaceflight measurement and control data exchange system based on condition constraint publishing-subscribing mode |
| CN106230896A (en) * | 2016-07-18 | 2016-12-14 | 深圳国泰安教育技术股份有限公司 | A kind of information push method, Apparatus and system |
-
2017
- 2017-04-18 CN CN201710253446.9A patent/CN107067325A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105303443A (en) * | 2015-10-10 | 2016-02-03 | 苏州工业园区凌志软件股份有限公司 | Stock investment method and stock investment system |
| CN105430060A (en) * | 2015-11-04 | 2016-03-23 | 中国人民解放军63680部队 | Spaceflight measurement and control data exchange system based on condition constraint publishing-subscribing mode |
| CN106230896A (en) * | 2016-07-18 | 2016-12-14 | 深圳国泰安教育技术股份有限公司 | A kind of information push method, Apparatus and system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769141A (en) * | 2018-05-09 | 2018-11-06 | 深圳市深弈科技有限公司 | A kind of method of multi-source real-time deal market data receiver and merger processing |
| CN110113362A (en) * | 2019-05-29 | 2019-08-09 | 杭州海兴泽科信息技术有限公司 | A kind of real-time method for pushing of message based on MQTT agreement |
| CN111104594A (en) * | 2019-12-12 | 2020-05-05 | 上海金纳信息科技有限公司 | Market quotation pushing method and device |
| CN112333119A (en) * | 2020-11-27 | 2021-02-05 | 深圳华云信息***有限公司 | Data transmission system and method |
| CN113193974A (en) * | 2021-07-02 | 2021-07-30 | 深圳华云信息***有限公司 | Multicast-based market information pushing method, system, equipment and medium |
| CN115186198A (en) * | 2022-09-09 | 2022-10-14 | 中国中金财富证券有限公司 | Stock market quotation pushing method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107067325A (en) | Filter method, filter and the supplying system of stock market data | |
| Wang et al. | LDPA: A local data processing architecture in ambient assisted living communications | |
| CN111400326B (en) | Smart city data management system and method thereof | |
| CN100531055C (en) | Data synchronous system and its method | |
| Reddy et al. | Image browsing, processing, and clustering for participatory sensing: lessons from a dietsense prototype | |
| US20140324977A1 (en) | Enterprise social networking software architecture | |
| CN106445986A (en) | Method and system used for realizing second-hand housing transaction information industry networking | |
| CN109582722A (en) | Public security resource data service system | |
| CN103455908A (en) | Brainstorming service in cloud environment | |
| CN107424072A (en) | Distributed stock present quotation supplying system and method at a high speed | |
| CN106846065A (en) | A kind of data processing method and device | |
| CN101923671A (en) | Digital comprehensive community service system | |
| CN106375480A (en) | Electric energy data real-time acquisition system and method based on distributed system | |
| CN105955807A (en) | System and method for processing task | |
| CN108829704A (en) | A kind of big data distributed libray Analysis Service technology | |
| CN108984333A (en) | The method and device calculated in real time for big data | |
| CN109636252A (en) | Floating population's big data multidimensional analysis method and system | |
| CN109390060A (en) | A kind of health steward system | |
| CN107731284A (en) | Medical data sharing method and system | |
| CN106202399A (en) | Method for implementing data management system of big data | |
| CN108709565A (en) | Step-recording method and step count set | |
| CN107040598A (en) | Distribution method, dispensing device and the supplying system of stock market data | |
| CN108550390A (en) | Intelligent medical treatment manages system and management method | |
| Feng et al. | Developing a smart healthcare framework with an ‘Aboriginal lens’ | |
| CN111275583A (en) | Service method based on face recognition and database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170818 |