CN104283914A - WEB data automatic acquisition system - Google Patents

WEB data automatic acquisition system Download PDF

Info

Publication number
CN104283914A
CN104283914A CN201310279488.1A CN201310279488A CN104283914A CN 104283914 A CN104283914 A CN 104283914A CN 201310279488 A CN201310279488 A CN 201310279488A CN 104283914 A CN104283914 A CN 104283914A
Authority
CN
China
Prior art keywords
web
data
module
link
data acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310279488.1A
Other languages
Chinese (zh)
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHANGHAI LANGMAI NETWORK TECHNOLOGY Co Ltd
Original Assignee
SHANGHAI LANGMAI NETWORK TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHANGHAI LANGMAI NETWORK TECHNOLOGY Co Ltd filed Critical SHANGHAI LANGMAI NETWORK TECHNOLOGY Co Ltd
Priority to CN201310279488.1A priority Critical patent/CN104283914A/en
Publication of CN104283914A publication Critical patent/CN104283914A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a WEB data automatic acquisition system. The system comprises a WEB client side, a WEB server and an application server, wherein the WEB client side comprises an index plan which saves the corresponding relation between graphs and data and links, the WEB client side sends the link corresponding to the graph or data clicked by a user to the WEB server, and the WEB server acquires the graph or data corresponding to the link from the application server, converts the acquired graph or data into an SVG file and then feeds the SVG file back to the WEB client side. By the adoption of the system, semi-structured and unstructured data can be converted into structured metadata, so that dynamic tracking and monitoring of flight data are achieved.

Description

A kind of WEB automatic data acquisition system
Technical field
The present invention relates to a kind of data acquisition system, more precisely a kind of WEB automatic data acquisition system.
Background technology
Web service system mainly realizes information issuing function, is one of basic function of distribution automation system, and client uses browser to be understood power distribution network operation conditions by Web service system and analyze.The distribution automation system of current on-line operation is all run on EMS (Energy Manage System substantially, EMS) the I controlled area of system, then by spacer assembly by data syn-chronization to non-controlling III district, externally provide Web to serve by non-controlling III district.The Web service that distribution automation system externally provides, based on ActiveX ActiveX Techniques or Java ActiveX Techniques mostly, no matter be based on which kind of ActiveX Techniques, corresponding control is filled under all needing user, the figure in a certain for distribution automation system moment and data are all downloaded to client by control, the request of checking of such user can meet with a response fast, but user sees is not the operation conditions of current distribution automation system.In addition, in order to system safety, need distribution automation system to run this control in protected mode, if the authority run is not arranged correctly, the disabler of these controls can be caused, thus cause the Consumer's Experience of client not good.
Summary of the invention
The object of this invention is to provide a kind of WEB automatic data acquisition system, it can solve the above-mentioned shortcoming that prior art is produced.
The present invention is by the following technical solutions:
A kind of WEB automatic data acquisition system; comprise WEB client, WEB server and application server; described WEB client comprises index map; described index map preserve figure and data and link between corresponding relation; the figure that client clicks by described WEB client or link corresponding to data are sent to WEB server; described WEB server from application server acquisition link graph of a correspondence or data, and is back to WEB client after the figure collected or data transaction are become SVG file; Also comprise a Web data acquisition control system, Web data acquisition control system is made up of data acquisition sending module and data reception module, data acquisition sending module comprises Signal-regulated kinase, A/D modular converter, microcontroller and wireless module, the signal collected is sent to A/D modular converter through Signal-regulated kinase, and A/D modular converter connects microcontroller; Data reception module comprises wireless module and microcontroller, and wireless module input connection data gathers the microcontroller in sending module, and the microcontroller in wireless module output connection data receiver module, microprocessor is connected with PC.
Described WEB server comprises:
Link parsing module, the link of sending for resolving WEB client draws the content of link, and the SVG file that SVG file derivation program is changed is returned to WEB client;
Graph data acquisition module, for the content graph of a correspondence that parses from application server acquisition link parsing module or data;
SVG file derivation program, for being converted to SVG file by the figure of graph data acquisition module collection or data and being transmitted to link parsing module.
Described WEB server also comprises SVG document renderer coloring process, after the plant stand figure being converted to SVG file is carried out topology coloring, export to described link parsing module, the SVG file after topology coloring is returned to WEB client by described link parsing module.
Described signal processing module comprises signal amplification circuit and filter circuit, and signal amplification circuit output connects filter circuit; Described microcontroller is STM32 chip.
Advantage of the present invention is: semi-structured and non-structured data can be become structurized metadata, realizes dynamic tracking and the monitoring of flight data.
Embodiment
Set forth the specific embodiment of the present invention further below:
The present invention discloses a kind of WEB automatic data acquisition system; comprise WEB client, WEB server and application server; it is characterized in that; described WEB client comprises index map; described index map preserve figure and data and link between corresponding relation; the figure that client clicks by described WEB client or link corresponding to data are sent to WEB server; described WEB server from application server acquisition link graph of a correspondence or data, and is back to WEB client after the figure collected or data transaction are become SVG file; Also comprise a Web data acquisition control system, Web data acquisition control system is made up of data acquisition sending module and data reception module, data acquisition sending module comprises Signal-regulated kinase, A/D modular converter, microcontroller and wireless module, the signal collected is sent to A/D modular converter through Signal-regulated kinase, and A/D modular converter connects microcontroller; Data reception module comprises wireless module and microcontroller, and wireless module input connection data gathers the microcontroller in sending module, and the microcontroller in wireless module output connection data receiver module, microprocessor is connected with PC.
Described WEB server comprises: link parsing module, and the link of sending for resolving WEB client draws the content of link, and the SVG file that SVG file derivation program is changed is returned to WEB client; Graph data acquisition module, for the content graph of a correspondence that parses from application server acquisition link parsing module or data; SVG file derivation program, for being converted to SVG file by the figure of graph data acquisition module collection or data and being transmitted to link parsing module.
Described WEB server also comprises SVG document renderer coloring process, after the plant stand figure being converted to SVG file is carried out topology coloring, export to described link parsing module, the SVG file after topology coloring is returned to WEB client by described link parsing module.
Described signal processing module comprises signal amplification circuit and filter circuit, and signal amplification circuit output connects filter circuit; Described microcontroller is STM32 chip.
Web data automatic acquisition technology relates to the technology such as web data excavation, Web information retrieval, information extraction, search engine.So-called web data gathers the non-trivial process referring to and find effective, novel, potential available information (comprising concept, pattern, rule, rule, constraint and the form such as visual) from the Web information resource of a large amount of destructuring, isomery automatically.Comprise Web content mining, Web structure is excavated and Web usage mining.
Show as according to flight data composition rule by WEB automatic data collection technology of the present invention, the magnanimity flight data of designated airline, OTA, GDS website is carried out to information retrieval, information extraction, analyzing and processing, looked into heavily denoising, integral data, semi-structured and non-structured data are become structurized metadata, realizes dynamic tracking and the monitoring of flight data.
Semi-structured and non-structured data can be become structurized metadata by the present invention, realize dynamic tracking and the monitoring of flight data.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, all any amendments done within the spirit and principles in the present invention, equivalent replacement and improvement etc., all should be included within protection scope of the present invention.

Claims (4)

1. a WEB automatic data acquisition system; comprise WEB client, WEB server and application server; it is characterized in that; described WEB client comprises index map; described index map preserve figure and data and link between corresponding relation; the figure that client clicks by described WEB client or link corresponding to data are sent to WEB server; described WEB server from application server acquisition link graph of a correspondence or data, and is back to WEB client after the figure collected or data transaction are become SVG file; Also comprise a Web data acquisition control system, Web data acquisition control system is made up of data acquisition sending module and data reception module, data acquisition sending module comprises Signal-regulated kinase, A/D modular converter, microcontroller and wireless module, the signal collected is sent to A/D modular converter through Signal-regulated kinase, and A/D modular converter connects microcontroller; Data reception module comprises wireless module and microcontroller, and wireless module input connection data gathers the microcontroller in sending module, and the microcontroller in wireless module output connection data receiver module, microprocessor is connected with PC.
2. according to the WEB automatic data acquisition system described in claim 1, it is characterized in that, described WEB server comprises:
Link parsing module, the link of sending for resolving WEB client draws the content of link, and the SVG file that SVG file derivation program is changed is returned to WEB client;
Graph data acquisition module, for the content graph of a correspondence that parses from application server acquisition link parsing module or data;
SVG file derivation program, for being converted to SVG file by the figure of graph data acquisition module collection or data and being transmitted to link parsing module.
3. according to the WEB automatic data acquisition system described in claim 2, it is characterized in that, described WEB server also comprises SVG document renderer coloring process, after the plant stand figure being converted to SVG file is carried out topology coloring, export to described link parsing module, the SVG file after topology coloring is returned to WEB client by described link parsing module.
4. WEB automatic data acquisition system as claimed in any of claims 1 to 3, is characterized in that, described signal processing module comprises signal amplification circuit and filter circuit, and signal amplification circuit output connects filter circuit; Described microcontroller is STM32 chip.
CN201310279488.1A 2013-07-04 2013-07-04 WEB data automatic acquisition system Pending CN104283914A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310279488.1A CN104283914A (en) 2013-07-04 2013-07-04 WEB data automatic acquisition system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310279488.1A CN104283914A (en) 2013-07-04 2013-07-04 WEB data automatic acquisition system

Publications (1)

Publication Number Publication Date
CN104283914A true CN104283914A (en) 2015-01-14

Family

ID=52258394

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310279488.1A Pending CN104283914A (en) 2013-07-04 2013-07-04 WEB data automatic acquisition system

Country Status (1)

Country Link
CN (1) CN104283914A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101546484A (en) * 2009-04-30 2009-09-30 南京航空航天大学 Flight delay conformance analysis and forecast system based on SOA and operation method thereof
CN101902500A (en) * 2010-07-23 2010-12-01 广东电网公司中山供电局 WEB service system based on SVG technique and method thereof
CN202663437U (en) * 2012-03-27 2013-01-09 大连经济技术开发区山海电子有限公司 Control system for Web wireless data acquisition

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101546484A (en) * 2009-04-30 2009-09-30 南京航空航天大学 Flight delay conformance analysis and forecast system based on SOA and operation method thereof
CN101902500A (en) * 2010-07-23 2010-12-01 广东电网公司中山供电局 WEB service system based on SVG technique and method thereof
CN202663437U (en) * 2012-03-27 2013-01-09 大连经济技术开发区山海电子有限公司 Control system for Web wireless data acquisition

Similar Documents

Publication Publication Date Title
CN102969796B (en) Near-real-time electric quantity monitoring and dispatching management system for rural power grid
AU2012253078B2 (en) Data acquisition concentrator and data acquisition method
CN105868075A (en) System and method for monitoring and analyzing large amount of logs in real time
CN106528880B (en) Method and system for regulating data structure format of multi-source power business data
CN104050281A (en) Webpage information extraction method and device based on http protocol
CN105184189A (en) Online control and management system for intelligent substation SCD file
CN105490854A (en) Real-time log collection method and system, and application server cluster
CN102998562A (en) Power quality monitoring system based on International Electrotechnical Commission (IEC) 61850 communication protocol
CN105375982A (en) Ethernet passive optical network failure prejudging method of smart distribution network system
CN105305617A (en) Transformer substation online secondary equipment standing book information acquisition method
CN103996276A (en) Remote transmission system and method for data of power plant
US20150227577A1 (en) Method and device for guaranteeing consistency of planning data
CN106202232A (en) Power failure event analysis method and device
CN109495290A (en) A kind of operational system boss stands exchange method and system
CN202563002U (en) Lightning arrester remote on-line monitoring system
CN103902539A (en) Method and device for analyzing extensible markup language data
CN201897729U (en) Power plant-dedicated remote distributed centralized control system based on industrial Ethernet
CN103702354A (en) Base station engineering parameter collection and analysis method
CN103942322A (en) Distribution network model discrepant data merging method based on XML files
US9232025B2 (en) Entry of electric power delivery system data in a web-based interface
CN104283914A (en) WEB data automatic acquisition system
CN104331512A (en) Automatic BBS (bulletin board system) page acquisition method
CN103761395A (en) Method for generating dynamic report of virtual terminal of intelligent substation
CN110795480B (en) Traffic operation data processing method and device
CN103198377A (en) Intelligent building comprehensive-wiring management system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20150114