CN103795748A - Method for downloading mobile internet website content information - Google Patents
Method for downloading mobile internet website content information Download PDFInfo
- Publication number
- CN103795748A CN103795748A CN201210424370.9A CN201210424370A CN103795748A CN 103795748 A CN103795748 A CN 103795748A CN 201210424370 A CN201210424370 A CN 201210424370A CN 103795748 A CN103795748 A CN 103795748A
- Authority
- CN
- China
- Prior art keywords
- mobile internet
- internet website
- information
- computer
- website server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application discloses a method for downloading mobile internet website content information. The method includes: a configured URL list to be downloaded is introduced into a computer, a download task is started, the computer is accessed to the mobile internet through a mobile terminal, and connection with mobile internet website servers corresponding to URL addresses in the URL list is established; request messages of obtaining mobile internet website content information corresponding to the URL addresses are constructed, and are sent to the corresponding mobile internet website servers; and when response messages sent by the mobile internet website servers are received, the corresponding mobile internet website content information are analyzed and obtained, thereby improving the efficiency of obtaining the mobile internet website content information.
Description
Technical field
The application relates to communication technical field, a kind of method that particularly mobile Internet web site contents information is downloaded.
Background technology
Along with enriching constantly of the Large scale construction of 3G network, mobile Internet application, and intelligent terminal is universal rapidly, and mobile Internet development is advanced by leaps and bounds, and becomes topmost feature of internet information epoch.Mobile Internet is as a kind of free, open network configuration, in offering convenience for people, flame in network also starts without restraint to propagate thereupon, threaten country and social stablizing, the how effectively propagation of these network flames of management and control, becomes the theme of various circles of society's common concern day by day.
Directly can sign in to very easily mobile Internet by mobile terminal, check whether certain website exists flame.But, along with the fast development of mobile Internet network scale, in the mobile Internet website of One's name is legion, find flame if want, and implement effective management and control, only rely on the direct visited communication network of mobile terminal to verify the object that can not reach expection far away, relevant content information how to obtain quickly and easily mobile Internet website is particularly important.
Summary of the invention
In view of this, the application provides a kind of method of mobile Internet web site contents information download, has improved the efficiency of obtaining of mobile Internet web site contents information.
For solving the problems of the technologies described above, technical scheme of the present invention is achieved in that
The method that mobile Internet web site contents information is downloaded, comprising:
Computer imports the url list to be downloaded of configuration, starts downloading task, and accesses mobile Internet by mobile terminal, and the mobile Internet Website server corresponding with URL address in described url list connects;
This computer construction obtains the request message of mobile Internet web site contents information corresponding to each URL address, and sends to corresponding mobile Internet Website server;
When this computer receives the response message of mobile Internet Website server transmission, resolve and obtain corresponding mobile Internet web site contents information.
In sum, the application is by importing pre-configured URL address, computer accesses mobile Internet by mobile terminal, the mobile Internet Website server corresponding with URL address in described url list connects, and construct and ask the request message of corresponding web site contents information to obtain corresponding mobile Internet web site contents information, improve the efficiency of obtaining of mobile Internet web site contents information.
Accompanying drawing explanation
Fig. 1 is the method flow schematic diagram that in the embodiment of the present invention, mobile Internet web site contents information is downloaded;
Fig. 2 is the method flow schematic diagram that in the specific embodiment of the invention, mobile Internet web site contents information is downloaded.
Embodiment
For making object of the present invention, technical scheme and advantage clearer, referring to the accompanying drawing embodiment that develops simultaneously, scheme of the present invention is described in further detail.
In the embodiment of the present invention, propose a kind of method that mobile Internet web site contents information is downloaded, computer accesses mobile Internet by mobile terminal, obtains the relevant content information of request message request by structure request message from mobile Internet Website server.Improved the efficiency of obtaining of mobile Internet web site contents information by said method.
Referring to Fig. 1, Fig. 1 is the method flow schematic diagram that in the embodiment of the present invention, mobile Internet web site contents information is downloaded.Concrete steps are:
The url list importing in this step can be configured as required, can comprise multiple URL address in url list, therefore can carry out batch to the content information of mobile Internet website and download.Computer is in the time accessing mobile Internet by mobile terminal, and the interface function that uses Windows function library to provide can be realized.
Computer, by the interface function that uses Windows function library to provide, has been realized highly compatible in many aspects, as multiple mobile network's type: WAP or NET access way; Multiple mobile network's system types: GSM, CDMA, TD-SCDMA, WCDMA, CDMA2000 etc.; Multiple operation enterprises: by different access points is set, can support China Telecom, China Mobile, CHINAUNICOM etc.In the time supporting multiple mobile network's system types and multiple operation enterprise, mobile terminal needs corresponding support, if mobile terminal is mobile phone, while supporting China Mobile, needs corresponding mobile SIM card.
This computer is the request message of each URL address architecture in url list, and sends to respectively mobile Internet Website server corresponding to this URL address.This computer is loaded according to downloading task, be that the quantity of URL address starts multiple processes and carries out downloading task simultaneously, start multiple threads, can initiate request message to multiple target mobile Internets website simultaneously, can fully use the network bandwidth further to accelerate the download of web site contents information.
Between computer and mobile Internet Website server mutual request message and response message be can be mutual between these two equipment message, and can transmit content information on mobile Internet Website server to computer, do not do specific requirement.
In the specific embodiment of the invention, take request message as HTTP request message, response message is that http response message is example.
HTTP is the request of a client and server end and the standard of replying, and the HTTP request message that computer sends can be moved internet site server and listen to, and responds a HTTP request message, and this can carry the information of HTTP request message request.
The HTTP parameter of configuration can comprise: HTTP version, accept type (Accept), mobile terminal style (User-Agent), Cache-Control, Connection, HTTP request timed out threshold value, request message content etc.According to the HTTP parametric configuration HTTP request message of this configuration.
When this computer receives the response message of mobile Internet Website server transmission in step 103, resolve and obtain corresponding mobile Internet web site contents information, comprising:
When this computer receives the http response message of mobile Internet Website server transmission, resolve and obtain text message, if there is universal resource identifier (URI) information of link picture in this http response message, extract corresponding URI information and also construct the HTTP request message of the pictorial information that obtains corresponding mobile Internet website, and send to the mobile Internet Website server corresponding to URI information of described link picture.
When this computer receives the http response message that carries pictorial information of mobile Internet Website server transmission, resolve and obtain pictorial information.
Computer utilizes Windows function, can realize the diversity package request to target URL address access request message, can independently define the each parameter information in HTTP request message.In the time of analytic message, can utilize key message fuzzy matching technology, extract the link URI information of the whole pictures that comprise in response message, but be not limited to the method; By the access of the server to link picture, obtain the picture resource comprising in targeted website again, complete the download to picture.
Below in conjunction with accompanying drawing, how to realize the download of mobile Internet web site contents information with specific embodiment detailed description the present invention.Referring to Fig. 2, Fig. 2 is the method flow schematic diagram that in the specific embodiment of the invention, mobile Internet web site contents information is downloaded.Concrete steps are:
Computer and mobile terminal be connected with two kinds of wireless connections and wired connections, if by the physics wired connection of USB structure, disconnect this physical connection.
Whether switch and being connected of mobile Internet website by configuration, that comes that test link covers is comprehensive, test high efficiency etc. needs.
In the specific embodiment of the invention, in the time downloading mobile Internet web site contents information, for the Accuracy and high efficiency that guarantees that mobile Internet content information is downloaded, computer need be monitored local network running status, and processes accordingly.In specific embodiments of the invention, there are following two kinds of implementations:
The first implementation is in real time monitoring, when computer accesses target mobile Internet website corresponding to URL address in described url list by mobile terminal, local network connection status is monitored in real time, connects when abnormal and automatically reconnects at network.This computer is monitored local network connection state by calling Windows function library.
The second implementation is, this computer accesses mobile Internet by mobile terminal, when the mobile Internet Website server corresponding with URL address in described url list connects, obtain local network connection status, connect when normal if the network connection state of obtaining is network, the request message of structure is sent to corresponding mobile Internet Website server; Otherwise, re-establish connection, then the request message of structure sent to corresponding mobile Internet Website server.Before sending request message, detect once local network connection state, to guarantee the success of this downloading contents information at every turn.
In the specific embodiment of the invention, this computer is by the mobile Internet web site contents information of the obtaining storage of classifying, for inquiring about, analyze, add up the Web content of mobile Internet website.
In concrete application, can determine whether the content information of storage exists flame, determines in corresponding mobile Internet website whether have flame by methods such as keyword filtration, illegal image model identifications.
In sum, in the specific embodiment of the invention, pass through to import pre-configured URL address, computer accesses mobile Internet by mobile terminal, the mobile Internet Website server corresponding with described URL address connects, and the request message of the corresponding web site contents information of structure request obtains corresponding mobile Internet web site contents information.Improved the efficiency of obtaining of mobile Internet web site contents information by said method.
In the specific embodiment of the invention, by utilizing the technology such as multi-thread concurrent processing, HTTP message custom parameter, realize the quick-downloading of the content informations such as target URL text, picture, further improved the efficiency of obtaining of mobile Internet content.
In the specific embodiment of the invention by calling the interface function of Windows function library, realize the Real-Time Monitoring to mobile terminal access communications network connection status, and can be by connecting and close from its network of master control, realize the random switching of mobile terminal access communications network link, the demands such as that the link that can meet the aptitude tests of mobile Internet flame monitoring filtration system covers is comprehensive, test high efficiency, science.
Can be to the information classification such as text, picture of the various target URL of quantity, classification storage in the specific embodiment of the invention, be convenient to inquiry, analyze, add up the Web content information of mobile Internet etc.In conjunction with the technology of the contents supervision aspects such as keyword filtration, illegal image model identification, can realize the automation of mobile Internet content monitoring.
The above, be only preferred embodiment of the present invention, is not intended to limit protection scope of the present invention.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (10)
1. the method that mobile Internet web site contents information is downloaded, is characterized in that, comprising:
Computer imports the uniform resource position mark URL list to be downloaded of configuration, starts downloading task, and accesses mobile Internet by mobile terminal, and the mobile Internet Website server corresponding with URL address in described url list connects;
This computer construction obtains the request message of mobile Internet web site contents information corresponding to each URL address, and sends to corresponding mobile Internet Website server;
When this computer receives the response message of mobile Internet Website server transmission, resolve and obtain corresponding mobile Internet web site contents information.
2. method according to claim 1, is characterized in that, when described this computer starting downloading task, described method further comprises:
According to the load of downloading task, start multiple thread parallels and download mobile Internet web site contents information.
3. method according to claim 1, is characterized in that, described parsing and obtain corresponding mobile Internet web site contents information after, described method further comprises:
This computer determines whether to need to switch and being connected of mobile Internet, and if so, disconnects current connection, again accesses mobile Internet by described mobile terminal, and proceeds content information download; Otherwise, process ends.
4. method according to claim 3, is characterized in that, before described process ends, described method further comprises:
This computer determines whether the content information of mobile Internet website corresponding to all URL address in the described url list importing has been downloaded, if so, and process ends; Otherwise, continue to download the content information of mobile Internet website corresponding to the URL address of not downloaded.
5. method according to claim 1, is characterized in that, described request message is HTTP request message; Described response message is http response message.
6. method according to claim 5, is characterized in that, when described this computer receives the response message of mobile Internet Website server transmission, resolves and obtain corresponding mobile Internet web site contents information, comprising:
When this computer receives the http response message of mobile Internet Website server transmission, resolve and obtain text message, if there is the universal resource identifier URI information of link picture in this http response message, extract corresponding URI information and also construct the HTTP request message of the pictorial information that obtains corresponding mobile Internet website, and send to the mobile Internet Website server corresponding to URI information of described link picture;
When this computer receives the http response message that carries pictorial information of mobile Internet Website server transmission, resolve and obtain pictorial information.
7. method according to claim 1, is characterized in that, described while accessing target mobile Internet website corresponding to URL address in described url list by mobile terminal, described method further comprises:
Local network connection status is monitored in real time, connected when abnormal and automatically reconnect at network.
8. method according to claim 7, is characterized in that, described method further comprises:
This computer accesses mobile Internet website by calling Windows function library by mobile terminal, and monitors local network connection state.
9. method according to claim 1, is characterized in that, described in send to corresponding mobile Internet Website server, before, described method further comprises:
Obtain local network connection status, connect when normal if the network connection state of obtaining is network, send to corresponding mobile Internet Website server step described in execution; Otherwise, re-establish connection, send to corresponding mobile Internet Website server step described in execution.
10. according to the method described in claim 1-9 any one, it is characterized in that, described method further comprises:
By the mobile Internet web site contents information of the obtaining storage of classifying, for inquiring about, analyze, add up the Web content of mobile Internet website.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210424370.9A CN103795748A (en) | 2012-10-30 | 2012-10-30 | Method for downloading mobile internet website content information |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210424370.9A CN103795748A (en) | 2012-10-30 | 2012-10-30 | Method for downloading mobile internet website content information |
Publications (1)
Publication Number | Publication Date |
---|---|
CN103795748A true CN103795748A (en) | 2014-05-14 |
Family
ID=50671031
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201210424370.9A Pending CN103795748A (en) | 2012-10-30 | 2012-10-30 | Method for downloading mobile internet website content information |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103795748A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107613003A (en) * | 2017-09-19 | 2018-01-19 | 北京达佳互联信息技术有限公司 | Multimedia file synchronous method, device and terminal |
CN111859234A (en) * | 2020-06-03 | 2020-10-30 | 北京神州泰岳智能数据技术有限公司 | Illegal content identification method and device, electronic equipment and storage medium |
CN117014425A (en) * | 2023-08-11 | 2023-11-07 | 深圳先锋居善科技有限公司 | File downloading method, device, equipment and computer readable storage medium |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20090090101A (en) * | 2008-02-20 | 2009-08-25 | 주식회사 케이티프리텔 | Method for loading multimedia contents in the mobile internet browser and wireless communication terminal therefor |
CN102026290A (en) * | 2010-12-16 | 2011-04-20 | 华为终端有限公司 | Wireless mobile gateway and method for responding user access by same |
CN102271331A (en) * | 2010-06-02 | 2011-12-07 | ***通信集团广东有限公司 | Method and system for detecting reliability of service provider (SP) site |
-
2012
- 2012-10-30 CN CN201210424370.9A patent/CN103795748A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20090090101A (en) * | 2008-02-20 | 2009-08-25 | 주식회사 케이티프리텔 | Method for loading multimedia contents in the mobile internet browser and wireless communication terminal therefor |
CN102271331A (en) * | 2010-06-02 | 2011-12-07 | ***通信集团广东有限公司 | Method and system for detecting reliability of service provider (SP) site |
CN102026290A (en) * | 2010-12-16 | 2011-04-20 | 华为终端有限公司 | Wireless mobile gateway and method for responding user access by same |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107613003A (en) * | 2017-09-19 | 2018-01-19 | 北京达佳互联信息技术有限公司 | Multimedia file synchronous method, device and terminal |
CN111859234A (en) * | 2020-06-03 | 2020-10-30 | 北京神州泰岳智能数据技术有限公司 | Illegal content identification method and device, electronic equipment and storage medium |
CN117014425A (en) * | 2023-08-11 | 2023-11-07 | 深圳先锋居善科技有限公司 | File downloading method, device, equipment and computer readable storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110300050B (en) | Message pushing method and device, computer equipment and storage medium | |
CN106330844B (en) | Cross-terminal login-free method and device | |
CN102006588B (en) | Method and system for monitoring network behavior of smart mobile phone | |
CN106469044B (en) | Method and device for realizing page jump | |
CN101958914A (en) | File sharing method, shared server and mobile communication terminal | |
CN108632367A (en) | Account correlating method and information-pushing method | |
CN102783119A (en) | Access control method and system, and access terminal | |
CN102480501A (en) | Application resource downloading method and associated equipment | |
CN103857007A (en) | Wireless local area network access system and method | |
WO2015021873A1 (en) | Method, platform server, and system of data pushing | |
CN104468852A (en) | Method, device and system for client to select IP link address | |
CN103703741B (en) | application program distribution method, terminal and server | |
CN103812900A (en) | Data synchronization method, device and system | |
CN102904765A (en) | Method and equipment for data reporting | |
CN103167014A (en) | Method and device of sharing resources with browsers | |
CN107368334B (en) | Business plug-in interaction system and method | |
CN103716230A (en) | Message sending method, device and server | |
CN107306388B (en) | Configuration method and device of Access Point Name (APN) | |
CN103795748A (en) | Method for downloading mobile internet website content information | |
CN109587197B (en) | Method, device and system for associating reported data | |
CN114039961A (en) | Message pushing method, device, server and storage medium based on WebSocket | |
CN104202432B (en) | Remote web management system and management method | |
CN107465723B (en) | Multi-screen interactive connection method and system, mobile terminal and readable storage medium | |
CN105991799B (en) | The method and device of mobile terminal network visiting | |
WO2014154053A1 (en) | Method, system, and computer storage medium for information dissemination based on wireless access point |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140514 |