CN103795748A - Method for downloading mobile internet website content information - Google Patents

Method for downloading mobile internet website content information Download PDF

Info

Publication number
CN103795748A
CN103795748A CN201210424370.9A CN201210424370A CN103795748A CN 103795748 A CN103795748 A CN 103795748A CN 201210424370 A CN201210424370 A CN 201210424370A CN 103795748 A CN103795748 A CN 103795748A
Authority
CN
China
Prior art keywords
mobile internet
internet website
information
computer
website server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201210424370.9A
Other languages
Chinese (zh)
Inventor
魏亮
谢玮
郑冠楠
邓东丰
杨剑锋
魏薇
祝卓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Research Institute of Telecommunications Transmission Ministry of Industry and Information Technology
Original Assignee
Research Institute of Telecommunications Transmission Ministry of Industry and Information Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Research Institute of Telecommunications Transmission Ministry of Industry and Information Technology filed Critical Research Institute of Telecommunications Transmission Ministry of Industry and Information Technology
Priority to CN201210424370.9A priority Critical patent/CN103795748A/en
Publication of CN103795748A publication Critical patent/CN103795748A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The application discloses a method for downloading mobile internet website content information. The method includes: a configured URL list to be downloaded is introduced into a computer, a download task is started, the computer is accessed to the mobile internet through a mobile terminal, and connection with mobile internet website servers corresponding to URL addresses in the URL list is established; request messages of obtaining mobile internet website content information corresponding to the URL addresses are constructed, and are sent to the corresponding mobile internet website servers; and when response messages sent by the mobile internet website servers are received, the corresponding mobile internet website content information are analyzed and obtained, thereby improving the efficiency of obtaining the mobile internet website content information.

Description

A kind of method that mobile Internet web site contents information is downloaded
Technical field
The application relates to communication technical field, a kind of method that particularly mobile Internet web site contents information is downloaded.
Background technology
Along with enriching constantly of the Large scale construction of 3G network, mobile Internet application, and intelligent terminal is universal rapidly, and mobile Internet development is advanced by leaps and bounds, and becomes topmost feature of internet information epoch.Mobile Internet is as a kind of free, open network configuration, in offering convenience for people, flame in network also starts without restraint to propagate thereupon, threaten country and social stablizing, the how effectively propagation of these network flames of management and control, becomes the theme of various circles of society's common concern day by day.
Directly can sign in to very easily mobile Internet by mobile terminal, check whether certain website exists flame.But, along with the fast development of mobile Internet network scale, in the mobile Internet website of One's name is legion, find flame if want, and implement effective management and control, only rely on the direct visited communication network of mobile terminal to verify the object that can not reach expection far away, relevant content information how to obtain quickly and easily mobile Internet website is particularly important.
Summary of the invention
In view of this, the application provides a kind of method of mobile Internet web site contents information download, has improved the efficiency of obtaining of mobile Internet web site contents information.
For solving the problems of the technologies described above, technical scheme of the present invention is achieved in that
The method that mobile Internet web site contents information is downloaded, comprising:
Computer imports the url list to be downloaded of configuration, starts downloading task, and accesses mobile Internet by mobile terminal, and the mobile Internet Website server corresponding with URL address in described url list connects;
This computer construction obtains the request message of mobile Internet web site contents information corresponding to each URL address, and sends to corresponding mobile Internet Website server;
When this computer receives the response message of mobile Internet Website server transmission, resolve and obtain corresponding mobile Internet web site contents information.
In sum, the application is by importing pre-configured URL address, computer accesses mobile Internet by mobile terminal, the mobile Internet Website server corresponding with URL address in described url list connects, and construct and ask the request message of corresponding web site contents information to obtain corresponding mobile Internet web site contents information, improve the efficiency of obtaining of mobile Internet web site contents information.
Accompanying drawing explanation
Fig. 1 is the method flow schematic diagram that in the embodiment of the present invention, mobile Internet web site contents information is downloaded;
Fig. 2 is the method flow schematic diagram that in the specific embodiment of the invention, mobile Internet web site contents information is downloaded.
Embodiment
For making object of the present invention, technical scheme and advantage clearer, referring to the accompanying drawing embodiment that develops simultaneously, scheme of the present invention is described in further detail.
In the embodiment of the present invention, propose a kind of method that mobile Internet web site contents information is downloaded, computer accesses mobile Internet by mobile terminal, obtains the relevant content information of request message request by structure request message from mobile Internet Website server.Improved the efficiency of obtaining of mobile Internet web site contents information by said method.
Referring to Fig. 1, Fig. 1 is the method flow schematic diagram that in the embodiment of the present invention, mobile Internet web site contents information is downloaded.Concrete steps are:
Step 101, computer imports the url list to be downloaded of configuration, start downloading task, and access mobile Internet by mobile terminal, the mobile Internet Website server corresponding with URL address in described URL(uniform resource locator) (URL) list connects.
The url list importing in this step can be configured as required, can comprise multiple URL address in url list, therefore can carry out batch to the content information of mobile Internet website and download.Computer is in the time accessing mobile Internet by mobile terminal, and the interface function that uses Windows function library to provide can be realized.
Computer, by the interface function that uses Windows function library to provide, has been realized highly compatible in many aspects, as multiple mobile network's type: WAP or NET access way; Multiple mobile network's system types: GSM, CDMA, TD-SCDMA, WCDMA, CDMA2000 etc.; Multiple operation enterprises: by different access points is set, can support China Telecom, China Mobile, CHINAUNICOM etc.In the time supporting multiple mobile network's system types and multiple operation enterprise, mobile terminal needs corresponding support, if mobile terminal is mobile phone, while supporting China Mobile, needs corresponding mobile SIM card.
Step 102, this computer construction obtains the request message of mobile Internet web site contents information corresponding to each URL address, and sends to corresponding mobile Internet Website server.
This computer is the request message of each URL address architecture in url list, and sends to respectively mobile Internet Website server corresponding to this URL address.This computer is loaded according to downloading task, be that the quantity of URL address starts multiple processes and carries out downloading task simultaneously, start multiple threads, can initiate request message to multiple target mobile Internets website simultaneously, can fully use the network bandwidth further to accelerate the download of web site contents information.
Step 103, when this computer receives the response message of mobile Internet Website server transmission, resolves and obtains corresponding mobile Internet web site contents information.
Between computer and mobile Internet Website server mutual request message and response message be can be mutual between these two equipment message, and can transmit content information on mobile Internet Website server to computer, do not do specific requirement.
In the specific embodiment of the invention, take request message as HTTP request message, response message is that http response message is example.
HTTP is the request of a client and server end and the standard of replying, and the HTTP request message that computer sends can be moved internet site server and listen to, and responds a HTTP request message, and this can carry the information of HTTP request message request.
The HTTP parameter of configuration can comprise: HTTP version, accept type (Accept), mobile terminal style (User-Agent), Cache-Control, Connection, HTTP request timed out threshold value, request message content etc.According to the HTTP parametric configuration HTTP request message of this configuration.
When this computer receives the response message of mobile Internet Website server transmission in step 103, resolve and obtain corresponding mobile Internet web site contents information, comprising:
When this computer receives the http response message of mobile Internet Website server transmission, resolve and obtain text message, if there is universal resource identifier (URI) information of link picture in this http response message, extract corresponding URI information and also construct the HTTP request message of the pictorial information that obtains corresponding mobile Internet website, and send to the mobile Internet Website server corresponding to URI information of described link picture.
When this computer receives the http response message that carries pictorial information of mobile Internet Website server transmission, resolve and obtain pictorial information.
Computer utilizes Windows function, can realize the diversity package request to target URL address access request message, can independently define the each parameter information in HTTP request message.In the time of analytic message, can utilize key message fuzzy matching technology, extract the link URI information of the whole pictures that comprise in response message, but be not limited to the method; By the access of the server to link picture, obtain the picture resource comprising in targeted website again, complete the download to picture.
Below in conjunction with accompanying drawing, how to realize the download of mobile Internet web site contents information with specific embodiment detailed description the present invention.Referring to Fig. 2, Fig. 2 is the method flow schematic diagram that in the specific embodiment of the invention, mobile Internet web site contents information is downloaded.Concrete steps are:
Step 201, computer imports the url list to be downloaded of configuration, starts downloading task.
Step 202, this computer accesses mobile Internet by mobile terminal, and the mobile Internet Website server corresponding with URL address in described url list connects.
Step 203, this computer is according to the HTTP parameter of configuration, and URL address architecture HTTP request message, and sends to mobile Internet Website server corresponding to URL address.
Step 204, this computer receives the HTTP request message that mobile Internet Website server sends, and resolves and obtain the text message in this message.
Step 205, this computer is determined the URI information that whether has link picture in this http response message by Method of Fuzzy Matching, if so, execution step 206; Otherwise, execution step 208.
Step 206, this computer extracts the URI information of link picture from this http response message, the HTTP request message of structure request pictorial information, and send to mobile Internet Website server corresponding to this URI information.
Step 207, this computer receives while carrying the http response message of pictorial information, obtains corresponding pictorial information.
Step 208, this computer determines whether to need to switch and being connected of mobile Internet, and if so, performs step 209; Otherwise, execution step 210.
Step 209, this computer disconnects current connection, execution step 202.
Computer and mobile terminal be connected with two kinds of wireless connections and wired connections, if by the physics wired connection of USB structure, disconnect this physical connection.
Whether switch and being connected of mobile Internet website by configuration, that comes that test link covers is comprehensive, test high efficiency etc. needs.
Step 210, this computer determines whether the content information of mobile Internet website corresponding to all URL address in the described url list importing has been downloaded, if so, execution step 211; Otherwise, execution step 203.
Step 211, process ends.
In the specific embodiment of the invention, in the time downloading mobile Internet web site contents information, for the Accuracy and high efficiency that guarantees that mobile Internet content information is downloaded, computer need be monitored local network running status, and processes accordingly.In specific embodiments of the invention, there are following two kinds of implementations:
The first implementation is in real time monitoring, when computer accesses target mobile Internet website corresponding to URL address in described url list by mobile terminal, local network connection status is monitored in real time, connects when abnormal and automatically reconnects at network.This computer is monitored local network connection state by calling Windows function library.
The second implementation is, this computer accesses mobile Internet by mobile terminal, when the mobile Internet Website server corresponding with URL address in described url list connects, obtain local network connection status, connect when normal if the network connection state of obtaining is network, the request message of structure is sent to corresponding mobile Internet Website server; Otherwise, re-establish connection, then the request message of structure sent to corresponding mobile Internet Website server.Before sending request message, detect once local network connection state, to guarantee the success of this downloading contents information at every turn.
In the specific embodiment of the invention, this computer is by the mobile Internet web site contents information of the obtaining storage of classifying, for inquiring about, analyze, add up the Web content of mobile Internet website.
In concrete application, can determine whether the content information of storage exists flame, determines in corresponding mobile Internet website whether have flame by methods such as keyword filtration, illegal image model identifications.
In sum, in the specific embodiment of the invention, pass through to import pre-configured URL address, computer accesses mobile Internet by mobile terminal, the mobile Internet Website server corresponding with described URL address connects, and the request message of the corresponding web site contents information of structure request obtains corresponding mobile Internet web site contents information.Improved the efficiency of obtaining of mobile Internet web site contents information by said method.
In the specific embodiment of the invention, by utilizing the technology such as multi-thread concurrent processing, HTTP message custom parameter, realize the quick-downloading of the content informations such as target URL text, picture, further improved the efficiency of obtaining of mobile Internet content.
In the specific embodiment of the invention by calling the interface function of Windows function library, realize the Real-Time Monitoring to mobile terminal access communications network connection status, and can be by connecting and close from its network of master control, realize the random switching of mobile terminal access communications network link, the demands such as that the link that can meet the aptitude tests of mobile Internet flame monitoring filtration system covers is comprehensive, test high efficiency, science.
Can be to the information classification such as text, picture of the various target URL of quantity, classification storage in the specific embodiment of the invention, be convenient to inquiry, analyze, add up the Web content information of mobile Internet etc.In conjunction with the technology of the contents supervision aspects such as keyword filtration, illegal image model identification, can realize the automation of mobile Internet content monitoring.
The above, be only preferred embodiment of the present invention, is not intended to limit protection scope of the present invention.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.

Claims (10)

1. the method that mobile Internet web site contents information is downloaded, is characterized in that, comprising:
Computer imports the uniform resource position mark URL list to be downloaded of configuration, starts downloading task, and accesses mobile Internet by mobile terminal, and the mobile Internet Website server corresponding with URL address in described url list connects;
This computer construction obtains the request message of mobile Internet web site contents information corresponding to each URL address, and sends to corresponding mobile Internet Website server;
When this computer receives the response message of mobile Internet Website server transmission, resolve and obtain corresponding mobile Internet web site contents information.
2. method according to claim 1, is characterized in that, when described this computer starting downloading task, described method further comprises:
According to the load of downloading task, start multiple thread parallels and download mobile Internet web site contents information.
3. method according to claim 1, is characterized in that, described parsing and obtain corresponding mobile Internet web site contents information after, described method further comprises:
This computer determines whether to need to switch and being connected of mobile Internet, and if so, disconnects current connection, again accesses mobile Internet by described mobile terminal, and proceeds content information download; Otherwise, process ends.
4. method according to claim 3, is characterized in that, before described process ends, described method further comprises:
This computer determines whether the content information of mobile Internet website corresponding to all URL address in the described url list importing has been downloaded, if so, and process ends; Otherwise, continue to download the content information of mobile Internet website corresponding to the URL address of not downloaded.
5. method according to claim 1, is characterized in that, described request message is HTTP request message; Described response message is http response message.
6. method according to claim 5, is characterized in that, when described this computer receives the response message of mobile Internet Website server transmission, resolves and obtain corresponding mobile Internet web site contents information, comprising:
When this computer receives the http response message of mobile Internet Website server transmission, resolve and obtain text message, if there is the universal resource identifier URI information of link picture in this http response message, extract corresponding URI information and also construct the HTTP request message of the pictorial information that obtains corresponding mobile Internet website, and send to the mobile Internet Website server corresponding to URI information of described link picture;
When this computer receives the http response message that carries pictorial information of mobile Internet Website server transmission, resolve and obtain pictorial information.
7. method according to claim 1, is characterized in that, described while accessing target mobile Internet website corresponding to URL address in described url list by mobile terminal, described method further comprises:
Local network connection status is monitored in real time, connected when abnormal and automatically reconnect at network.
8. method according to claim 7, is characterized in that, described method further comprises:
This computer accesses mobile Internet website by calling Windows function library by mobile terminal, and monitors local network connection state.
9. method according to claim 1, is characterized in that, described in send to corresponding mobile Internet Website server, before, described method further comprises:
Obtain local network connection status, connect when normal if the network connection state of obtaining is network, send to corresponding mobile Internet Website server step described in execution; Otherwise, re-establish connection, send to corresponding mobile Internet Website server step described in execution.
10. according to the method described in claim 1-9 any one, it is characterized in that, described method further comprises:
By the mobile Internet web site contents information of the obtaining storage of classifying, for inquiring about, analyze, add up the Web content of mobile Internet website.
CN201210424370.9A 2012-10-30 2012-10-30 Method for downloading mobile internet website content information Pending CN103795748A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210424370.9A CN103795748A (en) 2012-10-30 2012-10-30 Method for downloading mobile internet website content information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210424370.9A CN103795748A (en) 2012-10-30 2012-10-30 Method for downloading mobile internet website content information

Publications (1)

Publication Number Publication Date
CN103795748A true CN103795748A (en) 2014-05-14

Family

ID=50671031

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210424370.9A Pending CN103795748A (en) 2012-10-30 2012-10-30 Method for downloading mobile internet website content information

Country Status (1)

Country Link
CN (1) CN103795748A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107613003A (en) * 2017-09-19 2018-01-19 北京达佳互联信息技术有限公司 Multimedia file synchronous method, device and terminal
CN111859234A (en) * 2020-06-03 2020-10-30 北京神州泰岳智能数据技术有限公司 Illegal content identification method and device, electronic equipment and storage medium
CN117014425A (en) * 2023-08-11 2023-11-07 深圳先锋居善科技有限公司 File downloading method, device, equipment and computer readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090090101A (en) * 2008-02-20 2009-08-25 주식회사 케이티프리텔 Method for loading multimedia contents in the mobile internet browser and wireless communication terminal therefor
CN102026290A (en) * 2010-12-16 2011-04-20 华为终端有限公司 Wireless mobile gateway and method for responding user access by same
CN102271331A (en) * 2010-06-02 2011-12-07 ***通信集团广东有限公司 Method and system for detecting reliability of service provider (SP) site

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090090101A (en) * 2008-02-20 2009-08-25 주식회사 케이티프리텔 Method for loading multimedia contents in the mobile internet browser and wireless communication terminal therefor
CN102271331A (en) * 2010-06-02 2011-12-07 ***通信集团广东有限公司 Method and system for detecting reliability of service provider (SP) site
CN102026290A (en) * 2010-12-16 2011-04-20 华为终端有限公司 Wireless mobile gateway and method for responding user access by same

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107613003A (en) * 2017-09-19 2018-01-19 北京达佳互联信息技术有限公司 Multimedia file synchronous method, device and terminal
CN111859234A (en) * 2020-06-03 2020-10-30 北京神州泰岳智能数据技术有限公司 Illegal content identification method and device, electronic equipment and storage medium
CN117014425A (en) * 2023-08-11 2023-11-07 深圳先锋居善科技有限公司 File downloading method, device, equipment and computer readable storage medium

Similar Documents

Publication Publication Date Title
CN110300050B (en) Message pushing method and device, computer equipment and storage medium
CN106330844B (en) Cross-terminal login-free method and device
CN102006588B (en) Method and system for monitoring network behavior of smart mobile phone
CN106469044B (en) Method and device for realizing page jump
CN101958914A (en) File sharing method, shared server and mobile communication terminal
CN108632367A (en) Account correlating method and information-pushing method
CN102783119A (en) Access control method and system, and access terminal
CN102480501A (en) Application resource downloading method and associated equipment
CN103857007A (en) Wireless local area network access system and method
WO2015021873A1 (en) Method, platform server, and system of data pushing
CN104468852A (en) Method, device and system for client to select IP link address
CN103703741B (en) application program distribution method, terminal and server
CN103812900A (en) Data synchronization method, device and system
CN102904765A (en) Method and equipment for data reporting
CN103167014A (en) Method and device of sharing resources with browsers
CN107368334B (en) Business plug-in interaction system and method
CN103716230A (en) Message sending method, device and server
CN107306388B (en) Configuration method and device of Access Point Name (APN)
CN103795748A (en) Method for downloading mobile internet website content information
CN109587197B (en) Method, device and system for associating reported data
CN114039961A (en) Message pushing method, device, server and storage medium based on WebSocket
CN104202432B (en) Remote web management system and management method
CN107465723B (en) Multi-screen interactive connection method and system, mobile terminal and readable storage medium
CN105991799B (en) The method and device of mobile terminal network visiting
WO2014154053A1 (en) Method, system, and computer storage medium for information dissemination based on wireless access point

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20140514