CN104253844A - Microblog data downloading method and system, user terminal and downloading server - Google Patents

Microblog data downloading method and system, user terminal and downloading server Download PDF

Info

Publication number
CN104253844A
CN104253844A CN201310269096.7A CN201310269096A CN104253844A CN 104253844 A CN104253844 A CN 104253844A CN 201310269096 A CN201310269096 A CN 201310269096A CN 104253844 A CN104253844 A CN 104253844A
Authority
CN
China
Prior art keywords
download
microblogging
downloading task
document
user terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310269096.7A
Other languages
Chinese (zh)
Other versions
CN104253844B (en
Inventor
程振中
田明
刘里
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Beijing Co Ltd
Original Assignee
Tencent Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Beijing Co Ltd filed Critical Tencent Technology Beijing Co Ltd
Priority to CN201310269096.7A priority Critical patent/CN104253844B/en
Publication of CN104253844A publication Critical patent/CN104253844A/en
Application granted granted Critical
Publication of CN104253844B publication Critical patent/CN104253844B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a microblog data downloading method and system, a user terminal and a downloading server. The method includes: receiving a downloading task, containing downloading parameters, from the user terminal, wherein the downloading parameters include user names, time periods and microblog types; acquiring publishing index data corresponding to the user names and satisfying the time periods and the microblog types, and acquiring corresponding microblog data according to the publishing index data; generating microblog documents according to the user names and the microblog data, and uploading the microblog documents to appointed addresses; transmitting pushing information containing the appointed addresses to the user terminal; receiving a downloading request, containing the appointed addresses, from the user terminal, acquiring the microblog documents from the appointed addresses, and transmitting the microblog documents to the user terminal. By the method, the user terminal can download the microblog data.

Description

Carry out the method and system of microblog data download, user terminal and download server
Technical field
The present invention relates to microblog technology, particularly relate to method and system, user terminal and the download server of carrying out microblog data download.
Background technology
Microblogging, be a kind of typical user's original content (UCG, User Created Content) application, user constantly publishes the news on microblogging.As time goes on, the size of message of user can reach thousands of, even tens, up to a million.
If user wants to check the microblog data oneself delivered, need to pass through web page browsing.In actual applications, often need the microblog data delivered oneself to process, comprise off-line and check, analyze, arrange preservation etc.; How to realize the concrete download of microblog data, become problem demanding prompt solution.
To sum up, there is the defect can not downloaded microblog data in existing microblog data processing scheme.
Summary of the invention
The invention provides a kind of method of carrying out microblog data download, the method can realize the download of user terminal to microblog data.
The invention provides a kind of system of carrying out microblog data download, this system can realize the download of user terminal to microblog data.
The invention provides a kind of user terminal, this user terminal can realize the download to microblog data.
The invention provides a kind of download server of carrying out microblog data download, this download server can realize the download of user terminal to microblog data.
Carry out a method for microblog data download, the method comprises:
Receive the downloading task comprising download parameters of user terminal, described download parameters comprises user name, time period and microblogging type;
Obtain corresponding with user name meet time period and microblogging type deliver index data, obtain corresponding microblog data by delivering index data; Generate microblogging document by user name and microblog data, microblogging document is uploaded to assigned address;
The pushed information comprising assigned address is issued to user terminal;
Receive the download request comprising assigned address of user terminal, obtain microblogging document from assigned address, send to user terminal.
Carry out a system for microblog data download, this system comprises download server and user terminal;
Described download server, receives the downloading task comprising download parameters from described user terminal, and described download parameters comprises user name, time period and microblogging type; Obtain corresponding with user name meet time period and microblogging type deliver index data, obtain corresponding microblog data by delivering index data; Generate microblogging document by user name and microblog data, microblogging document is uploaded to assigned address; The pushed information comprising assigned address is issued to described user terminal; Receive the download request comprising assigned address from described user terminal, obtain microblogging document from assigned address, send to described user terminal.
Described user terminal, sends downloading task to described download server, receives the pushed information comprising assigned address of described download server feedback; Send the download request comprising assigned address to described download server, receive the microblogging document of described download server feedback.
A kind of user terminal, this user terminal comprises downloading task and initiates unit and microblogging document acquiring unit;
Described downloading task initiates unit, and send the downloading task comprising download parameters, described download parameters comprises user name, time period and microblogging type, and receiving package, containing the pushed information of assigned address, sends to described microblogging document acquiring unit;
Described microblogging document acquiring unit, sends the download request comprising assigned address, receives microblogging document.Carry out a download server for microblog data download, this download server comprises downloading task processing unit, microblogging document process unit and data-pushing unit;
Described downloading task processing unit, receive the downloading task comprising download parameters of user terminal, send to described microblogging document process unit, described download parameters comprises user name, time period and microblogging type;
Described microblogging document process unit, receives the downloading task from described downloading task processing unit, obtain corresponding with user name meet time period and microblogging type deliver index data, obtain corresponding microblog data by delivering index data; Generate microblogging document by user name and microblog data, microblogging document is uploaded to assigned address; The pushed information comprising assigned address is issued to user terminal;
Described data-pushing unit, receives the download request comprising assigned address of user terminal, obtains microblogging document, send to user terminal from assigned address.
As can be seen from such scheme, in the present invention, receive the downloading task of user terminal, microblogging document is generated according to download parameters, specifically comprise: obtain corresponding with user name meet time period and microblogging type deliver index data, obtaining corresponding microblog data by delivering index data, generating microblogging document by user name and microblog data; Then, microblogging document is uploaded to assigned address, issue the pushed information comprising assigned address to user terminal.Afterwards, receive the download request comprising assigned address of user terminal, obtain microblogging document from assigned address, send to user terminal.Like this, microblog data just can be downloaded to this locality by user terminal, realize off-line state microblog data checked and can to before microblog data analyze, arrange bookbinding for historical record persistence, meet demand further.
Accompanying drawing explanation
Fig. 1 is the method indicative flowchart that base of the present invention carries out microblog data download;
Fig. 2 is the method indicative flowchart example that the present invention carries out microblog data download;
Fig. 3 is the system configuration schematic diagram that the present invention carries out microblog data download.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly understand, below in conjunction with embodiment and accompanying drawing, the present invention is described in more detail.
In the present invention, receive the downloading task of user terminal, generate microblogging document according to download parameters, then, microblogging document is uploaded to assigned address, issue the pushed information comprising assigned address to user terminal; Afterwards, user just can download microblogging document from assigned address.Thus, realize the download of user terminal to microblog data, to check microblog data in off-line state, and former microblog data can be analyzed, arrange bookbinding for historical record persistence etc., meet demand further.
See Fig. 1, for the present invention carries out the method indicative flowchart of microblog data download, it comprises the following steps:
Step 101, receive the downloading task comprising download parameters of user terminal, described download parameters comprises user name, time period and microblogging type.
When user wants to download the microblog data oneself delivered, send downloading task, comprise download parameters in downloading task to download server, user can setup times section and microblogging type as required; For a certain downloading task, may need to pull hundreds of, even several thousand microbloggings.
Step 102, obtain corresponding with user name meet time period and microblogging type deliver index data, obtain corresponding microblog data by delivering index data; Generate microblogging document by user name and microblog data, microblogging document is uploaded to assigned address.
Further, obtain described in this step corresponding with user name meet time period and microblogging type deliver index data before, the method also comprises: obtain the pet name corresponding with user name;
Also the pet name is comprised in the microblogging document generated.
After user delivers microblogging at every turn, network side will store the pet name of respective user name, and store user and deliver time of microblogging, microblogging type and microblog data, and microblogging type is as picture, text etc.; When storing microblog data, for every bar microblog data arranges a numbering, reference numeral stores microblog data, and described numbering is delivers index data, can inquire corresponding microblog data by delivering index data.
In this step, download server, according to download parameters, generates microblogging document, comprises user name, the pet name and microblog data, specifically can adopt the implementation of word document in microblogging document.
Download server may process multiple downloading task simultaneously, and be limited to the resources such as CPU, memory size, download time, in order to ensure the normal operation of download server, the present invention also limits the current downloading task number processed.Particularly, before obtaining the pet name corresponding with user name described in this step, the method also comprises: judge whether the current downloading task number processed is greater than setting number, if, then downloading task is put into preliminary treatment queue, otherwise perform the step of the described acquisition pet name corresponding with user name.Download server except when receiving the downloading task of user terminal, outside the current downloading task number processed is judged; Also periodically judge whether the downloading task number processed is greater than setting number, if not, then read the downloading task in preliminary treatment queue, and the downloading task that process is read.
In order to avoid repeatedly processing same downloading task simultaneously, waste resource, concrete example such as user repeatedly can click in the very short time, and send the situation of same downloading task to download server, the present invention also carries out same parameter judgement; Particularly, after judging that the current downloading task number processed is not more than setting number, the method also comprises: the download parameters obtaining the current downloading task processed from parameter sharing internal memory, judge that whether the download parameters of the downloading task received is identical with the download parameters obtained from parameter sharing internal memory, if identical, then refuse to download, otherwise perform the step of the described acquisition pet name corresponding with user name, and in parameter sharing internal memory, store the download parameters of the downloading task of reception.
Step 103, issues the pushed information comprising assigned address to user terminal.
Particularly, pushed information can adopt the mode of microblogging personal letter to be handed down to user terminal.
Step 104, receives the download request comprising assigned address of user terminal, obtains microblogging document, send to user terminal from assigned address.
In order to improve the fail safe obtaining microblogging document, before obtaining microblogging document from assigned address described in this step, can also comprise: user validation is verified, if be proved to be successful, then performing the described step obtaining microblogging document from assigned address; Otherwise refusal download request.
Described to user validation carry out verifying concrete as: in download request, comprise user terminal to send time from download request to download server, be called initial time, after download server receives download request, judge that whether user is online, if, initial time is obtained from download request, initial time is deducted by current time, the time difference obtained and the shelf-life pre-set are compared, if the time difference is less than or equal to the shelf-life, then determine that user is legal, otherwise, determine that user is illegal.
In the flow process of Fig. 1, perform step 102 to 103, realizing by calling corresponding functional interface, comprising trunk interfaces and iteration interface.Call trunk interfaces, can obtain the trunk information of user, such as, comprise that the pet name pulls interface, index data pulls interface, interface uploaded by document structure tree interface, document and pushed information issues interface successively, these interfaces do not comprise pulling of concrete microblog data.Call iteration interface, can obtain the microblog data of user, such as pictorial information pulls interface etc.
Trunk interfaces is backbone module, must perform, and can not make mistakes.Iteration interface is the download interface of every bar microblogging, needs continuous iteration until download completing user full dose microblogging, namely until all got by all microbloggings meeting time period and microblogging type; Time different from trunk interfaces, make mistakes when a wherein microblogging is downloaded, can subsequent download be carried out, although certain microblogging may be caused to lose (situation as certain microblogging infringement), entirety be downloaded, still highly significant.
In order to improve the success rate of download, in the present invention, for trunk interfaces and iteration interface, all carrying out repeatedly failure detection, namely, if once failure, more repeatedly calling.
1) for trunk interfaces:
Particularly, repeatedly failure detection can be adopted to each trunk interfaces, also can carry out failure detection to wherein part trunk interfaces.
When realizing, Business Processing function comprises each trunk interfaces and iteration interface, outside the Business Processing function comprising trunk interfaces and iteration interface, also can arrange a cyclical function again, carries out trunk interfaces failure recursive call.Meanwhile, for each trunk interfaces distributes a treatment state, by each treatment state and trunk interfaces binding, this treatment state comprises process status of fail and process success status; When trunk interfaces repeatedly call still failed after, cyclical function can re invocation Business Processing function, leaps to the pet name and pulls interface and perform, namely re-start process to downloading service.
If call to a certain trunk interfaces the number of times exceeding and preset, be assumed to be 3 times, be then back to the step obtaining the user name pet name and re-execute, namely the re invocation pet name pulls interface.
Here interface is pulled with index data, namely obtaining and delivering index data is that example is described, after adopting failure detection scheme, acquisition described in step 102 is delivered index data and is specifically comprised: judge that index obtains number of times and whether is greater than index set point number, if not, then obtain corresponding with user name meet time period and microblogging type deliver index data, if obtain successfully, go to and perform the described step by delivering microblog data corresponding to index data acquisition, and increase index acquisition number of times, if failure, return and perform the described step whether index acquisition number of times is greater than index set point number that judges, if be greater than, then return the step performing the described acquisition pet name.The failure detection scheme of other trunk interfaces and index data pull interface class seemingly, do not repeat one by one here.
2) for iteration interface:
During specific implementation, for every bar microblogging, iteration interface all adopts repeatedly failure detection; For certain microblogging, if the number of times calling iteration interface exceedes the number of times preset, be assumed to be 3 times, then carry out the download for next microblog data.
Adopt repeatedly failure detection technology to iteration interface, the download success rate of microblog data will improve greatly, carry out analytic explanation below.
Do not adopt the situation of repeatedly failure detection technology:
Each user has a large amount of microbloggings, and the acquisition of every bar microblog data needs to call an iteration interface and just can complete.If each iteration interface interchange success rate is 0.9999, and a downloading task needs download 10,000 microblog data, then 10,000 microblog data all being downloaded successful probability is 0.9999^10000<37%.
Adopt the situation of repeatedly failure detection technology:
Here, suppose that detecting number of times is still 3 times, and every bar microblogging to download successful probability be 0.9999, then for the downloading task comprising 10,000 microblog data, 10,000 microblog data are all downloaded successful success rate is:
[1-(1-0.9999)^3]^10000=0.99999999999999999999999999
Wherein, 1-0.9999: represent that a microblogging downloads once failed probability;
(1-0.9999) ^3: represent that a microblogging downloads all failed probability continuous 3 times;
[1-(1-0.9999) ^3]: represent continuous three downloads of microblogging once successful probability;
[1-(1-0.9999) ^3] ^10000:1w bar microblog data all downloads successful probability.
Visible, relative to the situation not adopting repeatedly failure detection, microblog data is all downloaded successful probability much larger than 37%, success rate has had great improvement.
In the present invention, receive the downloading task of user terminal, microblogging document is generated according to download parameters, specifically comprise: obtain the pet name corresponding with user name, obtain corresponding with user name meet time period and microblogging type deliver index data, obtaining corresponding microblog data by delivering index data, generating microblogging document by user name, the pet name and microblog data; Then, microblogging document is uploaded to assigned address, issue the pushed information comprising assigned address to user terminal.Afterwards, receive the download request comprising assigned address of user terminal, obtain microblogging document from assigned address, send to user terminal.Like this, microblog data just can be downloaded to this locality by user terminal, realize off-line state microblog data checked and can to before microblog data analyze, arrange bookbinding for historical record persistence, meet demand further.
Further, in downloading process, adopt multiple fluffing check technology, substantially increase the success rate that user downloads microblog data.
Below by the flow process of Fig. 2, the method for the present invention being carried out to microblog data download is illustrated, and it comprises the following steps:
Step 201, user logs in microblog data downloading page.
The present invention increases microblog data download items in microblogging business.User logs in microblogging homepage, is arranging inner interpolation " microblog data download " function; Afterwards, just microblog data downloading page can be logged in.
Step 202, user fills in download parameters in microblog data downloading page, clicks " download " button.
Downloading task to Business Processing interface (INF, interface) server, then sends download server to via INF server via the MAP module transfer of network side; MAP module and INF server are used for carrying out protocol conversion process to downloading task, to convert the form of download server identification to.INF server can be set to mutually redundant two, and these two INF servers are all connected with download server, and using one of them as main interface server, another is as from interface server; Usually, downloading task sends download server to by main interface server, if main interface server failure, then adopts and sends downloading task to download server from interface server.
Step 203, download server receives the downloading task comprising download parameters of user terminal, judges whether the current downloading task number processed is greater than setting number, if so, then downloading task is put into preliminary treatment queue, otherwise performs step 204.
Download server is that downloading task creates a downloading process, with complete microblogging document generation, to uploading of assigned address and issuing of pushed information.Correspondingly, this step that is to say: receive downloading task, judge whether the current downloading process processed is greater than setting number, if so, then downloading task is put into preliminary treatment queue, otherwise creates a downloading process, processes the downloading task of current reception.
When creating downloading process, two process can be adopted to create mode.Particularly, parent process creates to be downloaded subprocess and downloads Sun Jincheng, and then subprocess exits, and carries out Business Processing by Sun Jincheng, and according to the feature of operating system, process is in isolated state, will be taken over by system; Like this, the drawback that one process creates mode is avoided.If adopt one process to create mode, parent process only creates download subprocess, makes mistakes, will be taken over by parent process if download subprocess; This mode increases the workload of parent process, and parent process may be caused to paralyse.
For preliminary treatment queue, download server periodically will judge whether the current downloading process processed is greater than setting number, if not, then read the downloading task in preliminary treatment queue, process for it creates downloading process; If so, the judgement in next cycle is continued.
Step 204, download server obtains the download parameters of the current downloading task processed from parameter sharing internal memory, judge that whether the download parameters of the downloading task of current reception is identical with the download parameters obtained from parameter sharing internal memory, if identical, then refuse to download, otherwise perform step 205, and in parameter sharing internal memory, store the download parameters of the downloading task of reception.
Parameter sharing internal memory, for storing the download parameters processed, specifically can adopt redis memory technology, and redis memory technology supports more storage class, comprises hash Value Types, ordered set (zset, sorted set) type etc.When adopting hash value mode to store, calculate the hash value of download parameters, respective user name stores hash value; When needing, obtain the hash value corresponding with user name from parameter sharing internal memory, carry out inverse operation, obtain download parameters.Ordered set (zset, sorted set) mode also can be adopted in parameter sharing internal memory to store download parameters, and zset mode is a kind of list storage mode.
Step 205, download server obtains the pet name corresponding with user name.
Step 206, download server obtain corresponding with user name meet time period and microblogging type deliver index data.
Step 207, download server obtains corresponding microblog data by delivering index data.
Step 208, download server generates microblogging document by user name, the pet name and microblog data, and microblogging document is uploaded to assigned address.
Step 209, download server issues the microblogging personal letter comprising assigned address to user terminal.
Step 204 is the implementation of downloading process to 209, downloading task number and downloading process number, is stored in counting shared drive, often creates a downloading process, needs to increase the counting in counting shared drive, makes counting add 1; Downloading process is finished, and needs to reduce the technology in counting shared drive, makes counting subtract 1.In order to avoid operating downloading task number simultaneously, mutual exclusion lock can be set for counting shared drive; Particularly, when creating downloading process, open mutual exclusion lock, increase the download counting in shared drive, then close mutual exclusion lock; When downloading process is finished, after the microblogging personal letter being about to comprise assigned address sends to user terminal, open mutual exclusion lock, reduce the download counting in shared drive, then close mutual exclusion lock afterwards.
Step 210, user checks microblogging personal letter, clicks the link about assigned address comprised in microblogging private.
Step 211, download server receives the download request comprising assigned address of user terminal.
Step 212, download server is verified user validation, if be proved to be successful, then obtained microblogging document from assigned address, sends to user terminal; Otherwise refusal download request.
See Fig. 3, for the present invention carries out the system configuration schematic diagram of microblog data download, this system comprises download server and user terminal;
Described download server, receives the downloading task comprising download parameters from described user terminal, and described download parameters comprises user name, time period and microblogging type; Obtain corresponding with user name meet time period and microblogging type deliver index data, obtain corresponding microblog data by delivering index data; Generate microblogging document by user name and microblog data, microblogging document is uploaded to assigned address; The pushed information comprising assigned address is issued to described user terminal; Receive the download request comprising assigned address from described user terminal, obtain microblogging document from assigned address, send to described user terminal.
Described user terminal, sends downloading task to described download server, receives the pushed information comprising assigned address of described download server feedback; Send the download request comprising assigned address to described download server, receive the microblogging document of described download server feedback.
Preferably, this user terminal comprises downloading task initiation unit and microblogging document acquiring unit;
Described downloading task initiates unit, and send the downloading task comprising download parameters, described download parameters comprises user name, time period and microblogging type, and receiving package, containing the pushed information of assigned address, sends to described microblogging document acquiring unit;
Described microblogging document acquiring unit, sends the download request comprising assigned address, receives microblogging document.
Preferably, this download server comprises downloading task processing unit, microblogging document process unit and data-pushing unit;
Described downloading task processing unit, receive the downloading task comprising download parameters of user terminal, send to described microblogging document process unit, described download parameters comprises user name, time period and microblogging type;
Described microblogging document process unit, receives the downloading task from described downloading task processing unit, obtain corresponding with user name meet time period and microblogging type deliver index data, obtain corresponding microblog data by delivering index data; Generate microblogging document by user name and microblog data, microblogging document is uploaded to assigned address; The pushed information comprising assigned address is issued to user terminal;
Described data-pushing unit, receives the download request comprising assigned address of user terminal, obtains microblogging document, send to user terminal from assigned address.
Preferably, described microblogging document process unit, obtain corresponding with user name meet time period and microblogging type deliver index data before, the pet name that also acquisition is corresponding with user name; Also the pet name is comprised in the microblogging document generated.Preferably, described downloading task processing unit comprises task number judgment sub-unit and task queue process subelement;
Described task number judgment sub-unit, receive the downloading task comprising download parameters of user terminal, judge whether the current downloading task number processed is greater than setting number, if, then downloading task is sent to described task queue process subelement, otherwise downloading task is sent to described microblogging document process unit;
Described task queue process subelement, receives the downloading task from described task number process subelement, puts into preliminary treatment queue; And periodically judge whether the downloading task number processed is greater than setting number, if so, then read the downloading task in preliminary treatment queue, send to described microblogging document process unit.
Preferably, described task number judgment sub-unit comprises same parameter judge module, when judging that the current downloading task number processed is not more than setting number, the download parameters of the current downloading task processed is obtained from parameter sharing internal memory, judge that whether the download parameters of the downloading task received is identical with the download parameters obtained from parameter sharing internal memory, if identical, then refuse to download, otherwise downloading task is sent to described microblogging document process unit, and in parameter sharing internal memory, store the download parameters of the downloading task of reception.
Preferably, described microblogging document process unit comprises microblogging document structure tree subelement, subelement uploaded by document and pushed information issues unit, and described microblogging document process unit comprises that the pet name pulls module, index data pulls module, full dose data acquisition module and document creation module;
The described pet name pulls module, obtains the pet name corresponding with user name in download parameters, sends to described document creation module;
Described index data pulls module, obtain corresponding with user name meet time period and microblogging type deliver index data, send to described full dose data acquisition module;
Described full dose data acquisition module, obtaining corresponding microblog data by delivering index data, sending to described document creation module;
Described document creation module, generates microblogging document by user name, the pet name and microblog data;
Subelement uploaded by described document, and the microblogging document described document creation module generated uploads to assigned address, sent to by assigned address described pushed information to issue unit;
Described pushed information issues unit, issues the pushed information comprising assigned address to user terminal.
The function called that the pet name pulls interface, index data pulls interface, interface uploaded by iteration interface, document structure tree interface, document, pushed information issues interface etc. and realize, is just equivalent to that the pet name pulls module, index data pulls module, subelement uploaded by full dose data acquisition module, document creation module, document, pushed information issues the function that unit etc. realizes respectively.Further, the pet name pulls module, index data pulls module, subelement uploaded by full dose data acquisition module, document creation module, document and pushed information issues unit, and aforesaid multiple fluffing check technology all can be adopted to complete respective function.
Preferably, described index data pulls module, also for judging that index obtains number of times and whether is greater than index set point number, if not, then obtain corresponding with user name meet time period and microblogging type deliver index data, if obtain successfully, then will deliver index data and send to described document creation module, and increase index acquisition number of times, if failure, return and perform the described step whether index acquisition number of times is greater than index set point number that judges; If be greater than, then pulled module to the described pet name and send enabled instruction;
The described pet name pulls module, receives enabled instruction, obtains the pet name corresponding with user name in download parameters, send to described document creation module.
Preferably, described data-pushing unit comprises syndrome unit and data acquisition subelement;
Described syndrome unit, receives the download request comprising assigned address of user terminal, verifies, if be proved to be successful, then assigned address is sent to described data acquisition subelement to user validation, otherwise refusal download request;
Described data acquisition subelement, obtains microblogging document from assigned address, sends to user terminal.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment made, equivalent replacement, improvement etc., all should be included within the scope of protection of the invention.

Claims (15)

1. carry out a method for microblog data download, it is characterized in that, the method comprises:
Receive the downloading task comprising download parameters of user terminal, described download parameters comprises user name, time period and microblogging type;
Obtain corresponding with user name meet time period and microblogging type deliver index data, obtain corresponding microblog data by delivering index data; Generate microblogging document by user name and microblog data, microblogging document is uploaded to assigned address;
The pushed information comprising assigned address is issued to user terminal;
Receive the download request comprising assigned address of user terminal, obtain microblogging document from assigned address, send to user terminal.
2. the method for claim 1, is characterized in that, what described acquisition was corresponding with user name meet time period and microblogging type deliver index data before, the method also comprises: obtain the pet name corresponding with user name;
Also the pet name is comprised in the microblogging document generated.
3. method as claimed in claim 2, it is characterized in that, before the pet name that described acquisition is corresponding with user name, the method also comprises: judge whether the current downloading task number processed is greater than setting number, if, then downloading task is put into preliminary treatment queue, otherwise perform the step of the described acquisition pet name corresponding with user name;
The method also comprises: periodically judge whether the downloading task number processed is greater than setting number, if not, then read the downloading task in preliminary treatment queue, perform the step of the described acquisition pet name corresponding with user name.
4. method as claimed in claim 3, is characterized in that, after judging that the current downloading task number processed is not more than setting number, the method also comprises:
The download parameters of the current downloading task processed is obtained from parameter sharing internal memory, judge that whether the download parameters of the downloading task received is identical with the download parameters obtained from parameter sharing internal memory, if identical, then refuse to download, otherwise perform the step of the described acquisition pet name corresponding with user name, and in parameter sharing internal memory, store the download parameters of the downloading task of reception.
5. method as claimed in claim 2, it is characterized in that, described acquisition is delivered index data and is comprised:
Judge that index obtains number of times and whether is greater than index set point number, if be not more than, then obtain corresponding with user name meet time period and microblogging type deliver index data, if obtain successfully, go to and perform the described step by delivering microblog data corresponding to index data acquisition, and increase index acquisition number of times, if failure, return and perform the described step whether index acquisition number of times is greater than index set point number that judges; If be greater than, then return the step performing the described acquisition pet name.
6. the method according to any one of claim 1 to 5, is characterized in that, described before assigned address acquisition microblogging document, the method also comprises:
User validation is verified, if be proved to be successful, then performs the described step obtaining microblogging document from assigned address; Otherwise refusal download request.
7. carry out a system for microblog data download, it is characterized in that, this system comprises download server and user terminal;
Described download server, receives the downloading task comprising download parameters from described user terminal, and described download parameters comprises user name, time period and microblogging type; Obtain corresponding with user name meet time period and microblogging type deliver index data, obtain corresponding microblog data by delivering index data; Generate microblogging document by user name and microblog data, microblogging document is uploaded to assigned address; The pushed information comprising assigned address is issued to described user terminal; Receive the download request comprising assigned address from described user terminal, obtain microblogging document from assigned address, send to described user terminal.
Described user terminal, sends downloading task to described download server, receives the pushed information comprising assigned address of described download server feedback; Send the download request comprising assigned address to described download server, receive the microblogging document of described download server feedback.
8. a user terminal, is characterized in that, this user terminal comprises downloading task and initiates unit and microblogging document acquiring unit;
Described downloading task initiates unit, and send the downloading task comprising download parameters, described download parameters comprises user name, time period and microblogging type, and receiving package, containing the pushed information of assigned address, sends to described microblogging document acquiring unit;
Described microblogging document acquiring unit, sends the download request comprising assigned address, receives microblogging document.
9. carry out a download server for microblog data download, it is characterized in that, this download server comprises downloading task processing unit, microblogging document process unit and data-pushing unit;
Described downloading task processing unit, receive the downloading task comprising download parameters of user terminal, send to described microblogging document process unit, described download parameters comprises user name, time period and microblogging type;
Described microblogging document process unit, receives the downloading task from described downloading task processing unit, obtain corresponding with user name meet time period and microblogging type deliver index data, obtain corresponding microblog data by delivering index data; Generate microblogging document by user name and microblog data, microblogging document is uploaded to assigned address; The pushed information comprising assigned address is issued to user terminal;
Described data-pushing unit, receives the download request comprising assigned address of user terminal, obtains microblogging document, send to user terminal from assigned address.
10. download server as claimed in claim 9, is characterized in that, described microblogging document process unit, obtain corresponding with user name meet time period and microblogging type deliver index data before, the pet name that also acquisition is corresponding with user name; Also the pet name is comprised in the microblogging document generated.
11. download servers as claimed in claim 10, is characterized in that, described downloading task processing unit comprises task number judgment sub-unit and task queue process subelement;
Described task number judgment sub-unit, receive the downloading task comprising download parameters of user terminal, judge whether the current downloading task number processed is greater than setting number, if, then downloading task is sent to described task queue process subelement, otherwise downloading task is sent to described microblogging document process unit;
Described task queue process subelement, receives the downloading task from described task number process subelement, puts into preliminary treatment queue; And periodically judge whether the downloading task number processed is greater than setting number, if so, then read the downloading task in preliminary treatment queue, send to described microblogging document process unit.
12. download servers as claimed in claim 11, it is characterized in that, described task number judgment sub-unit comprises same parameter judge module, when judging that the current downloading task number processed is not more than setting number, the download parameters of the current downloading task processed is obtained from parameter sharing internal memory, judge that whether the download parameters of the downloading task received is identical with the download parameters obtained from parameter sharing internal memory, if identical, then refuse to download, otherwise downloading task is sent to described microblogging document process unit, and in parameter sharing internal memory, store the download parameters of the downloading task of reception.
13. download servers as claimed in claim 10, it is characterized in that, described microblogging document process unit comprises microblogging document structure tree subelement, subelement uploaded by document and pushed information issues unit, and described microblogging document process unit comprises that the pet name pulls module, index data pulls module, full dose data acquisition module and document creation module;
The described pet name pulls module, obtains the pet name corresponding with user name in download parameters, sends to described document creation module;
Described index data pulls module, obtain corresponding with user name meet time period and microblogging type deliver index data, send to described full dose data acquisition module;
Described full dose data acquisition module, obtaining corresponding microblog data by delivering index data, sending to described document creation module;
Described document creation module, generates microblogging document by user name, the pet name and microblog data;
Subelement uploaded by described document, and the microblogging document described document creation module generated uploads to assigned address, sent to by assigned address described pushed information to issue unit;
Described pushed information issues unit, issues the pushed information comprising assigned address to user terminal.
14. download servers as claimed in claim 10, it is characterized in that, described index data pulls module, also for judging that index obtains number of times and whether is greater than index set point number, if be not more than, then obtain corresponding with user name meet time period and microblogging type deliver index data, if obtain successfully, then will deliver index data and send to described document creation module, and increase index acquisition number of times, if failure, return and perform the described step whether index acquisition number of times is greater than index set point number that judges; If be greater than, then pulled module to the described pet name and send enabled instruction;
The described pet name pulls module, receives enabled instruction, obtains the pet name corresponding with user name in download parameters, send to described document creation module.
15. download servers according to any one of claim 10 to 14, its feature is from being, described data-pushing unit comprises syndrome unit and data acquisition subelement;
Described syndrome unit, receives the download request comprising assigned address of user terminal, verifies, if be proved to be successful, then assigned address is sent to described data acquisition subelement to user validation, otherwise refusal download request;
Described data acquisition subelement, obtains microblogging document from assigned address, sends to user terminal.
CN201310269096.7A 2013-06-28 2013-06-28 Carry out method and system, user terminal and the download server of microblog data download Active CN104253844B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310269096.7A CN104253844B (en) 2013-06-28 2013-06-28 Carry out method and system, user terminal and the download server of microblog data download

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310269096.7A CN104253844B (en) 2013-06-28 2013-06-28 Carry out method and system, user terminal and the download server of microblog data download

Publications (2)

Publication Number Publication Date
CN104253844A true CN104253844A (en) 2014-12-31
CN104253844B CN104253844B (en) 2018-06-22

Family

ID=52188373

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310269096.7A Active CN104253844B (en) 2013-06-28 2013-06-28 Carry out method and system, user terminal and the download server of microblog data download

Country Status (1)

Country Link
CN (1) CN104253844B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106534247A (en) * 2016-09-18 2017-03-22 东软集团股份有限公司 Method and device for downloading forms
WO2017101265A1 (en) * 2015-12-18 2017-06-22 腾讯科技(深圳)有限公司 Message processing method, processing server, terminal and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090000253A (en) * 2007-02-08 2009-01-07 박종훈 Blog system and method for using contents registered thereon
CN101996196A (en) * 2009-08-28 2011-03-30 ***通信集团公司 Dynamic webpage acquisition method and device
CN102163203A (en) * 2010-02-24 2011-08-24 富士通株式会社 Method and device for downloading web pages
US20120072835A1 (en) * 2010-09-20 2012-03-22 UberMedia, Inc. Microblog Client
CN102663125A (en) * 2012-04-20 2012-09-12 李朋涛 Method and system for collecting microblog contents to make electronic document

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090000253A (en) * 2007-02-08 2009-01-07 박종훈 Blog system and method for using contents registered thereon
CN101996196A (en) * 2009-08-28 2011-03-30 ***通信集团公司 Dynamic webpage acquisition method and device
CN102163203A (en) * 2010-02-24 2011-08-24 富士通株式会社 Method and device for downloading web pages
US20120072835A1 (en) * 2010-09-20 2012-03-22 UberMedia, Inc. Microblog Client
CN102663125A (en) * 2012-04-20 2012-09-12 李朋涛 Method and system for collecting microblog contents to make electronic document

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017101265A1 (en) * 2015-12-18 2017-06-22 腾讯科技(深圳)有限公司 Message processing method, processing server, terminal and storage medium
US10587544B2 (en) 2015-12-18 2020-03-10 Tencent Technology (Shenzhen) Company Limited Message processing method, processing server, terminal, and storage medium
CN106534247A (en) * 2016-09-18 2017-03-22 东软集团股份有限公司 Method and device for downloading forms

Also Published As

Publication number Publication date
CN104253844B (en) 2018-06-22

Similar Documents

Publication Publication Date Title
CN102202102B (en) Network service polymerization system and polymerization method thereof based on cloud computing configuration
US9912747B2 (en) Browser and system for download and download method
CN103873517B (en) A kind of methods, devices and systems of data syn-chronization
CN102917070B (en) Webpage share system
TWI354475B (en) Dispatching client requests to appropriate server-
US10540271B2 (en) Document processing events
CN103812882A (en) Method and system for transferring files
CN103179148B (en) A kind of processing method sharing adnexa in the Internet and system
US10893091B2 (en) Management of asynchronous content post and media file transmissions
CN110263001B (en) File management method, device, system, equipment and computer readable storage medium
CN101355590B (en) Method, system and apparatus for prompting download
CN103188128A (en) Preview method of mail attachment and mail system
CN102932471B (en) Browser logon server and realize browser log in method and system
CN103810268A (en) Search result recommendation information loading method, device and system and URL detection method, device and system
CN105471968A (en) Data exchange method, data exchange system and data platform server
CN107656742A (en) A kind of software product dissemination method and device
CN102622550A (en) Safe online patch check system facing terminal computers
US20210358013A1 (en) Processing documents
CN104143110A (en) Two-dimensional code generating method with web site information
CN104253844A (en) Microblog data downloading method and system, user terminal and downloading server
US11501253B2 (en) Document event brokering and audit system
CN111369255B (en) User management method and device, electronic equipment and storage medium
CN104346460A (en) Method and device for downloading file and browser client
CN110933145A (en) Remote scheduling method, device, equipment and medium
CN105577658A (en) Method and system used for network link transmission

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant