CN103905906A - Smart-television-based data processing method and device - Google Patents
Smart-television-based data processing method and device Download PDFInfo
- Publication number
- CN103905906A CN103905906A CN201210583823.2A CN201210583823A CN103905906A CN 103905906 A CN103905906 A CN 103905906A CN 201210583823 A CN201210583823 A CN 201210583823A CN 103905906 A CN103905906 A CN 103905906A
- Authority
- CN
- China
- Prior art keywords
- video
- client
- server
- identifier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a smart-television-based data processing method and device. According to the method, a client and a server carry out communication through a custom communication identifier, so that cross platform interaction data processing between a smart television and a network is realized. According to the invention, when the client sends a video mail, only a packaged HTML page is sent; a user does not need to spend a lot of time to upload a large attachment; the upload can be completed when video recording is carried out; the mail sending efficiency is improved; and a recipient can carry out download and browsing at the same time when the recipient uses the webpage to browse a video later.
Description
Technical field
The application relates to data processing technique, particularly a kind of data processing method and device based on intelligent television.
Background technology
Comply with the trend of television set " high Qinghua ", " networking ", " intellectuality ", intelligent television is universal gradually.Intelligent television will be realized the various application services such as web search, Internet Protocol Television, BBTV netview.
At present, along with the development of intelligent television technology, intelligent television is becoming the third message reference terminal after computer, mobile phone, the information needing in order to facilitate user can utilize intelligent television to access at any time oneself, in the prior art, realizing the data processing of cross-platform interchange between intelligent television, network, is current technical problem urgently to be resolved hurrily.
Summary of the invention
The application provides a kind of data processing method and device based on intelligent television, to realize the data processing of cross-platform interchange between intelligent television, network.
The technical scheme that the application provides comprises:
Based on a data processing method for intelligent television, comprising:
Intelligent TV set is as client, and communicates by self-defining communication identifier between server, to obtain the network authorization of server;
Described client, in the time that needs send video-mail, utilizes the network identity ID of described server authorizes to log in to server, obtains the html page that is embedded in this client by server completing after logging in; Described html page at least comprises: transmitting-receiving hurdle, toolbar and mail editing area;
Described client is at least added addressee information, sender information, mail header and post time in the transmitting-receiving hurdle of described html page;
Described client is chosen insertion the Video Option at the toolbar of described html page, selects district so that the mail editing area of described html page adds a video;
Described client is write Mail Contents at the mail editing area of described html page, and in the time that video selects district to select to send local video file, local video file is uploaded onto the server, in the time selecting to send the video file of recording, adjust the size of video area, open recording arrangement with video area size mapping video resolution and start recorded video file, and the video file of recording is uploaded onto the server;
Described client is after uploading onto the server video file, and announcement server sends, and with the form of being understood according to mail generator by server, described html page is packed and is generated a video-mail, and be sent to addressee.
Based on a data processing method for intelligent television, comprising:
Described server carries out network authorization to the intelligent TV set as client;
Described server receives the connection request with the self-defining identifier that mails that described client sends by HTTP, whether out of dately identify the mail that this connection request asks, if not, return with self-defining mandate the replying to client of identifier that mail, if so, return with self-defining refusal the replying to client of identifier that mail;
Described server receive that described client sends with playing the playing request of adjusting identifier, described playing request is in the transmission during to the replying of the identifier that mails with mandate of described client;
Delay parameter FRAME_DELAY described in described server parses in playing request and network speed parameters R ATE_CHANGE, according to the performance parameter of described FRAME_DELAY, RATE_CHANGE and described client, adjust in real time the code check of transmission of multimedia streams, with the media stream of controlling transmission in client normal play.
Based on a data processing equipment for intelligent television, this device is intelligent TV set, comprising:
Communication module, for and server between communicate by self-defining communication identifier, to obtain the network authorization of server;
Log in module, in the time that described device need to send video-mail, utilize the network identity ID of described server authorizes to log in to server, obtain the html page that is embedded in this client by server completing after logging in; Described html page at least comprises: transmitting-receiving hurdle, toolbar and mail editing area;
Page processing module, for described html page being carried out to following processing: the transmitting-receiving hurdle at described html page at least adds addressee information, sender information, mail header, and post time, by choosing insertion the Video Option at the toolbar of described html page, so that adding a video, the mail editing area of described html page selects district, and write Mail Contents at the mail editing area of described html page, and in the time that video selects district to select to send local video file, local video file is uploaded onto the server, in the time selecting to send the video file of recording, adjust the size of video area, open recording arrangement with video area size mapping video resolution and start recorded video file, and the video file of recording is uploaded onto the server,
Notification module, for after described page processing module completes video file is uploaded onto the server, announcement server sends, and with the form of being understood according to mail generator by server, described html page is packed and is generated a video-mail, and be sent to addressee.
Based on a data processing equipment for intelligent television, this device is server, comprising:
Network process module, carries out network authorization for the intelligent TV set to as client;
Mail requests processing module, for receiving the connection request with the self-defining identifier that mails that described client sends by HTTP, whether out of dately identify the mail that this connection request asks, if not, return with self-defining mandate the replying to client of identifier that mail, if so, return with self-defining refusal the replying to client of identifier that mail;
Playing request processing module, the playing request with broadcasting adjustment identifier sending for receiving described client, resolve delay parameter FRAME_DELAY and network speed parameters R ATE_CHANGE in described playing request, according to the performance parameter of described FRAME_DELAY, RATE_CHANGE and described client, adjust in real time the code check of transmission, to control the broadcasting smoothness of client, wherein, described playing request is to send during to the replying of the identifier that mails with mandate at described client.
As can be seen from the above technical solutions, in the present invention, by the mutual data processing that has realized cross-platform interchange between intelligent television, network between client and server, and, in the present invention, in the time that client sends video-mail, compared with traditional transmission Email flow process, the present invention does not need the user effort plenty of time to upload jumbo annex, and it is uploaded and can in the time of video record, complete, and improves mail transmitting efficiency;
Further, in the present invention, what server sent is only a html page after packing, that is to say, addressee just receives a html page, and when this can guarantee that addressee is follow-up and can use web page browsing video, browse on download limit, limit.
Accompanying drawing explanation
The method flow diagram that Fig. 1 provides for the embodiment of the present invention;
The network authorization flow chart that Fig. 2 provides for the embodiment of the present invention;
Fig. 3 records authorization flow figure for what the embodiment of the present invention provided;
The server memory space dynamic allocation schematic diagram that Fig. 4 provides for the embodiment of the present invention;
The recorded video document flowchart that Fig. 5 provides for the embodiment of the present invention;
Sound, video data complex flow figure that Fig. 6 provides for the embodiment of the present invention;
The video-mail notice transmission flow figure that Fig. 7 provides for the embodiment of the present invention;
The server that Fig. 8 provides for the embodiment of the present invention sends the flow chart of video-mail to client;
The step 805 realization flow figure that Fig. 9 provides for the embodiment of the present invention;
The streamed schematic diagram of server selection multimedia that Figure 10 provides for the embodiment of the present invention;
The structure drawing of device that Figure 11 provides for the embodiment of the present invention;
The structure drawing of device that Figure 12 provides for the embodiment of the present invention.
Embodiment
In order to make the object, technical solutions and advantages of the present invention clearer, describe the present invention below in conjunction with the drawings and specific embodiments.
The invention provides a kind of data processing method based on intelligent television, as shown in Figure 1, the method comprises the flow process shown in Fig. 1:
Here, this step 101 specifically can realize by flow process shown in Fig. 2:
The network authorization flow chart that Fig. 2 provides for the embodiment of the present invention.As shown in Figure 2, this flow process comprises the following steps:
Step 201, client sends the connection request with self-defining application Access Identifier [CL_USER_ACCESS] by HTTP.
Here, connection request carries following parameter:
CLIENT_ID: be client id, when transmission, the private key by client be encrypted, use public-key and be decrypted at server end that checking client true identity takies 11 bytes.
TIMESTAMP: for sending the time of message, can be encrypted by private key equally, in order to checking client true identity, take 11 bytes.
Step 202, server coupling sends the information of the client of this connection request, determines whether authorized client access.
Here, the client-side information of coupling at least comprises username and password.
Step 203, server is in the time authorizing, and transmission is replied to client with self-defining access authorization identifier [SR_ACCESS_ACCEPT], otherwise, in the time not authorizing, send replying to client with self-defining access reject identifier [SR_ACCESS_REJECT].
Here carry TIMESTAMP and SERVER_ID with replying of [SR_ACCESS_ACCEPT].Wherein, SERVER_ID: be server ID, server will send confirmation to client, comprises the server ID of encrypting through privacy key, and client uses public-key and is decrypted, and for authentication server end true identity, takies 11 bytes.
Step 204, client, in the time receiving with the replying of [SR_ACCESS_ACCEPT], sends the capability message with self-defining performance parameter identifier [CL_PROFILE] by HTTP.
Here, why sending capability message object is the actual conditions of being convenient to this client of notification server, so that server admin.Wherein, the performance parameter that this capability message is carried at least comprises:
The CPU frequency (CPU_FREQ) of client, takies 10 bytes.
The maximum memory size (MEM) that client player is supported, takies 5 bytes.
The ultimate resolution (RES) that client is supported, takies 5 bytes.
The network rate (RATE) of client, takies 6 bytes.
Step 205, the performance parameter in server record capability message, returns to replying with self-defining confirming performance identifier [SR_PROFILE_DONE].
So far, complete the flow process shown in Fig. 2.
Can complete network authorization by flow process shown in Fig. 2.
Preferably, in the present invention, html page is mainly made up of toolbar, mail editing area, transmitting-receiving hurdle and video library.Based on this, in this step 103, client is processed and is specially described html page:
At the toolbar section of html page, except the option such as insert pictures or annex, the present invention has also increased the option that inserts video and cancel transmission.
1) for the option that inserts video, can add a video at mail editing area and select district, the label that this video selects district can provide user to select to add local video or recorded video, is specifically below being described.
2) for cancelling the option sending, before server delivering mail, this option is optional, otherwise not optional.
In the mail editing area part of html page, can write the content of mail, and, when user is in the time that video selects district to select to send local video file, local video file is uploaded onto the server, in the time selecting to send the video file of recording, adjust the size of video area, open recording arrangement with video area size mapping video resolution and start recorded video file, and the video file of recording is uploaded onto the server.
In the transmitting-receiving hurdle of html page part, preferably, this transmitting-receiving hurdle is made up of outbox hurdle and addressee hurdle, and user can click assembly according to transmitting-receiving demand.
1) for outbox hurdle, user can add address of the addressee, make a copy for people address and title content, and clicks transmission button and carry out the transmission of mail.
2), for addressee hurdle, show the information such as sender, the addressee of this mail, the people that makes a copy for, title content and transmitting time.
In the video library part of html page, with the form of thumbnail at video preview showing interface out, user can enter video preview interface by click in video council to be sent, triggers such as long by inserting video to mail editing area by setting triggering mode.
So far,, by describing, can complete the processing of html page above.
Step 104, described client is after uploading onto the server video file, and announcement server sends, and with the form of being understood according to mail generator by server, described html page is packed and is generated a video-mail, and be sent to addressee.
Here, in step 104 server according to mail generator understand form to described html page pack generation one video-mail be specifically below described.
So far, complete the flow process shown in Fig. 1.
The flow process that sends video-mail from the client shown in Fig. 1 can be found out, in the present invention, user does not need to spend the plenty of time and uploads jumbo annex, it is uploaded and can in the time of video record, complete, and, in the present invention, what server sent is only a html page after packing, that is to say, addressee just receives a html page, and when this can guarantee that addressee is follow-up and can use web page browsing video, browse on download limit, limit.
In flow process shown in Fig. 1, in step 103, before client starts recorded video, also need to communicate by self-defining communication identifier and server, to confirm whether server authorizes recorded video.
Wherein, this communication process mainly comprises each step as shown in Figure 3:
Wherein, this memory space dynamic allocation can be: the buffer-stored that a first default L is 20,000,000 such as the L value memory space that is 20,000,000 and L such as L value, exceed after default memory space at recorded content, double increase memory space, but the size of buffer-stored keeps L such as L value is 20,000,000 constant, also the memory space mm_storage=M+20 distributing, (M=20,40,80,, 10x2n; N=1,2 ...), take L value as 20,000,000 as example, the memory space distributing is as shown in Figure 4.By such memory allocated space, after can guaranteeing to have recorded, memory space is the size of the video file recorded.
Step 303, whether server meets according to recording condition, and transmission records identifier [SR_PVR_ACCEPT] with self-defining mandate or refusal is recorded replying to client of identifier [SR_PVR_REJECT].
So far, complete flow process shown in Fig. 3.
Preferably, in the present invention, the client recording video file in above-mentioned steps 103 mainly comprises flow process shown in Fig. 5:
Referring to Fig. 5, the recorded video document flowchart that Fig. 5 provides for the embodiment of the present invention.As shown in Figure 5, this flow process can comprise the following steps:
Here can gather respectively sound, video data by the microphone and the camera that are connected in client.
Wherein, in the time gathering sound, video data, can be according to the acquisition parameter of user's input configuration audio frequency and video, for video, its acquisition parameter can comprise: the configuration parameters such as resolution, yuv format, brightness, colourity, saturation; For audio frequency, its acquisition parameter can comprise: the parameters such as sample rate, bit depth.
It should be noted that, in the present invention, the acquisition parameter of sound, video can be adjusted according to the actual requirements by user.
In addition, also it should be noted that, in the present invention, preferably, the acquisition interval of Voice & Video must be less than synchronization constrain interval.
In this step 502, when to sound, video data encoding, can be according to the coding parameter of user's input configuration audio frequency and video, for video, its coding parameter can comprise: coded format, frame per second, GOP, code stream bit rate etc.; For audio frequency, its coding parameter can comprise: audio format, code stream bit rate etc.; It should be noted that, in the present invention, the coding parameter of sound, video can be adjusted according to the actual requirements by user.
In this step 503, at sound, video compound tense, can be according to the Container Type of user's input configuration video file, video file duration or total file size restriction are set, to the raw data packets packing of audio frequency and video.In order to guarantee the synchronous of sound, Video coding, timestamp that should record tone video, and join in audio frequency and video frame head.
In the present invention, because video data is larger, and voice data is much smaller, and the time that each capturing and coding frame of video consumes is also incomplete same, so can not guarantee that a frame audio data collecting completes time, video data also can just gather complete several frame, so in the present invention, using system time as with reference to clock, and select frame of video as a reference point, in the process of capturing and coding one-frame video data, processed good audio frame is cached in an audio buffer successively, after one-frame video data capturing and coding completes, add in video frame header using system reference clock as timestamp, and obtain all voice datas in audio buffer as an audio frame, and in frame head, add same system reference clock as timestamp information, idiographic flow as shown in Figure 6.
So far, complete flow process shown in Fig. 5.
In the present invention, in above-mentioned steps 104, client announcement server sends video-mail and can realize by flow process shown in Fig. 7:
Referring to Fig. 7, the video-mail notice transmission flow figure that Fig. 7 provides for the embodiment of the present invention.As shown in Figure 7, this flow process can comprise the following steps:
So far, complete flow process shown in Fig. 7.
In the present invention, in above-mentioned steps 104, server according to mail generator understand form to described html page pack generation one video-mail specifically can be:
Under mail generation device, define e-mail messages file, video file, script transaction file and some temporary files etc., complete and write after mail and uploaded videos in client, video-mail generator automatic acquisition Mail Contents, in e-mail messages file and video file, and upgrades video-mail generator script, final new mail, that is: the video_email_id.html of generating.
Wherein, e-mail messages document definition MailInfo.txt, obtains Mail Contents and is organized into the file format that video-mail generator is understood, and as txt file form, mainly comprises sender, addressee, the people that makes a copy for, title and content etc.
Video file definition MediaInfo.txt, obtains video path and video format information etc.
Script transaction file definition VideoEmail.sh, more the content of new mail messages file and video file is to new mail.
More new mail messages, defined variable FileC is responsible for inquiring about e-mail messages file, can utilize the txt file existing under the method inquiry mail directory of searching suffix name, that is: $ { FileC:-4}=" .txt ", and according to predefine variable Level, whether this Level value is that NULL defines by fresh content more, upgrades step by step Mail Contents, is specifically implemented as follows:
Level1, sender information is upgraded: video_email_simple.html is updated to addFrom.html;
Level2, addressee information upgrades: addFrom.html is updated to addTo.html;
Level3, the people's information updating of making a copy for: addTo.html is updated to addCc.html;
Level4, heading message is upgraded: addCc.html is updated to addSubject.html;
Level5, Mail Contents upgrades: addSubject.html is updated to addContent.html;
Upgrade video file information, defined variable URL is responsible for video link, and variable MediaC is responsible for the content of video, continues to upgrade Mail Contents, is specifically implemented as follows:
Level6, video information is upgraded: addContent.html is updated to video_email_id.html.
In the time of generating video mail, upgrade Mail Contents owing to having defined all kinds of template contrals, thus only need to fill necessary data, as inserted video at html page, only need in packing table 1 video tab attribute and value and be sent to Flash player, specific as follows:
Table 1
So far how, completed server packs and to generate the description of a video-mail described html page according to the form of mail generator understanding.
The method that above how client is sent to video-mail is described, and in the present invention, has also described server and how to have sent video-mail to client, is described below:
Referring to Fig. 8, the server that Fig. 8 provides for the embodiment of the present invention sends the flow chart of video-mail to client.As shown in Figure 8, this flow process can comprise the following steps:
This step 801 specific implementations can, with reference to flow process shown in above-mentioned Fig. 2, repeat no more here.
Here, FRAME_DELAY is client in playing, and the decoding delay time of generation, takies 13 bytes.And RATE_CHANGE is client actual network speed in playing process, take 13 bytes.
So far, complete the flow process shown in Fig. 8.
It should be noted that, in the present invention, between client and server, all self-defining identifiers are all to add by the data segment in packet header, and this user-defined identification symbol value occupies 16 bit widths, and the size of identifier arranges according to bit wide value.
In the present invention, server is based on cloud memory module, and in step 805, it is adjusted in real time the code check of transmission of multimedia streams and can realize by flow process shown in Fig. 9 according to the performance parameter of described FRAME_DELAY, RATE_CHANGE and described client:
Referring to Fig. 9, the step 805 realization flow figure that Fig. 9 provides for the embodiment of the present invention.As shown in Figure 9, this flow process can comprise the following steps:
In the present invention, one of server end support has the space of N layer and each space layer and has in time domain the scalable multimedia stream of no more than 3 time horizons on spatial domain, if the space layer of media stream is { L
0, L
1, L
2, L
3..., L
n-1, if subsidiary 3 the time layerings of each space layer remember that maximum frame per second is fps, under every kind of spatial level, time horizon deuterzooid is not fps, fps/2, fps/4.
Wherein, in media stream each layer by determining with making policy decision:
Note R
xbe the code check of X layer, if L
0to L
n-1spatial resolution is increasing, L
0to L
n-1code check increase progressively, if network speed is R, equipment supports that ultimate resolution is res, initial level number K will be as made decision.
When there is a layer k, the most approaching and code check of its resolution and device resolution is less than current network speed and is multiplied by λ, and λ is one and is greater than 1 coefficient, and λ value will be guaranteed the transmission of audio-frequency unit and smooth playing under certain network speed surging condition.
If there is not such layer, choose code check be less than λ R and with the immediate layer of λ R.
If λ R is less than the code check of basal layer, choose basal layer and time domain layering lowermost layer as initial layering.
Based on above-mentioned decision-making, Figure 10 shows each interlayer structure figure in media stream.
In the present invention, if FRAME_DELAY is greater than the maximum of every frame decoding time, indicate that this video cannot smooth playing in client, server, by adjusting the media stream of transmission, is specifically shown in step 902; And in the time that FRAME_DELAY is less than 1/2fps, mean that client CPU still has a large amount of free time, and can promote accordingly code stream quality, specifically see that step 903 describes.And work as the code check that RATE_CHANGE is less than current layer, and mean now to there is no need to adjust code stream, can continue to carry out bit stream according to reason mode.
So far, complete flow process shown in Fig. 9.
Wherein, in flow process shown in Fig. 9, server selects media stream transmission to realize by following steps:
Read selected media stream and put into internal memory by document reader;
Then use file demodulation multiplexer that the video data in media stream and voice data are separated;
Only video data is inputted to NAL bag selector, after making video data input to NAL bag selector, be organized into multiple NAL unit;
The NAL unit that NAL bag Chooser is inputted is chosen, and then voice data and the video data of finishing dealing with is sent into respectively to group of networks bag device, and the processing of packing, finally exports as network data flow.
Figure 10 shows server and selects the streamed schematic diagram of multimedia.
In the present invention, the number of plies is lower, show that code check is less, in decode procedure, the decoding of high one deck may rely on the data of low one deck, and the data of low one deck never rely on the data of high one deck, therefore, the NAL bag that NAL bag selector is inputted is chosen specifically and be can be: the concrete code check specification that decision-making before server is made to the media stream that will transmit is mapped as corresponding target dependency_id(U and represents) and target temporal_id(V represent), all NAL unit of inputting from NAL bag selector, read the NAL unit that NAL Type=first is worth, here, the NAL unit of the first value representation SVC extension header header, it specifically can be 14, if the dependency_id≤U of the NAL unit that this reads, temporal_id≤V, showing that all NAL unit after this NAL unit is all to choose sends, otherwise skip all NAL bags thereafter.The NAL bag that equals the first value as run into again NAL Type, re-starts judgement.
So far, completing method provided by the invention describes.
Below device provided by the invention is described:
Referring to Figure 11, the structure drawing of device that Figure 11 provides for the embodiment of the present invention.This device is intelligent TV set, is applied to flow process shown in Fig. 1, can comprise:
Communication module, for and server between communicate by self-defining communication identifier, to obtain the network authorization of server;
Log in module, in the time that described device need to send video-mail, utilize the network identity ID of described server authorizes to log in to server, obtain the html page that is embedded in this client by server completing after logging in; Described html page at least comprises: transmitting-receiving hurdle, toolbar and mail editing area;
Page processing module, for described html page being carried out to following processing: the transmitting-receiving hurdle at described html page at least adds addressee information, sender information, mail header, and post time, by choosing insertion the Video Option at the toolbar of described html page, so that adding a video, the mail editing area of described html page selects district, and write Mail Contents at the mail editing area of described html page, and in the time that video selects district to select to send local video file, local video file is uploaded onto the server, in the time selecting to send the video file of recording, adjust the size of video area, open recording arrangement with video area size mapping video resolution and start recorded video file, and the video file of recording is uploaded onto the server,
Notification module, for after described page processing module completes video file is uploaded onto the server, announcement server sends, and with the form of being understood according to mail generator by server, described html page is packed and is generated a video-mail, and be sent to addressee.
Preferably, in the present invention, described page processing module is passed through following steps recorded video file:
Gather sound, video data;
To the sound, the coding video data that gather;
System time is as with reference to clock, and select frame of video as a reference point, in the process of capturing and coding one-frame video data, processed good audio frame is cached in an audio buffer successively, after one-frame video data capturing and coding completes, add in video frame header using the current system time as timestamp, and obtain all voice datas in audio buffer as an audio frame, in audio frequency frame head, add same system time as timestamp.
In addition, the present invention also provides the another kind of data processing equipment based on intelligent television, and as shown in figure 12, wherein, this device is server, comprising:
Network process module, carries out network authorization for the intelligent TV set to as client;
Mail requests processing module, for receiving the connection request with the self-defining identifier that mails that described client sends by HTTP, whether out of dately identify the mail that this connection request asks, if not, return with self-defining mandate the replying to client of identifier that mail, if so, return with self-defining refusal the replying to client of identifier that mail;
Playing request processing module, the playing request with broadcasting adjustment identifier sending for receiving described client, resolve delay parameter FRAME_DELAY and network speed parameters R ATE_CHANGE in described playing request, according to the performance parameter of described FRAME_DELAY, RATE_CHANGE and described client, adjust in real time the code check of transmission of multimedia streams, with the media stream of controlling transmission in client normal play.
In the present invention, described media stream has the space of N layer on spatial domain, and each space layer has no more than three time horizons in time domain;
Based on this, described playing request processing module is according to the performance parameter of FRAME_DELAY, RATE_CHANGE and described client, and the code check of adjusting in real time transmission comprises:
If described FRAME_DELAY is greater than the maximum of every frame decoding time,,
CPU_FREQ and Q in the described client performance parameter more having recorded
low,described Q
low,support the needed CPU frequency value of smooth playing for current layer, if the former is less than the latter, select with respect to current layer, the media stream transmission of low one deck on spatial domain, if the former is more than or equal to the latter, select with respect to current layer the media stream transmission of low one deck in time domain;
If described FRAME_DELAY is less than 1/2fps, in the time that described RATE_CHANGE is greater than R` and is greater than R``, select with respect to current layer, the media stream transmission of high one deck on spatial domain, in the time that described RATE_CHANGE is greater than R` and is less than R``, select with respect to current layer the media stream transmission of high one deck in time domain; Wherein, described R` is the code check with respect to high one deck in current layer time domain, and R`` is with respect to current layer, the code check of high one deck on spatial domain.
So far, complete unit describe provided by the invention.
The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of making, be equal to replacement, improvement etc., within all should being included in the scope of protection of the invention.
Claims (14)
1. the data processing method based on intelligent television, is characterized in that, the method comprises:
Intelligent TV set is as client, and communicates by self-defining communication identifier between server, to obtain the network authorization of server;
Described client, in the time that needs send video-mail, utilizes the network identity ID of described server authorizes to log in to server, obtains the html page that is embedded in this client by server completing after logging in; Described html page at least comprises: transmitting-receiving hurdle, toolbar and mail editing area;
Described client is at least added addressee information, sender information, mail header and post time in the transmitting-receiving hurdle of described html page;
Described client is chosen insertion the Video Option at the toolbar of described html page, selects district so that the mail editing area of described html page adds a video;
Described client is write Mail Contents at the mail editing area of described html page, and in the time that video selects district to select to send local video file, local video file is uploaded onto the server, in the time selecting to send the video file of recording, adjust the size of video area, open recording arrangement with video area size mapping video resolution and start recorded video file, and the video file of recording is uploaded onto the server;
Described client is after uploading onto the server video file, and announcement server sends, and with the form of being understood according to mail generator by server, described html page is packed and is generated a video-mail, and be sent to addressee.
2. method according to claim 1, is characterized in that, between described client and server, communicates by self-defining communication identifier, comprises with the network authorization of obtaining server:
Described client sends the connection request with application Access Identifier by HTTP;
Described server coupling sends the information of the client of this connection request, if the match is successful, send with the replying to client of self-defining access authorization identifier, if it fails to match, send replying to client with self-defining access reject identifier;
Described client when with the replying of access authorization identifier, sends the capability message with self-defining performance parameter identifier by HTTP;
Described server receives after described capability message, records the performance parameter that this capability message is carried, and returns to confirming performance to client.
3. method according to claim 1, is characterized in that, described html page also comprises video library;
The video file that described video library has uploaded onto the server at video preview showing interface in the mode of thumbnail, described client is inserted into mail editing area by the insertion the Video Option that enters described video preview interface and trigger in described html page toolbar by setting triggering mode by the thumbnail of described video preview showing interface.
4. method according to claim 1, is characterized in that, before described client starts recorded video file, the method further comprises:
Described user end to server sends the connection request with self-defining recorded video identifier;
What described in described client, server returned for described connection request replys,
If described in reply with self-defining refusal and record identifier, client is closed and is recorded communication;
If described in reply with self-defining mandate and record identifier, client continues to carry out the operation that starts recorded video file.
5. according to the method described in claim 1 or 4, it is characterized in that, described client recording video file comprises:
Gather sound, video data;
To the sound, the coding video data that gather;
System time is as with reference to clock, and select frame of video as a reference point, in the process of capturing and coding one-frame video data, processed good audio frame is cached in an audio buffer successively, after one-frame video data capturing and coding completes, add in video frame header using the current system time as timestamp, and obtain all voice datas in audio buffer as an audio frame, in audio frequency frame head, add same system time as timestamp.
6. the data processing method based on intelligent television, is characterized in that, the method comprises:
Described server carries out network authorization to the intelligent TV set as client;
Described server receives the connection request with the self-defining identifier that mails that described client sends by HTTP, whether out of dately identify the mail that this connection request asks, if not, return with self-defining mandate the replying to client of identifier that mail, if so, return with self-defining refusal the replying to client of identifier that mail;
Described server receive that described client sends with playing the playing request of adjusting identifier, described playing request is in the transmission during to the replying of the identifier that mails with mandate of described client;
Delay parameter FRAME_DELAY described in described server parses in playing request and network speed parameters R ATE_CHANGE, according to the performance parameter of described FRAME_DELAY, RATE_CHANGE and described client, adjust in real time the code check of transmission of multimedia streams, with the media stream of controlling transmission in client normal play.
7. method according to claim 6, is characterized in that, described server carries out network authorization to the intelligent TV set as client and comprises:
Described server receives the connection request with self-defining application Access Identifier that described client sends by HTTP;
Described server coupling sends the information of the client of this connection request, if the match is successful, send with the replying to client of self-defining access authorization identifier, if it fails to match, send replying to client with self-defining access reject identifier;
Described server receives the capability message with self-defining performance parameter identifier that described client sends by HTTP, described capability message is to send when with the replying of access authorization identifier at client, the performance parameter of its described client of carrying;
The performance parameter that described in described server record, capability message is carried, and return to confirming performance to client.
8. method according to claim 6, is characterized in that, described performance parameter at least comprises: CPU frequency CPU_FREQ, the maximum memory size MEM that client player is supported, ultimate resolution RES, the network rate RATE of client that client is supported;
Described media stream has the space of N layer on spatial domain, and each space layer has no more than three time horizons in time domain;
The described performance parameter according to FRAME_DELAY, RATE_CHANGE and described client, the code check of adjusting in real time transmission comprises:
If described FRAME_DELAY is greater than the maximum of every frame decoding time,,
CPU_FREQ and Q in the described client performance parameter more having recorded
low, described Q
low, for current layer is supported the needed CPU frequency value of smooth playing, if the former is less than the latter, select with respect to current layer, the media stream transmission of low one deck on spatial domain, if the former is more than or equal to the latter, select with respect to current layer the media stream transmission of low one deck in time domain;
If described FRAME_DELAY is less than 1/2fps, in the time that described RATE_CHANGE is greater than R` and is greater than R``, select with respect to current layer, the media stream transmission of high one deck on spatial domain, in the time that described RATE_CHANGE is greater than R` and is less than R``, select with respect to current layer the media stream transmission of high one deck in time domain; Wherein, described R` is the code check with respect to high one deck in current layer time domain, and R`` is with respect to current layer, the code check of high one deck on spatial domain.
9. method according to claim 8, is characterized in that, selects media stream transmission to comprise:
Selected media stream is read and put into internal memory;
Video data in described media stream, voice data are made a distinction, video data is carried out to decision-making treatment, select the video data that needs transmission;
To select video data and described voice data packs and processes and transmit.
10. method according to claim 9, is characterized in that,
Described video data is carried out to decision-making treatment, selects and need the video data transmitting to comprise:
Described video data is organized into multiple NAL unit;
The code check of the media stream of selecting is mapped as to corresponding target dependency_id and target temporal_id;
Read arbitrary NAL unit, if the property value of this NAL bag is the first value, the NAL unit of described the first value representation SVC extension header header, when the temporal_id that is less than or equal to target dependency_id and described NAL unit at the dependency_id of described NAL unit is less than or equal to target temporal_id, select all NAL unit afterwards, this NAL unit to need to transmit, otherwise, determine that all NAL unit after this NAL unit does not need to transmit.
11. 1 kinds of data processing equipments based on intelligent television, is characterized in that, this device is intelligent TV set, comprising:
Communication module, for and server between communicate by self-defining communication identifier, to obtain the network authorization of server;
Log in module, in the time that described device need to send video-mail, utilize the network identity ID of described server authorizes to log in to server, obtain the html page that is embedded in this client by server completing after logging in; Described html page at least comprises: transmitting-receiving hurdle, toolbar and mail editing area;
Page processing module, for described html page being carried out to following processing: the transmitting-receiving hurdle at described html page at least adds addressee information, sender information, mail header, and post time, by choosing insertion the Video Option at the toolbar of described html page, so that adding a video, the mail editing area of described html page selects district, and write Mail Contents at the mail editing area of described html page, and in the time that video selects district to select to send local video file, local video file is uploaded onto the server, in the time selecting to send the video file of recording, adjust the size of video area, open recording arrangement with video area size mapping video resolution and start recorded video file, and the video file of recording is uploaded onto the server,
Notification module, for after described page processing module completes video file is uploaded onto the server, announcement server sends, and with the form of being understood according to mail generator by server, described html page is packed and is generated a video-mail, and be sent to addressee.
12. devices according to claim 11, is characterized in that, described page processing module is passed through following steps recorded video file:
Gather sound, video data;
To the sound, the coding video data that gather;
System time is as with reference to clock, and select frame of video as a reference point, in the process of capturing and coding one-frame video data, processed good audio frame is cached in an audio buffer successively, after one-frame video data capturing and coding completes, add in video frame header using the current system time as timestamp, and obtain all voice datas in audio buffer as an audio frame, in audio frequency frame head, add same system time as timestamp.
13. 1 kinds of data processing equipments based on intelligent television, is characterized in that, this device is server, comprising:
Network process module, carries out network authorization for the intelligent TV set to as client;
Mail requests processing module, for receiving the connection request with the self-defining identifier that mails that described client sends by HTTP, whether out of dately identify the mail that this connection request asks, if not, return with self-defining mandate the replying to client of identifier that mail, if so, return with self-defining refusal the replying to client of identifier that mail;
Playing request processing module, the playing request with broadcasting adjustment identifier sending for receiving described client, resolve delay parameter FRAME_DELAY and network speed parameters R ATE_CHANGE in described playing request, according to the performance parameter of described FRAME_DELAY, RATE_CHANGE and described client, adjust in real time the code check of transmission, to control the broadcasting smoothness of client, wherein, described playing request is to send during to the replying of the identifier that mails with mandate at described client.
14. devices according to claim 13, is characterized in that, described video flowing has the space of N layer on spatial domain, and each space layer has no more than three time horizons in time domain;
Described playing request processing module is according to the performance parameter of FRAME_DELAY, RATE_CHANGE and described client, and the code check of adjusting in real time transmission comprises:
If described FRAME_DELAY is greater than the maximum of every frame decoding time,,
CPU_FREQ and Q in the described client performance parameter more having recorded
low,described Q
low,support the needed CPU frequency value of smooth playing for current layer, if the former is less than the latter, select with respect to current layer, the video flowing transmission of low one deck on spatial domain, if the former is more than or equal to the latter, select with respect to current layer the video flowing transmission of low one deck in time domain;
If described FRAME_DELAY is less than 1/2fps, in the time that described RATE_CHANGE is greater than R` and is greater than R``, select with respect to current layer, the video flowing transmission of high one deck on spatial domain, in the time that described RATE_CHANGE is greater than R` and is less than R``, select with respect to current layer the video flowing transmission of high one deck in time domain; Wherein, described R` is the code check with respect to high one deck in current layer time domain, and R`` is with respect to current layer, the code check of high one deck on spatial domain.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611166170.2A CN106791973B (en) | 2012-12-27 | 2012-12-27 | data processing method and device based on smart television |
| CN201210583823.2A CN103905906B (en) | 2012-12-27 | 2012-12-27 | A kind of data processing method based on intelligent television and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210583823.2A CN103905906B (en) | 2012-12-27 | 2012-12-27 | A kind of data processing method based on intelligent television and device |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611166170.2A Division CN106791973B (en) | 2012-12-27 | 2012-12-27 | data processing method and device based on smart television |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103905906A true CN103905906A (en) | 2014-07-02 |
| CN103905906B CN103905906B (en) | 2017-03-01 |
Family
ID=50997022
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210583823.2A Active CN103905906B (en) | 2012-12-27 | 2012-12-27 | A kind of data processing method based on intelligent television and device |
| CN201611166170.2A Active CN106791973B (en) | 2012-12-27 | 2012-12-27 | data processing method and device based on smart television |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611166170.2A Active CN106791973B (en) | 2012-12-27 | 2012-12-27 | data processing method and device based on smart television |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN103905906B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105472339A (en) * | 2015-12-15 | 2016-04-06 | 浙江省公众信息产业有限公司 | Method, server and system for implementing video playback |
| CN105763857A (en) * | 2016-04-27 | 2016-07-13 | 王正作 | Video transmission method for unmanned aerial vehicle |
| CN106028058A (en) * | 2016-05-12 | 2016-10-12 | 青岛海信移动通信技术股份有限公司 | Method and device for recording multimedia data |
| CN107484008A (en) * | 2017-09-07 | 2017-12-15 | 北京奇虎科技有限公司 | A kind of video editing and sharing method, device, electronic equipment and medium |
| CN107529086A (en) * | 2017-09-07 | 2017-12-29 | 北京奇虎科技有限公司 | A kind of method for processing video frequency, device, electronic equipment and medium |
| CN109787942A (en) * | 2017-11-14 | 2019-05-21 | 广州市动景计算机科技有限公司 | Multimedia file submission and dissemination method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1719896A (en) * | 2005-08-03 | 2006-01-11 | 张杉 | Method for transmitting TV news image between foreign lands by internet |
| US20090144379A1 (en) * | 2007-12-04 | 2009-06-04 | At&T Delaware Intellectual Property, Inc. | Systems, methods and computer program products for the delivery of email text messages and audio video attachments to an iptv display device |
| CN101472159A (en) * | 2007-12-29 | 2009-07-01 | 东方有线网络有限公司 | System and method for implementing information service based on interactive television platform |
| CN101926123A (en) * | 2007-12-07 | 2010-12-22 | 威迪恩斯科技私人有限公司 | Method to display video in email |
| CN102572606A (en) * | 2010-12-17 | 2012-07-11 | 微软公司 | Streaming digital content with flexible remote playback |
| CN102779046A (en) * | 2012-07-04 | 2012-11-14 | 合一网络技术(北京)有限公司 | Video playing system based on HTML5 development and video playing method thereof |
| CN102833593A (en) * | 2012-07-17 | 2012-12-19 | 晨星软件研发(深圳)有限公司 | Authorization method and system applied to smart TV (television) as well as smart TV |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100512234C (en) * | 2005-11-22 | 2009-07-08 | 腾讯科技（深圳）有限公司 | A transmission method and system for attachment of multimedia mail |
| CN101867529A (en) * | 2010-02-24 | 2010-10-20 | 北京算通科技发展股份有限公司 | Realization mode for intercommunicating mails between digital television network and internet |
| CN102149005A (en) * | 2011-04-29 | 2011-08-10 | 四川长虹电器股份有限公司 | Self-adaptive method for controlling network video quality |
-
2012
- 2012-12-27 CN CN201210583823.2A patent/CN103905906B/en active Active
- 2012-12-27 CN CN201611166170.2A patent/CN106791973B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1719896A (en) * | 2005-08-03 | 2006-01-11 | 张杉 | Method for transmitting TV news image between foreign lands by internet |
| US20090144379A1 (en) * | 2007-12-04 | 2009-06-04 | At&T Delaware Intellectual Property, Inc. | Systems, methods and computer program products for the delivery of email text messages and audio video attachments to an iptv display device |
| CN101926123A (en) * | 2007-12-07 | 2010-12-22 | 威迪恩斯科技私人有限公司 | Method to display video in email |
| CN101472159A (en) * | 2007-12-29 | 2009-07-01 | 东方有线网络有限公司 | System and method for implementing information service based on interactive television platform |
| CN102572606A (en) * | 2010-12-17 | 2012-07-11 | 微软公司 | Streaming digital content with flexible remote playback |
| CN102779046A (en) * | 2012-07-04 | 2012-11-14 | 合一网络技术(北京)有限公司 | Video playing system based on HTML5 development and video playing method thereof |
| CN102833593A (en) * | 2012-07-17 | 2012-12-19 | 晨星软件研发(深圳)有限公司 | Authorization method and system applied to smart TV (television) as well as smart TV |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105472339A (en) * | 2015-12-15 | 2016-04-06 | 浙江省公众信息产业有限公司 | Method, server and system for implementing video playback |
| CN105472339B (en) * | 2015-12-15 | 2019-03-19 | 浙江省公众信息产业有限公司 | For realizing the method for playing back videos, server and system |
| CN105763857A (en) * | 2016-04-27 | 2016-07-13 | 王正作 | Video transmission method for unmanned aerial vehicle |
| CN106028058A (en) * | 2016-05-12 | 2016-10-12 | 青岛海信移动通信技术股份有限公司 | Method and device for recording multimedia data |
| CN107484008A (en) * | 2017-09-07 | 2017-12-15 | 北京奇虎科技有限公司 | A kind of video editing and sharing method, device, electronic equipment and medium |
| CN107529086A (en) * | 2017-09-07 | 2017-12-29 | 北京奇虎科技有限公司 | A kind of method for processing video frequency, device, electronic equipment and medium |
| CN109787942A (en) * | 2017-11-14 | 2019-05-21 | 广州市动景计算机科技有限公司 | Multimedia file submission and dissemination method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103905906B (en) | 2017-03-01 |
| CN106791973B (en) | 2019-12-06 |
| CN106791973A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9800566B2 (en) | Method of using server, server reservation control apparatus and program storage medium | |
| US9544245B2 (en) | Server reservation method, reservation control apparatus and program storage medium | |
| CN106713363B (en) | Method for constructing service based on global transmission shared interactive network | |
| KR101548444B1 (en) | Network streaming of video data using byte range requests | |
| US7856468B2 (en) | Server reservation method, reservation control apparatus and program storage medium | |
| US7941824B2 (en) | Methods, systems and computer program products for providing a media file to a designated set-top box | |
| CN103905906A (en) | Smart-television-based data processing method and device | |
| US7716708B2 (en) | Content distribution method, reservation management device, and program storage medium | |
| CN101159576B (en) | Chatting method, chatting room client terminal, system management background and server | |
| US7246169B2 (en) | Content distribution reservation method, content distribution method, reservation management device, and program | |
| CN102271099B (en) | Networking method and system | |
| CN102571726A (en) | Multimedia data sharing method, system and state judgment server | |
| US20080127273A1 (en) | Electronic program guide service system and establishing and operating method thereof | |
| CN105659623B (en) | Sending device, sending method, reception device and method of reseptance | |
| CN104683734A (en) | Video surveillance content adaptation method, system, central server and device | |
| US20210288735A1 (en) | Information processing apparatus, client apparatus, and data processing method | |
| US20080313150A1 (en) | Centralized Network Data Search, Sharing and Management System | |
| US20080313275A1 (en) | Method and System For Implementing Ring Service of Instant Messaging | |
| CN100428675C (en) | Method for realizing on-line playing of audio-video file and its network system | |
| JP2003069928A (en) | Video recording reservation setting method, video recording reservation device, and video recording reservation service | |
| WO2007137500A1 (en) | Public video system and implementation method | |
| CN101175237A (en) | MMS information source tracing method | |
| CN104539606B (en) | Audio file management method, device and system based on Upnp | |
| CN101902624A (en) | Set top box and user terminal | |
| CN101867529A (en) | Realization mode for intercommunicating mails between digital television network and internet |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |