CN105472296A

CN105472296A - Real-time performance verification method and device

Info

Publication number: CN105472296A
Application number: CN201410455243.4A
Authority: CN
Inventors: 宁晓魁; 尹华菊
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2014-09-09
Filing date: 2014-09-09
Publication date: 2016-04-06
Anticipated expiration: 2034-09-09
Also published as: CN105472296B

Abstract

The embodiment of the application discloses a real-time performance verification method and device. The method is applied to first end equipment of multimedia communication, and the method comprises the steps that transformation parameters are acquired; a data transformation request is transmitted to second end equipment, and the data transformation request is used for requesting the second end equipment to transform multimedia data which are acquired in real time according to the transformation parameters; feedback data are received from the second end equipment; benchmark data are acquired according to the feedback data, and the benchmark data are data of which similarity with the feedback data is not less than a first threshold value; and matching of the feedback data and the benchmark data is judged according to the transformation parameters, and the multimedia data transmitted to the first end equipment by the second end equipment are determined to be acquired in real time if the feedback data are matched with the benchmark data. Therefore, security of using multimedia communication is enhanced for users by the real-time performance verification method provided by the embodiment of the application.

Description

Real-time method of calibration and device

Technical field

The application relates to field of computer technology, and more specifically, the application relates to a kind of real-time method of calibration and device.

Background technology

Along with the development of Internet technology, multimedia communication mode is more universal.Such as, multimedia communication mainly comprises voice call and video calling etc.For video calling, it by the camera being connected to electronic equipment, can obtain image and the surrounding enviroment of user in real time, thus the far-out both sides that make spatially to be separated by see the other side each other, add the effect of communication.

Cause user cannot realize video call function in order to avoid not equipping camera due to electronic equipment, have developed a kind of Softcam software in the prior art, self simulation can be become " really " camera by the electronic device, and in video window, play the picture, animation, music, video etc. of user's setting.

But, be the real time video data obtained by physics cam device or the recorded broadcast video data play by Softcam software because existing electronic equipment None-identified goes out the video data received from opposite equip., this is just for lawless person has left opportunity.

Such as, in recent years, lawless person utilizes the communication software account usurped to steal video or installs trojan horse program and intercepts video, and utilizes the account of stealing and video to carry out the event swindled, and frequently occurs.Particularly, lawless person usurps foreign student's video and to appear in the newspapers repeatly especially chapter with the case swindling kith and kin's money and goods.

Summary of the invention

As mentioned above, in the prior art, the real-time of the multi-medium data that electronic equipment receives from opposite equip. due to None-identified, thus produce potential security breaches.

In order to solve the problems of the technologies described above, according to an aspect of the application, provide a kind of real-time method of calibration, described method is applied to the first end equipment of multimedia communication, for determining whether the multi-medium data that the second end equipment of described multimedia communication sends to described first end equipment is Real-time Obtaining, and described method comprises: obtain transformation parameter; To described second end equipment sending data conversion requests, described data transformation request converts according to the multi-medium data of described transformation parameter to Real-time Obtaining for asking described second end equipment; Feedback data is received from described second end equipment; Obtain reference data according to described feedback data, described reference data is the data that similarity between described feedback data is not less than first threshold; And judge whether described feedback data mates with described reference data according to described transformation parameter, if described feedback data is mated with described reference data, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining.

In addition, according to the another aspect of the application, provide a kind of real-time method of calibration, described method is applied to the second end equipment of multimedia communication, for determining whether the multi-medium data that described second end equipment sends to the first end equipment of described multimedia communication is Real-time Obtaining, described method comprises: from described first end equipment receiving data conversion requests, and described data transformation request converts according to the multi-medium data of transformation parameter to Real-time Obtaining for asking described second end equipment; When the multi-medium data that described second end equipment obtains is Real-time Obtaining, convert according to the multi-medium data of described transformation parameter to Real-time Obtaining; And converted multi-medium data is sent to described first end equipment as feedback data, make described first end equipment can obtain reference data according to described feedback data, described reference data is the data that similarity between described feedback data is not less than first threshold; And judge whether described feedback data mates with described reference data according to described transformation parameter, if described feedback data is mated with described reference data, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining.

According to the another aspect of the application, provide a kind of real-time calibration equipment, described application of installation is in the first end equipment of multimedia communication, for determining whether the multi-medium data that the second end equipment of described multimedia communication sends to described first end equipment is Real-time Obtaining, described device comprises: parameter acquiring unit, for obtaining transformation parameter; First transmitting element, for described second end equipment sending data conversion requests, described data transformation request converts according to the multi-medium data of described transformation parameter to Real-time Obtaining for asking described second end equipment; First receiving element, for receiving feedback data from described second end equipment; Benchmark acquiring unit, for obtaining reference data according to described feedback data, described reference data is the data that similarity between described feedback data is not less than first threshold; And real-time judging unit, for judging whether described feedback data mates with described reference data according to described transformation parameter, if described feedback data is mated with described reference data, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining.

According to the another aspect of the application, provide a kind of real-time calibration equipment, described application of installation is in the second end equipment of multimedia communication, for determining whether the multi-medium data that described second end equipment sends to the first end equipment of described multimedia communication is Real-time Obtaining, described device comprises: the second receiving element, for from described first end equipment receiving data conversion requests, described data transformation request converts according to the multi-medium data of transformation parameter to Real-time Obtaining for asking described second end equipment; Data conversion unit, the multi-medium data for obtaining at described second end equipment is Real-time Obtaining, converts according to the multi-medium data of described transformation parameter to Real-time Obtaining; And second transmitting element, for converted multi-medium data is sent to described first end equipment as feedback data, make described first end equipment can obtain reference data according to described feedback data, described reference data is the data that similarity between described feedback data is not less than first threshold; And judge whether described feedback data mates with described reference data according to described transformation parameter, if described feedback data is mated with described reference data, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining.

Compared with prior art, adopt the real-time method of calibration according to the application first embodiment and device, safety check operation initiator (namely, first end equipment), transformation parameter can be determined by various mode, transformation parameter is sent to responder's (that is, the second end equipment) of safety check operation; After receiving feedback data from responder, can according to after the reference data got, the transformation parameter generated before and the conversion received or the feedback data that do not convert carry out similarity comparison, thus determine whether the multi-medium data received by oneself is Real-time Obtaining.

Adopt the real-time method of calibration according to the application second embodiment and device, safety check operation responder (namely, second end equipment), the initiator of safety check operation can be received (namely, first end equipment) transformation parameter that sends, depend on whether the multi-medium data that the second end equipment sends to described first end equipment is Real-time Obtaining, initiator to safety check operation transmits different feedback data, the initiator that safety check is operated can according to the reference data got, the transformation parameter before generated, with after the conversion received or the feedback data that do not convert carry out similarity comparison, thus determine whether the multi-medium data received by oneself is Real-time Obtaining.

Therefore, in the embodiment of the application, providing a kind of real-time verification mode, improving the fail safe of user when using multimedia communication.

The further feature of the application and advantage will be set forth in the following description, and, partly become apparent from specification, or understand by implementing the application.The object of the application and other advantages realize by structure specifically noted in specification, claims and accompanying drawing and obtain.

Accompanying drawing explanation

Accompanying drawing is used to provide further understanding of the present application, and forms a part for specification, is used from explanation the application, does not form the restriction to the application with the embodiment one of the application.In the accompanying drawings:

Fig. 1 illustrates the application architecture according to the embodiment of the present application.

Fig. 2 illustrates the real-time method of calibration according to the application first embodiment.

Fig. 3 illustrates the real-time method of calibration according to the application second embodiment.

Fig. 4 illustrates the real-time calibration equipment according to the application first embodiment.

Fig. 5 illustrates the first end equipment according to the application first embodiment.

Fig. 6 illustrates the real-time calibration equipment according to the application second embodiment.

Fig. 7 illustrates the second end equipment according to the application second embodiment.

Embodiment

Describe each embodiment according to the application with reference to the accompanying drawings in detail.Here it is to be noted that it in the accompanying drawings, identical Reference numeral is given there is identical or similar structures and function part substantially, and the repeated description of will omit about them.

As shown in Figure 1, multimedia communications system 40 can be applied to according to the real-time method of calibration of the embodiment of the present application and device.This multimedia communications system 40 at least comprises first end equipment 10 and the second end equipment 20.This first end equipment 10 can carry out multimedia communication with the second end equipment 20 by any mode.

Such as, together with this first end equipment 10 and this second end equipment 20 can be connected directly between by wireless network or cable network point-to-pointly, and transmitting multimedia communication data is carried out according to the data format of agreement.This example comprises the communication scenes such as mobile phone communications, interphone communication, Bluetooth communication.

Alternatively, this multimedia communications system 40 can also comprise the communication server 30, and this first end equipment 10 can be set up multimedia communication via this communication server 30 with this second end equipment 20 and is connected.This example comprises the communication scenes such as instant messaging (IM).

In either case, by the two-way communication between two electronic equipments 10 and 20, the user of first end equipment 10 can carry out multimedia communication with the user of the second end equipment 20, such as voice call, video calling etc.

Such as, first end equipment 10 can gather the information such as audio frequency, video of the user of first end equipment 10 side in real time by physical unit, and send the second end equipment 20 to, alternatively, first end equipment 10 also can obtain the information such as audio frequency, video set by this user by virtual software, and sends the second end equipment 20 to.

Similarly, the second end equipment 20 also by the information such as real-time audio, video of the user of the second end equipment 20 side collected or can send the information such as non real-time audio frequency, video set by this user to first end equipment 10.

Particularly, in first end equipment 10 or the second end equipment 20, voice collection device (such as, microphone) can be utilized to carry out collected sound signal in real time, image collecting device (such as, camera) is utilized to gather picture signal etc. in real time; Or virtual bench software also can be utilized to simulate this voice collection device and image collecting device.

Obviously, in multimedia communications system, first end equipment can be the initiator that multimedia communication is connected with any one in the second end equipment, for sending for setting up the communication request relevant to this multimedia communication; And first end equipment can be the responder that multimedia communication is connected with the another one in the second end equipment, for responding this communication request, make to set up the communication connection for this multimedia communication between.

In addition, the initiation be connected with multimedia communication and respond independently, any one in first end equipment and the second end equipment can be the initiator of real-time verification operation, for sending the data transformation request of real-time verification operation, verify with the real-time of the multi-medium data sent opposite equip..

Below, for convenience, using the initiator of hypothesis first end equipment as real-time verification operation, and the second end equipment is as the responder of real-time verification operation.

Real-time method of calibration shown in Fig. 2 can be applied to the first end equipment of multimedia communication.After set up the communication connection for multimedia communication between first end equipment and the second end equipment, the user of first end equipment (or be referred to as, first user) multimedia communication can be carried out with the user of the second end equipment (or being referred to as, the second user).Now, in first end equipment, can come to initiate real-time verification operation, to determine whether the multi-medium data that the second end equipment of this multimedia communication sends to this first end equipment is Real-time Obtaining to the second end equipment by performing following real-time method of calibration.

As illustrated in Figure 2, this real-time method of calibration comprises:

In step s 110, transformation parameter is obtained.

Can determine to make first end equipment whether the multi-medium data that the second end equipment of this multimedia communication sends to this first end equipment is Real-time Obtaining, first can obtain transformation parameter in first end equipment.

Such as, this transformation parameter can be that user manually inputs, and also can be that electronic equipment generates automatically.

When the manual Input transformation parameter of user, in a first example, the user of this first end equipment can be obtained based on the determined transformation parameter of local multi-medium data in first end equipment.

Particularly, this acquisition transformation parameter can comprise: obtain multi-medium data at this first end equipment side; Show the multi-medium data obtained; The parameters input instruction that the user receiving this first end equipment performs based on shown multi-medium data; And determine this transformation parameter according to this parameters input instruction, this transformation parameter at least comprises the parameter for characterizing domain transformation.

Such as, for video communication, in this first end equipment, first can utilize and be positioned at local image collecting device (such as, camera) and gather picture signal about first user in real time.Then, display unit (such as, display, touch-screen etc.) can be utilized to show the picture signal about himself to first user.Next, command input device can be utilized (such as, mouse, keyboard, touch-screen, writing pen etc.) obtain the parameters input instruction (such as, click, towing, numerical value input etc.) that this first user performs in the picture signal about himself.Finally, this parameters input instruction can be analyzed, and determine the transformation parameter that first user uses the picture signal about himself, and this transformation parameter is used as first user wishes transformation parameter that the picture signal about the second user is used.Such as, this transformation parameter can comprise for characterizing domain transformation (such as, position coordinates), the parameter of mapping mode (such as, stretching, contraction, depression, projection, distortion, extruding) and conversion degree (such as, range value) etc.

Like this, initiator just by detecting for oneself face, and can carry out the distortion by a small margin of random angles for certain unessential position (such as, hair), determine the transformation parameter that will be used on responder's same section.

Although provide a kind of obtain manner of transformation parameter in a first example, but in actual applications, due to first user characteristic area (such as, face) position shared in local image signal and ratio and the second user same characteristic features region (such as, face) position shared in remote image signal may be different with ratio, so this obtain manner may cause cannot realizing operating for the particular transform in the second user characteristics region according to the real intention of first user in subsequent operation, thus cause key position in the second user face (such as, features muzzle ear etc.) display generation distortion, affect the normal video call of user.

For this reason, in the second example, in first end equipment, the user of this first end equipment can be obtained based on the determined transformation parameter of remote multi-media data.

Particularly, this acquisition transformation parameter can comprise: show the multi-medium data received from this second end equipment via this multimedia communication; The parameters input instruction that the user receiving this first end equipment performs based on shown multi-medium data; And determine this transformation parameter according to this parameters input instruction, this transformation parameter at least comprises the parameter for characterizing domain transformation.

Still, for video communication, in this first end equipment, communicator (such as, wire communication device or radio communication device) can be first utilized to receive the picture signal about the second user from the second end equipment.Then, display unit can be utilized to show the picture signal about the second user to first user.Next, the parameters input instruction that command input device performs in the picture signal about the second user to obtain this first user can be utilized.Finally, this parameters input instruction can be analyzed, and directly determine that first user wishes the transformation parameter used the picture signal about the second user.

Like this, a kind of obtain manner of transformation parameter is provided in the second example, it can guarantee to realize operating for the particular transform of the second user specific region according to the real intention of first user in subsequent operation, thus reduces the unnecessary impact that real-time verification operation produces for video calling.

Although determine that transformation parameter is illustrated for the user of first end equipment based on multi-medium data above, the application is not limited thereto.Such as, first end equipment also can provide directly to first user the candidate parameter list comprising multiple candidate transformation parameter, and receives the transformation parameter of user's manually selection from this candidate parameter list.

In addition, in order to realize automation, in the 3rd example, in first end equipment, this transformation parameter can automatically be generated based on the characteristic point distribution in remote multi-media data.

Particularly, this acquisition transformation parameter can comprise: carry out feature point extraction to the multi-medium data received from this second end equipment via this multimedia communication, and determines the feature distribution of received multi-medium data; And automatically determine this transformation parameter according to the distribution of this feature, this transformation parameter at least comprises the parameter for characterizing domain transformation.

Still, for video communication, in this first end equipment, communicator can be first utilized to receive the picture signal about the second user from the second end equipment.Then, the picture signal about the second user can be analyzed, thus use characteristic point extractive technique (such as, active shape model (ASM), scale invariant feature conversion (SIFT) algorithm, acceleration robust features (SURF) etc.) determines the feature distribution of the key feature points in the second user characteristics region.Finally, the feature distribution of this key feature points can be analyzed, and determine that first user wishes the transformation parameter used the picture signal about the second user.Such as, this transformation parameter can comprise the parameter for characterizing domain transformation, mapping mode and conversion degree etc.

Such as, first user can not be affected in order to ensure the map function performed by real-time verification operation and normally watch picture signal about the second user, here can end user's face detection tech, and select the region in second user's face area with less characteristic point as this domain transformation, and keep the region (such as, the features muzzle ear of the second user) with more characteristic point constant.For this reason, this domain transformation can be the region with pre-sizing, and the number of the characteristic point comprised wherein is less than or equal to Second Threshold.

Like this, provide a kind of obtain manner of transformation parameter in the 3rd example, it automatically can be created on transformation parameter required in real-time verification operation, thus saves the manual operation of user.Obviously

Although generate this transformation parameter for first end equipment based on the characteristic point distribution in remote multi-media data to be above illustrated, the application is not limited thereto.Such as, first end equipment also can based in local multi-medium data characteristic point distribution automatically generate this transformation parameter, be not even distinguished point based distribution but completely random generate this transformation parameter.

In the step s 120, to this second end equipment sending data conversion requests.

By various feasible mode (such as, stochastic generation, user select from candidate list, user determines in video data) get transformation parameter after, data transformation request can be generated based on this transformation parameter in first end equipment, this data transformation request carries accessed transformation parameter, and for asking this second end equipment to convert according to the multi-medium data of this transformation parameter to Real-time Obtaining.

Next, in first end equipment, communicator can be utilized to the second end equipment to send the data transformation request generated.Obviously, the data communication between first end equipment and the second end equipment can direct point-to-point realization, also can realize via Relay Server or the communication server (such as, instant communication server).

Correspondingly, communicator can be utilized in the second end equipment to receive this data transformation request from first end equipment, and depend on whether the multi-medium data that the second end equipment sends to this first end equipment is Real-time Obtaining, makes different responses.

Particularly, when the multi-medium data that this second end equipment obtains is Real-time Obtaining, in the second end equipment, can convert according to the multi-medium data of this transformation parameter to Real-time Obtaining, and utilize communicator that converted multi-medium data is sent to this first end equipment as feedback data.

On the contrary, when the multi-medium data that this second end equipment obtains is non-Real-time Obtaining, in the second end equipment, the multi-medium data of non real-time acquisition can be sent to this first end equipment as this feedback data, namely the second end equipment does not carry out any conversion process to the multi-medium data of non real-time acquisition.

Such as, in above process, if the second end equipment is utilizing and is being positioned at local image collecting device (such as, camera) and gathers picture signal about the second user in real time, then can think that the multi-medium data that this second end equipment obtains is Real-time Obtaining; And if the second end equipment is not utilize be positioned at local image collecting device but utilize Softcam software to play picture signal that the second user is arranged (such as, picture, animation, music, video etc.), then can think that the multi-medium data that this second end equipment obtains is not Real-time Obtaining.

In step s 130, which, feedback data is received from this second end equipment.

At the second end equipment utilization communicator to after first end equipment sends this feedback data, correspondingly, communicator can be utilized in first end equipment to receive this feedback data, for subsequent treatment from the second end equipment.

In step S140, obtain reference data according to this feedback data.

After getting feedback data, in this first end equipment, reference data can be obtained according to this feedback data.Such as, this reference data can be stored in the local storage of first end equipment, also can be stored in remote server (such as, high in the clouds) and to be obtained by communicator.

Such as, this reference data can be multiple templates of the face area about the second user.For this reason, the characteristic point of second user's face area can be gathered in advance, as the ATL of this second user.

In order to ensure the accuracy of real-time verification operation, this reference data can be the data that similarity between this feedback data is not less than first threshold.

In a first example, this obtains reference data according to this feedback data and can comprise: carry out feature point extraction to this feedback data, and determines the feature distribution of this feedback data; Obtain the feature distribution of multiple template data; And the template data that the similarity between the distribution of its feature and the feature of this feedback data being distributed is not less than this first threshold is defined as this reference data.

For video communication, in this first end equipment, first the feedback image signal as this feedback data can be analyzed, thus use characteristic point extractive technique (such as, active shape model (ASM), scale invariant feature conversion (SIFT) algorithm, acceleration robust features (SURF) etc.) determines the feature distribution of the key feature points of this feedback image signal.Then, the feature obtained as multiple template image signals of template data can distribute in this local storage or remote server.Here, in order to save process resource, the distribution of this feature can generate in advance.Next, a template image signal can be selected from multiple template image signal, and the similarity that the feature distribution of comparing this template image signal distributes with the feature of feedback data.If the comparative result of similarity is more than or equal to first threshold, then can by this template image signal behavior alternatively person.Finally, if find to there is multiple candidate, then candidate maximum for similarity can be defined as this reference data.

Although provide a kind of obtain manner of reference data in a first example, it finds immediate matching image signal based on whole image-region, but due in actual applications, picture signal as feedback data is likely through conversion process, if so extract all characteristic points in picture signal, likely cause finding the reference data of correct coupling with it.

For this reason, in the second example, in first end equipment, only can compare the similarity in the non-shifting region in feedback data and the non-shifting region in template data.

Particularly, this obtains reference data according to this feedback data and can comprise: carry out feature point extraction to the non-shifting region in this feedback data, this non-shifting region is the region except this domain transformation, and determines the feature distribution in the non-shifting region in this feedback data; Obtain the feature distribution in the non-shifting region in multiple template data; And the template data that the similarity between the feature in non-shifting region in the distribution of the feature in non-shifting region wherein and this feedback data being distributed is not less than this first threshold is defined as this reference data.

Such as, the parameter for characterizing domain transformation can be included in transformation parameter obtained in step s 110.

In step S150, judge whether this feedback data mates with this reference data according to this transformation parameter, if this feedback data is mated with this reference data, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining.

On the contrary, if this feedback data is not mated with this reference data, then determine that this second end equipment is not Real-time Obtaining to the multi-medium data that this first end equipment sends.

After acquisition reference data, feedback data, reference data and transformation parameter can being utilized, stating the real-time of the multi-medium data that the second end equipment sends to this first end equipment by using following any one mode finally to judge.

In one example, according to this transformation parameter, this judges whether this feedback data is mated can comprise with this reference data: use this transformation parameter that this reference data is transformed to transform data, and determine whether the similarity between this transform data and this feedback data is not less than the 3rd threshold value, if the similarity between this transform data and this feedback data is not less than the 3rd threshold value, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining.

In another example, according to this transformation parameter, this judges whether this feedback data is mated can comprise with this reference data: use this transformation parameter that this feedback data is inversely transformed into initial data, and determine whether the similarity between this initial data and this reference data is not less than the 3rd threshold value, if the similarity between this initial data and this reference data is not less than the 3rd threshold value, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining.

In another example, according to this transformation parameter, this judges whether this feedback data is mated can comprise with this reference data: use this feedback data and this reference data to carry out calculation check parameter, and determine whether the similarity between this checking parameter and this transformation parameter is not less than the 3rd threshold value, if the similarity between this checking parameter and this transformation parameter is not less than the 3rd threshold value, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining.

Obviously, in the first two example, between this multi-medium data (such as, picture signal), similarity can realize by feature based point matching algorithm more equally.But the application is not limited thereto.The process of above-mentioned mentioned similarity-rough set also can realize based on the combination of other modes such as pixel value, pixel histogram, angle point distribution, rim detection or above-mentioned several mode.

And, in whole three examples, can not be more whole picture signal, but only realize the comparison of similarity based on the domain transformation in feedback data and the domain transformation in reference data and this transformation parameter, to reduce amount of calculation, save process resource.

In addition, when determining that in step S150 this second end equipment is to after the multi-medium data Real-time Obtaining that this first end equipment sends, if directly utilize display unit to show the picture signal about the second user to first user in first end equipment, then because this picture signal is crossed through conversion process, so cause the characteristic area (such as, face) of the second user to occur distortion possibly.If this distortion appears at comparatively in multi-characteristic points region (such as, the features muzzle ear of the second user), then certainly will affect the viewing experience of first user.

For this reason, alternatively, judging that this second end equipment is to after the multi-medium data Real-time Obtaining that this first end equipment sends, and can use this transformation parameter that this feedback data is inversely transformed into initial data; And show this initial data.

Like this, the map function that just ensure that performed by real-time verification operation can not affect first user and normally watch picture signal about the second user.

In addition, when determining multi-medium data that this second end equipment sends to this first end equipment not after Real-time Obtaining in step S150, in order to cause giving one's full attention to of first user, information can be sent to first user.

For this reason, alternatively, if this feedback data is not mated with this reference data, then can generate information, it is not Real-time Obtaining to the multi-medium data that this first end equipment sends that this information indicates this second end equipment.Then, display unit can be utilized to show this information to first user.

As can be seen here, adopt the real-time method of calibration according to the application first embodiment, safety check operation initiator (namely, first end equipment), transformation parameter can be determined by various mode, transformation parameter is sent to responder's (that is, the second end equipment) of safety check operation; After receiving feedback data from responder, can according to after the reference data got, the transformation parameter generated before and the conversion received or the feedback data that do not convert carry out similarity comparison, thus determine whether the multi-medium data received by oneself is Real-time Obtaining.Therefore, in the embodiment of the application, providing a kind of real-time verification mode, improving the fail safe of user when using multimedia communication.

Particularly, when video calling, by adopting Facial metamorphosis identification, lawless person can be taken precautions against well pirate recordings and post-processed are carried out to the user video stolen.Even if lawless person takes the video record of user, but owing to being unfamiliar with the face characteristic of this user, and also cannot judge the transformation parameter that random or customization generates, so used identifying schemes cannot be told, thus make this identifying schemes hidden and effective.In addition, because this identifying schemes is relatively more directly perceived, than watermark calculation process more fast with efficient.

Real-time method of calibration shown in Fig. 3 can be applied to the second end equipment of multimedia communication.After set up the communication connection for multimedia communication between first end equipment and the second end equipment, the user of first end equipment (or be referred to as, first user) multimedia communication can be carried out with the user of the second end equipment (or being referred to as, the second user).Now, in the second end equipment, the real-time verification operation initiated by first end equipment can be responded, to determine whether the multi-medium data that the second end equipment of this multimedia communication sends to this first end equipment is Real-time Obtaining by performing following real-time method of calibration.

As illustrated in fig. 3, this real-time method of calibration comprises:

In step S210, from this first end equipment receiving data conversion requests.

At first end equipment utilization communicator to after the second end equipment sends this data transformation request, correspondingly, communicator can be utilized (such as in the second end equipment, wire communication device or radio communication device) receive this data transformation request, for subsequent treatment from first end equipment.

Obviously, the data communication between the second end equipment and first end equipment can direct point-to-point realization, also can realize via Relay Server or the communication server (such as, instant communication server).

In step S220, when the multi-medium data that this second end equipment obtains is Real-time Obtaining, convert according to the multi-medium data of this transformation parameter to Real-time Obtaining.

After receiving data transformation request, in this second end equipment, this data transformation request can be analyzed, and extract the transformation parameter that first user wishes to use the picture signal about the second user.Such as, this transformation parameter can comprise for characterizing domain transformation (such as, position coordinates), the parameter of mapping mode (such as, stretching, contraction, depression, projection, distortion, extruding) and conversion degree (such as, range value) etc.

When the multi-medium data that this second end equipment obtains is Real-time Obtaining, in the second end equipment, can convert according to the multi-medium data of extracted transformation parameter to Real-time Obtaining.

Such as, simply, this data transformation directly can be realized by the image collecting device (such as, camera) being positioned at second end equipment this locality.

For video communication, if in the second end equipment, second user is using Softcam software, but using physics cam device normally to carry out video calling, then transformation parameter can be sent to the acquisition source of picture signal, i.e. physics cam device, by physics cam device according to transformation parameter to captured in real-time to video data convert.Such as, the physics cam device mapping mode that first user can be used to specify and conversion degree carry out image conversion to the domain transformation that first user is specified in the picture signal about the second user.

Although be illustrated directly to realize data transformation in image collecting device above, the application is not limited thereto.Such as, in the second end equipment, also can monitor the source of the multi-medium data that the second end equipment obtains, and when this source is image collecting device, before sending to first end equipment, transformation parameter is used to convert this multi-medium data.

In step S230, converted multi-medium data is sent to this first end equipment as feedback data.

After converting the multi-medium data of Real-time Obtaining, in the second end equipment, can utilize communicator that converted multi-medium data is sent to this first end equipment as feedback data.

In step S240, when the multi-medium data that this second end equipment obtains is non-Real-time Obtaining, the multi-medium data of non real-time acquisition is sent to this first end equipment as this feedback data.

With in step S220 on the contrary, when the multi-medium data that this second end equipment obtains is non-Real-time Obtaining, in the second end equipment, can utilize communicator that the multi-medium data of non real-time acquisition is directly sent to this first end equipment as this feedback data, namely the second end equipment does not carry out any conversion process to the multi-medium data of non real-time acquisition.

Still for video communication, if in the second end equipment, second user is using Softcam software to carry out video calling (such as, lawless person carries out video swindle, certainly also possible that, validated user normally uses this software), then transformation parameter can be sent to the acquisition source of picture signal equally, i.e. Softcam software, because Softcam software is for providing corresponding application interface, so it can not use this transformation parameter to carry out any conversion process to the video data of non real-time recorded broadcast, thus in the second end equipment, continue the multi-medium data without any conversion to be sent to this first end equipment as feedback data by utilizing communicator.

Correspondingly, communicator can be utilized in first end equipment to receive this feedback data from the second end equipment.Then, reference data similarly can be obtained according to this feedback data.Finally, can judge whether this feedback data mates with this reference data according to this transformation parameter, if this feedback data is mated with this reference data, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining.Otherwise, determine that this second end equipment is not Real-time Obtaining to the multi-medium data that this first end equipment sends.

As can be seen here, adopt the real-time method of calibration according to the application second embodiment, safety check operation responder (namely, second end equipment), the initiator of safety check operation can be received (namely, first end equipment) transformation parameter that sends, depend on whether the multi-medium data that the second end equipment sends to this first end equipment is Real-time Obtaining, initiator to safety check operation transmits different feedback data, the initiator that safety check is operated can according to the reference data got, the transformation parameter before generated, with after the conversion received or the feedback data that do not convert carry out similarity comparison, thus determine whether the multi-medium data received by oneself is Real-time Obtaining.Therefore, in the embodiment of the application, providing a kind of real-time verification mode, improving the fail safe of user when using multimedia communication.

Fig. 4 illustrates the real-time calibration equipment according to the application first embodiment, and Fig. 5 illustrates the first end equipment according to the application first embodiment.

The real-time method of calibration according to the application first embodiment illustrated in Fig. 2 can be realized by the real-time calibration equipment 100 illustrated in Fig. 4, and this real-time calibration equipment 100 can be applied to the first end equipment 10 illustrated in Fig. 5.

Such as, this first end equipment 10 can carry out radio communication by means of intermediate equipments such as such as base station, access point, the communication servers with other peer device, alternatively, this first end equipment 10 also can directly and other peer device carry out radio communication, to carry out multimedia communication between both devices.Such as, first end equipment 10 can be the first end equipment 10 in the communication system shown in Fig. 1.

As illustrated in fig. 5, this first end equipment 10 can comprise: real-time calibration equipment 100, image collecting device 300, voice collection device 400, communicator 500, command input device 600 and display unit 700.

This real-time calibration equipment 100 can determine transformation parameter, transformation parameter is sent to the second end equipment 20; After receiving feedback data from the second end equipment 20, can according to after the reference data got, the transformation parameter generated before and the conversion received or the feedback data that do not convert carry out similarity comparison, thus determine whether first end equipment 10 is Real-time Obtaining from the multi-medium data received by the second end equipment 20.

This image collecting device 300 may be used for gathering picture signal.

This voice collection device 400 may be used for collected sound signal.

This command input device 600 may be used for receiving the input signal from user, such as, and parameters input instruction etc.

This communicator 500 may be used for communicating with other electronic equipments or server, to send image sequence to other electronic equipments, and/or receives image sequence etc. from other electronic equipments.Such as, this communicator 500 can be the wireless communication module for being connected to internet by WLAN (wireless local area network) (WLAN) communication standard, or for the mobile communication module that is connected to internet by mobile communication standard or bluetooth communication or near-field communication module etc. for being connected to other equipment by short-range communication standard.

This display unit 700 may be used for showing local multi-medium data that is that obtain and/or Remote Acquisitioning.

In addition, this real-time calibration equipment 100 can be communicated with first end equipment 10 by any mode.

In one example, this real-time calibration equipment 100 can be integrated in this first end equipment 10 as a software module and/or hardware module, and in other words, this first end equipment 10 can comprise this real-time calibration equipment 100.Such as, when first end equipment 10 is mobile phones, this real-time calibration equipment 100 can be a software module in the operating system of this mobile phone, or can be aimed at the application program that this mobile phone develops; Certainly, this real-time calibration equipment 100 can be one of numerous hardware modules of this mobile phone equally.

Alternatively, in another example, this real-time calibration equipment 100 and this first end equipment 10 also can be the equipment be separated, and this real-time calibration equipment 100 can be connected to this first end equipment 10 by wired and/or wireless network, and transmit interactive information according to the data format of agreement.

Real-time calibration equipment shown in Fig. 4 may be used for determining whether the multi-medium data that the second end equipment of this multimedia communication sends to this first end equipment is Real-time Obtaining.

As illustrated in figure 4, can comprise according to the real-time calibration equipment 100 of the embodiment of the present application: parameter acquiring unit 110, first transmitting element 120, first receiving element 130, benchmark acquiring unit 140 and real-time judging unit 150.

This parameter acquiring unit 110 may be used for obtaining transformation parameter.

This first transmitting element 120 may be used for this second end equipment sending data conversion requests, and this data transformation request converts according to the multi-medium data of this transformation parameter to Real-time Obtaining for asking this second end equipment.

This first receiving element 130 may be used for receiving feedback data from this second end equipment.

This benchmark acquiring unit 140 may be used for obtaining reference data according to this feedback data, and this reference data is the data that similarity between this feedback data is not less than first threshold.

This real-time judging unit 150 may be used for judging whether this feedback data mates with this reference data according to this transformation parameter, if this feedback data is mated with this reference data, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining.

In a first example, this parameter acquiring unit 110 can obtain transformation parameter by following operation: obtain multi-medium data at this first end equipment side; Show the multi-medium data obtained; The parameters input instruction that the user receiving this first end equipment performs based on shown multi-medium data; And determine this transformation parameter according to this parameters input instruction, this transformation parameter at least comprises the parameter for characterizing domain transformation.

In the second example, this parameter acquiring unit 110 can obtain transformation parameter by following operation: show the multi-medium data received from this second end equipment via this multimedia communication; The parameters input instruction that the user receiving this first end equipment performs based on shown multi-medium data; And determine this transformation parameter according to this parameters input instruction, this transformation parameter at least comprises the parameter for characterizing domain transformation.

In the 3rd example, this parameter acquiring unit 110 can obtain transformation parameter by following operation: carry out feature point extraction to the multi-medium data received from this second end equipment via this multimedia communication, and determines the feature distribution of received multi-medium data; And automatically determine this transformation parameter according to the distribution of this feature, this transformation parameter at least comprises the parameter for characterizing domain transformation.

Particularly, this domain transformation can be the region with pre-sizing, and the number of the characteristic point comprised wherein is less than or equal to Second Threshold.

In one example, this benchmark acquiring unit 140 can obtain reference data by following operation according to this feedback data: carry out feature point extraction to this feedback data, and determines the feature distribution of this feedback data; Obtain the feature distribution of multiple template data; And the template data that the similarity between the distribution of its feature and the feature of this feedback data being distributed is not less than this first threshold is defined as this reference data.

In another example, this benchmark acquiring unit 140 can obtain reference data by following operation according to this feedback data: carry out feature point extraction to the non-shifting region in this feedback data, this non-shifting region is the region except this domain transformation, and determines the feature distribution in the non-shifting region in this feedback data; Obtain the feature distribution in the non-shifting region in multiple template data; And the template data that the similarity between the feature in non-shifting region in the distribution of the feature in non-shifting region wherein and this feedback data being distributed is not less than this first threshold is defined as this reference data.

In one example, according to this transformation parameter, this real-time judging unit 150 can judge whether this feedback data mates with this reference data by following operation: use this transformation parameter that this reference data is transformed to transform data, and determine whether the similarity between this transform data and this feedback data is not less than the 3rd threshold value, if the similarity between this transform data and this feedback data is not less than the 3rd threshold value, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining; Or use this transformation parameter that this feedback data is inversely transformed into initial data, and determine whether the similarity between this initial data and this reference data is not less than the 3rd threshold value, if the similarity between this initial data and this reference data is not less than the 3rd threshold value, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining; Or use this feedback data and this reference data to carry out calculation check parameter, and determine whether the similarity between this checking parameter and this transformation parameter is not less than the 3rd threshold value, if the similarity between this checking parameter and this transformation parameter is not less than the 3rd threshold value, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining.

In addition, in order to realize one or more optional function, the real-time calibration equipment 100 according to the embodiment of the present application can also comprise: data inverse converter unit 160, data display unit 170 and information generating unit 180.

This data inverse converter unit 160 may be used for judging that this second end equipment is to after the multi-medium data Real-time Obtaining that this first end equipment sends, and uses this transformation parameter that this feedback data is inversely transformed into initial data.

This data display unit 170 may be used for showing this initial data.

Do not mate with this reference data if this information generating unit 180 may be used for this feedback data, then generate information, it is not Real-time Obtaining to the multi-medium data that this first end equipment sends that this information indicates this second end equipment.

Concrete configuration according to the unit in the real-time calibration equipment 100 of the embodiment of the present application and each device in electronic equipment 10 is introduced in detail with operation in the real-time method of calibration described above with reference to Fig. 2, and therefore, its repeated description will be omitted.

As can be seen here, adopt the real-time calibration equipment according to the application first embodiment, safety check operation initiator (namely, first end equipment), transformation parameter can be determined by various mode, transformation parameter is sent to responder's (that is, the second end equipment) of safety check operation; After receiving feedback data from responder, can according to after the reference data got, the transformation parameter generated before and the conversion received or the feedback data that do not convert carry out similarity comparison, thus determine whether the multi-medium data received by oneself is Real-time Obtaining.Therefore, in the embodiment of the application, providing a kind of real-time verification mode, improving the fail safe of user when using multimedia communication.

Fig. 6 illustrates the real-time calibration equipment according to the application second embodiment, and Fig. 7 illustrates the second end equipment according to the application second embodiment.

The real-time method of calibration according to the application second embodiment illustrated in Fig. 3 can be realized by the real-time calibration equipment 200 illustrated in Fig. 6, and this real-time calibration equipment 200 can be applied to the second end equipment 20 illustrated in Fig. 7.

Such as, this the second end equipment 20 can carry out radio communication by means of intermediate equipments such as such as base station, access point, the communication servers with other peer device, alternatively, this the second end equipment 20 also can directly and other peer device carry out radio communication, to carry out multimedia communication between both devices.Such as, the second end equipment 20 can be the second end equipment 20 in the communication system shown in Fig. 1.

As illustrated in figure 7, this second end equipment 20 can comprise: real-time calibration equipment 200, image collecting device 300, voice collection device 400 and communicator 500.

This real-time calibration equipment 200 can receive the transformation parameter that first end equipment 10 sends, depend on whether the multi-medium data that the second end equipment 20 sends to this first end equipment 10 is Real-time Obtaining, different feedback data is transmitted to first end equipment 10, make first end equipment 10 can according to after the reference data got, the transformation parameter generated before and the conversion received or the feedback data that do not convert carry out similarity comparison, thus determine whether the multi-medium data received by oneself is Real-time Obtaining.

This image collecting device 300 may be used for gathering picture signal.

This voice collection device 400 may be used for collected sound signal.

In addition, this real-time calibration equipment 200 can be communicated with the second end equipment 20 by any mode.

In one example, this real-time calibration equipment 200 can be integrated in this second end equipment 20 as a software module and/or hardware module, and in other words, this second end equipment 20 can comprise this real-time calibration equipment 200.Such as, when the second end equipment 20 is mobile phones, this real-time calibration equipment 200 can be a software module in the operating system of this mobile phone, or can be aimed at the application program that this mobile phone develops; Certainly, this real-time calibration equipment 200 can be one of numerous hardware modules of this mobile phone equally.

Alternatively, in another example, this real-time calibration equipment 200 also can be the equipment be separated with this second end equipment 20, and this real-time calibration equipment 200 can be connected to this second end equipment 20 by wired and/or wireless network, and transmit interactive information according to the data format of agreement.

Real-time calibration equipment shown in Fig. 6 may be used for determining whether the multi-medium data that the second end equipment of this multimedia communication sends to this first end equipment is Real-time Obtaining.

As illustrated in FIG. 6, can comprise according to the real-time calibration equipment 200 of the embodiment of the present application: the second receiving element 210, data conversion unit 220, second transmitting element 230.

This second receiving element 210 may be used for from this first end equipment receiving data conversion requests, and this data transformation request converts according to the multi-medium data of transformation parameter to Real-time Obtaining for asking this second end equipment.

The multi-medium data that this data conversion unit 220 may be used for obtaining at this second end equipment is Real-time Obtaining, convert according to the multi-medium data of this transformation parameter to Real-time Obtaining.

This second transmitting element 230 may be used for converted multi-medium data to be sent to this first end equipment as feedback data, make this first end equipment can obtain reference data according to this feedback data, this reference data is the data that similarity between this feedback data is not less than first threshold; And judge whether this feedback data mates with this reference data according to this transformation parameter, if this feedback data is mated with this reference data, then determine that the multi-medium data that this second end equipment sends to this first end equipment is Real-time Obtaining.

The multi-medium data that this second transmitting element 230 can also be used for obtaining at this second end equipment is non-Real-time Obtaining, the multi-medium data of non real-time acquisition is sent to this first end equipment as this feedback data.

Concrete configuration according to the unit in the real-time calibration equipment 200 of the embodiment of the present application and each device in electronic equipment 10 is introduced in detail with operation in the real-time method of calibration described above with reference to Fig. 2, and therefore, its repeated description will be omitted.

As can be seen here, adopt the real-time calibration equipment according to the application second embodiment, safety check operation responder (namely, second end equipment), the initiator of safety check operation can be received (namely, first end equipment) transformation parameter that sends, depend on whether the multi-medium data that the second end equipment sends to this first end equipment is Real-time Obtaining, initiator to safety check operation transmits different feedback data, the initiator that safety check is operated can according to the reference data got, the transformation parameter before generated, with after the conversion received or the feedback data that do not convert carry out similarity comparison, thus determine whether the multi-medium data received by oneself is Real-time Obtaining.Therefore, in the embodiment of the application, providing a kind of real-time verification mode, improving the fail safe of user when using multimedia communication.

It should be noted that, although be illustrated for the embodiment of video communication to the application hereinbefore, the application is not limited thereto.Such as, the application may be used for determining voice data that the second end equipment of voice communication sends to the first end equipment of the voice communication whether Real-time Obtaining by physics microphone apparatus equally.

In addition, although above-mentioned unit to be illustrated each embodiment of the application herein as the executive agent of each step, those skilled in the art are it is understood that the application is not limited thereto.The executive agent of each step can be served as by other one or more units, unit, even module.

Such as, be applied to the parameter acquiring unit 110 in the real-time calibration equipment 100 of first end equipment 10, first transmitting element 120, first receiving element 130, benchmark acquiring unit 140, real-time judging unit 150, data inverse converter unit 160, data display unit 170, with information generating unit 180, and the second receiving element 210 be applied in the real-time calibration equipment 200 of the second end equipment 20, data conversion unit 220, each step performed by second transmitting element 230 can be realized by the CPU (CPU) in electronic equipment uniformly.At this moment, above-mentioned transmitting element and receiving element can be the software interfaces of application program.

Through the above description of the embodiments, those skilled in the art can be well understood to the mode that the application can add required hardware platform by means of software and realize, and can certainly all be implemented by software or hardware.Based on such understanding, what the technical scheme of the application contributed to background technology can embody with the form of software product in whole or in part, this computer software product can be stored in storage medium, as ROM/RAM, disk, CD etc., comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) some part of performing each embodiment of the application or embodiment method of being somebody's turn to do.

Each embodiment of the application is described in detail above.But, it should be appreciated by those skilled in the art that when not departing from principle and the spirit of the application, various amendment can be carried out to these embodiments, combination or sub-portfolio, and such amendment should fall in the scope of the application.

Claims

1. a real-time method of calibration, it is characterized in that, described method is applied to the first end equipment of multimedia communication, for determining whether the multi-medium data that the second end equipment of described multimedia communication sends to described first end equipment is Real-time Obtaining, and described method comprises:

Obtain transformation parameter;

To described second end equipment sending data conversion requests, described data transformation request converts according to the multi-medium data of described transformation parameter to Real-time Obtaining for asking described second end equipment;

Feedback data is received from described second end equipment;

Obtain reference data according to described feedback data, described reference data is the data that similarity between described feedback data is not less than first threshold; And

Judge whether described feedback data mates with described reference data according to described transformation parameter, if described feedback data is mated with described reference data, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining.

2. method according to claim 1, is characterized in that, described acquisition transformation parameter, comprising:

Show the multi-medium data received from described second end equipment via described multimedia communication;

The parameters input instruction that the user receiving described first end equipment performs based on shown multi-medium data; And

Determine described transformation parameter according to described parameters input instruction, described transformation parameter at least comprises the parameter for characterizing domain transformation.

3. method according to claim 1, is characterized in that, described acquisition transformation parameter, comprising:

Feature point extraction is carried out to the multi-medium data received from described second end equipment via described multimedia communication, and determines the feature distribution of received multi-medium data; And

Automatically determine described transformation parameter according to described feature distribution, described transformation parameter at least comprises the parameter for characterizing domain transformation.

4. method according to claim 3, is characterized in that, described domain transformation is the region with pre-sizing, and the number of the characteristic point comprised wherein is less than or equal to Second Threshold.

5. method according to claim 1, is characterized in that, described acquisition transformation parameter, comprising:

Multi-medium data is obtained at described first end equipment side;

Show the multi-medium data obtained;

6. method according to claim 1, is characterized in that, describedly obtains reference data according to described feedback data, comprising:

Feature point extraction is carried out to described feedback data, and determines the feature distribution of described feedback data;

Obtain the feature distribution of multiple template data; And

The template data that similarity between the distribution of its feature and the feature of described feedback data being distributed is not less than described first threshold is defined as described reference data.

7. the method any one of claim 2 to 5, is characterized in that, describedly obtains reference data according to described feedback data, comprising:

Carry out feature point extraction to the non-shifting region in described feedback data, described non-shifting region is the region except described domain transformation, and determines the feature distribution in the non-shifting region in described feedback data;

Obtain the feature distribution in the non-shifting region in multiple template data; And

The template data that similarity between the feature in the non-shifting region in the distribution of the feature in non-shifting region wherein and described feedback data being distributed is not less than described first threshold is defined as described reference data.

8. method according to claim 1, is characterized in that, describedly judges whether described feedback data mates with described reference data, comprising according to described transformation parameter:

Use described transformation parameter that described reference data is transformed to transform data, and determine whether the similarity between described transform data and described feedback data is not less than the 3rd threshold value, if the similarity between described transform data and described feedback data is not less than the 3rd threshold value, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining; Or

Use described transformation parameter that described feedback data is inversely transformed into initial data, and determine whether the similarity between described initial data and described reference data is not less than the 3rd threshold value, if the similarity between described initial data and described reference data is not less than the 3rd threshold value, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining; Or

Described feedback data and described reference data is used to carry out calculation check parameter, and determine whether the similarity between described checking parameter and described transformation parameter is not less than the 3rd threshold value, if the similarity between described checking parameter and described transformation parameter is not less than the 3rd threshold value, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining.

9. method according to claim 1, is characterized in that, described method also comprises:

Judging that described second end equipment is to after the multi-medium data Real-time Obtaining that described first end equipment sends, and uses described transformation parameter that described feedback data is inversely transformed into initial data; And

Show described initial data.

10. method according to claim 1, is characterized in that, described method also comprises:

If described feedback data is not mated with described reference data, then generate information, it is not Real-time Obtaining to the multi-medium data that described first end equipment sends that described information indicates described second end equipment.

11. 1 kinds of real-time methods of calibration, it is characterized in that, described method is applied to the second end equipment of multimedia communication, for determining whether the multi-medium data that described second end equipment sends to the first end equipment of described multimedia communication is Real-time Obtaining, and described method comprises:

From described first end equipment receiving data conversion requests, described data transformation request converts according to the multi-medium data of transformation parameter to Real-time Obtaining for asking described second end equipment;

When the multi-medium data that described second end equipment obtains is Real-time Obtaining, convert according to the multi-medium data of described transformation parameter to Real-time Obtaining; And

Converted multi-medium data is sent to described first end equipment as feedback data, make described first end equipment can obtain reference data according to described feedback data, described reference data is the data that similarity between described feedback data is not less than first threshold; And judge whether described feedback data mates with described reference data according to described transformation parameter, if described feedback data is mated with described reference data, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining.

12. methods according to claim 11, is characterized in that, described method also comprises:

When the multi-medium data that described second end equipment obtains is non-Real-time Obtaining, the multi-medium data of non real-time acquisition is sent to described first end equipment as described feedback data.

13. 1 kinds of real-time calibration equipments, it is characterized in that, described application of installation in the first end equipment of multimedia communication, for determining whether the multi-medium data that the second end equipment of described multimedia communication sends to described first end equipment is Real-time Obtaining, and described device comprises:

Parameter acquiring unit, for obtaining transformation parameter;

First transmitting element, for described second end equipment sending data conversion requests, described data transformation request converts according to the multi-medium data of described transformation parameter to Real-time Obtaining for asking described second end equipment;

First receiving element, for receiving feedback data from described second end equipment;

Benchmark acquiring unit, for obtaining reference data according to described feedback data, described reference data is the data that similarity between described feedback data is not less than first threshold; And

Real-time judging unit, for judging whether described feedback data mates with described reference data according to described transformation parameter, if described feedback data is mated with described reference data, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining.

14. devices according to claim 13, is characterized in that, described parameter acquiring unit obtains transformation parameter by following operation:

15. devices according to claim 13, is characterized in that, described parameter acquiring unit obtains transformation parameter by following operation:

16. devices according to claim 15, is characterized in that, described domain transformation is the region with pre-sizing, and the number of the characteristic point comprised wherein is less than or equal to Second Threshold.

17. devices according to claim 13, is characterized in that, described parameter acquiring unit obtains transformation parameter by following operation:

Multi-medium data is obtained at described first end equipment side;

Show the multi-medium data obtained;

18. devices according to claim 13, is characterized in that, described benchmark acquiring unit obtains reference data by following operation according to described feedback data:

Obtain the feature distribution of multiple template data; And

19. devices any one of claim 14 to 17, it is characterized in that, described benchmark acquiring unit obtains reference data by following operation according to described feedback data:

20. devices according to claim 13, is characterized in that, according to described transformation parameter, described real-time judging unit judges whether described feedback data mates with described reference data by following operation:

21. devices according to claim 13, is characterized in that, described device also comprises:

Data inverse converter unit, for judging that described second end equipment is to after the multi-medium data Real-time Obtaining that described first end equipment sends, and uses described transformation parameter that described feedback data is inversely transformed into initial data; And

Data display unit, for showing described initial data.

22. devices according to claim 13, is characterized in that, described device also comprises:

Information generating unit, if do not mated with described reference data for described feedback data, then generates information, and it is not Real-time Obtaining to the multi-medium data that described first end equipment sends that described information indicates described second end equipment.

23. 1 kinds of real-time calibration equipments, it is characterized in that, described application of installation in the second end equipment of multimedia communication, for determining whether the multi-medium data that described second end equipment sends to the first end equipment of described multimedia communication is Real-time Obtaining, and described device comprises:

Second receiving element, for from described first end equipment receiving data conversion requests, described data transformation request converts according to the multi-medium data of transformation parameter to Real-time Obtaining for asking described second end equipment;

Data conversion unit, the multi-medium data for obtaining at described second end equipment is Real-time Obtaining, converts according to the multi-medium data of described transformation parameter to Real-time Obtaining; And

Second transmitting element, for converted multi-medium data is sent to described first end equipment as feedback data, make described first end equipment can obtain reference data according to described feedback data, described reference data is the data that similarity between described feedback data is not less than first threshold; And judge whether described feedback data mates with described reference data according to described transformation parameter, if described feedback data is mated with described reference data, then determine that the multi-medium data that described second end equipment sends to described first end equipment is Real-time Obtaining.

24. devices according to claim 23, it is characterized in that, the multi-medium data of described second transmitting element also for obtaining at described second end equipment is non-Real-time Obtaining, the multi-medium data of non real-time acquisition is sent to described first end equipment as described feedback data.