CN106358092B

CN106358092B - Information processing method and device

Info

Publication number: CN106358092B
Application number: CN201510407944.5A
Authority: CN
Inventors: 党茂昌
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2015-07-13
Filing date: 2015-07-13
Publication date: 2019-11-26
Anticipated expiration: 2035-07-13
Also published as: WO2017008652A1; CN106358092A

Abstract

The application provides a kind of information processing method and device.A kind of method includes: to parse the label data of the target object in image from the corresponding data flow of image, and target object is the object that label data is added in image；Show the label data of the target object in image.The application can simplify operation complexity, improve the real-time for obtaining the object information in image.

Description

Information processing method and device

[technical field]

This application involves Internet technical field more particularly to a kind of information processing methods and device.

[background technique]

User often wants to know about the specifying information of video content when watching video, for example, some commodity in video Or specifying information at some sight spot etc..When user is to some subject interests in video, usually according to interested right The simple knowledge of elephant searches for relevant information in a search engine.This mode is not fast enough, and real-time is poor.

[summary of the invention]

The many aspects of the application provide a kind of information processing method and device, and to simplify operation complexity, raising is obtained Take the real-time of the object information in video.

The one side of the application provides a kind of information processing method, comprising:

From the corresponding data flow of image, the label data of the target object in described image, the target pair are parsed As if the object of label data is added in described image；

Show the label data of the target object in described image.

The another aspect of the application provides a kind of information processing method, comprising:

Determine the target object for needing to add label data in image；

Obtain the label data of the target object；

According to the content-data of the label data of the target object and described image, the corresponding data of described image are formed Stream.

The another aspect of the application, provides a kind of information processing unit, comprising:

Parsing module, for parsing the number of tags of the target object in described image from the corresponding data flow of image According to the target object is the object for being added label data in described image；

Display module, for showing the label data of the target object in described image.

Determining module needs to add the target object of label data for determining in image；

Module is obtained, for obtaining the label data of the target object；

Module is formed, for according to the label data of the target object and the content-data of described image, described in formation The corresponding data flow of image.

As shown from the above technical solution, the application is inserted into the label data shape of objects in images in forming image process The label of target object is parsed from the corresponding data flow of image in playing image process at the corresponding data flow of image Data, and then show the label data of objects in images, so that the information of the available objects in images of user, easy to operate, It is higher to obtain efficiency.

[Detailed description of the invention]

It in order to more clearly explain the technical solutions in the embodiments of the present application, below will be to embodiment or description of the prior art Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is some realities of the application Example is applied, it for those of ordinary skill in the art, without any creative labor, can also be attached according to these Figure obtains other attached drawings.

Fig. 1 is the flow diagram for the information processing method that one embodiment of the application provides；

Fig. 2 is the flow diagram for the information processing method that another embodiment of the application provides；

Fig. 3-Fig. 6 is the addition label data or the process schematic for showing label data that one embodiment of the application provides；

Fig. 7 is the structural schematic diagram for the information processing unit that one embodiment of the application provides；

Fig. 8 is the structural schematic diagram for the information processing unit that another embodiment of the application provides；

Fig. 9 a is the structural schematic diagram for the video playback apparatus that another embodiment of the application provides；

Fig. 9 b be one embodiment of the application provide be in image object addition XML tag flow diagram；

Fig. 9 c is the flow diagram for the XML tag for extracting the object in image that one embodiment of the application provides.

[specific embodiment]

To keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with the embodiment of the present application In attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art Every other embodiment obtained without creative efforts, shall fall in the protection scope of this application.

Fig. 1 is the flow diagram for the information processing method that one embodiment of the application provides.As shown in Figure 1, this method packet It includes:

101, from the corresponding data flow of image, the label data of the target object in the image, target object are parsed It is the object that label data is added in the image.

102, the label data of the target object in image is shown.

The present embodiment provides a kind of information processing methods, can be executed by information processing unit.The information processing unit can To be there is the device of image processing function, such as can be the various devices with video playback capability, electricity specifically can be Depending on, various video playback apparatus such as mobile phone, PC, tablet computer.

Illustrate first, the image in the present embodiment can be each frame image in video display process.In other words, right Each frame image in video display process can be used the present embodiment method and be handled.Alternatively, the figure in the present embodiment As the image being also possible in non-video, such as the image in webpage.

Various contents, such as personage, animal, plant, article in image etc. are referred to as the object in image.Image is pair The result that the content-data of the image is showed.By taking the image in video as an example, the content-data of image mainly includes video Data and audio data.

In the present embodiment, in order to providing a user image in simple and fast mode in image playing process The information of middle object pre-generates the data flow of the label data including objects in images.In this way, in image playing process, The label data that objects in images can be parsed from the corresponding data flow of image shows the label of objects in images to user Data, so that user obtains the information of objects in images.Wherein, the label data of object may include related with object any Information.For example, the label data of object includes but is not limited to the service of the detail information, object of following at least one object The detail information of the service of entrance, object.

In view of the type and quantity of objects in images may be more, user may be only to the information of part of object It is interested, therefore only label data need to be added for partial objects.In addition, for ease of description and distinguish, by image with number of tags It is known as target object according to related object.Before adding label data, target object, which refers to, to be needed to be added label in image The object of data；After adding label data, target object refers to the object that label data is added in image.

According to application demand, label data can be added for the partial objects in image, or the whole in image Object adds label data.That is, target object can be the partial objects in image, the whole being also possible in image Object.The label data of target object may include any information related with target object.For example, the mark of target object Signing data includes but is not limited to the following detail information of at least one target object, the service entrance of target object, target object Service detail information.

Wherein, the detail information of target object is primarily referred to as the information directly related with target object.According to target object Difference, the detail information of target object generally will be different.With target object for a commodity, for clothes, then it is detailed Anti-counterfeiting information when feelings information generally comprises title, the place of production, price, brand, recommendation grade, material, trade company, off-line transaction or with It is believed that breath (anti-counterfeiting information can be antifalsification label, two dimensional code or bar code) etc..

The service entrance of target object is primarily referred to as the entrance of various services relevant to the target object.Pass through target pair Service related with the target object can be called or be accessed in the service entrance of elephant.The service entrance can be a chained address or Two dimensional code etc..

The detail information of the service of target object is mainly the essential information of service related with the target object, such as takes The title of business, the basic function of service, application method of service etc..

Based on above-mentioned, when playing image, information processing unit can parse image from the corresponding data flow of image The label data of middle target object shows the label data of target object to user, so that user obtains the information of target object. Compared with prior art, the present embodiment is inserted into the label data of target object in image and then is formed in forming image process The corresponding data flow of image parses the number of tags of target object in playing image process from the corresponding data flow of image According to, and then to the label data of user's displaying objects in images, so that the information of the available objects in images of user, operation letter It is single, it is higher to obtain efficiency.

Further, the service or right of target object can be used in the information of the target object obtained based on user, user User carries out shopping guide, realizes the purpose for obtaining service or the shopping of target object in image, and the service of target object includes But it is not limited to: goods advertisement, product customization, socialization recommendation, personage's social activity etc..

Further, user can also issue search instruction according to the label data of target object；Information processing unit receives The search instruction that user issues according to the label data of target object, according to the search instruction, from the label data of target object Middle extraction keyword scans for, and the search result to match with the label data of target object is returned to user, in order to Family obtains more abundant information.

In view of the content-data of image in video mainly includes the audio data and video data in image, it is belonging respectively to Audio types and video type.General audio data is stored in the data packet of audio types, and video data is stored in video type Data packet in.In an optional embodiment of this implementation, using the label data of target object as a kind of new data class Type realizes that the type is referred to as tag types, and be stored in the data packet of tag types.It is corresponding being pre-formed image Data flow a kind of embodiment in, according to the location information of the label data of target object and target object in the picture, Form the data packet of tag types；The data packet of tag types is inserted into the content-data of image, it is corresponding to form image Data flow.In this embodiment, the corresponding data flow of image mainly includes the data packet of audio types, the data of video type The data packet of packet and tag types.Wherein, different types of data packet is distinguished by the type id field in data packet.

Based on above-mentioned, one kind parsing the label data of the target object in image from the corresponding data flow of image Embodiment are as follows:

The corresponding data flow of detection image whether include tag types data packet；When detecting the corresponding data flow of image When data packet including tag types, the label data of target object is parsed from the data packet of the tag types.

It optionally, can in the corresponding data flow of detection image whether in the embodiment of data packet for including tag types To pass through the type id field of each data packet in the corresponding data flow of detection image, if the type identification of discovery tag types, Then determine that the corresponding data flow of the image includes the data packet of tag types；If not finding the type identification of tag types, determine The corresponding data flow of the image does not include the data packet of tag types.

Optionally, a kind of embodiment packet of the label data of target object is parsed from the data packet of tag types It includes:

When detecting the corresponding data flow of image includes the data packet of tag types, information processing unit is shown to user Prompt information, to prompt user that can carry out tag data process；For example, can show a view in the lower right corner of image (view) control has the object for being added label data to prompt user in the images, can carry out tag data process；

For users, can be known according to the prompt information can carry out tag data process for the image；When with When family determination will carry out tag data process, tag data process instruction can be issued, such as user can click, touches, grow By etc. modes operate the view control, thus issue tag data process instruction；

Information processing unit receives user and is instructed according to the tag data process that above-mentioned prompt information is sent；According to the label Data processing instructions extract the data packet of tag types from the corresponding data flow of image；For example, can be according to tag types Type identification, the data packet of tag types is extracted from the corresponding data flow of image；Wherein, the corresponding data flow of image can It is determined with the pts value by image, the pts value of every frame image is unique；

Later, information processing unit extracts the label data and mesh of target object from the data packet of above-mentioned tag types Mark the location information of object in the picture.It is worth noting that the data packet of the tag types includes the mark of all target objects Sign the location information of data and all target objects in the picture.Optionally, the label data of target object can be according to mesh The positional relationship of mark object in the picture is ranked up, and the position of the label data of target object and target object in the picture Confidence breath has certain mapping relations in storage location, such as the two adjacent can store.

Based on above-mentioned, a kind of embodiment for the label data showing target object includes:

According to the location information of target object in the picture, target object is marked out in the picture；Receive what user issued Label data shows instruction；It is shown and is instructed according to label data, show the label data of target object.

It is further alternative, a method of marking out target object in the picture are as follows: in the picture according to target object Location information, determine target object in the position where image on interface, directly at the position display can operational controls, To realize the mark to target object.

It is further alternative, a method of marking out target object in the picture are as follows: face shows a boundary on the image Face, it is preferred that the interface be it is transparent, do not influence the effect that user watches image in this way, user embodies preferable；According to target pair As location information in the picture, on the surface corresponding to controllable operating control is shown at the position of target object, to realize To the mark of target object.

Based on above-mentioned, user issues label data and shows that the mode of instruction may is that user by operating on above-mentioned interface At the position of target object can operational controls, with issue label data show instruction.User to can operational controls operation side Formula includes click, double-click, long-pressing, touch etc..For information processing unit, user is received by corresponding to target pair on interface At the position of elephant can operational controls issue label data show instruction.

It is worth noting that in the case where target object has multiple, if user wishes to show part of target object Label data, can operate wish show label data target object it is corresponding can operational controls, to issue label data Show instruction.

Further, label data shows that instruction includes the location information of target object.Based on this, information processing unit is specific Target can be determined according to the location information of location information and label data mapping relations and target labels in storage location The label data of object；And then show the label data of target object.

In a kind of optional embodiment, is shown and instructed according to label data, show the label data of target object, it can be with Using but be not limited to following methods:

First way: image displaying target object in the window label data.It illustrates, it is assumed that at information Reason device is TV, then can play the label data of displaying target object in the window of image on the tv screen.

The second way: where independently of image in another window of window displaying target object label data.It lifts Example explanation, it is assumed that information processing apparatus is set to TV, two windows is shown on video screen, a window is for playing image, separately One window is used for the label data of displaying target object.Arrangement mode between the two windows can be stacking or tiling.It is excellent Choosing, the window of the label data for displaying target object is less than the window for playing image.

The third mode: where independently of image in another display of display displaying target object number of tags According to.It illustrates, it is assumed that information processing unit is TV, and video screen shows a window, for playing image.Meanwhile the electricity It is connect depending on the PC with user, then can pass through the label data of the display displaying target object on PC.

It, can be to target object during being pre-formed image corresponding data flow in an optional embodiment Label data carry out signature processing, to prevent the label data of target object to be tampered, target object can be improved in this way The authenticity and reliability of label data.It can also be to mesh before the label data for showing target object to user based on this The label data for marking object carries out signature verification, when only passing through signature verification, just shows the number of tags of target object in image According to.For example, RSA signature algorithm can be used, signature processing is carried out to the label data of target object, treatment process of specifically signing It can be found in the prior art.

In an optional embodiment, the label data of target object includes the anti-counterfeiting information of target object.Based on this, In After the label data for showing target object, information processing unit can extract target object from the label data of target object Anti-counterfeiting information authenticity verification is carried out to target object according to the anti-counterfeiting information of target object.For example, when user needs online When lower purchase or acquisition target object, authenticity verification can be carried out to target object by the anti-counterfeiting information in label data, when When verification result is true, then the target object is bought or obtained to row, to prevent cheated.

Above-mentioned anti-counterfeiting information can be but not limited to: antifalsification label, two dimensional code or bar code.

It is worth noting that the label data of target object can be extensible markup language in each embodiment of the application (Extensible Markup Language, XML) label, but not limited to this.

Fig. 2 is the flow diagram for the information processing method that another embodiment of the application provides.This method mainly describes in advance It is initially formed the process of the corresponding data flow of image.As shown in Fig. 2, this method comprises:

201, the target object for needing to add label data in image is determined.

202, the label data of target object is obtained.

203, according to the content-data of the label data of target object and image, the corresponding data flow of image is formed.

The present embodiment provides a kind of information processing methods, can be executed by information processing unit.The information processing unit can To be there is the device of image processing function, such as can be the device with video playback capability, TV, hand specifically can be The various video playback apparatus such as machine, PC, tablet computer.

Illustrate first, the image in the present embodiment can be each frame image in video display process.In other words, right Each frame image in video display process can be used the present embodiment method and be handled.Alternatively, the figure in the present embodiment As the image being also possible in non-video, such as it can be the image on webpage.

In the present embodiment, in order to providing a user image in simple and fast mode in image playing process The information of middle object, generate include objects in images label data data flow, in order in image playing process to Family shows the label data of objects in images, so that user obtains the information of objects in images.

According to application demand, label data can be added for the partial objects in image, or the whole in image Object adds label data.That is, target object can be the partial objects in image, the whole being also possible in image Object.The label data of target object may include any information related with target object.

Before adding label data to target object, it is thus necessary to determine that need to add the object conduct of label data in image Target object.

In an optional embodiment, information processing unit can identify pair for meeting preset condition from image automatically As target object.The preset condition can be various conditions, such as can be for limiting object type, size, shape The condition of the features such as shape, color.This mode partial objects suitable for image add label data, by identifying target pair As the accuracy of addition label data can be improved.Alternatively, information processing unit can automatically identify whole objects in image As target object.This mode all objects suitable for image add label datas, add the efficiency of label data compared with It is high.

In another optional embodiment, information processing unit can receive the Object Selection that user issues on the image and refer to It enables, is instructed according to Object Selection, determine target object.The embodiment is suitable for still image, is also applied for dynamic image.

Further, for video playing scene, information processing unit can first determine figure before determining target object Picture.For example, information processing unit can be using currently playing picture as the image in the present embodiment.Alternatively, information processing apparatus The label data that user issues can be received and add instruction in video display process by setting；It is added and is instructed according to label data, temporarily Stop video playing, and using the video pictures suspended as image.

Specifically, for the image in dynamic application scene, it, can be angular in the lower-left of image in image playing process User shows addition (add) control, and user can issue label data addition instruction by operating the addition control.User is to this The mode of operation of addition control includes but is not limited to: click, touch, long-pressing etc..Information processing unit receives the mark that user issues Data addition instruction is signed, suspends video playing, needs to add the target object of label data for selection by the user.User can touch Touch, click or long-pressing image in need to add the object of label data, to issue Object Selection instruction.Information processing unit receives The Object Selection instruction that user issues determines the operated object of Object Selection instruction as target object.

After determining target object, the label data of available target object.

In an optional embodiment, the label description information of the available target object of information processing unit, to target The label description information of object formats, to generate the label data of target object.For example, label description information It is text formatting, and label data can be XML format, then carries out format by the label description information to text formatting and turn It changes, to obtain the label data of XML format, referred to as XML tag.

Further, information processing unit can to user show an information input frame, such as can where image window It is middle to show an information input frame to user, for user's input label description information；User is received to input by information input frame Label description information.Information acquiring pattern realizes that object is simple in this way, convenient for the user to operate, obtains the effect of label description information Rate is higher.

In addition, information processing unit can also obtain the label description information of target object by internet hunt.

In view of the content-data of image in video mainly includes the audio data and video data in image, it is belonging respectively to Audio types and video type.General audio data is stored in the data packet of audio types, and video data is stored in video type Data packet in.In an optional embodiment of this implementation, using the label data of target object as a kind of new data class Type realizes that the type is referred to as tag types, and be stored in the data packet of tag types.

Based on above-mentioned, according to the label data of target object and the content-data of image, the corresponding data of image are formed It, can be according to the location information of the label data and target object of target object in the picture, shape in a kind of embodiment of stream At the data packet of tag types；The data packet of tag types is inserted into the content-data of image, to form the corresponding number of image According to stream.In this embodiment, the corresponding data flow of image mainly includes the data packet of audio types, the data packet of video type And the data packet of tag types.Wherein, different types of data packet is distinguished by the type id field in data packet.

The location information of above-mentioned target object in the picture can issue Object Selection instruction according to user to obtain, such as It is clicked when user can be issued to Object Selection instruction, the position coordinates of touch or long-pressing, in the picture as target object Location information.

Optionally, if there is multiple target objects in image, can according to the positional relationship of target object in the picture, according to It is secondary that the label data of target object is added in the data packet of tag types.

Further, the data packet of tag types is being inserted into the content-data of image, to form the corresponding data of image Before stream, can the data packet to tag types carry out signature processing, to guarantee the authenticity and credibility of label data.Example Such as, it can use but be not limited to: RSA Algorithm.

Further, the data packet of tag types can include but is not limited to: frame number, time stamp, the target object of image are being schemed The information such as the type identification of location information, the label data of target object, tag types as in.

For example, the label data of target object includes but is not limited to the details letter of following at least one target object Breath, the service entrance of target object, target object service detail information.

From the foregoing, it can be seen that the present embodiment in forming image process, is inserted into the label data of target object in image in turn The corresponding data flow of image is formed, so that parsing target object from the corresponding data flow of image in playing image process Label data, and then to user show objects in images label data so that the letter of the available objects in images of user Breath, it is easy to operate, it is higher to obtain efficiency.

Fig. 3-Fig. 6 show the process schematic for adding or showing label data in the picture.In Fig. 3-Fig. 6, information Processing unit shows an image on its display, jacket, skirt, handbag, camera, the nail polish of a personage in the image Deng can be used as target object, it is added label data or extracts label data.In Fig. 3-Fig. 6, the lower left corner of the image is aobvious It is shown with a "+" icon, the practical icon is " add " control, for issuing label addition instruction for user；The right side of the image Inferior horn shows " magnifying glass " icon, and the practical icon is " view " control, for issuing tag data process for user Instruction.It is worth noting that showing " add " control and view simultaneously in Fig. 3-Fig. 6 for convenient for simplifying description " control, actually answer " add " control can be shown in label adding procedure in, and " view " control can only be shown during tag extraction.

Illustrate that the process for adding label data is as follows in conjunction with Fig. 3-Fig. 6:

In Fig. 3, in video display process, in the lower-left of every frame image, angular user shows " add " control, specifically For "+" icon.If user wishes to add label data to the object in image, above-mentioned "+" icon can be clicked, issues label Data addition instruction, information processing unit suspend video playing.

In Fig. 4, user clicks or touches on the image the object that addition label data is wanted in image, such as portable Packet is equivalent to and issues Object Selection instruction；Information processing unit is instructed according to the Object Selection, determines pair for being clicked or touching As, such as handbag, then emerge transparent cursor in click or touch point, and pop up the information input frame of specified format, such as It can be XML page frame.User inputs various label description informations in information input frame.Information processing unit describes to believe to label Breath formats, formed label data, later by current frame number, time stamp, the location information of handbag and XML format mark Label data are saved in together in the specified data Layer (the specifically data packets of tag types) of the corresponding data flow of image.

As shown in figure 5, being added in the same way to the camera, skirt, sweater, leather shoes, nail polish of personage in image Label data.It is worth noting that information input frame is not shown in figures 4 and 5.

A kind of pattern for the label data that Fig. 4 and Fig. 5 is formed is as shown in Figure 6.

Illustrate to show that the process of label data is as follows in conjunction with Fig. 3-Fig. 6:

In Fig. 3, in video display process, whether information processing unit detects has in the corresponding data flow of every frame image The data packet of tag types；If detect the data packet of tag types, in the bottom right of image, angular user shows one " view " control, specially " magnifying glass " icon.

In Fig. 5, if user wishes to obtain the label data of target object in image graph, above-mentioned " magnifying glass " can be clicked Icon issues tag data process instruction, and information processing unit suspends video playing, and transparent at all target object positions Emerge cursor (specifically emerging cursor at the click when adding label data or touch location position).

In Fig. 4, after user clicks or touch transparent cursor at some target object position, such as handbag, at information Reason device obtains the label data of the target object.The label data of target object can be in an independent window/display Middle display or transparent being superimposed upon in present image are shown.For convenient for showing handbag that user clicks or touches, its in Fig. 4 Transparent cursor on its target object is not shown.

A kind of pattern of the label data of handbag is as shown in Figure 6 in Fig. 4.

Based on label data shown in fig. 6, user is entered by network linking address in label data or two dimensional code barcode scanning Mouthful, it can easily obtain special object (article) or enter the network service of special object.

Based on label data shown in fig. 6, user can be from obtaining the identity code or anti-of doing shopping under line in label data Pseudo label, such as download, shows in O2O off-line transaction, using as the object off-line transaction authority (enjoy privileges or Counterfeit-deterrent strategies).

Based on label data shown in fig. 6, user can issue search instruction, in order to which information processing unit is from number of tags It scans for, and then exports and the matched search result of label data, search of the realization based on image according to middle extraction keyword.

It should be noted that for the various method embodiments described above, for simple description, therefore, it is stated as a series of Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because According to the application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know It knows, the embodiments described in the specification are all preferred embodiments, related actions and modules not necessarily the application It is necessary.

In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, reference can be made to the related descriptions of other embodiments.

Fig. 7 is the structural schematic diagram for the information processing unit that one embodiment of the application provides.As shown in fig. 7, the device packet It includes: determining module 71 and display module 72.

Parsing module 71, for parsing the label data of the target object in image from the corresponding data flow of image, Target object is the object that label data is added in image.

Display module 72, for showing the label data of the target object in image that parsing module 71 parses.

In an optional embodiment, parsing module 71 is specifically used for:

The corresponding data flow of detection image whether include tag types data packet；

If the corresponding data flow of image includes the data packet of tag types, target is parsed from the data packet of tag types The label data of object.

Further alternative, parsing module 71 is in the label for parsing target object from the data packet of tag types When data, it is specifically used for:

Prompt information is shown to user, to prompt user that can carry out tag data process；

User is received to be instructed according to the tag data process that prompt information is sent；

It is instructed according to tag data process, the data packet of tag types is extracted from the corresponding data flow of image；

From the data packet of tag types, the position letter of the label data and target object of target object in the picture is extracted Breath.

In an optional embodiment, display module 72 is specifically used for:

According to the location information of target object in the picture, target object is marked out in the picture；

It receives the label data that user issues and shows instruction；

It is shown and is instructed according to label data, the label data of target object is shown to user.

Further alternative, display module 72 is for the location information according to target object in the picture, in the picture When marking out target object, it is specifically used for:

Face shows an interface on the image；

According to the location information of target object in the picture, corresponds at the position of target object on interface and show and can grasp Make control.

Further alternative, display module 72 is specific to use when the label data for receiving user's sending shows instruction In:

Receive at position of the user by corresponding to target object on interface can the label data exhibition that issues of operational controls Show instruction.

Optionally, label data shows that instruction includes: the location information of target labels.Based on this, display module 72 is in root It shows and instructs according to label data, when showing the label data of target object to user, be specifically used for: according to location information and label The location information of mapping relations and target labels of the data in storage location, determines the label data of target object；Show mesh Mark the label data of object.

In an optional embodiment, display module 72 is instructed for being shown according to label data, shows target object Label data when, be specifically used for:

Image displaying target object in the window label data；Or

Where independently of image in another window of window displaying target object label data；Or

Where independently of image in another display of display displaying target object label data.

In an optional embodiment, display module 72 is specifically used for:

Signature verification is carried out to the label data of target object；

When passing through signature verification, the operation for showing the label data of the target object in image is executed.

In an optional embodiment, information processing unit can also include: search module, for receiving user according to mesh Mark the search instruction that the label data of object issues；According to search instruction, the label data phase with target object is returned to user Matched search result.

The label data of above-mentioned target object comprises at least one of the following:

The detail information of target object, the service entrance of target object, target object service detail information.

The label data of above-mentioned target object can be XML tag.

The label data of above-mentioned target object may include: the anti-counterfeiting information of target object.Based on this, which can be with It include: anti-fake module.

Anti-fake module, for extracting the anti-counterfeiting information of target object from the label data of target object；According to target pair The anti-counterfeiting information of elephant carries out authenticity verification to target object.

It is worth noting that the image in the present embodiment can be the image in video, the figure being also possible in non-video Image in picture, such as webpage.

Information processing unit provided in this embodiment is parsed from the corresponding data flow of image in playing image process The label data of target object out, and then show the label data of objects in images, so that the available objects in images of user Information, it is easy to operate, obtain efficiency it is higher.

Fig. 8 is the structural schematic diagram for the information processing unit that another embodiment of the application provides.As shown in figure 8, the device It comprises determining that module 81, obtain module 82 and forms module 83.

Determining module 81 needs to add the target object of label data for determining in image.

Module 82 is obtained, for obtaining the label data for the target object that determining module 81 is determined.

Module 83 is formed, for the content number according to the label data and image for obtaining the target object that module 82 obtains According to the corresponding data flow of formation image.

In an optional embodiment, determining module 81 is particularly used in:

Receive the Object Selection instruction that user issues on the image；

It is instructed according to Object Selection, determines target object.

Further, determining module 81 is also used to: before receiving the Object Selection instruction that user issues on the image, being regarded In frequency playing process, receives the label data that user issues and add instruction；It is added and is instructed according to the label data, suspend video It plays, using the video pictures suspended as described image.

In an optional embodiment, determining module 81 is particularly used in:

Identify the object for meeting preset condition as the target object from described image automatically；Or

Whole objects in described image are automatically identified as the target object.

In an optional embodiment, obtains module 82 and is particularly used in:

Obtain the label description information of target object；

The label description information of target object is formatted, to generate the label data of target object.

Further, module 82 is obtained in the label description information for obtaining target object, is specifically used for:

Information input frame is shown to user, receives the label description information that user is inputted by information input frame；Or

The label description information of the target object is obtained by internet hunt.

In an optional embodiment, forms module 83 and is particularly used in:

According to the location information of the label data of target object and target object in the picture, the data of tag types are formed Packet；

The data packet of tag types is inserted into the content-data of image, to form the corresponding data flow of image.

Optionally, the data packet of tag types is being inserted into the content-data of image, to form the corresponding data of image Before stream, formed module 83 can also the data packet to the tag types carry out signature processing, to guarantee the true of label data Reality and reliability.

The label data of above-mentioned target object can be XML tag.

Optionally, the label data of target object comprises at least one of the following: detail information, the target object of target object Service entrance, target object service detail information.

Information processing unit provided in this embodiment, the information processing unit provided with previous embodiment matches, in shape The corresponding data flow of image is formed at the label data in image process, being inserted into objects in images, so that playing image process In, the label data of target object is parsed from the corresponding data flow of image, and then the mark of objects in images is shown to user Data are signed, so that the information of the available objects in images of user, easy to operate, it is higher to obtain efficiency.

In practical applications, video playback apparatus can generally have the function of information processing unit shown in Fig. 7 and Fig. 8 simultaneously Energy.Following example will introduce a kind of structure and working principle of video playback apparatus that can be realized technical scheme. In the examples below, by taking video image as an example, the label data of target in video image object can use XML format, letter Referred to as XML tag.

Fig. 9 a is the structural schematic diagram for the video playback apparatus that one embodiment of the application provides.As illustrated in fig. 9, the video Playback equipment includes: video player (video player), web engine (web Engine) and display (display).

Video player includes at least: demultiplexer (Demux), audio decoder, Video Decoder, label filter module Block (XPreFilter), label record module (TSRecorder) and label processing module (XTAG).Wherein, demultiplexer, Audio decoder and Video Decoder belong to existing module, and working principle can be found in the prior art, and details are not described herein.Under Face emphasis discusses label filtering module, label records the working principle of module and label processing module.

Label filtering module is XML tag pretreatment (filtering) module, and label filtering module with individualism or can be put into In demultiplexer.Label filtering module is mainly responsible for following both sides function:

On the one hand, in video display process, label filtering module is responsible for filtering from the corresponding TS code stream of video image The PES packet of XML tag (XML tag) type out, issues label processing module and is parsed.Specifically, label filtering module is real When the corresponding TS code stream of detection video image in whether there is the PES packet of XML tag type, if it does, web engine is notified to exist The lower right corner of video image transparent emersion " view " control suspends video if user clicks " view " control, and acquisition is worked as The pts value of preceding video image filters out corresponding PES packet, so according to the pts value and XML tag type mark from TS code stream After be sent to label processing module and carry out processing of unpacking.

On the other hand, in XML tag collation forming process, label filtering module is responsible for original TS code stream to be sent to mark Label are recorded module and are recorded.

Label records module and is mainly responsible for the original TS code stream for receiving the transmission of label filtering module, and receives at label The PES packet of XML tag type formed after what reason module was sent be packaged the XML tag of target object, by the XML tag The PES packet of type is inserted into original TS code stream, and it is corresponding to be inserted into PAT, PMT formation video image relevant to XML tag type Data flow, if PS flows, PS stream is cut into TS packet (each TS packet by the then requirement according to transport protocol to data package size Have 188 bytes), save as final TS code stream.Optionally, the TS code stream after preservation can be used third party's tool and generate publication Format, such as HLS, MPEG2, in order to release.

Label processing module is mainly responsible for unpacking, being packaged for the PES packet of XML tag type, and keeps event with web engine Synchronous, event here specifically includes that pause (pause), plays (play), addition (add), view (view), long-pressing (long Touch), click (touch), save (saved), playback (view returned), label (xtag), Hui Tianjia (add Returned) etc..The process unpacked and be packaged mainly is introduced below:

During the PES packet to XML tag type is unpacked, label processing module is responsible for parsing label filtering module The PES packet for the XML tag type sent sends web to by the PES Packet analyzing of the XML tag type at the data of XML format Engine shows the XML tag in relation to object for web engine dissection process under the control of web engine.

Wherein, label processing module, can be with mesh in video image when the PES packet to XML tag type is unpacked The coordinate value for marking object is index, is one the PES package-restructuring (if need not recombinate in a NALU) of XML tag type XML file gives web engine, and one is shown as after web engine is handled and the comparable interface of video frame size emerges current On video image, cursor control can be clicked corresponding to presentation at the position of each target object on the interface.When the user clicks The XML tag of the target object is parsed and is shown to user by the cursor control on corresponding target object, web engine.

During being packed into the PES packet of XML tag type, label processing module, which is mainly responsible for, sends out web engine The label description information for the user's input sent is packaged into the PES packet of XML tag type, and is transmitted to label recording module and is recorded To form final TS code stream.

In the present embodiment, when label processing module is packaged XML tag, each XML tag is placed in a NALU, will The NALU of this storage XML tag is customized for the NALU (being abbreviated as XNALU) of XML type.In XNALU, in addition to XML is marked Label, further include position coordinate value of the corresponding target object of XML tag in video image, it is true which can be user The coordinate of long opsition dependent on the video images when needing to add the target object of label data surely.Each video image may correspond to Multiple XML tags then can form XNALU sequence by input sequence, which is packaged into the PES packet of XML tag type, can Choosing, packet header of the PES packet of the XML tag type using current video image pts value, so as to and video frame sync, and XML tag type is set by the type of the PES packet.

Web engine includes at least: web nucleus module, network module and web application module (webapp).Web nucleus module Belong to the existing module in web engine with network module, function can be found in the description of the prior art.Web is introduced below The function of application module.

Web application module is mainly responsible for the function in terms of following four:

In a first aspect, web engine is responsible for and user carries out UI interaction, handled according to the instruction of user to user's display label The XML tag that module transmits；Second aspect, web engine receive the label description information of user's input and convert it into XML mark Label, issue label processing module for XML tag；The third aspect, web engine be also responsible for showing on the video images " add ", Cursor controls such as " view " obtain the seat of user's click location when selection target object during adding label or display label Mark etc.；Fourth aspect, web engine is also responsible for user and far-end network service providing end interacts.

The video playback apparatus in conjunction with shown in Fig. 9 a, a kind of object in video image add the process such as figure of XML tag Shown in 9b, comprising:

The original TS code stream received is sent to label recording module and is recorded by label filtering module；

The pause broadcast event of label processing module response video；

The pts value of label processing module acquisition current video image；

Label processing module notice web application module has pause broadcast event；

Web application module pops up " add " control on current video image；

User clicks the label data addition that " add " control issues and refers to；Web application module receives user and passes through click The label data that " add " control issues adds instruction；

Web application module waits user to select to need to add the target object of label data；

Web application module receives the Object Selection instruction that user is issued by the object on long-pressing video image；

Web application module is instructed according to above-mentioned Object Selection, determines the target object and target for needing to add label data The position coordinates of object；

Web application module pops up information input frame at above-mentioned target object, for user's input label description information；

Web application module receives the label description information that inputs by information input frame of user, and by label description information It is converted into XML tag；

XML tag is sent to label processing module by web application module；

The corresponding all XML tags of current video image are packaged into the PES packet of XML tag type by label processing module；

The PES packet of XML tag type is sent to label and records module by label processing module；

Label records module and the PES packet of XML tag type, PAT, PMT etc. is inserted into original TS code stream, is formed final TS code stream.

The video playback apparatus in conjunction with shown in Fig. 9 a, a kind of process such as figure of the XML tag extracting the object in video image Shown in 9c, comprising:

Label filtering module receives TS code stream, detects the PES packet that whether there is XML tag type in TS code stream；If it exists, The PES packet of XML tag type is then therefrom obtained, and is sent to label processing module；

Label processing module is to web application module notified tag event；

Web application module shows " view " control on current video image；

User clicks the tag data process instruction that " view " control issues；Web application module receives user and passes through click The tag data process instruction that " view " control issues；

Web application module notified tag processing module has tag data process event；

Label processing module obtains the pts value of current video image, obtains the PES of the identical XML tag type of pts value Packet；

The PES packet parsed is sent to web application module by label processing module；

It is XML file that web application module, which parses PES packet, and it is transparent on the video images emerge an interface, it is right on interface Cursor control should be emerged in the position of target object；

User clicks the label data that cursor control issues and shows instruction；Web application module receives user and clicks cursor control The label data that part issues shows instruction；

Web application module shows that above-mentioned label data shows the XML tag of the corresponding target object of instruction to user；

What the entrance that web application module receives the network service that user clicks the target object provided on XML tag issued Service call instruction；

The network service providing end of web application module and target object interacts, to provide a user related network clothes Business.

As shown from the above technical solution, the present embodiment is inserted into object in video image during forming video image Label data forms the corresponding data flow of video image, during playing video image, from the corresponding data flow of video image In parse the label data of target object, and then the label data of object in video image is shown to user, so that user can It is easy to operate to obtain the information of object in video image, it is higher to obtain efficiency.

It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.

In several embodiments provided herein, it should be understood that disclosed system, device and method can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit It closes or communicates to connect, can be electrical property, mechanical or other forms.

The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.

It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.

The above-mentioned integrated unit being realized in the form of SFU software functional unit can store and computer-readable deposit at one In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are used so that a computer It is each that equipment (can be personal computer, server or the network equipment etc.) or processor (processor) execute the application The part steps of embodiment the method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read- Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. it is various It can store the medium of program code.

Finally, it should be noted that above embodiments are only to illustrate the technical solution of the application, rather than its limitations；Although The application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it still may be used To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features； And these are modified or replaceed, each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution spirit and Range.

Claims

1. a kind of information processing method characterized by comprising

From the corresponding data flow of image, the data packet of tag types is extracted；

From the data packet of the tag types, the label data and the target object for extracting target object are in described image Location information, the target object is the object that label data is added in described image；

According to location information of the target object in described image, the target object is marked out in described image, is opened up Show the label data of the target object in described image；

Before the label data of target object in the displaying described image, further includes:

Signature verification is carried out to the label data of the target object；

When passing through signature verification, the operation for showing the label data of the target object in described image is executed；

The method also includes:

The anti-counterfeiting information of the target object is extracted from the label data of the target object；

According to the anti-counterfeiting information of the target object, authenticity verification is carried out to the target object.

2. the method according to claim 1, wherein extracting institute from the corresponding data flow of image described Before the data packet for stating tag types, comprising:

The corresponding data flow of detection described image whether include tag types data packet；

If the corresponding data flow of described image includes the data packet of tag types, continue to execute described from the corresponding data flow of image In, extract the data packet of the tag types.

3. according to the method described in claim 2, extracting described it is characterized in that, described from the corresponding data flow of image The data packet of tag types, comprising:

Prompt information is shown to user, to prompt the user that can carry out tag data process；

The user is received to be instructed according to the tag data process that the prompt information is sent；

It is instructed according to the tag data process, the data of the tag types is extracted from the corresponding data flow of described image Packet.

4. according to the method described in claim 3, it is characterized in that, the number of tags for showing the target object in described image According to, comprising:

It receives the label data that the user issues and shows instruction；

It is shown and is instructed according to the label data, show the label data of the target object.

5. according to the method described in claim 4, it is characterized in that, the position according to the target object in described image Confidence breath, marks out the target object in described image, comprising:

Face shows an interface on the image；

According to location information of the target object in described image, the position of the target object is corresponded on the interface Setting place's display can operational controls；

The label data displaying instruction for receiving the user and issuing, comprising:

Receive the user by the interface correspond to the target object position at can operational controls issue institute It states label data and shows instruction.

6. according to the method described in claim 4, it is characterized in that, the label data shows that instruction includes: the target mark The location information of label；

Described shown according to the label data instructs, and shows the label data of the target object, comprising:

According to the location information of the mapping relations and the target labels of location information and label data in storage location, determine The label data of the target object；

Show the label data of the target object.

7. according to the method described in claim 4, it is characterized in that, described show instruction, displaying institute according to the label data State the label data of target object, comprising:

The label data of the target object is shown in the window in described image；Or

The label data of the target object is shown in another window of window where independently of described image；Or

The label data of the target object is shown in another display of display where independently of described image.

8. method according to claim 1-7, which is characterized in that further include:

Receive the search instruction that the user issues according to the label data of the target object；

It is instructed according to described search, Xiang Suoshu user returns to the search result to match with the label data of the target object.

9. method according to claim 1-7, which is characterized in that the label data of the target object include with Lower at least one:

10. method according to claim 1-7, which is characterized in that the label data of the target object is XML Label.

11. the method according to claim 1, wherein the anti-counterfeiting information of the target object is antifalsification label, two Tie up code or bar code.

12. method according to claim 1-7, which is characterized in that described image is the image in video.

13. a kind of information processing method characterized by comprising

Determine the target object for needing to add label data in image；

Obtain the label data of the target object；

According to the location information of the label data of the target object and the target object in described image, tag class are formed The data packet of type；

Signature processing is carried out to the data packet of the tag types, it will be in the data packet insertion described image of the tag types Hold in data, to form the corresponding data flow of described image；

The label data of the target object includes: the anti-counterfeiting information of the target object, for carrying out to the target object Authenticity verification.

14. according to the method for claim 13, which is characterized in that need to add the mesh of label data in the determining image Mark object, comprising:

Receive the Object Selection instruction that user issues on the image；

It is instructed according to the Object Selection, determines the target object.

15. according to the method for claim 14, which is characterized in that the object for receiving the user and issuing on the image Before selection instruction, comprising: in video display process, receive the label data addition instruction that the user issues；

It is added and is instructed according to the label data, suspend video playing, using the video pictures suspended as described image.

16. according to the method for claim 13, which is characterized in that need to add the mesh of label data in the determining image Mark object, comprising:

17. according to the method for claim 13, which is characterized in that the label data for obtaining the target object, packet It includes:

Obtain the label description information of the target object；

The label description information of the target object is formatted, to generate the label data of the target object.

18. according to the method for claim 17, which is characterized in that the label for obtaining the target object describes letter Breath, comprising:

Information input frame is shown to user, receives the label description letter that the user is inputted by the information input frame Breath；Or

19. the described in any item methods of 3-18 according to claim 1, which is characterized in that the label data packet of the target object Include following at least one:

20. a kind of information processing unit characterized by comprising

Parsing module, for extracting the data packet of tag types from the corresponding data flow of image；From the tag types In data packet, the location information of the label data and the target object of target object in described image, the target are extracted Object is the object that label data is added in described image；

Display module marks out institute for the location information according to the target object in described image in described image Target object is stated, shows the label data of the target object in described image；

The display module carries out signature verification specifically for the label data to the target object；When passing through signature verification When, execute the operation for showing the label data of the target object in described image；

Anti-fake module, for extracting the anti-counterfeiting information of the target object from the label data of the target object；According to institute The anti-counterfeiting information for stating target object carries out authenticity verification to the target object.

21. device according to claim 20, which is characterized in that the parsing module is specifically used for:

If the corresponding data flow of described image includes the data packet of tag types, parsed from the data packet of the tag types The label data of the target object.

22. device according to claim 21, which is characterized in that the parsing module is specifically used for:

It is instructed according to the tag data process, the data of the tag types is extracted from the corresponding data flow of described image Packet；

From the data packet of the tag types, the label data and the target object for extracting the target object are in the figure Location information as in.

23. device according to claim 22, which is characterized in that the display module is specifically used for:

According to location information of the target object in described image, the target object is marked out in described image；

It receives the label data that the user issues and shows instruction；

24. device according to claim 23, which is characterized in that the display module is specifically used for:

Face shows an interface on the image；

25. device according to claim 23, which is characterized in that the label data shows that instruction includes: the target The location information of label；

The display module is specifically used for:

Show the label data of the target object.

26. device according to claim 23, which is characterized in that the display module is specifically used for:

27. according to the described in any item devices of claim 20-26, which is characterized in that further include:

Search module, the search instruction issued for receiving the user according to the label data of the target object；According to institute Search instruction is stated, Xiang Suoshu user returns to the search result to match with the label data of the target object.

28. according to the described in any item devices of claim 20-26, which is characterized in that the label data packet of the target object Include following at least one:

29. according to the described in any item devices of claim 20-26, which is characterized in that the label data of the target object is XML tag.

30. device according to claim 20, which is characterized in that the anti-counterfeiting information of the target object be antifalsification label, Two dimensional code or bar code.

31. according to the described in any item devices of claim 20-26, which is characterized in that described image is the image in video.

32. a kind of information processing unit characterized by comprising

Module is obtained, for obtaining the label data of the target object；

Module is formed, for position letter of the label data and the target object according to the target object in described image Breath, forms the data packet of tag types；The data packet of the tag types is inserted into the content-data of described image, to be formed The corresponding data flow of described image；

The formation module is also used to carry out signature processing to the data packet of the tag types；

33. device according to claim 32, which is characterized in that the determining module is specifically used for:

Receive the Object Selection instruction that user issues on the image；

34. device according to claim 33, which is characterized in that the determining module is also used to:

In video display process, the label data addition instruction that the user issues is received；

35. device according to claim 32, which is characterized in that the determining module is specifically used for:

36. device according to claim 32, which is characterized in that the acquisition module is specifically used for:

Obtain the label description information of the target object；

37. device according to claim 36, which is characterized in that the acquisition module is specifically used for:

38. according to the described in any item devices of claim 32-37, which is characterized in that the label data packet of the target object Include following at least one: